2023-07-11T00:11:19.481 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-11T00:11:19.482 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332904 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_pdonnell@teuthology --name pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi --verbose -- /home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332904/orig.config.yaml 2023-07-11T00:11:19.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T00:11:19.622 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332904 branch: wip-pdonnell-testing-20230710.195410 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: pdonnell@redhat.com first_in_suite: false job_id: '7332904' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-pdonnell-testing-20230710.195410 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20230710.195410 sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 948 sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 sleep_before_teardown: 0 subset: 199/512 suite: fs suite_branch: wip-pdonnell-testing-20230710.195410 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi022.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgQ+Ht0qTotK8GnC4IYq01T83FEdgqap91gwp4OMOmXOPD4O4LcXpUl8d24SvRCkWqATwgX78Lzpu5OFjJex4FgvrCaf7LoMXKFyO/QpOZ6q887UhVloedJKvVZNuF4Q20pWedq/Q1XxHOhXGxFldXosqzgvx8L36lg0pYZYurReMdxuyJd5iY9RqYEiBeyJqK7Dpdt348xplpJ/YNVcwsKfduz0UkrvscKG2pffRrSKvBve3mrHbIqr0vyt6Kg+MX51p82mmmojXrDsVEGgN2iaVEWaa63fmBdLWiu7hvcDkBf+oMwINNdexw6KFLZyypN0V3j8GaszpwaYZcewOwUO+g6x/RDUA6hBIKXBrPDjJTZj2eT+g5lJlO5oCsvXteLNQnBffgmOn9MsQZhxX66MlY4yajM35d8pQhA0jKXbSuqcZGcT3O2IAHxJNta6ROvtVy6WYDl1aRCYMRAVznYdgOTKOmsg1RP12qdj1nnhugRdtk/I4iUnycDD3XAPc= smithi184.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBRJbe+IlVW3PTJ+9eYbpPw4xynyqBeuRskF8Ey3JtvaVxQQ4zYwN5Dh/OilOtJ08zFo7spbRsdehoWvjKTJOvbx09VMdUD/vVAW1wlvmYu8f0ThlrsoBGZfS+JtudDe4L5UOaE5jeGgNU9MRno7jFmxiznKBD9g4PMaCOGR2F6qjpIxVAWulh2nwvAIWyFpnrLvecAu/1jR0gNJZ9rqATVFvpUIzzhFXuH0NabL297nwMaDw6igA+6CGxOnz5pYZUbktgv+l/0FcqG0d0asfqz8lj9U5PIhBPm49UG19w9/HqjCUNL41zU3mUWlyV5pvUh25ZnczQ0d2b5DpC0gl+Qt1tzkiS4YoXXAh2mMeMVAsn4/P0Zq/7lE8HUxa90jb1tjVUCu1Q+qKL5bZjTo6q5vuQpdf1E/SLoNMzWDR7mTEvoTzioHlhSZx+n6tfAqlKBO2DdzxSVJnV2NmbnPfFYkA/C1tPW5HS7d20sg7Nyh1G75/bcsd9MV9vVz94C7M= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b53f236c1077f1d295baafb9e0ca9a4b447019d7 timestamp: 2023-07-10_22:55:54 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-11T00:11:19.622 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/qa; will attempt to use it 2023-07-11T00:11:19.623 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/qa/tasks 2023-07-11T00:11:19.623 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-11T00:11:19.625 INFO:teuthology.task.internal:Checking packages... 2023-07-11T00:11:19.655 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2' 2023-07-11T00:11:19.655 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-11T00:11:19.656 INFO:teuthology.packaging:ref: None 2023-07-11T00:11:19.656 INFO:teuthology.packaging:tag: None 2023-07-11T00:11:19.656 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20230710.195410 2023-07-11T00:11:19.657 INFO:teuthology.packaging:sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-11T00:11:19.657 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20230710.195410 2023-07-11T00:11:19.799 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4828.gb5891ed6 2023-07-11T00:11:19.799 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-11T00:11:19.806 INFO:teuthology.task.internal:no buildpackages task found 2023-07-11T00:11:19.806 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-11T00:11:19.862 INFO:teuthology.task.internal:Saving configuration 2023-07-11T00:11:19.884 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-11T00:11:19.890 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-11T00:11:19.918 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332904', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 00:06:17.194592', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFJhj3beNOON+9AHeALD8PziSz2y4fEjKOkVt62OnGUPx1cpYS3s7p9YmzYXo08O1GcgABa+iLrhKmoT1+vH0Lk='} 2023-07-11T00:11:19.942 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332904', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 00:06:17.192164', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK9ZU4M1e8wyoBuXLE9s67k7G88+QF6Zk5votDKxpp6ONeIn36W8grk2959oU4vrc6eLOGBLCSyA3W/VyxRBXx0='} 2023-07-11T00:11:19.943 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-11T00:11:19.949 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-11T00:11:19.949 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-11T00:11:19.949 INFO:teuthology.run_tasks:Running task console_log... 2023-07-11T00:11:20.033 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f774f86b280>, signals=[15]) 2023-07-11T00:11:20.034 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-11T00:11:20.040 INFO:teuthology.task.internal:Opening connections... 2023-07-11T00:11:20.041 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2023-07-11T00:11:20.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T00:11:20.115 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2023-07-11T00:11:20.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T00:11:20.183 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-11T00:11:20.190 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2023-07-11T00:11:20.214 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2023-07-11T00:11:20.215 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-07-11T00:11:20.277 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2023-07-11T00:11:20.278 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8" 2023-07-11T00:11:20.278 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2023-07-11T00:11:20.278 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2023-07-11T00:11:20.278 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8" 2023-07-11T00:11:20.278 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-07-11T00:11:20.279 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-11T00:11:20.279 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-07-11T00:11:20.279 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-11T00:11:20.279 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2023-07-11T00:11:20.279 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-11T00:11:20.279 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-11T00:11:20.280 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-11T00:11:20.281 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-07-11T00:11:20.303 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-07-11T00:11:20.326 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-07-11T00:11:20.326 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-07-11T00:11:20.388 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2023-07-11T00:11:20.388 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8" 2023-07-11T00:11:20.389 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2023-07-11T00:11:20.389 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2023-07-11T00:11:20.390 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8" 2023-07-11T00:11:20.390 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2023-07-11T00:11:20.390 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-11T00:11:20.390 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-07-11T00:11:20.390 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-11T00:11:20.391 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2023-07-11T00:11:20.391 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-11T00:11:20.391 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-11T00:11:20.391 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-11T00:11:20.391 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-07-11T00:11:20.412 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-11T00:11:20.422 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-11T00:11:20.430 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-11T00:11:20.431 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2023-07-11T00:11:20.435 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2023-07-11T00:11:20.456 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-11T00:11:20.461 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-11T00:11:20.462 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2023-07-11T00:11:20.497 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2023-07-11T00:11:20.539 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-11T00:11:20.605 INFO:teuthology.run_tasks:Running task kernel... 2023-07-11T00:11:20.623 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-07-11T00:11:20.624 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-07-11T00:11:20.624 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-07-11T00:11:20.626 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-11T00:11:20.627 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-11T00:11:20.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-11T00:11:20.649 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-07-11T00:11:20.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-11T00:11:20.653 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-07-11T00:11:20.870 DEBUG:teuthology.task.kernel:sha1 for client.0 is 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-11T00:11:20.870 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "84139c18d56f518615369e8310ae4ecf07a36dcd"... 2023-07-11T00:11:20.871 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2023-07-11T00:11:20.883 DEBUG:teuthology.task.kernel:sha1 for client.1 is 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-11T00:11:20.884 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "84139c18d56f518615369e8310ae4ecf07a36dcd"... 2023-07-11T00:11:20.884 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-07-11T00:11:20.893 INFO:teuthology.orchestra.run.smithi022.stdout:4.18.0-489.el8.x86_64 2023-07-11T00:11:20.893 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-11T00:11:20.894 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-11T00:11:20.895 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum upgrade -y linux-firmware 2023-07-11T00:11:20.906 INFO:teuthology.orchestra.run.smithi184.stdout:4.18.0-489.el8.x86_64 2023-07-11T00:11:20.906 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-11T00:11:20.907 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-11T00:11:20.907 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum upgrade -y linux-firmware 2023-07-11T00:11:24.841 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - AppStream 24 MB/s | 31 MB 00:01 2023-07-11T00:11:26.118 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - AppStream 12 MB/s | 31 MB 00:02 2023-07-11T00:11:32.658 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - BaseOS 22 MB/s | 41 MB 00:01 2023-07-11T00:11:34.110 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 41 MB 00:02 2023-07-11T00:11:39.408 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - Extras 46 kB/s | 18 kB 00:00 2023-07-11T00:11:39.967 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.6 kB 00:00 2023-07-11T00:11:40.476 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - Extras 45 kB/s | 18 kB 00:00 2023-07-11T00:11:41.194 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.6 kB 00:00 2023-07-11T00:11:42.719 INFO:teuthology.orchestra.run.smithi022.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-11T00:11:43.527 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2023-07-11T00:11:44.004 INFO:teuthology.orchestra.run.smithi184.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-11T00:11:46.323 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 7.2 MB/s | 16 MB 00:02 2023-07-11T00:11:47.486 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 373 kB/s | 24 kB 00:00 2023-07-11T00:11:50.062 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 395 kB/s | 24 kB 00:00 2023-07-11T00:11:51.112 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-07-11T00:11:51.209 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-07-11T00:11:51.209 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-07-11T00:11:51.209 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-07-11T00:11:51.210 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2023-07-11T00:11:51.210 INFO:teuthology.orchestra.run.smithi022.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-07-11T00:11:51.210 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:11:51.210 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-07-11T00:11:51.210 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-07-11T00:11:51.210 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 1 Package 2023-07-11T00:11:51.210 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:11:51.211 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 266 M 2023-07-11T00:11:51.211 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-07-11T00:11:53.528 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-07-11T00:11:53.529 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-07-11T00:11:53.529 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repo Size 2023-07-11T00:11:53.529 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-07-11T00:11:53.529 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2023-07-11T00:11:53.529 INFO:teuthology.orchestra.run.smithi184.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-07-11T00:11:53.529 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:11:53.530 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-07-11T00:11:53.530 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-07-11T00:11:53.530 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 1 Package 2023-07-11T00:11:53.530 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:11:53.530 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 266 M 2023-07-11T00:11:53.530 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-07-11T00:12:05.844 INFO:teuthology.orchestra.run.smithi022.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 18 MB/s | 266 MB 00:14 2023-07-11T00:12:05.845 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-07-11T00:12:05.845 INFO:teuthology.orchestra.run.smithi022.stdout:Total 18 MB/s | 266 MB 00:14 2023-07-11T00:12:07.506 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-07-11T00:12:07.569 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-07-11T00:12:07.569 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-07-11T00:12:09.310 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-07-11T00:12:09.339 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-07-11T00:12:15.761 INFO:teuthology.orchestra.run.smithi184.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 12 MB/s | 266 MB 00:22 2023-07-11T00:12:15.762 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-07-11T00:12:15.762 INFO:teuthology.orchestra.run.smithi184.stdout:Total 12 MB/s | 266 MB 00:22 2023-07-11T00:12:17.338 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-07-11T00:12:17.412 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-07-11T00:12:17.412 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-07-11T00:12:19.075 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-07-11T00:12:19.109 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-07-11T00:12:28.525 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-07-11T00:12:28.869 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-11T00:12:29.140 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-11T00:12:29.396 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-11T00:12:29.397 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-11T00:12:30.084 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-11T00:12:30.084 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:12:30.085 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2023-07-11T00:12:30.085 INFO:teuthology.orchestra.run.smithi022.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-07-11T00:12:30.085 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:12:30.085 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-07-11T00:12:30.279 INFO:teuthology.task.kernel:Downloading kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.0... 2023-07-11T00:12:30.280 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-11T00:12:30.497 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ 2023-07-11T00:12:30.498 DEBUG:teuthology.orchestra.run.smithi022:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_g84139c18d56f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-11T00:12:30.502 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi022.front.sepia.ceph.com to complete... 2023-07-11T00:12:36.875 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-07-11T00:12:37.298 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-11T00:12:37.544 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-11T00:12:37.794 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-11T00:12:37.794 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-11T00:12:38.515 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-11T00:12:38.515 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:12:38.515 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2023-07-11T00:12:38.515 INFO:teuthology.orchestra.run.smithi184.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-07-11T00:12:38.515 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:12:38.516 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-07-11T00:12:38.708 INFO:teuthology.task.kernel:Downloading kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.1... 2023-07-11T00:12:38.708 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-11T00:12:38.926 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ 2023-07-11T00:12:38.927 DEBUG:teuthology.orchestra.run.smithi184:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_g84139c18d56f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-11T00:12:38.929 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi184.front.sepia.ceph.com to complete... 2023-07-11T00:12:45.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11 00:12:45 URL:https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/kernel-6.4.0_g84139c18d56f-1.x86_64.rpm [379858600/379858600] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-11T00:12:45.271 INFO:teuthology.orchestra.run.smithi022.stderr:FINISHED --2023-07-11 00:12:45-- 2023-07-11T00:12:45.271 INFO:teuthology.orchestra.run.smithi022.stderr:Total wall clock time: 15s 2023-07-11T00:12:45.272 INFO:teuthology.orchestra.run.smithi022.stderr:Downloaded: 1 files, 362M in 14s (25.2 MB/s) 2023-07-11T00:12:45.273 INFO:teuthology.task.kernel:Installing kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.0... 2023-07-11T00:12:45.273 DEBUG:teuthology.orchestra.run.smithi022:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-11T00:12:47.003 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying... ######################################## 2023-07-11T00:12:47.049 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing... ######################################## 2023-07-11T00:12:47.165 INFO:teuthology.orchestra.run.smithi022.stdout:Updating / installing... 2023-07-11T00:13:05.589 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11 00:13:05 URL:https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/kernel-6.4.0_g84139c18d56f-1.x86_64.rpm [379858600/379858600] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-11T00:13:05.590 INFO:teuthology.orchestra.run.smithi184.stderr:FINISHED --2023-07-11 00:13:05-- 2023-07-11T00:13:05.590 INFO:teuthology.orchestra.run.smithi184.stderr:Total wall clock time: 27s 2023-07-11T00:13:05.590 INFO:teuthology.orchestra.run.smithi184.stderr:Downloaded: 1 files, 362M in 26s (13.9 MB/s) 2023-07-11T00:13:05.592 INFO:teuthology.task.kernel:Installing kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.1... 2023-07-11T00:13:05.592 DEBUG:teuthology.orchestra.run.smithi184:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-11T00:13:07.249 INFO:teuthology.orchestra.run.smithi184.stdout:Verifying... ######################################## 2023-07-11T00:13:07.292 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing... ######################################## 2023-07-11T00:13:07.402 INFO:teuthology.orchestra.run.smithi184.stdout:Updating / installing... 2023-07-11T00:13:27.483 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-6.4.0_g84139c18d56f-1 ######################################## 2023-07-11T00:13:45.218 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-6.4.0_g84139c18d56f-1 ######################################## 2023-07-11T00:13:51.129 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi022.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-11T00:13:51.129 DEBUG:teuthology.orchestra.run.smithi022:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-11T00:13:51.186 INFO:teuthology.orchestra.run.smithi022.stdout:/boot/System.map-6.4.0-g84139c18d56f 2023-07-11T00:13:51.187 INFO:teuthology.orchestra.run.smithi022.stdout:/boot/config-6.4.0-g84139c18d56f 2023-07-11T00:13:51.187 INFO:teuthology.orchestra.run.smithi022.stdout:/boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-11T00:13:51.188 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f 2023-07-11T00:13:51.188 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel 2023-07-11T00:13:51.188 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch 2023-07-11T00:13:51.189 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86 2023-07-11T00:13:51.189 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto 2023-07-11T00:13:51.189 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-11T00:13:51.189 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-11T00:13:51.190 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-11T00:13:51.190 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-11T00:13:51.190 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-11T00:13:51.191 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-11T00:13:51.191 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-11T00:13:51.191 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-11T00:13:51.191 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-11T00:13:51.192 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-11T00:13:51.192 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-11T00:13:51.192 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-11T00:13:51.192 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-11T00:13:51.193 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-11T00:13:51.193 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-11T00:13:51.193 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-11T00:13:51.193 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-11T00:13:51.193 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-11T00:13:51.194 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-11T00:13:51.194 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-11T00:13:51.194 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel 2023-07-11T00:13:51.194 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu 2023-07-11T00:13:51.194 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce 2023-07-11T00:13:51.194 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-11T00:13:51.194 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm 2023-07-11T00:13:51.194 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-11T00:13:51.195 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-11T00:13:51.195 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm.ko 2023-07-11T00:13:51.195 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto 2023-07-11T00:13:51.195 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ansi_cprng.ko 2023-07-11T00:13:51.195 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/anubis.ko 2023-07-11T00:13:51.195 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/arc4.ko 2023-07-11T00:13:51.195 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx 2023-07-11T00:13:51.196 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_memcpy.ko 2023-07-11T00:13:51.196 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_pq.ko 2023-07-11T00:13:51.196 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-11T00:13:51.196 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_tx.ko 2023-07-11T00:13:51.196 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_xor.ko 2023-07-11T00:13:51.196 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/raid6test.ko 2023-07-11T00:13:51.196 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authenc.ko 2023-07-11T00:13:51.197 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authencesn.ko 2023-07-11T00:13:51.197 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blake2b_generic.ko 2023-07-11T00:13:51.197 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_common.ko 2023-07-11T00:13:51.197 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_generic.ko 2023-07-11T00:13:51.197 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/camellia_generic.ko 2023-07-11T00:13:51.197 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast5_generic.ko 2023-07-11T00:13:51.197 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast6_generic.ko 2023-07-11T00:13:51.197 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast_common.ko 2023-07-11T00:13:51.198 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ccm.ko 2023-07-11T00:13:51.198 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cmac.ko 2023-07-11T00:13:51.198 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crc32_generic.ko 2023-07-11T00:13:51.198 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_engine.ko 2023-07-11T00:13:51.198 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_user.ko 2023-07-11T00:13:51.198 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cts.ko 2023-07-11T00:13:51.198 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/des_generic.ko 2023-07-11T00:13:51.198 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/dh_generic.ko 2023-07-11T00:13:51.199 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/echainiv.ko 2023-07-11T00:13:51.199 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/essiv.ko 2023-07-11T00:13:51.199 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/fcrypt.ko 2023-07-11T00:13:51.199 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/khazad.ko 2023-07-11T00:13:51.199 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4.ko 2023-07-11T00:13:51.199 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4hc.ko 2023-07-11T00:13:51.200 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/md4.ko 2023-07-11T00:13:51.200 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/michael_mic.ko 2023-07-11T00:13:51.200 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcbc.ko 2023-07-11T00:13:51.200 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcrypt.ko 2023-07-11T00:13:51.201 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/rmd160.ko 2023-07-11T00:13:51.201 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/seed.ko 2023-07-11T00:13:51.201 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/serpent_generic.ko 2023-07-11T00:13:51.201 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tcrypt.ko 2023-07-11T00:13:51.202 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tea.ko 2023-07-11T00:13:51.202 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_common.ko 2023-07-11T00:13:51.202 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_generic.ko 2023-07-11T00:13:51.202 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/vmac.ko 2023-07-11T00:13:51.202 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/wp512.ko 2023-07-11T00:13:51.203 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xcbc.ko 2023-07-11T00:13:51.203 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xor.ko 2023-07-11T00:13:51.203 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xxhash_generic.ko 2023-07-11T00:13:51.204 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers 2023-07-11T00:13:51.204 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi 2023-07-11T00:13:51.204 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-11T00:13:51.204 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_pad.ko 2023-07-11T00:13:51.205 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/custom_method.ko 2023-07-11T00:13:51.205 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ec_sys.ko 2023-07-11T00:13:51.205 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/platform_profile.ko 2023-07-11T00:13:51.205 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbs.ko 2023-07-11T00:13:51.206 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbshc.ko 2023-07-11T00:13:51.206 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/video.ko 2023-07-11T00:13:51.206 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata 2023-07-11T00:13:51.207 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/acard-ahci.ko 2023-07-11T00:13:51.207 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci_platform.ko 2023-07-11T00:13:51.207 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ata_generic.ko 2023-07-11T00:13:51.207 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci_platform.ko 2023-07-11T00:13:51.208 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_acpi.ko 2023-07-11T00:13:51.208 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ali.ko 2023-07-11T00:13:51.208 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_amd.ko 2023-07-11T00:13:51.208 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_artop.ko 2023-07-11T00:13:51.209 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atiixp.ko 2023-07-11T00:13:51.209 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atp867x.ko 2023-07-11T00:13:51.209 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd640.ko 2023-07-11T00:13:51.210 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd64x.ko 2023-07-11T00:13:51.210 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cypress.ko 2023-07-11T00:13:51.210 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_efar.ko 2023-07-11T00:13:51.210 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt366.ko 2023-07-11T00:13:51.211 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt37x.ko 2023-07-11T00:13:51.211 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-11T00:13:51.211 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-11T00:13:51.211 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it8213.ko 2023-07-11T00:13:51.211 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it821x.ko 2023-07-11T00:13:51.211 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_jmicron.ko 2023-07-11T00:13:51.212 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_marvell.ko 2023-07-11T00:13:51.212 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_mpiix.ko 2023-07-11T00:13:51.212 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_netcell.ko 2023-07-11T00:13:51.212 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ninja32.ko 2023-07-11T00:13:51.212 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87410.ko 2023-07-11T00:13:51.212 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87415.ko 2023-07-11T00:13:51.212 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_oldpiix.ko 2023-07-11T00:13:51.213 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_opti.ko 2023-07-11T00:13:51.213 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_optidma.ko 2023-07-11T00:13:51.213 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pcmcia.ko 2023-07-11T00:13:51.213 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-11T00:13:51.213 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-11T00:13:51.213 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_piccolo.ko 2023-07-11T00:13:51.213 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rdc.ko 2023-07-11T00:13:51.214 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sch.ko 2023-07-11T00:13:51.214 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_serverworks.ko 2023-07-11T00:13:51.214 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sil680.ko 2023-07-11T00:13:51.214 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sis.ko 2023-07-11T00:13:51.214 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sl82c105.ko 2023-07-11T00:13:51.214 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_triflex.ko 2023-07-11T00:13:51.214 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_via.ko 2023-07-11T00:13:51.214 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pdc_adma.ko 2023-07-11T00:13:51.215 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_inic162x.ko 2023-07-11T00:13:51.215 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_mv.ko 2023-07-11T00:13:51.215 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_nv.ko 2023-07-11T00:13:51.215 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_promise.ko 2023-07-11T00:13:51.215 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_qstor.ko 2023-07-11T00:13:51.215 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil.ko 2023-07-11T00:13:51.215 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil24.ko 2023-07-11T00:13:51.215 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sis.ko 2023-07-11T00:13:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_svw.ko 2023-07-11T00:13:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sx4.ko 2023-07-11T00:13:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_uli.ko 2023-07-11T00:13:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_via.ko 2023-07-11T00:13:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_vsc.ko 2023-07-11T00:13:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay 2023-07-11T00:13:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ks0108.ko 2023-07-11T00:13:51.217 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base 2023-07-11T00:13:51.217 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap 2023-07-11T00:13:51.217 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-11T00:13:51.217 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma 2023-07-11T00:13:51.217 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/bcma.ko 2023-07-11T00:13:51.217 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block 2023-07-11T00:13:51.217 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe 2023-07-11T00:13:51.217 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/aoe.ko 2023-07-11T00:13:51.218 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/brd.ko 2023-07-11T00:13:51.218 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd 2023-07-11T00:13:51.218 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/drbd.ko 2023-07-11T00:13:51.218 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/floppy.ko 2023-07-11T00:13:51.218 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/loop.ko 2023-07-11T00:13:51.218 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx 2023-07-11T00:13:51.218 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-11T00:13:51.218 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/nbd.ko 2023-07-11T00:13:51.219 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk 2023-07-11T00:13:51.219 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/null_blk.ko 2023-07-11T00:13:51.219 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/pktcdvd.ko 2023-07-11T00:13:51.219 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/rbd.ko 2023-07-11T00:13:51.219 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/virtio_blk.ko 2023-07-11T00:13:51.219 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback 2023-07-11T00:13:51.219 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-11T00:13:51.219 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkfront.ko 2023-07-11T00:13:51.220 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram 2023-07-11T00:13:51.220 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/zram.ko 2023-07-11T00:13:51.220 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char 2023-07-11T00:13:51.220 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hangcheck-timer.ko 2023-07-11T00:13:51.220 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random 2023-07-11T00:13:51.220 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-11T00:13:51.220 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-11T00:13:51.220 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-11T00:13:51.221 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/via-rng.ko 2023-07-11T00:13:51.221 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-11T00:13:51.221 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi 2023-07-11T00:13:51.221 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-11T00:13:51.221 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-11T00:13:51.221 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-11T00:13:51.221 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-11T00:13:51.221 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-11T00:13:51.222 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-11T00:13:51.222 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/lp.ko 2023-07-11T00:13:51.222 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave 2023-07-11T00:13:51.222 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/mwave.ko 2023-07-11T00:13:51.222 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ppdev.ko 2023-07-11T00:13:51.222 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tlclk.ko 2023-07-11T00:13:51.222 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm 2023-07-11T00:13:51.222 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm.ko 2023-07-11T00:13:51.223 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-11T00:13:51.223 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-11T00:13:51.223 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-11T00:13:51.223 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-11T00:13:51.223 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-11T00:13:51.223 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/uv_mmtimer.ko 2023-07-11T00:13:51.223 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/virtio_console.ko 2023-07-11T00:13:51.223 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq 2023-07-11T00:13:51.224 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-11T00:13:51.224 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-11T00:13:51.224 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-11T00:13:51.224 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-11T00:13:51.224 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-11T00:13:51.225 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-11T00:13:51.225 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto 2023-07-11T00:13:51.225 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp 2023-07-11T00:13:51.225 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-11T00:13:51.226 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp.ko 2023-07-11T00:13:51.226 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel 2023-07-11T00:13:51.226 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat 2023-07-11T00:13:51.227 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common 2023-07-11T00:13:51.227 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-11T00:13:51.227 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-11T00:13:51.227 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-11T00:13:51.228 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-aes.ko 2023-07-11T00:13:51.228 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-sha.ko 2023-07-11T00:13:51.228 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio 2023-07-11T00:13:51.229 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-11T00:13:51.229 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca 2023-07-11T00:13:51.229 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/dca.ko 2023-07-11T00:13:51.229 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq 2023-07-11T00:13:51.230 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-11T00:13:51.230 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma 2023-07-11T00:13:51.230 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw 2023-07-11T00:13:51.231 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-11T00:13:51.231 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat 2023-07-11T00:13:51.231 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-11T00:13:51.231 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac 2023-07-11T00:13:51.232 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/amd64_edac.ko 2023-07-11T00:13:51.232 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/e752x_edac.ko 2023-07-11T00:13:51.232 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/edac_mce_amd.ko 2023-07-11T00:13:51.232 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3000_edac.ko 2023-07-11T00:13:51.233 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3200_edac.ko 2023-07-11T00:13:51.233 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5100_edac.ko 2023-07-11T00:13:51.233 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5400_edac.ko 2023-07-11T00:13:51.233 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7300_edac.ko 2023-07-11T00:13:51.233 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7core_edac.ko 2023-07-11T00:13:51.234 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i82975x_edac.ko 2023-07-11T00:13:51.234 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ie31200_edac.ko 2023-07-11T00:13:51.234 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/sb_edac.ko 2023-07-11T00:13:51.235 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/x38_edac.ko 2023-07-11T00:13:51.235 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware 2023-07-11T00:13:51.235 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/edd.ko 2023-07-11T00:13:51.235 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-11T00:13:51.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio 2023-07-11T00:13:51.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ich.ko 2023-07-11T00:13:51.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-11T00:13:51.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid 2023-07-11T00:13:51.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-appleir.ko 2023-07-11T00:13:51.236 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-aureal.ko 2023-07-11T00:13:51.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-axff.ko 2023-07-11T00:13:51.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-dr.ko 2023-07-11T00:13:51.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elecom.ko 2023-07-11T00:13:51.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elo.ko 2023-07-11T00:13:51.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-emsff.ko 2023-07-11T00:13:51.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gaff.ko 2023-07-11T00:13:51.237 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gt683r.ko 2023-07-11T00:13:51.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gyration.ko 2023-07-11T00:13:51.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-11T00:13:51.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-11T00:13:51.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtekff.ko 2023-07-11T00:13:51.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-hyperv.ko 2023-07-11T00:13:51.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-icade.ko 2023-07-11T00:13:51.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-keytouch.ko 2023-07-11T00:13:51.238 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kye.ko 2023-07-11T00:13:51.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lcpower.ko 2023-07-11T00:13:51.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-led.ko 2023-07-11T00:13:51.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lenovo.ko 2023-07-11T00:13:51.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-11T00:13:51.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-11T00:13:51.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-multitouch.ko 2023-07-11T00:13:51.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ortek.ko 2023-07-11T00:13:51.239 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-penmount.ko 2023-07-11T00:13:51.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-petalynx.ko 2023-07-11T00:13:51.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-picolcd.ko 2023-07-11T00:13:51.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-pl.ko 2023-07-11T00:13:51.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-plantronics.ko 2023-07-11T00:13:51.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-primax.ko 2023-07-11T00:13:51.240 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-rmi.ko 2023-07-11T00:13:51.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-11T00:13:51.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-common.ko 2023-07-11T00:13:51.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-11T00:13:51.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-11T00:13:51.241 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-11T00:13:51.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-11T00:13:51.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-11T00:13:51.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-11T00:13:51.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-11T00:13:51.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-11T00:13:51.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-11T00:13:51.242 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat.ko 2023-07-11T00:13:51.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-saitek.ko 2023-07-11T00:13:51.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-samsung.ko 2023-07-11T00:13:51.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-11T00:13:51.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sjoy.ko 2023-07-11T00:13:51.243 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sony.ko 2023-07-11T00:13:51.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-speedlink.ko 2023-07-11T00:13:51.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-steelseries.ko 2023-07-11T00:13:51.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sunplus.ko 2023-07-11T00:13:51.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-11T00:13:51.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tivo.ko 2023-07-11T00:13:51.244 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tmff.ko 2023-07-11T00:13:51.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-topseed.ko 2023-07-11T00:13:51.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-twinhan.ko 2023-07-11T00:13:51.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-uclogic.ko 2023-07-11T00:13:51.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-waltop.ko 2023-07-11T00:13:51.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-wiimote.ko 2023-07-11T00:13:51.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-xinmo.ko 2023-07-11T00:13:51.245 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zpff.ko 2023-07-11T00:13:51.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zydacron.ko 2023-07-11T00:13:51.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/uhid.ko 2023-07-11T00:13:51.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/wacom.ko 2023-07-11T00:13:51.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv 2023-07-11T00:13:51.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_balloon.ko 2023-07-11T00:13:51.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_utils.ko 2023-07-11T00:13:51.246 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_vmbus.ko 2023-07-11T00:13:51.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon 2023-07-11T00:13:51.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru.ko 2023-07-11T00:13:51.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru3.ko 2023-07-11T00:13:51.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-11T00:13:51.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7414.ko 2023-07-11T00:13:51.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7418.ko 2023-07-11T00:13:51.247 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adc128d818.ko 2023-07-11T00:13:51.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1025.ko 2023-07-11T00:13:51.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1026.ko 2023-07-11T00:13:51.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1029.ko 2023-07-11T00:13:51.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1031.ko 2023-07-11T00:13:51.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm9240.ko 2023-07-11T00:13:51.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ads7828.ko 2023-07-11T00:13:51.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7410.ko 2023-07-11T00:13:51.248 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7411.ko 2023-07-11T00:13:51.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7462.ko 2023-07-11T00:13:51.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7470.ko 2023-07-11T00:13:51.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7475.ko 2023-07-11T00:13:51.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7x10.ko 2023-07-11T00:13:51.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/amc6821.ko 2023-07-11T00:13:51.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/applesmc.ko 2023-07-11T00:13:51.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asb100.ko 2023-07-11T00:13:51.249 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asc7621.ko 2023-07-11T00:13:51.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-11T00:13:51.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/atxp1.ko 2023-07-11T00:13:51.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/coretemp.ko 2023-07-11T00:13:51.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-11T00:13:51.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dme1737.ko 2023-07-11T00:13:51.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds1621.ko 2023-07-11T00:13:51.250 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds620.ko 2023-07-11T00:13:51.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc1403.ko 2023-07-11T00:13:51.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc6w201.ko 2023-07-11T00:13:51.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71805f.ko 2023-07-11T00:13:51.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71882fg.ko 2023-07-11T00:13:51.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f75375s.ko 2023-07-11T00:13:51.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fam15h_power.ko 2023-07-11T00:13:51.251 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fschmd.ko 2023-07-11T00:13:51.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g760a.ko 2023-07-11T00:13:51.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g762.ko 2023-07-11T00:13:51.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl518sm.ko 2023-07-11T00:13:51.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl520sm.ko 2023-07-11T00:13:51.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-11T00:13:51.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5500_temp.ko 2023-07-11T00:13:51.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5k_amb.ko 2023-07-11T00:13:51.252 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmaem.ko 2023-07-11T00:13:51.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmpex.ko 2023-07-11T00:13:51.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina209.ko 2023-07-11T00:13:51.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina2xx.ko 2023-07-11T00:13:51.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/it87.ko 2023-07-11T00:13:51.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k10temp.ko 2023-07-11T00:13:51.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k8temp.ko 2023-07-11T00:13:51.253 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lineage-pem.ko 2023-07-11T00:13:51.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm63.ko 2023-07-11T00:13:51.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm73.ko 2023-07-11T00:13:51.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm75.ko 2023-07-11T00:13:51.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm77.ko 2023-07-11T00:13:51.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm78.ko 2023-07-11T00:13:51.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm80.ko 2023-07-11T00:13:51.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm83.ko 2023-07-11T00:13:51.254 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm85.ko 2023-07-11T00:13:51.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm87.ko 2023-07-11T00:13:51.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm90.ko 2023-07-11T00:13:51.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm92.ko 2023-07-11T00:13:51.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm93.ko 2023-07-11T00:13:51.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95234.ko 2023-07-11T00:13:51.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95241.ko 2023-07-11T00:13:51.255 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95245.ko 2023-07-11T00:13:51.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc2945.ko 2023-07-11T00:13:51.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4151.ko 2023-07-11T00:13:51.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4215.ko 2023-07-11T00:13:51.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4222.ko 2023-07-11T00:13:51.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4245.ko 2023-07-11T00:13:51.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4260.ko 2023-07-11T00:13:51.256 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4261.ko 2023-07-11T00:13:51.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max16065.ko 2023-07-11T00:13:51.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1619.ko 2023-07-11T00:13:51.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1668.ko 2023-07-11T00:13:51.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max197.ko 2023-07-11T00:13:51.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6639.ko 2023-07-11T00:13:51.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6650.ko 2023-07-11T00:13:51.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6697.ko 2023-07-11T00:13:51.257 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mcp3021.ko 2023-07-11T00:13:51.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6683.ko 2023-07-11T00:13:51.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775-core.ko 2023-07-11T00:13:51.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775.ko 2023-07-11T00:13:51.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct7802.ko 2023-07-11T00:13:51.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87360.ko 2023-07-11T00:13:51.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87427.ko 2023-07-11T00:13:51.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pcf8591.ko 2023-07-11T00:13:51.258 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus 2023-07-11T00:13:51.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-11T00:13:51.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-11T00:13:51.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-11T00:13:51.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-11T00:13:51.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-11T00:13:51.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-11T00:13:51.259 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-11T00:13:51.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-11T00:13:51.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-11T00:13:51.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-11T00:13:51.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-11T00:13:51.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-11T00:13:51.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/powr1220.ko 2023-07-11T00:13:51.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5627.ko 2023-07-11T00:13:51.260 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5636.ko 2023-07-11T00:13:51.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-11T00:13:51.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht15.ko 2023-07-11T00:13:51.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht21.ko 2023-07-11T00:13:51.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/shtc1.ko 2023-07-11T00:13:51.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sis5595.ko 2023-07-11T00:13:51.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47b397.ko 2023-07-11T00:13:51.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m1.ko 2023-07-11T00:13:51.261 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m192.ko 2023-07-11T00:13:51.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/thmc50.ko 2023-07-11T00:13:51.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp102.ko 2023-07-11T00:13:51.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp103.ko 2023-07-11T00:13:51.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp401.ko 2023-07-11T00:13:51.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp421.ko 2023-07-11T00:13:51.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via-cputemp.ko 2023-07-11T00:13:51.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via686a.ko 2023-07-11T00:13:51.262 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt1211.ko 2023-07-11T00:13:51.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt8231.ko 2023-07-11T00:13:51.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627ehf.ko 2023-07-11T00:13:51.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627hf.ko 2023-07-11T00:13:51.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83781d.ko 2023-07-11T00:13:51.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83791d.ko 2023-07-11T00:13:51.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83792d.ko 2023-07-11T00:13:51.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83793.ko 2023-07-11T00:13:51.263 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83795.ko 2023-07-11T00:13:51.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l785ts.ko 2023-07-11T00:13:51.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l786ng.ko 2023-07-11T00:13:51.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c 2023-07-11T00:13:51.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos 2023-07-11T00:13:51.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-11T00:13:51.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-11T00:13:51.264 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses 2023-07-11T00:13:51.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-11T00:13:51.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-11T00:13:51.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-11T00:13:51.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-11T00:13:51.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-11T00:13:51.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-11T00:13:51.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-11T00:13:51.265 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-11T00:13:51.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-11T00:13:51.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-11T00:13:51.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-11T00:13:51.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-11T00:13:51.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-11T00:13:51.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-11T00:13:51.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-11T00:13:51.266 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-11T00:13:51.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-11T00:13:51.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-11T00:13:51.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-11T00:13:51.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-11T00:13:51.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-11T00:13:51.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-11T00:13:51.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-11T00:13:51.267 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-dev.ko 2023-07-11T00:13:51.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-mux.ko 2023-07-11T00:13:51.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-11T00:13:51.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-smbus.ko 2023-07-11T00:13:51.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-stub.ko 2023-07-11T00:13:51.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband 2023-07-11T00:13:51.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core 2023-07-11T00:13:51.268 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-11T00:13:51.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_core.ko 2023-07-11T00:13:51.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-11T00:13:51.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-11T00:13:51.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-11T00:13:51.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-11T00:13:51.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-11T00:13:51.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw 2023-07-11T00:13:51.269 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4 2023-07-11T00:13:51.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-11T00:13:51.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4 2023-07-11T00:13:51.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-11T00:13:51.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5 2023-07-11T00:13:51.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-11T00:13:51.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca 2023-07-11T00:13:51.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-11T00:13:51.270 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp 2023-07-11T00:13:51.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib 2023-07-11T00:13:51.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-11T00:13:51.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser 2023-07-11T00:13:51.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-11T00:13:51.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert 2023-07-11T00:13:51.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-11T00:13:51.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp 2023-07-11T00:13:51.271 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-11T00:13:51.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt 2023-07-11T00:13:51.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-11T00:13:51.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input 2023-07-11T00:13:51.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport 2023-07-11T00:13:51.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-11T00:13:51.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-11T00:13:51.272 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/gameport.ko 2023-07-11T00:13:51.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/lightning.ko 2023-07-11T00:13:51.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ns558.ko 2023-07-11T00:13:51.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/joydev.ko 2023-07-11T00:13:51.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard 2023-07-11T00:13:51.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-11T00:13:51.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse 2023-07-11T00:13:51.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/appletouch.ko 2023-07-11T00:13:51.273 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/bcm5974.ko 2023-07-11T00:13:51.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/cyapatp.ko 2023-07-11T00:13:51.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-11T00:13:51.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/sermouse.ko 2023-07-11T00:13:51.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-11T00:13:51.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-11T00:13:51.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-11T00:13:51.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4 2023-07-11T00:13:51.274 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-11T00:13:51.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio 2023-07-11T00:13:51.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/altera_ps2.ko 2023-07-11T00:13:51.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/arc_ps2.ko 2023-07-11T00:13:51.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-11T00:13:51.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serio_raw.ko 2023-07-11T00:13:51.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/sparse-keymap.ko 2023-07-11T00:13:51.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu 2023-07-11T00:13:51.275 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd 2023-07-11T00:13:51.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-11T00:13:51.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds 2023-07-11T00:13:51.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-blinkm.ko 2023-07-11T00:13:51.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3530.ko 2023-07-11T00:13:51.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp3944.ko 2023-07-11T00:13:51.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-ss4200.ko 2023-07-11T00:13:51.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger 2023-07-11T00:13:51.276 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-11T00:13:51.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-11T00:13:51.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-11T00:13:51.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-11T00:13:51.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-11T00:13:51.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-11T00:13:51.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-11T00:13:51.277 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-11T00:13:51.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md 2023-07-11T00:13:51.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache 2023-07-11T00:13:51.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/bcache.ko 2023-07-11T00:13:51.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bio-prison.ko 2023-07-11T00:13:51.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache-smq.ko 2023-07-11T00:13:51.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache.ko 2023-07-11T00:13:51.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-crypt.ko 2023-07-11T00:13:51.278 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-delay.ko 2023-07-11T00:13:51.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-flakey.ko 2023-07-11T00:13:51.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log-userspace.ko 2023-07-11T00:13:51.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-multipath.ko 2023-07-11T00:13:51.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-queue-length.ko 2023-07-11T00:13:51.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-raid.ko 2023-07-11T00:13:51.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-round-robin.ko 2023-07-11T00:13:51.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-service-time.ko 2023-07-11T00:13:51.279 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-switch.ko 2023-07-11T00:13:51.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-thin-pool.ko 2023-07-11T00:13:51.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-verity.ko 2023-07-11T00:13:51.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/faulty.ko 2023-07-11T00:13:51.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/linear.ko 2023-07-11T00:13:51.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/multipath.ko 2023-07-11T00:13:51.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data 2023-07-11T00:13:51.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-11T00:13:51.280 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid0.ko 2023-07-11T00:13:51.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid1.ko 2023-07-11T00:13:51.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid10.ko 2023-07-11T00:13:51.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid456.ko 2023-07-11T00:13:51.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message 2023-07-11T00:13:51.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion 2023-07-11T00:13:51.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptbase.ko 2023-07-11T00:13:51.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptctl.ko 2023-07-11T00:13:51.281 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptfc.ko 2023-07-11T00:13:51.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptlan.ko 2023-07-11T00:13:51.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptsas.ko 2023-07-11T00:13:51.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptscsih.ko 2023-07-11T00:13:51.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptspi.ko 2023-07-11T00:13:51.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd 2023-07-11T00:13:51.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_ich.ko 2023-07-11T00:13:51.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_sch.ko 2023-07-11T00:13:51.282 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mfd-core.ko 2023-07-11T00:13:51.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/sm501.ko 2023-07-11T00:13:51.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/viperboard.ko 2023-07-11T00:13:51.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/vx855.ko 2023-07-11T00:13:51.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wl1273-core.ko 2023-07-11T00:13:51.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc 2023-07-11T00:13:51.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl 2023-07-11T00:13:51.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-11T00:13:51.283 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds9802als.ko 2023-07-11T00:13:51.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds990x.ko 2023-07-11T00:13:51.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/bh1770glc.ko 2023-07-11T00:13:51.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710 2023-07-11T00:13:51.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/cb710.ko 2023-07-11T00:13:51.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom 2023-07-11T00:13:51.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/at24.ko 2023-07-11T00:13:51.284 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-11T00:13:51.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-11T00:13:51.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/max6875.ko 2023-07-11T00:13:51.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/enclosure.ko 2023-07-11T00:13:51.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hpilo.ko 2023-07-11T00:13:51.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29003.ko 2023-07-11T00:13:51.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29020.ko 2023-07-11T00:13:51.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d 2023-07-11T00:13:51.285 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-11T00:13:51.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-11T00:13:51.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei 2023-07-11T00:13:51.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-me.ko 2023-07-11T00:13:51.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-txe.ko 2023-07-11T00:13:51.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei.ko 2023-07-11T00:13:51.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru 2023-07-11T00:13:51.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-11T00:13:51.286 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp 2023-07-11T00:13:51.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-11T00:13:51.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-11T00:13:51.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-11T00:13:51.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_7xx1.ko 2023-07-11T00:13:51.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_core.ko 2023-07-11T00:13:51.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tsl2550.ko 2023-07-11T00:13:51.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_balloon.ko 2023-07-11T00:13:51.287 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci 2023-07-11T00:13:51.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-11T00:13:51.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net 2023-07-11T00:13:51.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding 2023-07-11T00:13:51.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/bonding.ko 2023-07-11T00:13:51.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa 2023-07-11T00:13:51.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53 2023-07-11T00:13:51.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-11T00:13:51.288 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-11T00:13:51.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-11T00:13:51.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx 2023-07-11T00:13:51.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-11T00:13:51.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dummy.ko 2023-07-11T00:13:51.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/eql.ko 2023-07-11T00:13:51.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet 2023-07-11T00:13:51.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com 2023-07-11T00:13:51.289 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-11T00:13:51.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-11T00:13:51.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-11T00:13:51.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-11T00:13:51.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390 2023-07-11T00:13:51.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-11T00:13:51.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-11T00:13:51.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-11T00:13:51.290 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-11T00:13:51.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec 2023-07-11T00:13:51.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-11T00:13:51.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere 2023-07-11T00:13:51.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-11T00:13:51.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon 2023-07-11T00:13:51.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-11T00:13:51.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera 2023-07-11T00:13:51.291 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-11T00:13:51.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd 2023-07-11T00:13:51.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-11T00:13:51.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-11T00:13:51.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-11T00:13:51.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros 2023-07-11T00:13:51.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx 2023-07-11T00:13:51.292 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-11T00:13:51.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-11T00:13:51.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-11T00:13:51.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-11T00:13:51.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-11T00:13:51.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx 2023-07-11T00:13:51.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-11T00:13:51.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-11T00:13:51.293 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom 2023-07-11T00:13:51.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-11T00:13:51.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-11T00:13:51.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-11T00:13:51.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-11T00:13:51.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-11T00:13:51.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet 2023-07-11T00:13:51.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-11T00:13:51.294 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-11T00:13:51.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade 2023-07-11T00:13:51.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna 2023-07-11T00:13:51.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-11T00:13:51.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio 2023-07-11T00:13:51.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-11T00:13:51.295 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-11T00:13:51.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-11T00:13:51.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-11T00:13:51.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-11T00:13:51.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-11T00:13:51.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-11T00:13:51.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-11T00:13:51.296 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-11T00:13:51.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-11T00:13:51.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco 2023-07-11T00:13:51.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic 2023-07-11T00:13:51.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-11T00:13:51.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec 2023-07-11T00:13:51.297 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip 2023-07-11T00:13:51.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-11T00:13:51.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-11T00:13:51.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-11T00:13:51.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-11T00:13:51.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-11T00:13:51.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-11T00:13:51.298 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink 2023-07-11T00:13:51.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-11T00:13:51.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-11T00:13:51.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dnet.ko 2023-07-11T00:13:51.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex 2023-07-11T00:13:51.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet 2023-07-11T00:13:51.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-11T00:13:51.299 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ethoc.ko 2023-07-11T00:13:51.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fealnx.ko 2023-07-11T00:13:51.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel 2023-07-11T00:13:51.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-11T00:13:51.300 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000 2023-07-11T00:13:51.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-11T00:13:51.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e 2023-07-11T00:13:51.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-11T00:13:51.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k 2023-07-11T00:13:51.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-11T00:13:51.301 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e 2023-07-11T00:13:51.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-11T00:13:51.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf 2023-07-11T00:13:51.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-11T00:13:51.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb 2023-07-11T00:13:51.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-11T00:13:51.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf 2023-07-11T00:13:51.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-11T00:13:51.302 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-11T00:13:51.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-11T00:13:51.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-11T00:13:51.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-11T00:13:51.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/jme.ko 2023-07-11T00:13:51.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell 2023-07-11T00:13:51.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-11T00:13:51.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-11T00:13:51.303 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-11T00:13:51.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox 2023-07-11T00:13:51.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-11T00:13:51.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-11T00:13:51.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-11T00:13:51.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-11T00:13:51.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-11T00:13:51.304 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-11T00:13:51.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel 2023-07-11T00:13:51.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-11T00:13:51.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom 2023-07-11T00:13:51.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-11T00:13:51.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-11T00:13:51.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi 2023-07-11T00:13:51.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-11T00:13:51.305 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-11T00:13:51.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion 2023-07-11T00:13:51.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-11T00:13:51.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia 2023-07-11T00:13:51.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-11T00:13:51.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines 2023-07-11T00:13:51.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-11T00:13:51.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-11T00:13:51.306 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic 2023-07-11T00:13:51.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-11T00:13:51.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-11T00:13:51.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-11T00:13:51.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-11T00:13:51.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-11T00:13:51.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc 2023-07-11T00:13:51.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-11T00:13:51.307 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek 2023-07-11T00:13:51.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-11T00:13:51.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-11T00:13:51.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-11T00:13:51.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-11T00:13:51.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker 2023-07-11T00:13:51.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-11T00:13:51.308 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc 2023-07-11T00:13:51.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-11T00:13:51.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan 2023-07-11T00:13:51.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-11T00:13:51.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis 2023-07-11T00:13:51.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-11T00:13:51.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-11T00:13:51.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc 2023-07-11T00:13:51.309 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-11T00:13:51.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-11T00:13:51.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-11T00:13:51.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-11T00:13:51.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro 2023-07-11T00:13:51.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-11T00:13:51.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-11T00:13:51.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-11T00:13:51.310 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun 2023-07-11T00:13:51.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-11T00:13:51.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-11T00:13:51.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-11T00:13:51.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-11T00:13:51.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti 2023-07-11T00:13:51.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-11T00:13:51.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti 2023-07-11T00:13:51.311 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-11T00:13:51.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via 2023-07-11T00:13:51.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-11T00:13:51.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-11T00:13:51.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet 2023-07-11T00:13:51.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-11T00:13:51.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-11T00:13:51.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom 2023-07-11T00:13:51.312 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-11T00:13:51.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/geneve.ko 2023-07-11T00:13:51.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv 2023-07-11T00:13:51.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-11T00:13:51.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154 2023-07-11T00:13:51.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-11T00:13:51.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ifb.ko 2023-07-11T00:13:51.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan 2023-07-11T00:13:51.313 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-11T00:13:51.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvlan.ko 2023-07-11T00:13:51.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvtap.ko 2023-07-11T00:13:51.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio 2023-07-11T00:13:51.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio.ko 2023-07-11T00:13:51.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-11T00:13:51.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-11T00:13:51.314 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mii.ko 2023-07-11T00:13:51.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/net_failover.ko 2023-07-11T00:13:51.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/netconsole.ko 2023-07-11T00:13:51.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/nlmon.ko 2023-07-11T00:13:51.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs 2023-07-11T00:13:51.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-07-11T00:13:51.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-11T00:13:51.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy 2023-07-11T00:13:51.315 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/amd.ko 2023-07-11T00:13:51.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-11T00:13:51.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-11T00:13:51.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-11T00:13:51.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm87xx.ko 2023-07-11T00:13:51.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/broadcom.ko 2023-07-11T00:13:51.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/cicada.ko 2023-07-11T00:13:51.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/davicom.ko 2023-07-11T00:13:51.316 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/dp83640.ko 2023-07-11T00:13:51.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/et1011c.ko 2023-07-11T00:13:51.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/icplus.ko 2023-07-11T00:13:51.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/lxt.ko 2023-07-11T00:13:51.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/marvell.ko 2023-07-11T00:13:51.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/micrel.ko 2023-07-11T00:13:51.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/national.ko 2023-07-11T00:13:51.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/phylink.ko 2023-07-11T00:13:51.317 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/qsemi.ko 2023-07-11T00:13:51.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/realtek.ko 2023-07-11T00:13:51.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/smsc.ko 2023-07-11T00:13:51.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ste10Xp.ko 2023-07-11T00:13:51.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/vitesse.ko 2023-07-11T00:13:51.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp 2023-07-11T00:13:51.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-11T00:13:51.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_async.ko 2023-07-11T00:13:51.318 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-11T00:13:51.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-11T00:13:51.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-11T00:13:51.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-11T00:13:51.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppoe.ko 2023-07-11T00:13:51.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppox.ko 2023-07-11T00:13:51.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pptp.ko 2023-07-11T00:13:51.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip 2023-07-11T00:13:51.319 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slhc.ko 2023-07-11T00:13:51.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slip.ko 2023-07-11T00:13:51.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sungem_phy.ko 2023-07-11T00:13:51.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tap.ko 2023-07-11T00:13:51.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team 2023-07-11T00:13:51.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team.ko 2023-07-11T00:13:51.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-11T00:13:51.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-11T00:13:51.320 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-11T00:13:51.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_random.ko 2023-07-11T00:13:51.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-11T00:13:51.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tun.ko 2023-07-11T00:13:51.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/veth.ko 2023-07-11T00:13:51.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/virtio_net.ko 2023-07-11T00:13:51.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3 2023-07-11T00:13:51.321 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-11T00:13:51.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan 2023-07-11T00:13:51.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/vxlan.ko 2023-07-11T00:13:51.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback 2023-07-11T00:13:51.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-11T00:13:51.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netfront.ko 2023-07-11T00:13:51.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb 2023-07-11T00:13:51.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ntb.ko 2023-07-11T00:13:51.322 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme 2023-07-11T00:13:51.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host 2023-07-11T00:13:51.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme-core.ko 2023-07-11T00:13:51.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme.ko 2023-07-11T00:13:51.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport 2023-07-11T00:13:51.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport.ko 2023-07-11T00:13:51.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_cs.ko 2023-07-11T00:13:51.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_pc.ko 2023-07-11T00:13:51.323 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_serial.ko 2023-07-11T00:13:51.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci 2023-07-11T00:13:51.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug 2023-07-11T00:13:51.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-11T00:13:51.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie 2023-07-11T00:13:51.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-11T00:13:51.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/xen-pcifront.ko 2023-07-11T00:13:51.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia 2023-07-11T00:13:51.324 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/i82092.ko 2023-07-11T00:13:51.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pd6729.ko 2023-07-11T00:13:51.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-11T00:13:51.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl 2023-07-11T00:13:51.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel 2023-07-11T00:13:51.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-11T00:13:51.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform 2023-07-11T00:13:51.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86 2023-07-11T00:13:51.325 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-11T00:13:51.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acerhdf.ko 2023-07-11T00:13:51.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-11T00:13:51.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-11T00:13:51.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-11T00:13:51.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-11T00:13:51.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-11T00:13:51.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-11T00:13:51.326 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-11T00:13:51.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-11T00:13:51.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-11T00:13:51.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/hdaps.ko 2023-07-11T00:13:51.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel 2023-07-11T00:13:51.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-11T00:13:51.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel_ips.ko 2023-07-11T00:13:51.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-11T00:13:51.327 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-11T00:13:51.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-11T00:13:51.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-11T00:13:51.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-11T00:13:51.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-11T00:13:51.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-11T00:13:51.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-11T00:13:51.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-11T00:13:51.328 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi.ko 2023-07-11T00:13:51.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap 2023-07-11T00:13:51.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-11T00:13:51.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-11T00:13:51.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps 2023-07-11T00:13:51.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients 2023-07-11T00:13:51.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-11T00:13:51.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-11T00:13:51.329 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps_parport.ko 2023-07-11T00:13:51.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/pps_core.ko 2023-07-11T00:13:51.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp 2023-07-11T00:13:51.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp.ko 2023-07-11T00:13:51.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp_kvm.ko 2023-07-11T00:13:51.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc 2023-07-11T00:13:51.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-11T00:13:51.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-11T00:13:51.330 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-11T00:13:51.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-11T00:13:51.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-11T00:13:51.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-11T00:13:51.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-11T00:13:51.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-11T00:13:51.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-11T00:13:51.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-11T00:13:51.331 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-11T00:13:51.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-em3027.ko 2023-07-11T00:13:51.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-11T00:13:51.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-11T00:13:51.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-11T00:13:51.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-11T00:13:51.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-11T00:13:51.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-11T00:13:51.332 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max6900.ko 2023-07-11T00:13:51.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-11T00:13:51.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-11T00:13:51.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-11T00:13:51.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-11T00:13:51.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-11T00:13:51.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-11T00:13:51.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-11T00:13:51.333 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-11T00:13:51.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-11T00:13:51.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-11T00:13:51.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-11T00:13:51.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-11T00:13:51.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-x1205.ko 2023-07-11T00:13:51.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi 2023-07-11T00:13:51.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-9xxx.ko 2023-07-11T00:13:51.334 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-sas.ko 2023-07-11T00:13:51.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-xxxx.ko 2023-07-11T00:13:51.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/BusLogic.ko 2023-07-11T00:13:51.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/a100u2w.ko 2023-07-11T00:13:51.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid 2023-07-11T00:13:51.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-11T00:13:51.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/advansys.ko 2023-07-11T00:13:51.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx 2023-07-11T00:13:51.335 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-11T00:13:51.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-11T00:13:51.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/am53c974.ko 2023-07-11T00:13:51.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr 2023-07-11T00:13:51.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-11T00:13:51.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/atp870u.ko 2023-07-11T00:13:51.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi 2023-07-11T00:13:51.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-11T00:13:51.336 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa 2023-07-11T00:13:51.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/bfa.ko 2023-07-11T00:13:51.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc 2023-07-11T00:13:51.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-11T00:13:51.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i 2023-07-11T00:13:51.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-11T00:13:51.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ch.ko 2023-07-11T00:13:51.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor 2023-07-11T00:13:51.337 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-11T00:13:51.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi 2023-07-11T00:13:51.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-11T00:13:51.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-11T00:13:51.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-11T00:13:51.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-11T00:13:51.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-11T00:13:51.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dc395x.ko 2023-07-11T00:13:51.338 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler 2023-07-11T00:13:51.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-11T00:13:51.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-11T00:13:51.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-11T00:13:51.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-11T00:13:51.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dmx3191d.ko 2023-07-11T00:13:51.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r 2023-07-11T00:13:51.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-11T00:13:51.339 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esp_scsi.ko 2023-07-11T00:13:51.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe 2023-07-11T00:13:51.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-11T00:13:51.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-11T00:13:51.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic 2023-07-11T00:13:51.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/fnic.ko 2023-07-11T00:13:51.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hpsa.ko 2023-07-11T00:13:51.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hptiop.ko 2023-07-11T00:13:51.340 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hv_storvsc.ko 2023-07-11T00:13:51.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/initio.ko 2023-07-11T00:13:51.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ipr.ko 2023-07-11T00:13:51.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ips.ko 2023-07-11T00:13:51.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci 2023-07-11T00:13:51.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/isci.ko 2023-07-11T00:13:51.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-11T00:13:51.341 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-11T00:13:51.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc 2023-07-11T00:13:51.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/libfc.ko 2023-07-11T00:13:51.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi.ko 2023-07-11T00:13:51.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-11T00:13:51.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas 2023-07-11T00:13:51.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/libsas.ko 2023-07-11T00:13:51.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc 2023-07-11T00:13:51.342 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-11T00:13:51.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid 2023-07-11T00:13:51.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid.ko 2023-07-11T00:13:51.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-11T00:13:51.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-11T00:13:51.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-11T00:13:51.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas 2023-07-11T00:13:51.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-11T00:13:51.343 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas 2023-07-11T00:13:51.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-11T00:13:51.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvumi.ko 2023-07-11T00:13:51.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001 2023-07-11T00:13:51.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-11T00:13:51.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pmcraid.ko 2023-07-11T00:13:51.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla1280.ko 2023-07-11T00:13:51.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx 2023-07-11T00:13:51.344 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-11T00:13:51.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-11T00:13:51.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx 2023-07-11T00:13:51.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-11T00:13:51.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/raid_class.ko 2023-07-11T00:13:51.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_debug.ko 2023-07-11T00:13:51.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-11T00:13:51.345 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-11T00:13:51.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-11T00:13:51.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-11T00:13:51.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-11T00:13:51.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ses.ko 2023-07-11T00:13:51.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/st.ko 2023-07-11T00:13:51.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/stex.ko 2023-07-11T00:13:51.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2 2023-07-11T00:13:51.346 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-11T00:13:51.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/virtio_scsi.ko 2023-07-11T00:13:51.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-11T00:13:51.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/wd719x.ko 2023-07-11T00:13:51.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb 2023-07-11T00:13:51.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ssb.ko 2023-07-11T00:13:51.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target 2023-07-11T00:13:51.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi 2023-07-11T00:13:51.347 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-11T00:13:51.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback 2023-07-11T00:13:51.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-11T00:13:51.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_file.ko 2023-07-11T00:13:51.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_iblock.ko 2023-07-11T00:13:51.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_mod.ko 2023-07-11T00:13:51.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_pscsi.ko 2023-07-11T00:13:51.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_user.ko 2023-07-11T00:13:51.348 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc 2023-07-11T00:13:51.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-11T00:13:51.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal 2023-07-11T00:13:51.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel 2023-07-11T00:13:51.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal 2023-07-11T00:13:51.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-11T00:13:51.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-11T00:13:51.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-11T00:13:51.349 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-11T00:13:51.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-11T00:13:51.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-11T00:13:51.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-11T00:13:51.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-11T00:13:51.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-11T00:13:51.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-11T00:13:51.350 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-11T00:13:51.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-11T00:13:51.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-11T00:13:51.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-11T00:13:51.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-11T00:13:51.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty 2023-07-11T00:13:51.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless 2023-07-11T00:13:51.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-11T00:13:51.351 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_gsm.ko 2023-07-11T00:13:51.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_hdlc.ko 2023-07-11T00:13:51.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/nozomi.ko 2023-07-11T00:13:51.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial 2023-07-11T00:13:51.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250 2023-07-11T00:13:51.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-11T00:13:51.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/arc_uart.ko 2023-07-11T00:13:51.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm 2023-07-11T00:13:51.352 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-11T00:13:51.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/synclink_gt.ko 2023-07-11T00:13:51.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs 2023-07-11T00:13:51.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core 2023-07-11T00:13:51.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-11T00:13:51.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host 2023-07-11T00:13:51.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-11T00:13:51.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio 2023-07-11T00:13:51.353 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio.ko 2023-07-11T00:13:51.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_aec.ko 2023-07-11T00:13:51.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_cif.ko 2023-07-11T00:13:51.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pci_generic.ko 2023-07-11T00:13:51.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_sercos3.ko 2023-07-11T00:13:51.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb 2023-07-11T00:13:51.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class 2023-07-11T00:13:51.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-acm.ko 2023-07-11T00:13:51.354 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-11T00:13:51.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usblp.ko 2023-07-11T00:13:51.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usbtmc.ko 2023-07-11T00:13:51.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host 2023-07-11T00:13:51.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-11T00:13:51.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image 2023-07-11T00:13:51.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/mdc800.ko 2023-07-11T00:13:51.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/microtek.ko 2023-07-11T00:13:51.355 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc 2023-07-11T00:13:51.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/adutux.ko 2023-07-11T00:13:51.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/appledisplay.ko 2023-07-11T00:13:51.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi26.ko 2023-07-11T00:13:51.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi62.ko 2023-07-11T00:13:51.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ezusb.ko 2023-07-11T00:13:51.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/idmouse.ko 2023-07-11T00:13:51.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/iowarrior.ko 2023-07-11T00:13:51.356 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-11T00:13:51.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ldusb.ko 2023-07-11T00:13:51.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/legousbtower.ko 2023-07-11T00:13:51.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga 2023-07-11T00:13:51.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-11T00:13:51.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-11T00:13:51.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usb3503.ko 2023-07-11T00:13:51.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usblcd.ko 2023-07-11T00:13:51.357 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-11T00:13:51.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/uss720.ko 2023-07-11T00:13:51.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/yurex.ko 2023-07-11T00:13:51.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy 2023-07-11T00:13:51.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-generic.ko 2023-07-11T00:13:51.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial 2023-07-11T00:13:51.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/aircable.ko 2023-07-11T00:13:51.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ark3116.ko 2023-07-11T00:13:51.358 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-11T00:13:51.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ch341.ko 2023-07-11T00:13:51.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cp210x.ko 2023-07-11T00:13:51.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cyberjack.ko 2023-07-11T00:13:51.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-11T00:13:51.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-11T00:13:51.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/empeg.ko 2023-07-11T00:13:51.359 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-11T00:13:51.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-11T00:13:51.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-11T00:13:51.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_ti.ko 2023-07-11T00:13:51.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipaq.ko 2023-07-11T00:13:51.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipw.ko 2023-07-11T00:13:51.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ir-usb.ko 2023-07-11T00:13:51.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-11T00:13:51.360 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan.ko 2023-07-11T00:13:51.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-11T00:13:51.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-11T00:13:51.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-11T00:13:51.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mct_u232.ko 2023-07-11T00:13:51.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7720.ko 2023-07-11T00:13:51.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7840.ko 2023-07-11T00:13:51.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/navman.ko 2023-07-11T00:13:51.361 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/omninet.ko 2023-07-11T00:13:51.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/opticon.ko 2023-07-11T00:13:51.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/option.ko 2023-07-11T00:13:51.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/oti6858.ko 2023-07-11T00:13:51.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/pl2303.ko 2023-07-11T00:13:51.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcaux.ko 2023-07-11T00:13:51.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcserial.ko 2023-07-11T00:13:51.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/quatech2.ko 2023-07-11T00:13:51.362 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/safe_serial.ko 2023-07-11T00:13:51.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/sierra.ko 2023-07-11T00:13:51.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-11T00:13:51.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ssu100.ko 2023-07-11T00:13:51.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/symbolserial.ko 2023-07-11T00:13:51.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-11T00:13:51.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-11T00:13:51.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_debug.ko 2023-07-11T00:13:51.363 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-11T00:13:51.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/visor.ko 2023-07-11T00:13:51.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/whiteheat.ko 2023-07-11T00:13:51.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-11T00:13:51.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage 2023-07-11T00:13:51.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/uas.ko 2023-07-11T00:13:51.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-11T00:13:51.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-11T00:13:51.364 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-11T00:13:51.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-11T00:13:51.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-11T00:13:51.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-11T00:13:51.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-11T00:13:51.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-karma.ko 2023-07-11T00:13:51.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-11T00:13:51.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-11T00:13:51.365 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-11T00:13:51.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-11T00:13:51.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-11T00:13:51.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/usb-storage.ko 2023-07-11T00:13:51.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip 2023-07-11T00:13:51.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-11T00:13:51.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-11T00:13:51.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-11T00:13:51.366 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio 2023-07-11T00:13:51.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci 2023-07-11T00:13:51.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-11T00:13:51.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-11T00:13:51.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio.ko 2023-07-11T00:13:51.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-11T00:13:51.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost 2023-07-11T00:13:51.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost.ko 2023-07-11T00:13:51.367 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-11T00:13:51.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_net.ko 2023-07-11T00:13:51.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_scsi.ko 2023-07-11T00:13:51.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video 2023-07-11T00:13:51.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight 2023-07-11T00:13:51.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/apple_bl.ko 2023-07-11T00:13:51.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lcd.ko 2023-07-11T00:13:51.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-11T00:13:51.368 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio 2023-07-11T00:13:51.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio.ko 2023-07-11T00:13:51.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_balloon.ko 2023-07-11T00:13:51.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_mmio.ko 2023-07-11T00:13:51.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci.ko 2023-07-11T00:13:51.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-11T00:13:51.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-11T00:13:51.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_ring.ko 2023-07-11T00:13:51.369 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1 2023-07-11T00:13:51.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters 2023-07-11T00:13:51.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2482.ko 2023-07-11T00:13:51.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2490.ko 2023-07-11T00:13:51.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves 2023-07-11T00:13:51.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-11T00:13:51.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-11T00:13:51.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-11T00:13:51.370 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-11T00:13:51.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-11T00:13:51.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-11T00:13:51.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-11T00:13:51.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-11T00:13:51.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-11T00:13:51.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-11T00:13:51.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-11T00:13:51.371 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/wire.ko 2023-07-11T00:13:51.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog 2023-07-11T00:13:51.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-11T00:13:51.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-11T00:13:51.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-11T00:13:51.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/hpwdt.ko 2023-07-11T00:13:51.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/i6300esb.ko 2023-07-11T00:13:51.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-11T00:13:51.372 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-11T00:13:51.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ib700wdt.ko 2023-07-11T00:13:51.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ibmasr.ko 2023-07-11T00:13:51.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-11T00:13:51.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-11T00:13:51.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it87_wdt.ko 2023-07-11T00:13:51.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/machzwd.ko 2023-07-11T00:13:51.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/nv_tco.ko 2023-07-11T00:13:51.373 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-11T00:13:51.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-11T00:13:51.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-11T00:13:51.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-11T00:13:51.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/softdog.ko 2023-07-11T00:13:51.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-11T00:13:51.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/via_wdt.ko 2023-07-11T00:13:51.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-11T00:13:51.374 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-11T00:13:51.375 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-11T00:13:51.375 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wdt_pci.ko 2023-07-11T00:13:51.375 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/xen_wdt.ko 2023-07-11T00:13:51.375 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen 2023-07-11T00:13:51.375 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-11T00:13:51.375 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-evtchn.ko 2023-07-11T00:13:51.375 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntalloc.ko 2023-07-11T00:13:51.375 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntdev.ko 2023-07-11T00:13:51.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback 2023-07-11T00:13:51.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-11T00:13:51.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-privcmd.ko 2023-07-11T00:13:51.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs 2023-07-11T00:13:51.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-11T00:13:51.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs 2023-07-11T00:13:51.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p 2023-07-11T00:13:51.376 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/9p.ko 2023-07-11T00:13:51.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs 2023-07-11T00:13:51.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/affs.ko 2023-07-11T00:13:51.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs 2023-07-11T00:13:51.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/befs.ko 2023-07-11T00:13:51.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/binfmt_misc.ko 2023-07-11T00:13:51.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs 2023-07-11T00:13:51.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/btrfs.ko 2023-07-11T00:13:51.377 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles 2023-07-11T00:13:51.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/cachefiles.ko 2023-07-11T00:13:51.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph 2023-07-11T00:13:51.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ceph.ko 2023-07-11T00:13:51.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda 2023-07-11T00:13:51.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/coda.ko 2023-07-11T00:13:51.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs 2023-07-11T00:13:51.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/cramfs.ko 2023-07-11T00:13:51.378 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm 2023-07-11T00:13:51.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/dlm.ko 2023-07-11T00:13:51.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs 2023-07-11T00:13:51.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-11T00:13:51.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs 2023-07-11T00:13:51.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/f2fs.ko 2023-07-11T00:13:51.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat 2023-07-11T00:13:51.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/fat.ko 2023-07-11T00:13:51.379 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/msdos.ko 2023-07-11T00:13:51.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/vfat.ko 2023-07-11T00:13:51.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache 2023-07-11T00:13:51.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/fscache.ko 2023-07-11T00:13:51.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse 2023-07-11T00:13:51.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/cuse.ko 2023-07-11T00:13:51.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/fuse.ko 2023-07-11T00:13:51.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2 2023-07-11T00:13:51.380 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/gfs2.ko 2023-07-11T00:13:51.381 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs 2023-07-11T00:13:51.381 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/hfs.ko 2023-07-11T00:13:51.381 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus 2023-07-11T00:13:51.381 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/hfsplus.ko 2023-07-11T00:13:51.381 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs 2023-07-11T00:13:51.381 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/isofs.ko 2023-07-11T00:13:51.381 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs 2023-07-11T00:13:51.381 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/jfs.ko 2023-07-11T00:13:51.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd 2023-07-11T00:13:51.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/lockd.ko 2023-07-11T00:13:51.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix 2023-07-11T00:13:51.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/minix.ko 2023-07-11T00:13:51.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs 2023-07-11T00:13:51.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/netfs.ko 2023-07-11T00:13:51.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs 2023-07-11T00:13:51.382 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout 2023-07-11T00:13:51.383 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-11T00:13:51.383 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout 2023-07-11T00:13:51.383 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-11T00:13:51.383 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout 2023-07-11T00:13:51.383 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-11T00:13:51.383 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfs.ko 2023-07-11T00:13:51.383 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv3.ko 2023-07-11T00:13:51.383 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv4.ko 2023-07-11T00:13:51.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common 2023-07-11T00:13:51.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/grace.ko 2023-07-11T00:13:51.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/nfs_acl.ko 2023-07-11T00:13:51.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd 2023-07-11T00:13:51.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/nfsd.ko 2023-07-11T00:13:51.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2 2023-07-11T00:13:51.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/nilfs2.ko 2023-07-11T00:13:51.384 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls 2023-07-11T00:13:51.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-celtic.ko 2023-07-11T00:13:51.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-centeuro.ko 2023-07-11T00:13:51.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-croatian.ko 2023-07-11T00:13:51.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-cyrillic.ko 2023-07-11T00:13:51.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-gaelic.ko 2023-07-11T00:13:51.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-greek.ko 2023-07-11T00:13:51.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-iceland.ko 2023-07-11T00:13:51.385 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-inuit.ko 2023-07-11T00:13:51.386 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-roman.ko 2023-07-11T00:13:51.386 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-romanian.ko 2023-07-11T00:13:51.386 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-turkish.ko 2023-07-11T00:13:51.386 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1250.ko 2023-07-11T00:13:51.386 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1251.ko 2023-07-11T00:13:51.386 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1255.ko 2023-07-11T00:13:51.386 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp737.ko 2023-07-11T00:13:51.386 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp775.ko 2023-07-11T00:13:51.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp850.ko 2023-07-11T00:13:51.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp852.ko 2023-07-11T00:13:51.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp855.ko 2023-07-11T00:13:51.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp857.ko 2023-07-11T00:13:51.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp860.ko 2023-07-11T00:13:51.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp861.ko 2023-07-11T00:13:51.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp862.ko 2023-07-11T00:13:51.387 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp863.ko 2023-07-11T00:13:51.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp864.ko 2023-07-11T00:13:51.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp865.ko 2023-07-11T00:13:51.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp866.ko 2023-07-11T00:13:51.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp869.ko 2023-07-11T00:13:51.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp874.ko 2023-07-11T00:13:51.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp932.ko 2023-07-11T00:13:51.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp936.ko 2023-07-11T00:13:51.388 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp949.ko 2023-07-11T00:13:51.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp950.ko 2023-07-11T00:13:51.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_euc-jp.ko 2023-07-11T00:13:51.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-1.ko 2023-07-11T00:13:51.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-13.ko 2023-07-11T00:13:51.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-14.ko 2023-07-11T00:13:51.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-15.ko 2023-07-11T00:13:51.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-2.ko 2023-07-11T00:13:51.389 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-3.ko 2023-07-11T00:13:51.390 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-4.ko 2023-07-11T00:13:51.390 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-5.ko 2023-07-11T00:13:51.390 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-6.ko 2023-07-11T00:13:51.390 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-7.ko 2023-07-11T00:13:51.390 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-9.ko 2023-07-11T00:13:51.390 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-r.ko 2023-07-11T00:13:51.390 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-ru.ko 2023-07-11T00:13:51.390 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-u.ko 2023-07-11T00:13:51.391 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_utf8.ko 2023-07-11T00:13:51.391 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2 2023-07-11T00:13:51.391 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster 2023-07-11T00:13:51.391 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-11T00:13:51.391 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm 2023-07-11T00:13:51.391 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-11T00:13:51.391 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs 2023-07-11T00:13:51.391 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-11T00:13:51.392 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2.ko 2023-07-11T00:13:51.392 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-11T00:13:51.392 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-11T00:13:51.392 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-11T00:13:51.392 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs 2023-07-11T00:13:51.392 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/overlay.ko 2023-07-11T00:13:51.392 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore 2023-07-11T00:13:51.392 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ramoops.ko 2023-07-11T00:13:51.393 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs 2023-07-11T00:13:51.393 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/reiserfs.ko 2023-07-11T00:13:51.393 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs 2023-07-11T00:13:51.393 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/romfs.ko 2023-07-11T00:13:51.393 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb 2023-07-11T00:13:51.393 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client 2023-07-11T00:13:51.393 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/cifs.ko 2023-07-11T00:13:51.393 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common 2023-07-11T00:13:51.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_arc4.ko 2023-07-11T00:13:51.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_md4.ko 2023-07-11T00:13:51.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs 2023-07-11T00:13:51.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/squashfs.ko 2023-07-11T00:13:51.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv 2023-07-11T00:13:51.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/sysv.ko 2023-07-11T00:13:51.394 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf 2023-07-11T00:13:51.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/udf.ko 2023-07-11T00:13:51.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs 2023-07-11T00:13:51.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ufs.ko 2023-07-11T00:13:51.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs 2023-07-11T00:13:51.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/xfs.ko 2023-07-11T00:13:51.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel 2023-07-11T00:13:51.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu 2023-07-11T00:13:51.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu/rcutorture.ko 2023-07-11T00:13:51.395 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/torture.ko 2023-07-11T00:13:51.396 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace 2023-07-11T00:13:51.396 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-11T00:13:51.396 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib 2023-07-11T00:13:51.396 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/asn1_encoder.ko 2023-07-11T00:13:51.396 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc-itu-t.ko 2023-07-11T00:13:51.396 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc8.ko 2023-07-11T00:13:51.396 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto 2023-07-11T00:13:51.397 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libarc4.ko 2023-07-11T00:13:51.397 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libdes.ko 2023-07-11T00:13:51.397 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/libcrc32c.ko 2023-07-11T00:13:51.397 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lru_cache.ko 2023-07-11T00:13:51.397 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4 2023-07-11T00:13:51.397 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4_compress.ko 2023-07-11T00:13:51.397 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4hc_compress.ko 2023-07-11T00:13:51.397 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math 2023-07-11T00:13:51.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/cordic.ko 2023-07-11T00:13:51.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6 2023-07-11T00:13:51.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/raid6_pq.ko 2023-07-11T00:13:51.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon 2023-07-11T00:13:51.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-11T00:13:51.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_bm.ko 2023-07-11T00:13:51.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_fsm.ko 2023-07-11T00:13:51.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_kmp.ko 2023-07-11T00:13:51.398 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd 2023-07-11T00:13:51.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd/zstd_compress.ko 2023-07-11T00:13:51.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm 2023-07-11T00:13:51.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm/hwpoison-inject.ko 2023-07-11T00:13:51.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net 2023-07-11T00:13:51.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan 2023-07-11T00:13:51.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/6lowpan.ko 2023-07-11T00:13:51.399 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_dest.ko 2023-07-11T00:13:51.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_fragment.ko 2023-07-11T00:13:51.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_hop.ko 2023-07-11T00:13:51.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-11T00:13:51.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_mobility.ko 2023-07-11T00:13:51.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_routing.ko 2023-07-11T00:13:51.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_udp.ko 2023-07-11T00:13:51.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802 2023-07-11T00:13:51.400 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/garp.ko 2023-07-11T00:13:51.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/mrp.ko 2023-07-11T00:13:51.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/p8022.ko 2023-07-11T00:13:51.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/psnap.ko 2023-07-11T00:13:51.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/stp.ko 2023-07-11T00:13:51.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q 2023-07-11T00:13:51.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/8021q.ko 2023-07-11T00:13:51.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p 2023-07-11T00:13:51.401 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet.ko 2023-07-11T00:13:51.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_fd.ko 2023-07-11T00:13:51.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_rdma.ko 2023-07-11T00:13:51.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_virtio.ko 2023-07-11T00:13:51.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv 2023-07-11T00:13:51.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/batman-adv.ko 2023-07-11T00:13:51.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge 2023-07-11T00:13:51.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/br_netfilter.ko 2023-07-11T00:13:51.402 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/bridge.ko 2023-07-11T00:13:51.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter 2023-07-11T00:13:51.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-11T00:13:51.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-11T00:13:51.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-11T00:13:51.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-11T00:13:51.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-11T00:13:51.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-11T00:13:51.403 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-11T00:13:51.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-11T00:13:51.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-11T00:13:51.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-11T00:13:51.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-11T00:13:51.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-11T00:13:51.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-11T00:13:51.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-11T00:13:51.404 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-11T00:13:51.405 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-11T00:13:51.405 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-11T00:13:51.405 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-11T00:13:51.405 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-11T00:13:51.405 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-11T00:13:51.405 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtables.ko 2023-07-11T00:13:51.405 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-11T00:13:51.405 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-11T00:13:51.406 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-11T00:13:51.406 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph 2023-07-11T00:13:51.406 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/libceph.ko 2023-07-11T00:13:51.406 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core 2023-07-11T00:13:51.406 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/failover.ko 2023-07-11T00:13:51.406 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/pktgen.ko 2023-07-11T00:13:51.406 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp 2023-07-11T00:13:51.406 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp.ko 2023-07-11T00:13:51.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_diag.ko 2023-07-11T00:13:51.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv4.ko 2023-07-11T00:13:51.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv6.ko 2023-07-11T00:13:51.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver 2023-07-11T00:13:51.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver/dns_resolver.ko 2023-07-11T00:13:51.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa 2023-07-11T00:13:51.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/dsa_core.ko 2023-07-11T00:13:51.407 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_brcm.ko 2023-07-11T00:13:51.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_dsa.ko 2023-07-11T00:13:51.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_none.ko 2023-07-11T00:13:51.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_trailer.ko 2023-07-11T00:13:51.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154 2023-07-11T00:13:51.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan 2023-07-11T00:13:51.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-11T00:13:51.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154.ko 2023-07-11T00:13:51.408 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-11T00:13:51.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4 2023-07-11T00:13:51.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ah4.ko 2023-07-11T00:13:51.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/esp4.ko 2023-07-11T00:13:51.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/fou.ko 2023-07-11T00:13:51.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/gre.ko 2023-07-11T00:13:51.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/inet_diag.ko 2023-07-11T00:13:51.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_gre.ko 2023-07-11T00:13:51.409 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_tunnel.ko 2023-07-11T00:13:51.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_vti.ko 2023-07-11T00:13:51.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipcomp.ko 2023-07-11T00:13:51.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipip.ko 2023-07-11T00:13:51.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter 2023-07-11T00:13:51.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-11T00:13:51.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-11T00:13:51.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-11T00:13:51.410 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-11T00:13:51.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-11T00:13:51.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-11T00:13:51.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-11T00:13:51.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-11T00:13:51.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-11T00:13:51.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-11T00:13:51.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-11T00:13:51.411 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-11T00:13:51.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-11T00:13:51.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-11T00:13:51.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-11T00:13:51.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-11T00:13:51.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-11T00:13:51.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-11T00:13:51.412 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-11T00:13:51.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-11T00:13:51.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-11T00:13:51.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_bic.ko 2023-07-11T00:13:51.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_dctcp.ko 2023-07-11T00:13:51.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_diag.ko 2023-07-11T00:13:51.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_highspeed.ko 2023-07-11T00:13:51.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_htcp.ko 2023-07-11T00:13:51.413 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_hybla.ko 2023-07-11T00:13:51.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_illinois.ko 2023-07-11T00:13:51.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_lp.ko 2023-07-11T00:13:51.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_scalable.ko 2023-07-11T00:13:51.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_vegas.ko 2023-07-11T00:13:51.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_veno.ko 2023-07-11T00:13:51.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_westwood.ko 2023-07-11T00:13:51.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_yeah.ko 2023-07-11T00:13:51.414 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tunnel4.ko 2023-07-11T00:13:51.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_diag.ko 2023-07-11T00:13:51.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_tunnel.ko 2023-07-11T00:13:51.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-11T00:13:51.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6 2023-07-11T00:13:51.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ah6.ko 2023-07-11T00:13:51.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/esp6.ko 2023-07-11T00:13:51.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/fou6.ko 2023-07-11T00:13:51.415 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_tunnel.ko 2023-07-11T00:13:51.416 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-11T00:13:51.416 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_vti.ko 2023-07-11T00:13:51.416 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ipcomp6.ko 2023-07-11T00:13:51.416 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter 2023-07-11T00:13:51.416 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-11T00:13:51.416 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-11T00:13:51.416 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-11T00:13:51.416 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-11T00:13:51.417 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-11T00:13:51.417 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-11T00:13:51.417 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-11T00:13:51.417 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-11T00:13:51.417 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-11T00:13:51.417 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-11T00:13:51.417 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-11T00:13:51.417 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-11T00:13:51.418 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-11T00:13:51.418 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-11T00:13:51.418 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-11T00:13:51.418 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-11T00:13:51.418 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-11T00:13:51.418 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-11T00:13:51.418 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-11T00:13:51.418 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-11T00:13:51.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-11T00:13:51.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-11T00:13:51.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-11T00:13:51.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-11T00:13:51.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/sit.ko 2023-07-11T00:13:51.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/tunnel6.ko 2023-07-11T00:13:51.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-11T00:13:51.419 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key 2023-07-11T00:13:51.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key/af_key.ko 2023-07-11T00:13:51.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp 2023-07-11T00:13:51.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_core.ko 2023-07-11T00:13:51.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-11T00:13:51.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_eth.ko 2023-07-11T00:13:51.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip.ko 2023-07-11T00:13:51.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip6.ko 2023-07-11T00:13:51.420 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_netlink.ko 2023-07-11T00:13:51.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ppp.ko 2023-07-11T00:13:51.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc 2023-07-11T00:13:51.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc.ko 2023-07-11T00:13:51.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154 2023-07-11T00:13:51.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/mac802154.ko 2023-07-11T00:13:51.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls 2023-07-11T00:13:51.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/mpls_gso.ko 2023-07-11T00:13:51.421 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter 2023-07-11T00:13:51.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset 2023-07-11T00:13:51.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set.ko 2023-07-11T00:13:51.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-11T00:13:51.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-11T00:13:51.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-11T00:13:51.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-11T00:13:51.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-11T00:13:51.422 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-11T00:13:51.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-11T00:13:51.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-11T00:13:51.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-11T00:13:51.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-11T00:13:51.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-11T00:13:51.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-11T00:13:51.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-11T00:13:51.423 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-11T00:13:51.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-11T00:13:51.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs 2023-07-11T00:13:51.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-11T00:13:51.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-11T00:13:51.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-11T00:13:51.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-11T00:13:51.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-11T00:13:51.424 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-11T00:13:51.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-11T00:13:51.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-11T00:13:51.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-11T00:13:51.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-11T00:13:51.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-11T00:13:51.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-11T00:13:51.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-11T00:13:51.425 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-11T00:13:51.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conncount.ko 2023-07-11T00:13:51.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack.ko 2023-07-11T00:13:51.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-11T00:13:51.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-11T00:13:51.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-11T00:13:51.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-11T00:13:51.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-11T00:13:51.426 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-11T00:13:51.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-11T00:13:51.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-11T00:13:51.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-11T00:13:51.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-11T00:13:51.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-11T00:13:51.427 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-11T00:13:51.428 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-11T00:13:51.428 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table.ko 2023-07-11T00:13:51.428 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-11T00:13:51.428 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_log_syslog.ko 2023-07-11T00:13:51.428 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat.ko 2023-07-11T00:13:51.428 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-11T00:13:51.428 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-11T00:13:51.428 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_irc.ko 2023-07-11T00:13:51.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_sip.ko 2023-07-11T00:13:51.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-11T00:13:51.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-11T00:13:51.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_tables.ko 2023-07-11T00:13:51.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink.ko 2023-07-11T00:13:51.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-11T00:13:51.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_log.ko 2023-07-11T00:13:51.429 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-11T00:13:51.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-11T00:13:51.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_chain_nat.ko 2023-07-11T00:13:51.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_compat.ko 2023-07-11T00:13:51.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_ct.ko 2023-07-11T00:13:51.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-11T00:13:51.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fib.ko 2023-07-11T00:13:51.430 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-11T00:13:51.431 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_hash.ko 2023-07-11T00:13:51.431 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_limit.ko 2023-07-11T00:13:51.431 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_log.ko 2023-07-11T00:13:51.431 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_masq.ko 2023-07-11T00:13:51.431 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_nat.ko 2023-07-11T00:13:51.431 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_numgen.ko 2023-07-11T00:13:51.431 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_queue.ko 2023-07-11T00:13:51.432 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_quota.ko 2023-07-11T00:13:51.432 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_redir.ko 2023-07-11T00:13:51.432 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject.ko 2023-07-11T00:13:51.432 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject_inet.ko 2023-07-11T00:13:51.432 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_socket.ko 2023-07-11T00:13:51.432 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_tunnel.ko 2023-07-11T00:13:51.432 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_AUDIT.ko 2023-07-11T00:13:51.432 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-11T00:13:51.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-11T00:13:51.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-11T00:13:51.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CT.ko 2023-07-11T00:13:51.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_DSCP.ko 2023-07-11T00:13:51.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HL.ko 2023-07-11T00:13:51.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HMARK.ko 2023-07-11T00:13:51.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-11T00:13:51.433 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LED.ko 2023-07-11T00:13:51.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LOG.ko 2023-07-11T00:13:51.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-11T00:13:51.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NETMAP.ko 2023-07-11T00:13:51.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFLOG.ko 2023-07-11T00:13:51.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-11T00:13:51.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_RATEEST.ko 2023-07-11T00:13:51.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-11T00:13:51.434 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_SECMARK.ko 2023-07-11T00:13:51.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-11T00:13:51.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-11T00:13:51.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TEE.ko 2023-07-11T00:13:51.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TPROXY.ko 2023-07-11T00:13:51.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TRACE.ko 2023-07-11T00:13:51.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_addrtype.ko 2023-07-11T00:13:51.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_bpf.ko 2023-07-11T00:13:51.435 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cgroup.ko 2023-07-11T00:13:51.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cluster.ko 2023-07-11T00:13:51.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_comment.ko 2023-07-11T00:13:51.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connbytes.ko 2023-07-11T00:13:51.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlabel.ko 2023-07-11T00:13:51.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlimit.ko 2023-07-11T00:13:51.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connmark.ko 2023-07-11T00:13:51.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_conntrack.ko 2023-07-11T00:13:51.436 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cpu.ko 2023-07-11T00:13:51.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dccp.ko 2023-07-11T00:13:51.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_devgroup.ko 2023-07-11T00:13:51.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dscp.ko 2023-07-11T00:13:51.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ecn.ko 2023-07-11T00:13:51.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_esp.ko 2023-07-11T00:13:51.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hashlimit.ko 2023-07-11T00:13:51.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_helper.ko 2023-07-11T00:13:51.437 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hl.ko 2023-07-11T00:13:51.438 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipcomp.ko 2023-07-11T00:13:51.438 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_iprange.ko 2023-07-11T00:13:51.438 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipvs.ko 2023-07-11T00:13:51.438 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_l2tp.ko 2023-07-11T00:13:51.438 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_length.ko 2023-07-11T00:13:51.438 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_limit.ko 2023-07-11T00:13:51.438 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mac.ko 2023-07-11T00:13:51.438 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mark.ko 2023-07-11T00:13:51.439 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_multiport.ko 2023-07-11T00:13:51.439 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nat.ko 2023-07-11T00:13:51.439 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nfacct.ko 2023-07-11T00:13:51.439 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_osf.ko 2023-07-11T00:13:51.439 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_owner.ko 2023-07-11T00:13:51.439 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_physdev.ko 2023-07-11T00:13:51.439 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_pkttype.ko 2023-07-11T00:13:51.439 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_policy.ko 2023-07-11T00:13:51.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_quota.ko 2023-07-11T00:13:51.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_rateest.ko 2023-07-11T00:13:51.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_realm.ko 2023-07-11T00:13:51.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_recent.ko 2023-07-11T00:13:51.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_sctp.ko 2023-07-11T00:13:51.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_set.ko 2023-07-11T00:13:51.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_socket.ko 2023-07-11T00:13:51.440 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_state.ko 2023-07-11T00:13:51.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_statistic.ko 2023-07-11T00:13:51.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_string.ko 2023-07-11T00:13:51.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpmss.ko 2023-07-11T00:13:51.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_time.ko 2023-07-11T00:13:51.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_u32.ko 2023-07-11T00:13:51.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink 2023-07-11T00:13:51.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/netlink_diag.ko 2023-07-11T00:13:51.441 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh 2023-07-11T00:13:51.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/nsh.ko 2023-07-11T00:13:51.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch 2023-07-11T00:13:51.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/openvswitch.ko 2023-07-11T00:13:51.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-geneve.ko 2023-07-11T00:13:51.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-gre.ko 2023-07-11T00:13:51.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-vxlan.ko 2023-07-11T00:13:51.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet 2023-07-11T00:13:51.442 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/af_packet_diag.ko 2023-07-11T00:13:51.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds 2023-07-11T00:13:51.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds.ko 2023-07-11T00:13:51.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_rdma.ko 2023-07-11T00:13:51.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_tcp.ko 2023-07-11T00:13:51.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched 2023-07-11T00:13:51.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_csum.ko 2023-07-11T00:13:51.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_gact.ko 2023-07-11T00:13:51.443 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_ipt.ko 2023-07-11T00:13:51.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_mirred.ko 2023-07-11T00:13:51.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_nat.ko 2023-07-11T00:13:51.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_pedit.ko 2023-07-11T00:13:51.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_police.ko 2023-07-11T00:13:51.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_simple.ko 2023-07-11T00:13:51.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_skbedit.ko 2023-07-11T00:13:51.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_vlan.ko 2023-07-11T00:13:51.444 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_basic.ko 2023-07-11T00:13:51.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_bpf.ko 2023-07-11T00:13:51.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_flow.ko 2023-07-11T00:13:51.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_fw.ko 2023-07-11T00:13:51.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_route.ko 2023-07-11T00:13:51.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_u32.ko 2023-07-11T00:13:51.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_cmp.ko 2023-07-11T00:13:51.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_ipset.ko 2023-07-11T00:13:51.445 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_meta.ko 2023-07-11T00:13:51.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_nbyte.ko 2023-07-11T00:13:51.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_text.ko 2023-07-11T00:13:51.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_u32.ko 2023-07-11T00:13:51.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_choke.ko 2023-07-11T00:13:51.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_codel.ko 2023-07-11T00:13:51.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_drr.ko 2023-07-11T00:13:51.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq.ko 2023-07-11T00:13:51.446 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_gred.ko 2023-07-11T00:13:51.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hfsc.ko 2023-07-11T00:13:51.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hhf.ko 2023-07-11T00:13:51.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_htb.ko 2023-07-11T00:13:51.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_ingress.ko 2023-07-11T00:13:51.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio.ko 2023-07-11T00:13:51.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio_lib.ko 2023-07-11T00:13:51.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_multiq.ko 2023-07-11T00:13:51.447 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_netem.ko 2023-07-11T00:13:51.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_pie.ko 2023-07-11T00:13:51.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_plug.ko 2023-07-11T00:13:51.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_prio.ko 2023-07-11T00:13:51.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_qfq.ko 2023-07-11T00:13:51.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_red.ko 2023-07-11T00:13:51.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfb.ko 2023-07-11T00:13:51.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfq.ko 2023-07-11T00:13:51.448 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_tbf.ko 2023-07-11T00:13:51.449 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_teql.ko 2023-07-11T00:13:51.449 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp 2023-07-11T00:13:51.449 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp.ko 2023-07-11T00:13:51.449 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp_diag.ko 2023-07-11T00:13:51.449 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc 2023-07-11T00:13:51.449 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss 2023-07-11T00:13:51.449 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-11T00:13:51.449 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-11T00:13:51.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/sunrpc.ko 2023-07-11T00:13:51.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma 2023-07-11T00:13:51.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-11T00:13:51.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc 2023-07-11T00:13:51.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/diag.ko 2023-07-11T00:13:51.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/tipc.ko 2023-07-11T00:13:51.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix 2023-07-11T00:13:51.450 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/unix_diag.ko 2023-07-11T00:13:51.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock 2023-07-11T00:13:51.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-11T00:13:51.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-11T00:13:51.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock.ko 2023-07-11T00:13:51.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-11T00:13:51.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-11T00:13:51.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm 2023-07-11T00:13:51.451 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-11T00:13:51.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security 2023-07-11T00:13:51.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys 2023-07-11T00:13:51.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys 2023-07-11T00:13:51.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-11T00:13:51.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys 2023-07-11T00:13:51.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys/trusted.ko 2023-07-11T00:13:51.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt 2023-07-11T00:13:51.452 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib 2023-07-11T00:13:51.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/irqbypass.ko 2023-07-11T00:13:51.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias 2023-07-11T00:13:51.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias.bin 2023-07-11T00:13:51.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin 2023-07-11T00:13:51.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.bin 2023-07-11T00:13:51.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.modinfo 2023-07-11T00:13:51.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep 2023-07-11T00:13:51.453 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep.bin 2023-07-11T00:13:51.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.devname 2023-07-11T00:13:51.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.order 2023-07-11T00:13:51.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.softdep 2023-07-11T00:13:51.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols 2023-07-11T00:13:51.454 INFO:teuthology.orchestra.run.smithi022.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols.bin 2023-07-11T00:13:51.455 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-g84139c18d56f 2023-07-11T00:13:51.455 DEBUG:teuthology.orchestra.run.smithi022:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-11T00:13:51.483 INFO:teuthology.orchestra.run.smithi022.stdout:postinstall scriptlet (using /bin/sh): 2023-07-11T00:13:51.483 INFO:teuthology.orchestra.run.smithi022.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-g84139c18d56f -a -r /boot/System.map-6.4.0-g84139c18d56f ]; then 2023-07-11T00:13:51.483 INFO:teuthology.orchestra.run.smithi022.stdout:cp /boot/vmlinuz-6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm 2023-07-11T00:13:51.483 INFO:teuthology.orchestra.run.smithi022.stdout:cp /boot/System.map-6.4.0-g84139c18d56f /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-11T00:13:51.484 INFO:teuthology.orchestra.run.smithi022.stdout:rm -f /boot/vmlinuz-6.4.0-g84139c18d56f /boot/System.map-6.4.0-g84139c18d56f 2023-07-11T00:13:51.484 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/installkernel 6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-11T00:13:51.484 INFO:teuthology.orchestra.run.smithi022.stdout:rm -f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-11T00:13:51.484 INFO:teuthology.orchestra.run.smithi022.stdout:fi 2023-07-11T00:13:51.484 INFO:teuthology.orchestra.run.smithi022.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-11T00:13:51.484 INFO:teuthology.orchestra.run.smithi022.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-11T00:13:51.484 INFO:teuthology.orchestra.run.smithi022.stdout:new-kernel-pkg --remove 6.4.0-g84139c18d56f --rminitrd --initrdfile=/boot/initramfs-6.4.0-g84139c18d56f.img 2023-07-11T00:13:51.485 INFO:teuthology.orchestra.run.smithi022.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-11T00:13:51.485 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-install remove 6.4.0-g84139c18d56f 2023-07-11T00:13:51.485 INFO:teuthology.orchestra.run.smithi022.stdout:fi 2023-07-11T00:13:51.485 INFO:teuthology.orchestra.run.smithi022.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-11T00:13:51.485 INFO:teuthology.orchestra.run.smithi022.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-11T00:13:51.485 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/update-bootloader --remove 6.4.0-g84139c18d56f 2023-07-11T00:13:51.485 INFO:teuthology.orchestra.run.smithi022.stdout:fi 2023-07-11T00:13:51.486 DEBUG:teuthology.orchestra.run.smithi022:> sudo rpm -qi grub2-tools 2023-07-11T00:13:51.566 INFO:teuthology.orchestra.run.smithi022.stdout:Name : grub2-tools 2023-07-11T00:13:51.566 INFO:teuthology.orchestra.run.smithi022.stdout:Epoch : 1 2023-07-11T00:13:51.566 INFO:teuthology.orchestra.run.smithi022.stdout:Version : 2.02 2023-07-11T00:13:51.566 INFO:teuthology.orchestra.run.smithi022.stdout:Release : 129.el8 2023-07-11T00:13:51.567 INFO:teuthology.orchestra.run.smithi022.stdout:Architecture: x86_64 2023-07-11T00:13:51.567 INFO:teuthology.orchestra.run.smithi022.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-11T00:13:51.567 INFO:teuthology.orchestra.run.smithi022.stdout:Group : System Environment/Base 2023-07-11T00:13:51.567 INFO:teuthology.orchestra.run.smithi022.stdout:Size : 9265586 2023-07-11T00:13:51.567 INFO:teuthology.orchestra.run.smithi022.stdout:License : GPLv3+ 2023-07-11T00:13:51.567 INFO:teuthology.orchestra.run.smithi022.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-11T00:13:51.567 INFO:teuthology.orchestra.run.smithi022.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-11T00:13:51.568 INFO:teuthology.orchestra.run.smithi022.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-11T00:13:51.568 INFO:teuthology.orchestra.run.smithi022.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-11T00:13:51.568 INFO:teuthology.orchestra.run.smithi022.stdout:Relocations : (not relocatable) 2023-07-11T00:13:51.568 INFO:teuthology.orchestra.run.smithi022.stdout:Packager : CentOS BuildSystem 2023-07-11T00:13:51.568 INFO:teuthology.orchestra.run.smithi022.stdout:Vendor : CentOS 2023-07-11T00:13:51.568 INFO:teuthology.orchestra.run.smithi022.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-11T00:13:51.568 INFO:teuthology.orchestra.run.smithi022.stdout:Summary : Support tools for GRUB. 2023-07-11T00:13:51.569 INFO:teuthology.orchestra.run.smithi022.stdout:Description : 2023-07-11T00:13:51.569 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:13:51.569 INFO:teuthology.orchestra.run.smithi022.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-11T00:13:51.569 INFO:teuthology.orchestra.run.smithi022.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-11T00:13:51.569 INFO:teuthology.orchestra.run.smithi022.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-11T00:13:51.569 INFO:teuthology.orchestra.run.smithi022.stdout:hardware devices. 2023-07-11T00:13:51.569 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:13:51.569 INFO:teuthology.orchestra.run.smithi022.stdout:This subpackage provides tools for support of all platforms. 2023-07-11T00:13:51.570 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-11T00:13:51.571 INFO:teuthology.task.kernel:Updating grub on smithi022 to boot 6.4.0-g84139c18d56f 2023-07-11T00:13:51.571 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-11T00:13:55.844 INFO:teuthology.orchestra.run.smithi022.stderr:Generating grub configuration file ... 2023-07-11T00:13:57.995 INFO:teuthology.orchestra.run.smithi022.stderr:done 2023-07-11T00:13:57.997 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2023-07-11T00:13:58.020 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.i9EzOQbvzB 2023-07-11T00:13:58.020 DEBUG:teuthology.orchestra.run.smithi022:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.i9EzOQbvzB 2023-07-11T00:13:58.096 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.i9EzOQbvzB 2023-07-11T00:13:58.253 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.i9EzOQbvzB is 6KB 2023-07-11T00:13:58.276 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.i9EzOQbvzB 2023-07-11T00:13:58.294 DEBUG:teuthology.orchestra.run.smithi022:> sudo /bin/ls /boot/loader/entries || true 2023-07-11T00:13:58.360 INFO:teuthology.orchestra.run.smithi022.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-11T00:13:58.360 INFO:teuthology.orchestra.run.smithi022.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-11T00:13:58.360 INFO:teuthology.orchestra.run.smithi022.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-11T00:13:58.360 INFO:teuthology.orchestra.run.smithi022.stdout:a1b29d6c289747bdb22930598d39874a-6.4.0-g84139c18d56f.conf 2023-07-11T00:13:58.361 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.4.0-g84139c18d56f 2023-07-11T00:13:58.533 DEBUG:teuthology.orchestra.run.smithi022:> sudo shutdown -r now 2023-07-11T00:14:10.862 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi184.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-11T00:14:10.862 DEBUG:teuthology.orchestra.run.smithi184:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-11T00:14:10.912 INFO:teuthology.orchestra.run.smithi184.stdout:/boot/System.map-6.4.0-g84139c18d56f 2023-07-11T00:14:10.912 INFO:teuthology.orchestra.run.smithi184.stdout:/boot/config-6.4.0-g84139c18d56f 2023-07-11T00:14:10.912 INFO:teuthology.orchestra.run.smithi184.stdout:/boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-11T00:14:10.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f 2023-07-11T00:14:10.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel 2023-07-11T00:14:10.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch 2023-07-11T00:14:10.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86 2023-07-11T00:14:10.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto 2023-07-11T00:14:10.914 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-11T00:14:10.914 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-11T00:14:10.914 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-11T00:14:10.914 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-11T00:14:10.914 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-11T00:14:10.914 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-11T00:14:10.914 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-11T00:14:10.914 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-11T00:14:10.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-11T00:14:10.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-11T00:14:10.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-11T00:14:10.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-11T00:14:10.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-11T00:14:10.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-11T00:14:10.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-11T00:14:10.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-11T00:14:10.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-11T00:14:10.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-11T00:14:10.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-11T00:14:10.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-11T00:14:10.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel 2023-07-11T00:14:10.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu 2023-07-11T00:14:10.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce 2023-07-11T00:14:10.917 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-11T00:14:10.917 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm 2023-07-11T00:14:10.917 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-11T00:14:10.917 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-11T00:14:10.917 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm.ko 2023-07-11T00:14:10.917 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto 2023-07-11T00:14:10.917 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ansi_cprng.ko 2023-07-11T00:14:10.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/anubis.ko 2023-07-11T00:14:10.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/arc4.ko 2023-07-11T00:14:10.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx 2023-07-11T00:14:10.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_memcpy.ko 2023-07-11T00:14:10.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_pq.ko 2023-07-11T00:14:10.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-11T00:14:10.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_tx.ko 2023-07-11T00:14:10.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_xor.ko 2023-07-11T00:14:10.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/raid6test.ko 2023-07-11T00:14:10.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authenc.ko 2023-07-11T00:14:10.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authencesn.ko 2023-07-11T00:14:10.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blake2b_generic.ko 2023-07-11T00:14:10.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_common.ko 2023-07-11T00:14:10.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_generic.ko 2023-07-11T00:14:10.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/camellia_generic.ko 2023-07-11T00:14:10.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast5_generic.ko 2023-07-11T00:14:10.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast6_generic.ko 2023-07-11T00:14:10.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast_common.ko 2023-07-11T00:14:10.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ccm.ko 2023-07-11T00:14:10.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cmac.ko 2023-07-11T00:14:10.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crc32_generic.ko 2023-07-11T00:14:10.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_engine.ko 2023-07-11T00:14:10.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_user.ko 2023-07-11T00:14:10.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cts.ko 2023-07-11T00:14:10.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/des_generic.ko 2023-07-11T00:14:10.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/dh_generic.ko 2023-07-11T00:14:10.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/echainiv.ko 2023-07-11T00:14:10.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/essiv.ko 2023-07-11T00:14:10.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/fcrypt.ko 2023-07-11T00:14:10.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/khazad.ko 2023-07-11T00:14:10.922 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4.ko 2023-07-11T00:14:10.922 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4hc.ko 2023-07-11T00:14:10.922 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/md4.ko 2023-07-11T00:14:10.922 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/michael_mic.ko 2023-07-11T00:14:10.922 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcbc.ko 2023-07-11T00:14:10.922 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcrypt.ko 2023-07-11T00:14:10.922 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/rmd160.ko 2023-07-11T00:14:10.923 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/seed.ko 2023-07-11T00:14:10.923 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/serpent_generic.ko 2023-07-11T00:14:10.923 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tcrypt.ko 2023-07-11T00:14:10.923 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tea.ko 2023-07-11T00:14:10.923 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_common.ko 2023-07-11T00:14:10.923 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_generic.ko 2023-07-11T00:14:10.923 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/vmac.ko 2023-07-11T00:14:10.923 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/wp512.ko 2023-07-11T00:14:10.924 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xcbc.ko 2023-07-11T00:14:10.924 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xor.ko 2023-07-11T00:14:10.924 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xxhash_generic.ko 2023-07-11T00:14:10.924 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers 2023-07-11T00:14:10.924 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi 2023-07-11T00:14:10.924 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-11T00:14:10.924 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_pad.ko 2023-07-11T00:14:10.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/custom_method.ko 2023-07-11T00:14:10.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ec_sys.ko 2023-07-11T00:14:10.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/platform_profile.ko 2023-07-11T00:14:10.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbs.ko 2023-07-11T00:14:10.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbshc.ko 2023-07-11T00:14:10.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/video.ko 2023-07-11T00:14:10.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata 2023-07-11T00:14:10.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/acard-ahci.ko 2023-07-11T00:14:10.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci_platform.ko 2023-07-11T00:14:10.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ata_generic.ko 2023-07-11T00:14:10.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci_platform.ko 2023-07-11T00:14:10.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_acpi.ko 2023-07-11T00:14:10.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ali.ko 2023-07-11T00:14:10.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_amd.ko 2023-07-11T00:14:10.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_artop.ko 2023-07-11T00:14:10.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atiixp.ko 2023-07-11T00:14:10.927 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atp867x.ko 2023-07-11T00:14:10.927 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd640.ko 2023-07-11T00:14:10.927 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd64x.ko 2023-07-11T00:14:10.927 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cypress.ko 2023-07-11T00:14:10.927 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_efar.ko 2023-07-11T00:14:10.927 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt366.ko 2023-07-11T00:14:10.927 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt37x.ko 2023-07-11T00:14:10.928 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-11T00:14:10.928 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-11T00:14:10.928 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it8213.ko 2023-07-11T00:14:10.928 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it821x.ko 2023-07-11T00:14:10.928 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_jmicron.ko 2023-07-11T00:14:10.928 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_marvell.ko 2023-07-11T00:14:10.928 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_mpiix.ko 2023-07-11T00:14:10.929 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_netcell.ko 2023-07-11T00:14:10.929 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ninja32.ko 2023-07-11T00:14:10.929 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87410.ko 2023-07-11T00:14:10.929 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87415.ko 2023-07-11T00:14:10.929 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_oldpiix.ko 2023-07-11T00:14:10.929 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_opti.ko 2023-07-11T00:14:10.929 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_optidma.ko 2023-07-11T00:14:10.929 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pcmcia.ko 2023-07-11T00:14:10.930 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-11T00:14:10.930 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-11T00:14:10.930 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_piccolo.ko 2023-07-11T00:14:10.930 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rdc.ko 2023-07-11T00:14:10.930 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sch.ko 2023-07-11T00:14:10.930 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_serverworks.ko 2023-07-11T00:14:10.930 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sil680.ko 2023-07-11T00:14:10.931 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sis.ko 2023-07-11T00:14:10.931 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sl82c105.ko 2023-07-11T00:14:10.931 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_triflex.ko 2023-07-11T00:14:10.931 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_via.ko 2023-07-11T00:14:10.931 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pdc_adma.ko 2023-07-11T00:14:10.931 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_inic162x.ko 2023-07-11T00:14:10.931 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_mv.ko 2023-07-11T00:14:10.931 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_nv.ko 2023-07-11T00:14:10.932 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_promise.ko 2023-07-11T00:14:10.932 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_qstor.ko 2023-07-11T00:14:10.932 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil.ko 2023-07-11T00:14:10.932 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil24.ko 2023-07-11T00:14:10.932 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sis.ko 2023-07-11T00:14:10.933 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_svw.ko 2023-07-11T00:14:10.933 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sx4.ko 2023-07-11T00:14:10.933 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_uli.ko 2023-07-11T00:14:10.933 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_via.ko 2023-07-11T00:14:10.933 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_vsc.ko 2023-07-11T00:14:10.933 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay 2023-07-11T00:14:10.933 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ks0108.ko 2023-07-11T00:14:10.933 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base 2023-07-11T00:14:10.934 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap 2023-07-11T00:14:10.934 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-11T00:14:10.934 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma 2023-07-11T00:14:10.934 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/bcma.ko 2023-07-11T00:14:10.934 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block 2023-07-11T00:14:10.934 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe 2023-07-11T00:14:10.934 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/aoe.ko 2023-07-11T00:14:10.935 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/brd.ko 2023-07-11T00:14:10.935 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd 2023-07-11T00:14:10.935 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/drbd.ko 2023-07-11T00:14:10.935 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/floppy.ko 2023-07-11T00:14:10.935 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/loop.ko 2023-07-11T00:14:10.935 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx 2023-07-11T00:14:10.935 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-11T00:14:10.936 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/nbd.ko 2023-07-11T00:14:10.936 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk 2023-07-11T00:14:10.936 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/null_blk.ko 2023-07-11T00:14:10.936 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/pktcdvd.ko 2023-07-11T00:14:10.936 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/rbd.ko 2023-07-11T00:14:10.936 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/virtio_blk.ko 2023-07-11T00:14:10.936 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback 2023-07-11T00:14:10.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-11T00:14:10.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkfront.ko 2023-07-11T00:14:10.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram 2023-07-11T00:14:10.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/zram.ko 2023-07-11T00:14:10.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char 2023-07-11T00:14:10.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hangcheck-timer.ko 2023-07-11T00:14:10.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random 2023-07-11T00:14:10.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-11T00:14:10.938 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-11T00:14:10.938 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-11T00:14:10.938 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/via-rng.ko 2023-07-11T00:14:10.938 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-11T00:14:10.938 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi 2023-07-11T00:14:10.938 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-11T00:14:10.938 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-11T00:14:10.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-11T00:14:10.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-11T00:14:10.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-11T00:14:10.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-11T00:14:10.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/lp.ko 2023-07-11T00:14:10.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave 2023-07-11T00:14:10.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/mwave.ko 2023-07-11T00:14:10.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ppdev.ko 2023-07-11T00:14:10.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tlclk.ko 2023-07-11T00:14:10.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm 2023-07-11T00:14:10.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm.ko 2023-07-11T00:14:10.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-11T00:14:10.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-11T00:14:10.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-11T00:14:10.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-11T00:14:10.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-11T00:14:10.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/uv_mmtimer.ko 2023-07-11T00:14:10.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/virtio_console.ko 2023-07-11T00:14:10.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq 2023-07-11T00:14:10.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-11T00:14:10.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-11T00:14:10.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-11T00:14:10.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-11T00:14:10.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-11T00:14:10.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-11T00:14:10.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto 2023-07-11T00:14:10.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp 2023-07-11T00:14:10.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-11T00:14:10.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp.ko 2023-07-11T00:14:10.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel 2023-07-11T00:14:10.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat 2023-07-11T00:14:10.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common 2023-07-11T00:14:10.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-11T00:14:10.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-11T00:14:10.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-11T00:14:10.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-aes.ko 2023-07-11T00:14:10.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-sha.ko 2023-07-11T00:14:10.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio 2023-07-11T00:14:10.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-11T00:14:10.944 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca 2023-07-11T00:14:10.944 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/dca.ko 2023-07-11T00:14:10.944 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq 2023-07-11T00:14:10.944 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-11T00:14:10.944 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma 2023-07-11T00:14:10.944 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw 2023-07-11T00:14:10.944 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-11T00:14:10.945 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat 2023-07-11T00:14:10.945 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-11T00:14:10.945 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac 2023-07-11T00:14:10.945 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/amd64_edac.ko 2023-07-11T00:14:10.945 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/e752x_edac.ko 2023-07-11T00:14:10.945 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/edac_mce_amd.ko 2023-07-11T00:14:10.945 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3000_edac.ko 2023-07-11T00:14:10.945 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3200_edac.ko 2023-07-11T00:14:10.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5100_edac.ko 2023-07-11T00:14:10.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5400_edac.ko 2023-07-11T00:14:10.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7300_edac.ko 2023-07-11T00:14:10.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7core_edac.ko 2023-07-11T00:14:10.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i82975x_edac.ko 2023-07-11T00:14:10.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ie31200_edac.ko 2023-07-11T00:14:10.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/sb_edac.ko 2023-07-11T00:14:10.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/x38_edac.ko 2023-07-11T00:14:10.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware 2023-07-11T00:14:10.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/edd.ko 2023-07-11T00:14:10.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-11T00:14:10.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio 2023-07-11T00:14:10.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ich.ko 2023-07-11T00:14:10.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-11T00:14:10.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid 2023-07-11T00:14:10.948 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-appleir.ko 2023-07-11T00:14:10.948 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-aureal.ko 2023-07-11T00:14:10.948 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-axff.ko 2023-07-11T00:14:10.948 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-dr.ko 2023-07-11T00:14:10.948 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elecom.ko 2023-07-11T00:14:10.948 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elo.ko 2023-07-11T00:14:10.948 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-emsff.ko 2023-07-11T00:14:10.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gaff.ko 2023-07-11T00:14:10.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gt683r.ko 2023-07-11T00:14:10.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gyration.ko 2023-07-11T00:14:10.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-11T00:14:10.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-11T00:14:10.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtekff.ko 2023-07-11T00:14:10.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-hyperv.ko 2023-07-11T00:14:10.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-icade.ko 2023-07-11T00:14:10.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-keytouch.ko 2023-07-11T00:14:10.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kye.ko 2023-07-11T00:14:10.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lcpower.ko 2023-07-11T00:14:10.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-led.ko 2023-07-11T00:14:10.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lenovo.ko 2023-07-11T00:14:10.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-11T00:14:10.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-11T00:14:10.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-multitouch.ko 2023-07-11T00:14:10.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ortek.ko 2023-07-11T00:14:10.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-penmount.ko 2023-07-11T00:14:10.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-petalynx.ko 2023-07-11T00:14:10.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-picolcd.ko 2023-07-11T00:14:10.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-pl.ko 2023-07-11T00:14:10.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-plantronics.ko 2023-07-11T00:14:10.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-primax.ko 2023-07-11T00:14:10.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-rmi.ko 2023-07-11T00:14:10.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-11T00:14:10.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-common.ko 2023-07-11T00:14:10.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-11T00:14:10.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-11T00:14:10.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-11T00:14:10.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-11T00:14:10.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-11T00:14:10.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-11T00:14:10.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-11T00:14:10.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-11T00:14:10.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-11T00:14:10.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat.ko 2023-07-11T00:14:10.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-saitek.ko 2023-07-11T00:14:10.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-samsung.ko 2023-07-11T00:14:10.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-11T00:14:10.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sjoy.ko 2023-07-11T00:14:10.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sony.ko 2023-07-11T00:14:10.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-speedlink.ko 2023-07-11T00:14:10.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-steelseries.ko 2023-07-11T00:14:10.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sunplus.ko 2023-07-11T00:14:10.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-11T00:14:10.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tivo.ko 2023-07-11T00:14:10.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tmff.ko 2023-07-11T00:14:10.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-topseed.ko 2023-07-11T00:14:10.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-twinhan.ko 2023-07-11T00:14:10.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-uclogic.ko 2023-07-11T00:14:10.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-waltop.ko 2023-07-11T00:14:10.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-wiimote.ko 2023-07-11T00:14:10.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-xinmo.ko 2023-07-11T00:14:10.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zpff.ko 2023-07-11T00:14:10.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zydacron.ko 2023-07-11T00:14:10.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/uhid.ko 2023-07-11T00:14:10.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/wacom.ko 2023-07-11T00:14:10.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv 2023-07-11T00:14:10.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_balloon.ko 2023-07-11T00:14:10.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_utils.ko 2023-07-11T00:14:10.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_vmbus.ko 2023-07-11T00:14:10.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon 2023-07-11T00:14:10.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru.ko 2023-07-11T00:14:10.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru3.ko 2023-07-11T00:14:10.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-11T00:14:10.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7414.ko 2023-07-11T00:14:10.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7418.ko 2023-07-11T00:14:10.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adc128d818.ko 2023-07-11T00:14:10.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1025.ko 2023-07-11T00:14:10.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1026.ko 2023-07-11T00:14:10.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1029.ko 2023-07-11T00:14:10.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1031.ko 2023-07-11T00:14:10.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm9240.ko 2023-07-11T00:14:10.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ads7828.ko 2023-07-11T00:14:10.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7410.ko 2023-07-11T00:14:10.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7411.ko 2023-07-11T00:14:10.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7462.ko 2023-07-11T00:14:10.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7470.ko 2023-07-11T00:14:10.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7475.ko 2023-07-11T00:14:10.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7x10.ko 2023-07-11T00:14:10.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/amc6821.ko 2023-07-11T00:14:10.960 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/applesmc.ko 2023-07-11T00:14:10.960 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asb100.ko 2023-07-11T00:14:10.960 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asc7621.ko 2023-07-11T00:14:10.960 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-11T00:14:10.960 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/atxp1.ko 2023-07-11T00:14:10.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/coretemp.ko 2023-07-11T00:14:10.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-11T00:14:10.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dme1737.ko 2023-07-11T00:14:10.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds1621.ko 2023-07-11T00:14:10.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds620.ko 2023-07-11T00:14:10.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc1403.ko 2023-07-11T00:14:10.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc6w201.ko 2023-07-11T00:14:10.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71805f.ko 2023-07-11T00:14:10.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71882fg.ko 2023-07-11T00:14:10.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f75375s.ko 2023-07-11T00:14:10.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fam15h_power.ko 2023-07-11T00:14:10.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fschmd.ko 2023-07-11T00:14:10.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g760a.ko 2023-07-11T00:14:10.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g762.ko 2023-07-11T00:14:10.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl518sm.ko 2023-07-11T00:14:10.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl520sm.ko 2023-07-11T00:14:10.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-11T00:14:10.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5500_temp.ko 2023-07-11T00:14:10.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5k_amb.ko 2023-07-11T00:14:10.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmaem.ko 2023-07-11T00:14:10.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmpex.ko 2023-07-11T00:14:10.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina209.ko 2023-07-11T00:14:10.964 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina2xx.ko 2023-07-11T00:14:10.964 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/it87.ko 2023-07-11T00:14:10.964 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k10temp.ko 2023-07-11T00:14:10.964 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k8temp.ko 2023-07-11T00:14:10.964 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lineage-pem.ko 2023-07-11T00:14:10.964 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm63.ko 2023-07-11T00:14:10.964 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm73.ko 2023-07-11T00:14:10.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm75.ko 2023-07-11T00:14:10.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm77.ko 2023-07-11T00:14:10.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm78.ko 2023-07-11T00:14:10.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm80.ko 2023-07-11T00:14:10.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm83.ko 2023-07-11T00:14:10.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm85.ko 2023-07-11T00:14:10.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm87.ko 2023-07-11T00:14:10.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm90.ko 2023-07-11T00:14:10.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm92.ko 2023-07-11T00:14:10.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm93.ko 2023-07-11T00:14:10.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95234.ko 2023-07-11T00:14:10.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95241.ko 2023-07-11T00:14:10.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95245.ko 2023-07-11T00:14:10.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc2945.ko 2023-07-11T00:14:10.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4151.ko 2023-07-11T00:14:10.967 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4215.ko 2023-07-11T00:14:10.967 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4222.ko 2023-07-11T00:14:10.967 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4245.ko 2023-07-11T00:14:10.967 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4260.ko 2023-07-11T00:14:10.967 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4261.ko 2023-07-11T00:14:10.967 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max16065.ko 2023-07-11T00:14:10.967 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1619.ko 2023-07-11T00:14:10.968 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1668.ko 2023-07-11T00:14:10.968 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max197.ko 2023-07-11T00:14:10.968 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6639.ko 2023-07-11T00:14:10.968 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6650.ko 2023-07-11T00:14:10.968 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6697.ko 2023-07-11T00:14:10.968 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mcp3021.ko 2023-07-11T00:14:10.968 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6683.ko 2023-07-11T00:14:10.968 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775-core.ko 2023-07-11T00:14:10.969 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775.ko 2023-07-11T00:14:10.969 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct7802.ko 2023-07-11T00:14:10.969 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87360.ko 2023-07-11T00:14:10.969 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87427.ko 2023-07-11T00:14:10.969 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pcf8591.ko 2023-07-11T00:14:10.969 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus 2023-07-11T00:14:10.969 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-11T00:14:10.970 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-11T00:14:10.970 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-11T00:14:10.970 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-11T00:14:10.970 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-11T00:14:10.970 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-11T00:14:10.970 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-11T00:14:10.970 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-11T00:14:10.970 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-11T00:14:10.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-11T00:14:10.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-11T00:14:10.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-11T00:14:10.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/powr1220.ko 2023-07-11T00:14:10.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5627.ko 2023-07-11T00:14:10.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5636.ko 2023-07-11T00:14:10.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-11T00:14:10.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht15.ko 2023-07-11T00:14:10.972 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht21.ko 2023-07-11T00:14:10.972 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/shtc1.ko 2023-07-11T00:14:10.972 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sis5595.ko 2023-07-11T00:14:10.972 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47b397.ko 2023-07-11T00:14:10.972 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m1.ko 2023-07-11T00:14:10.972 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m192.ko 2023-07-11T00:14:10.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/thmc50.ko 2023-07-11T00:14:10.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp102.ko 2023-07-11T00:14:10.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp103.ko 2023-07-11T00:14:10.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp401.ko 2023-07-11T00:14:10.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp421.ko 2023-07-11T00:14:10.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via-cputemp.ko 2023-07-11T00:14:10.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via686a.ko 2023-07-11T00:14:10.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt1211.ko 2023-07-11T00:14:10.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt8231.ko 2023-07-11T00:14:10.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627ehf.ko 2023-07-11T00:14:10.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627hf.ko 2023-07-11T00:14:10.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83781d.ko 2023-07-11T00:14:10.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83791d.ko 2023-07-11T00:14:10.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83792d.ko 2023-07-11T00:14:10.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83793.ko 2023-07-11T00:14:10.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83795.ko 2023-07-11T00:14:10.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l785ts.ko 2023-07-11T00:14:10.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l786ng.ko 2023-07-11T00:14:10.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c 2023-07-11T00:14:10.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos 2023-07-11T00:14:10.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-11T00:14:10.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-11T00:14:10.976 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses 2023-07-11T00:14:10.976 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-11T00:14:10.976 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-11T00:14:10.976 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-11T00:14:10.976 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-11T00:14:10.976 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-11T00:14:10.976 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-11T00:14:10.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-11T00:14:10.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-11T00:14:10.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-11T00:14:10.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-11T00:14:10.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-11T00:14:10.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-11T00:14:10.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-11T00:14:10.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-11T00:14:10.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-11T00:14:10.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-11T00:14:10.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-11T00:14:10.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-11T00:14:10.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-11T00:14:10.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-11T00:14:10.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-11T00:14:10.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-11T00:14:10.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-11T00:14:10.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-dev.ko 2023-07-11T00:14:10.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-mux.ko 2023-07-11T00:14:10.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-11T00:14:10.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-smbus.ko 2023-07-11T00:14:10.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-stub.ko 2023-07-11T00:14:10.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband 2023-07-11T00:14:10.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core 2023-07-11T00:14:10.980 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-11T00:14:10.980 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_core.ko 2023-07-11T00:14:10.980 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-11T00:14:10.980 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-11T00:14:10.980 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-11T00:14:10.980 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-11T00:14:10.980 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-11T00:14:10.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw 2023-07-11T00:14:10.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4 2023-07-11T00:14:10.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-11T00:14:10.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4 2023-07-11T00:14:10.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-11T00:14:10.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5 2023-07-11T00:14:10.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-11T00:14:10.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca 2023-07-11T00:14:10.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-11T00:14:10.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp 2023-07-11T00:14:10.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib 2023-07-11T00:14:10.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-11T00:14:10.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser 2023-07-11T00:14:10.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-11T00:14:10.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert 2023-07-11T00:14:10.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-11T00:14:10.983 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp 2023-07-11T00:14:10.983 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-11T00:14:10.983 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt 2023-07-11T00:14:10.983 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-11T00:14:10.983 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input 2023-07-11T00:14:10.983 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport 2023-07-11T00:14:10.983 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-11T00:14:10.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-11T00:14:10.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/gameport.ko 2023-07-11T00:14:10.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/lightning.ko 2023-07-11T00:14:10.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ns558.ko 2023-07-11T00:14:10.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/joydev.ko 2023-07-11T00:14:10.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard 2023-07-11T00:14:10.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-11T00:14:10.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse 2023-07-11T00:14:10.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/appletouch.ko 2023-07-11T00:14:10.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/bcm5974.ko 2023-07-11T00:14:10.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/cyapatp.ko 2023-07-11T00:14:10.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-11T00:14:10.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/sermouse.ko 2023-07-11T00:14:10.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-11T00:14:10.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-11T00:14:10.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-11T00:14:10.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4 2023-07-11T00:14:10.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-11T00:14:10.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio 2023-07-11T00:14:10.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/altera_ps2.ko 2023-07-11T00:14:10.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/arc_ps2.ko 2023-07-11T00:14:10.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-11T00:14:10.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serio_raw.ko 2023-07-11T00:14:10.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/sparse-keymap.ko 2023-07-11T00:14:10.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu 2023-07-11T00:14:10.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd 2023-07-11T00:14:10.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-11T00:14:10.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds 2023-07-11T00:14:10.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-blinkm.ko 2023-07-11T00:14:10.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3530.ko 2023-07-11T00:14:10.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp3944.ko 2023-07-11T00:14:10.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-ss4200.ko 2023-07-11T00:14:10.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger 2023-07-11T00:14:10.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-11T00:14:10.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-11T00:14:10.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-11T00:14:10.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-11T00:14:10.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-11T00:14:10.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-11T00:14:10.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-11T00:14:10.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-11T00:14:10.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md 2023-07-11T00:14:10.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache 2023-07-11T00:14:10.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/bcache.ko 2023-07-11T00:14:10.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bio-prison.ko 2023-07-11T00:14:10.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache-smq.ko 2023-07-11T00:14:10.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache.ko 2023-07-11T00:14:10.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-crypt.ko 2023-07-11T00:14:10.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-delay.ko 2023-07-11T00:14:10.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-flakey.ko 2023-07-11T00:14:10.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log-userspace.ko 2023-07-11T00:14:10.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-multipath.ko 2023-07-11T00:14:10.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-queue-length.ko 2023-07-11T00:14:10.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-raid.ko 2023-07-11T00:14:10.991 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-round-robin.ko 2023-07-11T00:14:10.991 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-service-time.ko 2023-07-11T00:14:10.991 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-switch.ko 2023-07-11T00:14:10.991 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-thin-pool.ko 2023-07-11T00:14:10.991 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-verity.ko 2023-07-11T00:14:10.991 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/faulty.ko 2023-07-11T00:14:10.991 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/linear.ko 2023-07-11T00:14:10.991 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/multipath.ko 2023-07-11T00:14:10.992 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data 2023-07-11T00:14:10.992 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-11T00:14:10.992 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid0.ko 2023-07-11T00:14:10.992 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid1.ko 2023-07-11T00:14:10.992 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid10.ko 2023-07-11T00:14:10.992 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid456.ko 2023-07-11T00:14:10.992 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message 2023-07-11T00:14:10.993 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion 2023-07-11T00:14:10.993 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptbase.ko 2023-07-11T00:14:10.993 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptctl.ko 2023-07-11T00:14:10.993 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptfc.ko 2023-07-11T00:14:10.993 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptlan.ko 2023-07-11T00:14:10.993 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptsas.ko 2023-07-11T00:14:10.993 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptscsih.ko 2023-07-11T00:14:10.993 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptspi.ko 2023-07-11T00:14:10.994 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd 2023-07-11T00:14:10.994 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_ich.ko 2023-07-11T00:14:10.994 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_sch.ko 2023-07-11T00:14:10.994 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mfd-core.ko 2023-07-11T00:14:10.994 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/sm501.ko 2023-07-11T00:14:10.994 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/viperboard.ko 2023-07-11T00:14:10.994 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/vx855.ko 2023-07-11T00:14:10.995 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wl1273-core.ko 2023-07-11T00:14:10.995 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc 2023-07-11T00:14:10.995 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl 2023-07-11T00:14:10.995 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-11T00:14:10.995 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds9802als.ko 2023-07-11T00:14:10.995 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds990x.ko 2023-07-11T00:14:10.995 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/bh1770glc.ko 2023-07-11T00:14:10.995 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710 2023-07-11T00:14:10.996 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/cb710.ko 2023-07-11T00:14:10.996 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom 2023-07-11T00:14:10.996 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/at24.ko 2023-07-11T00:14:10.996 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-11T00:14:10.996 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-11T00:14:10.996 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/max6875.ko 2023-07-11T00:14:10.996 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/enclosure.ko 2023-07-11T00:14:10.997 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hpilo.ko 2023-07-11T00:14:10.997 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29003.ko 2023-07-11T00:14:10.997 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29020.ko 2023-07-11T00:14:10.997 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d 2023-07-11T00:14:10.997 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-11T00:14:10.997 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-11T00:14:10.997 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei 2023-07-11T00:14:10.997 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-me.ko 2023-07-11T00:14:10.998 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-txe.ko 2023-07-11T00:14:10.998 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei.ko 2023-07-11T00:14:10.998 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru 2023-07-11T00:14:10.998 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-11T00:14:10.998 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp 2023-07-11T00:14:10.998 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-11T00:14:10.998 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-11T00:14:10.998 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-11T00:14:10.999 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_7xx1.ko 2023-07-11T00:14:10.999 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_core.ko 2023-07-11T00:14:10.999 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tsl2550.ko 2023-07-11T00:14:10.999 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_balloon.ko 2023-07-11T00:14:10.999 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci 2023-07-11T00:14:10.999 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-11T00:14:10.999 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net 2023-07-11T00:14:11.000 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding 2023-07-11T00:14:11.000 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/bonding.ko 2023-07-11T00:14:11.000 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa 2023-07-11T00:14:11.000 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53 2023-07-11T00:14:11.000 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-11T00:14:11.000 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-11T00:14:11.000 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-11T00:14:11.001 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx 2023-07-11T00:14:11.001 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-11T00:14:11.001 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dummy.ko 2023-07-11T00:14:11.001 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/eql.ko 2023-07-11T00:14:11.001 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet 2023-07-11T00:14:11.002 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com 2023-07-11T00:14:11.002 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-11T00:14:11.002 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-11T00:14:11.002 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-11T00:14:11.002 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-11T00:14:11.002 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390 2023-07-11T00:14:11.002 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-11T00:14:11.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-11T00:14:11.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-11T00:14:11.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-11T00:14:11.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec 2023-07-11T00:14:11.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-11T00:14:11.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere 2023-07-11T00:14:11.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-11T00:14:11.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon 2023-07-11T00:14:11.004 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-11T00:14:11.004 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera 2023-07-11T00:14:11.004 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-11T00:14:11.004 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd 2023-07-11T00:14:11.004 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-11T00:14:11.004 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-11T00:14:11.004 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-11T00:14:11.005 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros 2023-07-11T00:14:11.005 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx 2023-07-11T00:14:11.005 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-11T00:14:11.005 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-11T00:14:11.005 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-11T00:14:11.005 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-11T00:14:11.005 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-11T00:14:11.005 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx 2023-07-11T00:14:11.006 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-11T00:14:11.006 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-11T00:14:11.006 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom 2023-07-11T00:14:11.006 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-11T00:14:11.006 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-11T00:14:11.006 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-11T00:14:11.006 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-11T00:14:11.006 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-11T00:14:11.007 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet 2023-07-11T00:14:11.007 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-11T00:14:11.007 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-11T00:14:11.007 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade 2023-07-11T00:14:11.007 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna 2023-07-11T00:14:11.007 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-11T00:14:11.007 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio 2023-07-11T00:14:11.008 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-11T00:14:11.008 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-11T00:14:11.008 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-11T00:14:11.008 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-11T00:14:11.008 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-11T00:14:11.009 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-11T00:14:11.009 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-11T00:14:11.009 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-11T00:14:11.009 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-11T00:14:11.009 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-11T00:14:11.009 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco 2023-07-11T00:14:11.009 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic 2023-07-11T00:14:11.010 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-11T00:14:11.010 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec 2023-07-11T00:14:11.010 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip 2023-07-11T00:14:11.010 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-11T00:14:11.010 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-11T00:14:11.010 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-11T00:14:11.010 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-11T00:14:11.010 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-11T00:14:11.011 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-11T00:14:11.011 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink 2023-07-11T00:14:11.011 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-11T00:14:11.011 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-11T00:14:11.011 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dnet.ko 2023-07-11T00:14:11.011 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex 2023-07-11T00:14:11.011 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet 2023-07-11T00:14:11.011 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-11T00:14:11.012 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ethoc.ko 2023-07-11T00:14:11.012 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fealnx.ko 2023-07-11T00:14:11.012 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel 2023-07-11T00:14:11.012 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-11T00:14:11.012 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000 2023-07-11T00:14:11.012 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-11T00:14:11.012 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e 2023-07-11T00:14:11.013 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-11T00:14:11.013 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k 2023-07-11T00:14:11.013 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-11T00:14:11.013 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e 2023-07-11T00:14:11.013 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-11T00:14:11.013 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf 2023-07-11T00:14:11.013 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-11T00:14:11.013 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb 2023-07-11T00:14:11.014 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-11T00:14:11.014 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf 2023-07-11T00:14:11.014 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-11T00:14:11.014 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-11T00:14:11.014 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-11T00:14:11.014 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-11T00:14:11.014 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-11T00:14:11.014 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/jme.ko 2023-07-11T00:14:11.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell 2023-07-11T00:14:11.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-11T00:14:11.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-11T00:14:11.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-11T00:14:11.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox 2023-07-11T00:14:11.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-11T00:14:11.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-11T00:14:11.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-11T00:14:11.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-11T00:14:11.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-11T00:14:11.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-11T00:14:11.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel 2023-07-11T00:14:11.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-11T00:14:11.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom 2023-07-11T00:14:11.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-11T00:14:11.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-11T00:14:11.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi 2023-07-11T00:14:11.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-11T00:14:11.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-11T00:14:11.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion 2023-07-11T00:14:11.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-11T00:14:11.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia 2023-07-11T00:14:11.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-11T00:14:11.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines 2023-07-11T00:14:11.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-11T00:14:11.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-11T00:14:11.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic 2023-07-11T00:14:11.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-11T00:14:11.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-11T00:14:11.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-11T00:14:11.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-11T00:14:11.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-11T00:14:11.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc 2023-07-11T00:14:11.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-11T00:14:11.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek 2023-07-11T00:14:11.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-11T00:14:11.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-11T00:14:11.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-11T00:14:11.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-11T00:14:11.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker 2023-07-11T00:14:11.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-11T00:14:11.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc 2023-07-11T00:14:11.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-11T00:14:11.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan 2023-07-11T00:14:11.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-11T00:14:11.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis 2023-07-11T00:14:11.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-11T00:14:11.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-11T00:14:11.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc 2023-07-11T00:14:11.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-11T00:14:11.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-11T00:14:11.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-11T00:14:11.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-11T00:14:11.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro 2023-07-11T00:14:11.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-11T00:14:11.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-11T00:14:11.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-11T00:14:11.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun 2023-07-11T00:14:11.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-11T00:14:11.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-11T00:14:11.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-11T00:14:11.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-11T00:14:11.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti 2023-07-11T00:14:11.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-11T00:14:11.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti 2023-07-11T00:14:11.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-11T00:14:11.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via 2023-07-11T00:14:11.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-11T00:14:11.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-11T00:14:11.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet 2023-07-11T00:14:11.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-11T00:14:11.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-11T00:14:11.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom 2023-07-11T00:14:11.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-11T00:14:11.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/geneve.ko 2023-07-11T00:14:11.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv 2023-07-11T00:14:11.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-11T00:14:11.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154 2023-07-11T00:14:11.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-11T00:14:11.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ifb.ko 2023-07-11T00:14:11.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan 2023-07-11T00:14:11.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-11T00:14:11.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvlan.ko 2023-07-11T00:14:11.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvtap.ko 2023-07-11T00:14:11.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio 2023-07-11T00:14:11.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio.ko 2023-07-11T00:14:11.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-11T00:14:11.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-11T00:14:11.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mii.ko 2023-07-11T00:14:11.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/net_failover.ko 2023-07-11T00:14:11.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/netconsole.ko 2023-07-11T00:14:11.027 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/nlmon.ko 2023-07-11T00:14:11.027 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs 2023-07-11T00:14:11.027 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-07-11T00:14:11.027 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-11T00:14:11.027 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy 2023-07-11T00:14:11.027 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/amd.ko 2023-07-11T00:14:11.027 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-11T00:14:11.028 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-11T00:14:11.028 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-11T00:14:11.028 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm87xx.ko 2023-07-11T00:14:11.028 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/broadcom.ko 2023-07-11T00:14:11.028 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/cicada.ko 2023-07-11T00:14:11.028 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/davicom.ko 2023-07-11T00:14:11.028 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/dp83640.ko 2023-07-11T00:14:11.028 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/et1011c.ko 2023-07-11T00:14:11.029 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/icplus.ko 2023-07-11T00:14:11.029 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/lxt.ko 2023-07-11T00:14:11.029 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/marvell.ko 2023-07-11T00:14:11.029 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/micrel.ko 2023-07-11T00:14:11.029 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/national.ko 2023-07-11T00:14:11.029 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/phylink.ko 2023-07-11T00:14:11.029 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/qsemi.ko 2023-07-11T00:14:11.029 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/realtek.ko 2023-07-11T00:14:11.030 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/smsc.ko 2023-07-11T00:14:11.030 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ste10Xp.ko 2023-07-11T00:14:11.030 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/vitesse.ko 2023-07-11T00:14:11.030 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp 2023-07-11T00:14:11.030 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-11T00:14:11.030 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_async.ko 2023-07-11T00:14:11.030 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-11T00:14:11.030 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-11T00:14:11.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-11T00:14:11.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-11T00:14:11.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppoe.ko 2023-07-11T00:14:11.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppox.ko 2023-07-11T00:14:11.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pptp.ko 2023-07-11T00:14:11.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip 2023-07-11T00:14:11.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slhc.ko 2023-07-11T00:14:11.032 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slip.ko 2023-07-11T00:14:11.032 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sungem_phy.ko 2023-07-11T00:14:11.032 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tap.ko 2023-07-11T00:14:11.032 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team 2023-07-11T00:14:11.032 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team.ko 2023-07-11T00:14:11.032 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-11T00:14:11.032 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-11T00:14:11.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-11T00:14:11.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_random.ko 2023-07-11T00:14:11.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-11T00:14:11.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tun.ko 2023-07-11T00:14:11.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/veth.ko 2023-07-11T00:14:11.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/virtio_net.ko 2023-07-11T00:14:11.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3 2023-07-11T00:14:11.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-11T00:14:11.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan 2023-07-11T00:14:11.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/vxlan.ko 2023-07-11T00:14:11.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback 2023-07-11T00:14:11.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-11T00:14:11.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netfront.ko 2023-07-11T00:14:11.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb 2023-07-11T00:14:11.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ntb.ko 2023-07-11T00:14:11.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme 2023-07-11T00:14:11.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host 2023-07-11T00:14:11.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme-core.ko 2023-07-11T00:14:11.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme.ko 2023-07-11T00:14:11.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport 2023-07-11T00:14:11.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport.ko 2023-07-11T00:14:11.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_cs.ko 2023-07-11T00:14:11.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_pc.ko 2023-07-11T00:14:11.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_serial.ko 2023-07-11T00:14:11.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci 2023-07-11T00:14:11.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug 2023-07-11T00:14:11.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-11T00:14:11.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie 2023-07-11T00:14:11.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-11T00:14:11.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/xen-pcifront.ko 2023-07-11T00:14:11.037 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia 2023-07-11T00:14:11.037 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/i82092.ko 2023-07-11T00:14:11.037 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pd6729.ko 2023-07-11T00:14:11.037 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-11T00:14:11.037 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl 2023-07-11T00:14:11.037 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel 2023-07-11T00:14:11.037 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-11T00:14:11.037 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform 2023-07-11T00:14:11.038 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86 2023-07-11T00:14:11.038 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-11T00:14:11.038 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acerhdf.ko 2023-07-11T00:14:11.038 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-11T00:14:11.038 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-11T00:14:11.038 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-11T00:14:11.038 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-11T00:14:11.038 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-11T00:14:11.039 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-11T00:14:11.039 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-11T00:14:11.039 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-11T00:14:11.039 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-11T00:14:11.039 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/hdaps.ko 2023-07-11T00:14:11.039 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel 2023-07-11T00:14:11.039 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-11T00:14:11.039 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel_ips.ko 2023-07-11T00:14:11.040 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-11T00:14:11.040 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-11T00:14:11.040 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-11T00:14:11.040 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-11T00:14:11.040 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-11T00:14:11.040 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-11T00:14:11.040 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-11T00:14:11.040 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-11T00:14:11.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-11T00:14:11.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi.ko 2023-07-11T00:14:11.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap 2023-07-11T00:14:11.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-11T00:14:11.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-11T00:14:11.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps 2023-07-11T00:14:11.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients 2023-07-11T00:14:11.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-11T00:14:11.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-11T00:14:11.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps_parport.ko 2023-07-11T00:14:11.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/pps_core.ko 2023-07-11T00:14:11.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp 2023-07-11T00:14:11.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp.ko 2023-07-11T00:14:11.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp_kvm.ko 2023-07-11T00:14:11.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc 2023-07-11T00:14:11.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-11T00:14:11.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-11T00:14:11.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-11T00:14:11.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-11T00:14:11.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-11T00:14:11.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-11T00:14:11.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-11T00:14:11.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-11T00:14:11.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-11T00:14:11.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-11T00:14:11.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-11T00:14:11.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-em3027.ko 2023-07-11T00:14:11.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-11T00:14:11.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-11T00:14:11.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-11T00:14:11.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-11T00:14:11.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-11T00:14:11.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-11T00:14:11.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max6900.ko 2023-07-11T00:14:11.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-11T00:14:11.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-11T00:14:11.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-11T00:14:11.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-11T00:14:11.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-11T00:14:11.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-11T00:14:11.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-11T00:14:11.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-11T00:14:11.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-11T00:14:11.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-11T00:14:11.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-11T00:14:11.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-11T00:14:11.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-x1205.ko 2023-07-11T00:14:11.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi 2023-07-11T00:14:11.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-9xxx.ko 2023-07-11T00:14:11.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-sas.ko 2023-07-11T00:14:11.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-xxxx.ko 2023-07-11T00:14:11.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/BusLogic.ko 2023-07-11T00:14:11.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/a100u2w.ko 2023-07-11T00:14:11.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid 2023-07-11T00:14:11.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-11T00:14:11.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/advansys.ko 2023-07-11T00:14:11.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx 2023-07-11T00:14:11.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-11T00:14:11.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-11T00:14:11.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/am53c974.ko 2023-07-11T00:14:11.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr 2023-07-11T00:14:11.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-11T00:14:11.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/atp870u.ko 2023-07-11T00:14:11.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi 2023-07-11T00:14:11.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-11T00:14:11.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa 2023-07-11T00:14:11.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/bfa.ko 2023-07-11T00:14:11.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc 2023-07-11T00:14:11.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-11T00:14:11.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i 2023-07-11T00:14:11.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-11T00:14:11.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ch.ko 2023-07-11T00:14:11.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor 2023-07-11T00:14:11.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-11T00:14:11.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi 2023-07-11T00:14:11.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-11T00:14:11.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-11T00:14:11.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-11T00:14:11.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-11T00:14:11.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-11T00:14:11.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dc395x.ko 2023-07-11T00:14:11.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler 2023-07-11T00:14:11.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-11T00:14:11.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-11T00:14:11.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-11T00:14:11.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-11T00:14:11.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dmx3191d.ko 2023-07-11T00:14:11.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r 2023-07-11T00:14:11.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-11T00:14:11.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esp_scsi.ko 2023-07-11T00:14:11.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe 2023-07-11T00:14:11.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-11T00:14:11.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-11T00:14:11.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic 2023-07-11T00:14:11.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/fnic.ko 2023-07-11T00:14:11.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hpsa.ko 2023-07-11T00:14:11.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hptiop.ko 2023-07-11T00:14:11.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hv_storvsc.ko 2023-07-11T00:14:11.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/initio.ko 2023-07-11T00:14:11.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ipr.ko 2023-07-11T00:14:11.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ips.ko 2023-07-11T00:14:11.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci 2023-07-11T00:14:11.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/isci.ko 2023-07-11T00:14:11.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-11T00:14:11.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-11T00:14:11.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc 2023-07-11T00:14:11.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/libfc.ko 2023-07-11T00:14:11.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi.ko 2023-07-11T00:14:11.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-11T00:14:11.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas 2023-07-11T00:14:11.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/libsas.ko 2023-07-11T00:14:11.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc 2023-07-11T00:14:11.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-11T00:14:11.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid 2023-07-11T00:14:11.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid.ko 2023-07-11T00:14:11.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-11T00:14:11.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-11T00:14:11.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-11T00:14:11.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas 2023-07-11T00:14:11.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-11T00:14:11.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas 2023-07-11T00:14:11.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-11T00:14:11.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvumi.ko 2023-07-11T00:14:11.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001 2023-07-11T00:14:11.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-11T00:14:11.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pmcraid.ko 2023-07-11T00:14:11.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla1280.ko 2023-07-11T00:14:11.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx 2023-07-11T00:14:11.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-11T00:14:11.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-11T00:14:11.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx 2023-07-11T00:14:11.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-11T00:14:11.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/raid_class.ko 2023-07-11T00:14:11.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_debug.ko 2023-07-11T00:14:11.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-11T00:14:11.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-11T00:14:11.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-11T00:14:11.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-11T00:14:11.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-11T00:14:11.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ses.ko 2023-07-11T00:14:11.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/st.ko 2023-07-11T00:14:11.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/stex.ko 2023-07-11T00:14:11.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2 2023-07-11T00:14:11.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-11T00:14:11.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/virtio_scsi.ko 2023-07-11T00:14:11.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-11T00:14:11.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/wd719x.ko 2023-07-11T00:14:11.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb 2023-07-11T00:14:11.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ssb.ko 2023-07-11T00:14:11.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target 2023-07-11T00:14:11.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi 2023-07-11T00:14:11.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-11T00:14:11.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback 2023-07-11T00:14:11.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-11T00:14:11.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_file.ko 2023-07-11T00:14:11.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_iblock.ko 2023-07-11T00:14:11.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_mod.ko 2023-07-11T00:14:11.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_pscsi.ko 2023-07-11T00:14:11.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_user.ko 2023-07-11T00:14:11.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc 2023-07-11T00:14:11.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-11T00:14:11.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal 2023-07-11T00:14:11.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel 2023-07-11T00:14:11.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal 2023-07-11T00:14:11.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-11T00:14:11.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-11T00:14:11.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-11T00:14:11.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-11T00:14:11.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-11T00:14:11.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-11T00:14:11.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-11T00:14:11.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-11T00:14:11.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-11T00:14:11.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-11T00:14:11.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-11T00:14:11.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-11T00:14:11.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-11T00:14:11.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-11T00:14:11.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-11T00:14:11.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty 2023-07-11T00:14:11.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless 2023-07-11T00:14:11.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-11T00:14:11.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_gsm.ko 2023-07-11T00:14:11.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_hdlc.ko 2023-07-11T00:14:11.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/nozomi.ko 2023-07-11T00:14:11.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial 2023-07-11T00:14:11.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250 2023-07-11T00:14:11.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-11T00:14:11.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/arc_uart.ko 2023-07-11T00:14:11.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm 2023-07-11T00:14:11.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-11T00:14:11.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/synclink_gt.ko 2023-07-11T00:14:11.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs 2023-07-11T00:14:11.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core 2023-07-11T00:14:11.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-11T00:14:11.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host 2023-07-11T00:14:11.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-11T00:14:11.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio 2023-07-11T00:14:11.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio.ko 2023-07-11T00:14:11.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_aec.ko 2023-07-11T00:14:11.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_cif.ko 2023-07-11T00:14:11.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pci_generic.ko 2023-07-11T00:14:11.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_sercos3.ko 2023-07-11T00:14:11.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb 2023-07-11T00:14:11.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class 2023-07-11T00:14:11.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-acm.ko 2023-07-11T00:14:11.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-11T00:14:11.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usblp.ko 2023-07-11T00:14:11.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usbtmc.ko 2023-07-11T00:14:11.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host 2023-07-11T00:14:11.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-11T00:14:11.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image 2023-07-11T00:14:11.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/mdc800.ko 2023-07-11T00:14:11.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/microtek.ko 2023-07-11T00:14:11.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc 2023-07-11T00:14:11.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/adutux.ko 2023-07-11T00:14:11.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/appledisplay.ko 2023-07-11T00:14:11.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi26.ko 2023-07-11T00:14:11.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi62.ko 2023-07-11T00:14:11.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ezusb.ko 2023-07-11T00:14:11.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/idmouse.ko 2023-07-11T00:14:11.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/iowarrior.ko 2023-07-11T00:14:11.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-11T00:14:11.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ldusb.ko 2023-07-11T00:14:11.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/legousbtower.ko 2023-07-11T00:14:11.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga 2023-07-11T00:14:11.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-11T00:14:11.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-11T00:14:11.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usb3503.ko 2023-07-11T00:14:11.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usblcd.ko 2023-07-11T00:14:11.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-11T00:14:11.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/uss720.ko 2023-07-11T00:14:11.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/yurex.ko 2023-07-11T00:14:11.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy 2023-07-11T00:14:11.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-generic.ko 2023-07-11T00:14:11.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial 2023-07-11T00:14:11.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/aircable.ko 2023-07-11T00:14:11.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ark3116.ko 2023-07-11T00:14:11.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-11T00:14:11.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ch341.ko 2023-07-11T00:14:11.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cp210x.ko 2023-07-11T00:14:11.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cyberjack.ko 2023-07-11T00:14:11.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-11T00:14:11.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-11T00:14:11.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/empeg.ko 2023-07-11T00:14:11.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-11T00:14:11.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-11T00:14:11.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-11T00:14:11.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_ti.ko 2023-07-11T00:14:11.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipaq.ko 2023-07-11T00:14:11.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipw.ko 2023-07-11T00:14:11.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ir-usb.ko 2023-07-11T00:14:11.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-11T00:14:11.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan.ko 2023-07-11T00:14:11.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-11T00:14:11.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-11T00:14:11.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-11T00:14:11.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mct_u232.ko 2023-07-11T00:14:11.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7720.ko 2023-07-11T00:14:11.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7840.ko 2023-07-11T00:14:11.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/navman.ko 2023-07-11T00:14:11.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/omninet.ko 2023-07-11T00:14:11.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/opticon.ko 2023-07-11T00:14:11.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/option.ko 2023-07-11T00:14:11.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/oti6858.ko 2023-07-11T00:14:11.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/pl2303.ko 2023-07-11T00:14:11.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcaux.ko 2023-07-11T00:14:11.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcserial.ko 2023-07-11T00:14:11.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/quatech2.ko 2023-07-11T00:14:11.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/safe_serial.ko 2023-07-11T00:14:11.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/sierra.ko 2023-07-11T00:14:11.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-11T00:14:11.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ssu100.ko 2023-07-11T00:14:11.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/symbolserial.ko 2023-07-11T00:14:11.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-11T00:14:11.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-11T00:14:11.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_debug.ko 2023-07-11T00:14:11.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-11T00:14:11.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/visor.ko 2023-07-11T00:14:11.078 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/whiteheat.ko 2023-07-11T00:14:11.078 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-11T00:14:11.078 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage 2023-07-11T00:14:11.078 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/uas.ko 2023-07-11T00:14:11.078 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-11T00:14:11.078 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-11T00:14:11.078 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-11T00:14:11.078 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-11T00:14:11.079 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-11T00:14:11.079 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-11T00:14:11.079 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-11T00:14:11.079 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-karma.ko 2023-07-11T00:14:11.079 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-11T00:14:11.079 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-11T00:14:11.079 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-11T00:14:11.079 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-11T00:14:11.080 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-11T00:14:11.080 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/usb-storage.ko 2023-07-11T00:14:11.080 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip 2023-07-11T00:14:11.080 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-11T00:14:11.080 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-11T00:14:11.080 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-11T00:14:11.080 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio 2023-07-11T00:14:11.080 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci 2023-07-11T00:14:11.081 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-11T00:14:11.081 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-11T00:14:11.081 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio.ko 2023-07-11T00:14:11.081 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-11T00:14:11.081 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost 2023-07-11T00:14:11.081 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost.ko 2023-07-11T00:14:11.081 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-11T00:14:11.081 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_net.ko 2023-07-11T00:14:11.082 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_scsi.ko 2023-07-11T00:14:11.082 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video 2023-07-11T00:14:11.082 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight 2023-07-11T00:14:11.082 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/apple_bl.ko 2023-07-11T00:14:11.082 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lcd.ko 2023-07-11T00:14:11.082 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-11T00:14:11.082 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio 2023-07-11T00:14:11.082 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio.ko 2023-07-11T00:14:11.083 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_balloon.ko 2023-07-11T00:14:11.083 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_mmio.ko 2023-07-11T00:14:11.083 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci.ko 2023-07-11T00:14:11.083 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-11T00:14:11.083 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-11T00:14:11.083 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_ring.ko 2023-07-11T00:14:11.083 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1 2023-07-11T00:14:11.083 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters 2023-07-11T00:14:11.084 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2482.ko 2023-07-11T00:14:11.084 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2490.ko 2023-07-11T00:14:11.084 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves 2023-07-11T00:14:11.084 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-11T00:14:11.084 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-11T00:14:11.084 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-11T00:14:11.084 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-11T00:14:11.085 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-11T00:14:11.085 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-11T00:14:11.085 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-11T00:14:11.085 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-11T00:14:11.085 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-11T00:14:11.085 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-11T00:14:11.086 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-11T00:14:11.086 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/wire.ko 2023-07-11T00:14:11.086 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog 2023-07-11T00:14:11.086 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-11T00:14:11.086 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-11T00:14:11.087 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-11T00:14:11.087 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/hpwdt.ko 2023-07-11T00:14:11.087 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/i6300esb.ko 2023-07-11T00:14:11.087 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-11T00:14:11.087 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-11T00:14:11.087 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ib700wdt.ko 2023-07-11T00:14:11.087 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ibmasr.ko 2023-07-11T00:14:11.088 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-11T00:14:11.088 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-11T00:14:11.088 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it87_wdt.ko 2023-07-11T00:14:11.088 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/machzwd.ko 2023-07-11T00:14:11.088 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/nv_tco.ko 2023-07-11T00:14:11.088 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-11T00:14:11.088 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-11T00:14:11.089 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-11T00:14:11.089 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-11T00:14:11.089 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/softdog.ko 2023-07-11T00:14:11.089 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-11T00:14:11.089 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/via_wdt.ko 2023-07-11T00:14:11.089 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-11T00:14:11.089 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-11T00:14:11.090 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-11T00:14:11.090 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wdt_pci.ko 2023-07-11T00:14:11.090 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/xen_wdt.ko 2023-07-11T00:14:11.090 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen 2023-07-11T00:14:11.090 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-11T00:14:11.090 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-evtchn.ko 2023-07-11T00:14:11.090 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntalloc.ko 2023-07-11T00:14:11.091 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntdev.ko 2023-07-11T00:14:11.091 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback 2023-07-11T00:14:11.091 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-11T00:14:11.091 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-privcmd.ko 2023-07-11T00:14:11.091 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs 2023-07-11T00:14:11.091 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-11T00:14:11.091 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs 2023-07-11T00:14:11.092 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p 2023-07-11T00:14:11.092 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/9p.ko 2023-07-11T00:14:11.092 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs 2023-07-11T00:14:11.092 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/affs.ko 2023-07-11T00:14:11.092 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs 2023-07-11T00:14:11.092 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/befs.ko 2023-07-11T00:14:11.092 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/binfmt_misc.ko 2023-07-11T00:14:11.093 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs 2023-07-11T00:14:11.093 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/btrfs.ko 2023-07-11T00:14:11.093 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles 2023-07-11T00:14:11.093 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/cachefiles.ko 2023-07-11T00:14:11.093 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph 2023-07-11T00:14:11.093 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ceph.ko 2023-07-11T00:14:11.093 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda 2023-07-11T00:14:11.094 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/coda.ko 2023-07-11T00:14:11.094 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs 2023-07-11T00:14:11.094 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/cramfs.ko 2023-07-11T00:14:11.094 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm 2023-07-11T00:14:11.094 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/dlm.ko 2023-07-11T00:14:11.094 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs 2023-07-11T00:14:11.094 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-11T00:14:11.095 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs 2023-07-11T00:14:11.095 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/f2fs.ko 2023-07-11T00:14:11.095 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat 2023-07-11T00:14:11.095 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/fat.ko 2023-07-11T00:14:11.095 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/msdos.ko 2023-07-11T00:14:11.095 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/vfat.ko 2023-07-11T00:14:11.095 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache 2023-07-11T00:14:11.096 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/fscache.ko 2023-07-11T00:14:11.096 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse 2023-07-11T00:14:11.096 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/cuse.ko 2023-07-11T00:14:11.096 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/fuse.ko 2023-07-11T00:14:11.096 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2 2023-07-11T00:14:11.096 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/gfs2.ko 2023-07-11T00:14:11.096 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs 2023-07-11T00:14:11.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/hfs.ko 2023-07-11T00:14:11.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus 2023-07-11T00:14:11.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/hfsplus.ko 2023-07-11T00:14:11.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs 2023-07-11T00:14:11.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/isofs.ko 2023-07-11T00:14:11.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs 2023-07-11T00:14:11.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/jfs.ko 2023-07-11T00:14:11.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd 2023-07-11T00:14:11.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/lockd.ko 2023-07-11T00:14:11.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix 2023-07-11T00:14:11.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/minix.ko 2023-07-11T00:14:11.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs 2023-07-11T00:14:11.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/netfs.ko 2023-07-11T00:14:11.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs 2023-07-11T00:14:11.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout 2023-07-11T00:14:11.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-11T00:14:11.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout 2023-07-11T00:14:11.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-11T00:14:11.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout 2023-07-11T00:14:11.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-11T00:14:11.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfs.ko 2023-07-11T00:14:11.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv3.ko 2023-07-11T00:14:11.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv4.ko 2023-07-11T00:14:11.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common 2023-07-11T00:14:11.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/grace.ko 2023-07-11T00:14:11.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/nfs_acl.ko 2023-07-11T00:14:11.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd 2023-07-11T00:14:11.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/nfsd.ko 2023-07-11T00:14:11.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2 2023-07-11T00:14:11.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/nilfs2.ko 2023-07-11T00:14:11.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls 2023-07-11T00:14:11.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-celtic.ko 2023-07-11T00:14:11.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-centeuro.ko 2023-07-11T00:14:11.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-croatian.ko 2023-07-11T00:14:11.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-cyrillic.ko 2023-07-11T00:14:11.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-gaelic.ko 2023-07-11T00:14:11.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-greek.ko 2023-07-11T00:14:11.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-iceland.ko 2023-07-11T00:14:11.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-inuit.ko 2023-07-11T00:14:11.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-roman.ko 2023-07-11T00:14:11.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-romanian.ko 2023-07-11T00:14:11.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-turkish.ko 2023-07-11T00:14:11.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1250.ko 2023-07-11T00:14:11.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1251.ko 2023-07-11T00:14:11.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1255.ko 2023-07-11T00:14:11.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp737.ko 2023-07-11T00:14:11.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp775.ko 2023-07-11T00:14:11.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp850.ko 2023-07-11T00:14:11.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp852.ko 2023-07-11T00:14:11.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp855.ko 2023-07-11T00:14:11.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp857.ko 2023-07-11T00:14:11.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp860.ko 2023-07-11T00:14:11.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp861.ko 2023-07-11T00:14:11.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp862.ko 2023-07-11T00:14:11.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp863.ko 2023-07-11T00:14:11.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp864.ko 2023-07-11T00:14:11.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp865.ko 2023-07-11T00:14:11.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp866.ko 2023-07-11T00:14:11.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp869.ko 2023-07-11T00:14:11.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp874.ko 2023-07-11T00:14:11.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp932.ko 2023-07-11T00:14:11.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp936.ko 2023-07-11T00:14:11.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp949.ko 2023-07-11T00:14:11.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp950.ko 2023-07-11T00:14:11.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_euc-jp.ko 2023-07-11T00:14:11.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-1.ko 2023-07-11T00:14:11.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-13.ko 2023-07-11T00:14:11.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-14.ko 2023-07-11T00:14:11.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-15.ko 2023-07-11T00:14:11.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-2.ko 2023-07-11T00:14:11.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-3.ko 2023-07-11T00:14:11.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-4.ko 2023-07-11T00:14:11.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-5.ko 2023-07-11T00:14:11.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-6.ko 2023-07-11T00:14:11.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-7.ko 2023-07-11T00:14:11.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-9.ko 2023-07-11T00:14:11.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-r.ko 2023-07-11T00:14:11.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-ru.ko 2023-07-11T00:14:11.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-u.ko 2023-07-11T00:14:11.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_utf8.ko 2023-07-11T00:14:11.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2 2023-07-11T00:14:11.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster 2023-07-11T00:14:11.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-11T00:14:11.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm 2023-07-11T00:14:11.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-11T00:14:11.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs 2023-07-11T00:14:11.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-11T00:14:11.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2.ko 2023-07-11T00:14:11.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-11T00:14:11.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-11T00:14:11.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-11T00:14:11.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs 2023-07-11T00:14:11.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/overlay.ko 2023-07-11T00:14:11.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore 2023-07-11T00:14:11.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ramoops.ko 2023-07-11T00:14:11.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs 2023-07-11T00:14:11.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/reiserfs.ko 2023-07-11T00:14:11.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs 2023-07-11T00:14:11.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/romfs.ko 2023-07-11T00:14:11.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb 2023-07-11T00:14:11.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client 2023-07-11T00:14:11.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/cifs.ko 2023-07-11T00:14:11.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common 2023-07-11T00:14:11.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_arc4.ko 2023-07-11T00:14:11.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_md4.ko 2023-07-11T00:14:11.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs 2023-07-11T00:14:11.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/squashfs.ko 2023-07-11T00:14:11.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv 2023-07-11T00:14:11.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/sysv.ko 2023-07-11T00:14:11.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf 2023-07-11T00:14:11.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/udf.ko 2023-07-11T00:14:11.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs 2023-07-11T00:14:11.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ufs.ko 2023-07-11T00:14:11.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs 2023-07-11T00:14:11.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/xfs.ko 2023-07-11T00:14:11.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel 2023-07-11T00:14:11.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu 2023-07-11T00:14:11.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu/rcutorture.ko 2023-07-11T00:14:11.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/torture.ko 2023-07-11T00:14:11.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace 2023-07-11T00:14:11.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-11T00:14:11.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib 2023-07-11T00:14:11.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/asn1_encoder.ko 2023-07-11T00:14:11.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc-itu-t.ko 2023-07-11T00:14:11.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc8.ko 2023-07-11T00:14:11.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto 2023-07-11T00:14:11.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libarc4.ko 2023-07-11T00:14:11.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libdes.ko 2023-07-11T00:14:11.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/libcrc32c.ko 2023-07-11T00:14:11.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lru_cache.ko 2023-07-11T00:14:11.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4 2023-07-11T00:14:11.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4_compress.ko 2023-07-11T00:14:11.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4hc_compress.ko 2023-07-11T00:14:11.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math 2023-07-11T00:14:11.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/cordic.ko 2023-07-11T00:14:11.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6 2023-07-11T00:14:11.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/raid6_pq.ko 2023-07-11T00:14:11.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon 2023-07-11T00:14:11.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-11T00:14:11.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_bm.ko 2023-07-11T00:14:11.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_fsm.ko 2023-07-11T00:14:11.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_kmp.ko 2023-07-11T00:14:11.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd 2023-07-11T00:14:11.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd/zstd_compress.ko 2023-07-11T00:14:11.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm 2023-07-11T00:14:11.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm/hwpoison-inject.ko 2023-07-11T00:14:11.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net 2023-07-11T00:14:11.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan 2023-07-11T00:14:11.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/6lowpan.ko 2023-07-11T00:14:11.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_dest.ko 2023-07-11T00:14:11.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_fragment.ko 2023-07-11T00:14:11.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_hop.ko 2023-07-11T00:14:11.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-11T00:14:11.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_mobility.ko 2023-07-11T00:14:11.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_routing.ko 2023-07-11T00:14:11.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_udp.ko 2023-07-11T00:14:11.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802 2023-07-11T00:14:11.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/garp.ko 2023-07-11T00:14:11.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/mrp.ko 2023-07-11T00:14:11.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/p8022.ko 2023-07-11T00:14:11.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/psnap.ko 2023-07-11T00:14:11.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/stp.ko 2023-07-11T00:14:11.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q 2023-07-11T00:14:11.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/8021q.ko 2023-07-11T00:14:11.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p 2023-07-11T00:14:11.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet.ko 2023-07-11T00:14:11.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_fd.ko 2023-07-11T00:14:11.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_rdma.ko 2023-07-11T00:14:11.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_virtio.ko 2023-07-11T00:14:11.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv 2023-07-11T00:14:11.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/batman-adv.ko 2023-07-11T00:14:11.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge 2023-07-11T00:14:11.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/br_netfilter.ko 2023-07-11T00:14:11.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/bridge.ko 2023-07-11T00:14:11.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter 2023-07-11T00:14:11.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-11T00:14:11.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-11T00:14:11.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-11T00:14:11.123 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-11T00:14:11.123 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-11T00:14:11.123 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-11T00:14:11.123 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-11T00:14:11.123 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-11T00:14:11.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-11T00:14:11.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-11T00:14:11.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-11T00:14:11.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-11T00:14:11.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-11T00:14:11.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-11T00:14:11.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-11T00:14:11.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-11T00:14:11.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-11T00:14:11.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-11T00:14:11.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-11T00:14:11.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-11T00:14:11.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtables.ko 2023-07-11T00:14:11.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-11T00:14:11.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-11T00:14:11.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-11T00:14:11.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph 2023-07-11T00:14:11.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/libceph.ko 2023-07-11T00:14:11.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core 2023-07-11T00:14:11.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/failover.ko 2023-07-11T00:14:11.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/pktgen.ko 2023-07-11T00:14:11.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp 2023-07-11T00:14:11.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp.ko 2023-07-11T00:14:11.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_diag.ko 2023-07-11T00:14:11.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv4.ko 2023-07-11T00:14:11.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv6.ko 2023-07-11T00:14:11.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver 2023-07-11T00:14:11.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver/dns_resolver.ko 2023-07-11T00:14:11.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa 2023-07-11T00:14:11.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/dsa_core.ko 2023-07-11T00:14:11.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_brcm.ko 2023-07-11T00:14:11.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_dsa.ko 2023-07-11T00:14:11.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_none.ko 2023-07-11T00:14:11.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_trailer.ko 2023-07-11T00:14:11.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154 2023-07-11T00:14:11.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan 2023-07-11T00:14:11.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-11T00:14:11.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154.ko 2023-07-11T00:14:11.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-11T00:14:11.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4 2023-07-11T00:14:11.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ah4.ko 2023-07-11T00:14:11.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/esp4.ko 2023-07-11T00:14:11.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/fou.ko 2023-07-11T00:14:11.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/gre.ko 2023-07-11T00:14:11.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/inet_diag.ko 2023-07-11T00:14:11.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_gre.ko 2023-07-11T00:14:11.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_tunnel.ko 2023-07-11T00:14:11.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_vti.ko 2023-07-11T00:14:11.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipcomp.ko 2023-07-11T00:14:11.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipip.ko 2023-07-11T00:14:11.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter 2023-07-11T00:14:11.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-11T00:14:11.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-11T00:14:11.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-11T00:14:11.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-11T00:14:11.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-11T00:14:11.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-11T00:14:11.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-11T00:14:11.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-11T00:14:11.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-11T00:14:11.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-11T00:14:11.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-11T00:14:11.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-11T00:14:11.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-11T00:14:11.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-11T00:14:11.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-11T00:14:11.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-11T00:14:11.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-11T00:14:11.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-11T00:14:11.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-11T00:14:11.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-11T00:14:11.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-11T00:14:11.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_bic.ko 2023-07-11T00:14:11.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_dctcp.ko 2023-07-11T00:14:11.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_diag.ko 2023-07-11T00:14:11.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_highspeed.ko 2023-07-11T00:14:11.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_htcp.ko 2023-07-11T00:14:11.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_hybla.ko 2023-07-11T00:14:11.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_illinois.ko 2023-07-11T00:14:11.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_lp.ko 2023-07-11T00:14:11.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_scalable.ko 2023-07-11T00:14:11.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_vegas.ko 2023-07-11T00:14:11.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_veno.ko 2023-07-11T00:14:11.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_westwood.ko 2023-07-11T00:14:11.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_yeah.ko 2023-07-11T00:14:11.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tunnel4.ko 2023-07-11T00:14:11.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_diag.ko 2023-07-11T00:14:11.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_tunnel.ko 2023-07-11T00:14:11.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-11T00:14:11.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6 2023-07-11T00:14:11.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ah6.ko 2023-07-11T00:14:11.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/esp6.ko 2023-07-11T00:14:11.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/fou6.ko 2023-07-11T00:14:11.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_tunnel.ko 2023-07-11T00:14:11.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-11T00:14:11.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_vti.ko 2023-07-11T00:14:11.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ipcomp6.ko 2023-07-11T00:14:11.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter 2023-07-11T00:14:11.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-11T00:14:11.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-11T00:14:11.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-11T00:14:11.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-11T00:14:11.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-11T00:14:11.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-11T00:14:11.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-11T00:14:11.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-11T00:14:11.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-11T00:14:11.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-11T00:14:11.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-11T00:14:11.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-11T00:14:11.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-11T00:14:11.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-11T00:14:11.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-11T00:14:11.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-11T00:14:11.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-11T00:14:11.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-11T00:14:11.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-11T00:14:11.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-11T00:14:11.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-11T00:14:11.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-11T00:14:11.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-11T00:14:11.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-11T00:14:11.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/sit.ko 2023-07-11T00:14:11.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/tunnel6.ko 2023-07-11T00:14:11.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-11T00:14:11.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key 2023-07-11T00:14:11.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key/af_key.ko 2023-07-11T00:14:11.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp 2023-07-11T00:14:11.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_core.ko 2023-07-11T00:14:11.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-11T00:14:11.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_eth.ko 2023-07-11T00:14:11.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip.ko 2023-07-11T00:14:11.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip6.ko 2023-07-11T00:14:11.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_netlink.ko 2023-07-11T00:14:11.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ppp.ko 2023-07-11T00:14:11.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc 2023-07-11T00:14:11.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc.ko 2023-07-11T00:14:11.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154 2023-07-11T00:14:11.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/mac802154.ko 2023-07-11T00:14:11.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls 2023-07-11T00:14:11.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/mpls_gso.ko 2023-07-11T00:14:11.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter 2023-07-11T00:14:11.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset 2023-07-11T00:14:11.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set.ko 2023-07-11T00:14:11.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-11T00:14:11.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-11T00:14:11.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-11T00:14:11.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-11T00:14:11.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-11T00:14:11.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-11T00:14:11.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-11T00:14:11.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-11T00:14:11.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-11T00:14:11.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-11T00:14:11.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-11T00:14:11.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-11T00:14:11.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-11T00:14:11.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-11T00:14:11.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-11T00:14:11.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs 2023-07-11T00:14:11.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-11T00:14:11.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-11T00:14:11.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-11T00:14:11.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-11T00:14:11.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-11T00:14:11.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-11T00:14:11.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-11T00:14:11.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-11T00:14:11.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-11T00:14:11.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-11T00:14:11.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-11T00:14:11.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-11T00:14:11.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-11T00:14:11.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-11T00:14:11.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conncount.ko 2023-07-11T00:14:11.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack.ko 2023-07-11T00:14:11.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-11T00:14:11.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-11T00:14:11.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-11T00:14:11.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-11T00:14:11.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-11T00:14:11.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-11T00:14:11.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-11T00:14:11.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-11T00:14:11.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-11T00:14:11.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-11T00:14:11.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-11T00:14:11.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-11T00:14:11.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-11T00:14:11.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table.ko 2023-07-11T00:14:11.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-11T00:14:11.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_log_syslog.ko 2023-07-11T00:14:11.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat.ko 2023-07-11T00:14:11.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-11T00:14:11.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-11T00:14:11.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_irc.ko 2023-07-11T00:14:11.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_sip.ko 2023-07-11T00:14:11.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-11T00:14:11.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-11T00:14:11.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_tables.ko 2023-07-11T00:14:11.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink.ko 2023-07-11T00:14:11.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-11T00:14:11.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_log.ko 2023-07-11T00:14:11.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-11T00:14:11.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-11T00:14:11.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_chain_nat.ko 2023-07-11T00:14:11.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_compat.ko 2023-07-11T00:14:11.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_ct.ko 2023-07-11T00:14:11.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-11T00:14:11.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fib.ko 2023-07-11T00:14:11.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-11T00:14:11.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_hash.ko 2023-07-11T00:14:11.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_limit.ko 2023-07-11T00:14:11.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_log.ko 2023-07-11T00:14:11.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_masq.ko 2023-07-11T00:14:11.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_nat.ko 2023-07-11T00:14:11.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_numgen.ko 2023-07-11T00:14:11.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_queue.ko 2023-07-11T00:14:11.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_quota.ko 2023-07-11T00:14:11.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_redir.ko 2023-07-11T00:14:11.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject.ko 2023-07-11T00:14:11.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject_inet.ko 2023-07-11T00:14:11.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_socket.ko 2023-07-11T00:14:11.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_tunnel.ko 2023-07-11T00:14:11.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_AUDIT.ko 2023-07-11T00:14:11.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-11T00:14:11.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-11T00:14:11.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-11T00:14:11.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CT.ko 2023-07-11T00:14:11.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_DSCP.ko 2023-07-11T00:14:11.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HL.ko 2023-07-11T00:14:11.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HMARK.ko 2023-07-11T00:14:11.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-11T00:14:11.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LED.ko 2023-07-11T00:14:11.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LOG.ko 2023-07-11T00:14:11.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-11T00:14:11.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NETMAP.ko 2023-07-11T00:14:11.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFLOG.ko 2023-07-11T00:14:11.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-11T00:14:11.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_RATEEST.ko 2023-07-11T00:14:11.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-11T00:14:11.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_SECMARK.ko 2023-07-11T00:14:11.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-11T00:14:11.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-11T00:14:11.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TEE.ko 2023-07-11T00:14:11.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TPROXY.ko 2023-07-11T00:14:11.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TRACE.ko 2023-07-11T00:14:11.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_addrtype.ko 2023-07-11T00:14:11.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_bpf.ko 2023-07-11T00:14:11.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cgroup.ko 2023-07-11T00:14:11.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cluster.ko 2023-07-11T00:14:11.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_comment.ko 2023-07-11T00:14:11.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connbytes.ko 2023-07-11T00:14:11.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlabel.ko 2023-07-11T00:14:11.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlimit.ko 2023-07-11T00:14:11.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connmark.ko 2023-07-11T00:14:11.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_conntrack.ko 2023-07-11T00:14:11.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cpu.ko 2023-07-11T00:14:11.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dccp.ko 2023-07-11T00:14:11.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_devgroup.ko 2023-07-11T00:14:11.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dscp.ko 2023-07-11T00:14:11.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ecn.ko 2023-07-11T00:14:11.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_esp.ko 2023-07-11T00:14:11.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hashlimit.ko 2023-07-11T00:14:11.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_helper.ko 2023-07-11T00:14:11.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hl.ko 2023-07-11T00:14:11.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipcomp.ko 2023-07-11T00:14:11.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_iprange.ko 2023-07-11T00:14:11.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipvs.ko 2023-07-11T00:14:11.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_l2tp.ko 2023-07-11T00:14:11.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_length.ko 2023-07-11T00:14:11.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_limit.ko 2023-07-11T00:14:11.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mac.ko 2023-07-11T00:14:11.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mark.ko 2023-07-11T00:14:11.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_multiport.ko 2023-07-11T00:14:11.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nat.ko 2023-07-11T00:14:11.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nfacct.ko 2023-07-11T00:14:11.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_osf.ko 2023-07-11T00:14:11.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_owner.ko 2023-07-11T00:14:11.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_physdev.ko 2023-07-11T00:14:11.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_pkttype.ko 2023-07-11T00:14:11.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_policy.ko 2023-07-11T00:14:11.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_quota.ko 2023-07-11T00:14:11.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_rateest.ko 2023-07-11T00:14:11.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_realm.ko 2023-07-11T00:14:11.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_recent.ko 2023-07-11T00:14:11.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_sctp.ko 2023-07-11T00:14:11.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_set.ko 2023-07-11T00:14:11.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_socket.ko 2023-07-11T00:14:11.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_state.ko 2023-07-11T00:14:11.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_statistic.ko 2023-07-11T00:14:11.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_string.ko 2023-07-11T00:14:11.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpmss.ko 2023-07-11T00:14:11.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_time.ko 2023-07-11T00:14:11.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_u32.ko 2023-07-11T00:14:11.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink 2023-07-11T00:14:11.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/netlink_diag.ko 2023-07-11T00:14:11.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh 2023-07-11T00:14:11.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/nsh.ko 2023-07-11T00:14:11.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch 2023-07-11T00:14:11.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/openvswitch.ko 2023-07-11T00:14:11.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-geneve.ko 2023-07-11T00:14:11.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-gre.ko 2023-07-11T00:14:11.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-vxlan.ko 2023-07-11T00:14:11.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet 2023-07-11T00:14:11.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/af_packet_diag.ko 2023-07-11T00:14:11.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds 2023-07-11T00:14:11.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds.ko 2023-07-11T00:14:11.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_rdma.ko 2023-07-11T00:14:11.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_tcp.ko 2023-07-11T00:14:11.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched 2023-07-11T00:14:11.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_csum.ko 2023-07-11T00:14:11.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_gact.ko 2023-07-11T00:14:11.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_ipt.ko 2023-07-11T00:14:11.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_mirred.ko 2023-07-11T00:14:11.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_nat.ko 2023-07-11T00:14:11.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_pedit.ko 2023-07-11T00:14:11.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_police.ko 2023-07-11T00:14:11.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_simple.ko 2023-07-11T00:14:11.171 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_skbedit.ko 2023-07-11T00:14:11.171 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_vlan.ko 2023-07-11T00:14:11.171 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_basic.ko 2023-07-11T00:14:11.171 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_bpf.ko 2023-07-11T00:14:11.171 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_flow.ko 2023-07-11T00:14:11.171 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_fw.ko 2023-07-11T00:14:11.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_route.ko 2023-07-11T00:14:11.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_u32.ko 2023-07-11T00:14:11.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_cmp.ko 2023-07-11T00:14:11.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_ipset.ko 2023-07-11T00:14:11.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_meta.ko 2023-07-11T00:14:11.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_nbyte.ko 2023-07-11T00:14:11.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_text.ko 2023-07-11T00:14:11.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_u32.ko 2023-07-11T00:14:11.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_choke.ko 2023-07-11T00:14:11.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_codel.ko 2023-07-11T00:14:11.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_drr.ko 2023-07-11T00:14:11.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq.ko 2023-07-11T00:14:11.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_gred.ko 2023-07-11T00:14:11.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hfsc.ko 2023-07-11T00:14:11.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hhf.ko 2023-07-11T00:14:11.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_htb.ko 2023-07-11T00:14:11.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_ingress.ko 2023-07-11T00:14:11.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio.ko 2023-07-11T00:14:11.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio_lib.ko 2023-07-11T00:14:11.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_multiq.ko 2023-07-11T00:14:11.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_netem.ko 2023-07-11T00:14:11.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_pie.ko 2023-07-11T00:14:11.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_plug.ko 2023-07-11T00:14:11.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_prio.ko 2023-07-11T00:14:11.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_qfq.ko 2023-07-11T00:14:11.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_red.ko 2023-07-11T00:14:11.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfb.ko 2023-07-11T00:14:11.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfq.ko 2023-07-11T00:14:11.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_tbf.ko 2023-07-11T00:14:11.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_teql.ko 2023-07-11T00:14:11.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp 2023-07-11T00:14:11.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp.ko 2023-07-11T00:14:11.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp_diag.ko 2023-07-11T00:14:11.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc 2023-07-11T00:14:11.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss 2023-07-11T00:14:11.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-11T00:14:11.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-11T00:14:11.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/sunrpc.ko 2023-07-11T00:14:11.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma 2023-07-11T00:14:11.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-11T00:14:11.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc 2023-07-11T00:14:11.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/diag.ko 2023-07-11T00:14:11.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/tipc.ko 2023-07-11T00:14:11.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix 2023-07-11T00:14:11.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/unix_diag.ko 2023-07-11T00:14:11.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock 2023-07-11T00:14:11.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-11T00:14:11.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-11T00:14:11.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock.ko 2023-07-11T00:14:11.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-11T00:14:11.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-11T00:14:11.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm 2023-07-11T00:14:11.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-11T00:14:11.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security 2023-07-11T00:14:11.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys 2023-07-11T00:14:11.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys 2023-07-11T00:14:11.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-11T00:14:11.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys 2023-07-11T00:14:11.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys/trusted.ko 2023-07-11T00:14:11.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt 2023-07-11T00:14:11.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib 2023-07-11T00:14:11.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/irqbypass.ko 2023-07-11T00:14:11.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias 2023-07-11T00:14:11.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias.bin 2023-07-11T00:14:11.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin 2023-07-11T00:14:11.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.bin 2023-07-11T00:14:11.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.modinfo 2023-07-11T00:14:11.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep 2023-07-11T00:14:11.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep.bin 2023-07-11T00:14:11.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.devname 2023-07-11T00:14:11.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.order 2023-07-11T00:14:11.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.softdep 2023-07-11T00:14:11.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols 2023-07-11T00:14:11.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols.bin 2023-07-11T00:14:11.182 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-g84139c18d56f 2023-07-11T00:14:11.183 DEBUG:teuthology.orchestra.run.smithi184:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-11T00:14:11.212 INFO:teuthology.orchestra.run.smithi184.stdout:postinstall scriptlet (using /bin/sh): 2023-07-11T00:14:11.212 INFO:teuthology.orchestra.run.smithi184.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-g84139c18d56f -a -r /boot/System.map-6.4.0-g84139c18d56f ]; then 2023-07-11T00:14:11.212 INFO:teuthology.orchestra.run.smithi184.stdout:cp /boot/vmlinuz-6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm 2023-07-11T00:14:11.213 INFO:teuthology.orchestra.run.smithi184.stdout:cp /boot/System.map-6.4.0-g84139c18d56f /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-11T00:14:11.213 INFO:teuthology.orchestra.run.smithi184.stdout:rm -f /boot/vmlinuz-6.4.0-g84139c18d56f /boot/System.map-6.4.0-g84139c18d56f 2023-07-11T00:14:11.213 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/installkernel 6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-11T00:14:11.214 INFO:teuthology.orchestra.run.smithi184.stdout:rm -f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-11T00:14:11.214 INFO:teuthology.orchestra.run.smithi184.stdout:fi 2023-07-11T00:14:11.214 INFO:teuthology.orchestra.run.smithi184.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-11T00:14:11.215 INFO:teuthology.orchestra.run.smithi184.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-11T00:14:11.215 INFO:teuthology.orchestra.run.smithi184.stdout:new-kernel-pkg --remove 6.4.0-g84139c18d56f --rminitrd --initrdfile=/boot/initramfs-6.4.0-g84139c18d56f.img 2023-07-11T00:14:11.215 INFO:teuthology.orchestra.run.smithi184.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-11T00:14:11.215 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-install remove 6.4.0-g84139c18d56f 2023-07-11T00:14:11.216 INFO:teuthology.orchestra.run.smithi184.stdout:fi 2023-07-11T00:14:11.216 INFO:teuthology.orchestra.run.smithi184.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-11T00:14:11.216 INFO:teuthology.orchestra.run.smithi184.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-11T00:14:11.217 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/update-bootloader --remove 6.4.0-g84139c18d56f 2023-07-11T00:14:11.217 INFO:teuthology.orchestra.run.smithi184.stdout:fi 2023-07-11T00:14:11.218 DEBUG:teuthology.orchestra.run.smithi184:> sudo rpm -qi grub2-tools 2023-07-11T00:14:11.298 INFO:teuthology.orchestra.run.smithi184.stdout:Name : grub2-tools 2023-07-11T00:14:11.298 INFO:teuthology.orchestra.run.smithi184.stdout:Epoch : 1 2023-07-11T00:14:11.298 INFO:teuthology.orchestra.run.smithi184.stdout:Version : 2.02 2023-07-11T00:14:11.299 INFO:teuthology.orchestra.run.smithi184.stdout:Release : 129.el8 2023-07-11T00:14:11.299 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: x86_64 2023-07-11T00:14:11.299 INFO:teuthology.orchestra.run.smithi184.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-11T00:14:11.299 INFO:teuthology.orchestra.run.smithi184.stdout:Group : System Environment/Base 2023-07-11T00:14:11.299 INFO:teuthology.orchestra.run.smithi184.stdout:Size : 9265586 2023-07-11T00:14:11.299 INFO:teuthology.orchestra.run.smithi184.stdout:License : GPLv3+ 2023-07-11T00:14:11.299 INFO:teuthology.orchestra.run.smithi184.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-11T00:14:11.300 INFO:teuthology.orchestra.run.smithi184.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-11T00:14:11.300 INFO:teuthology.orchestra.run.smithi184.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-11T00:14:11.300 INFO:teuthology.orchestra.run.smithi184.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-11T00:14:11.300 INFO:teuthology.orchestra.run.smithi184.stdout:Relocations : (not relocatable) 2023-07-11T00:14:11.300 INFO:teuthology.orchestra.run.smithi184.stdout:Packager : CentOS BuildSystem 2023-07-11T00:14:11.300 INFO:teuthology.orchestra.run.smithi184.stdout:Vendor : CentOS 2023-07-11T00:14:11.300 INFO:teuthology.orchestra.run.smithi184.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-11T00:14:11.301 INFO:teuthology.orchestra.run.smithi184.stdout:Summary : Support tools for GRUB. 2023-07-11T00:14:11.301 INFO:teuthology.orchestra.run.smithi184.stdout:Description : 2023-07-11T00:14:11.301 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:14:11.301 INFO:teuthology.orchestra.run.smithi184.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-11T00:14:11.301 INFO:teuthology.orchestra.run.smithi184.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-11T00:14:11.301 INFO:teuthology.orchestra.run.smithi184.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-11T00:14:11.302 INFO:teuthology.orchestra.run.smithi184.stdout:hardware devices. 2023-07-11T00:14:11.302 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:14:11.302 INFO:teuthology.orchestra.run.smithi184.stdout:This subpackage provides tools for support of all platforms. 2023-07-11T00:14:11.303 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-11T00:14:11.303 INFO:teuthology.task.kernel:Updating grub on smithi184 to boot 6.4.0-g84139c18d56f 2023-07-11T00:14:11.303 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-11T00:14:14.534 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2023-07-11T00:14:16.771 INFO:teuthology.orchestra.run.smithi184.stderr:done 2023-07-11T00:14:16.772 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2023-07-11T00:14:16.809 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.O989UAqZ7b 2023-07-11T00:14:16.810 DEBUG:teuthology.orchestra.run.smithi184:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.O989UAqZ7b 2023-07-11T00:14:16.883 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.O989UAqZ7b 2023-07-11T00:14:17.070 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.O989UAqZ7b is 6KB 2023-07-11T00:14:17.096 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.O989UAqZ7b 2023-07-11T00:14:17.116 DEBUG:teuthology.orchestra.run.smithi184:> sudo /bin/ls /boot/loader/entries || true 2023-07-11T00:14:17.192 INFO:teuthology.orchestra.run.smithi184.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-11T00:14:17.192 INFO:teuthology.orchestra.run.smithi184.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-11T00:14:17.192 INFO:teuthology.orchestra.run.smithi184.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-11T00:14:17.193 INFO:teuthology.orchestra.run.smithi184.stdout:a1b29d6c289747bdb22930598d39874a-6.4.0-g84139c18d56f.conf 2023-07-11T00:14:17.194 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.4.0-g84139c18d56f 2023-07-11T00:14:17.372 DEBUG:teuthology.orchestra.run.smithi184:> sudo shutdown -r now 2023-07-11T00:14:28.548 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-07-11T00:14:28.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-07-11T00:14:28.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T00:14:46.896 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-07-11T00:14:47.376 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-07-11T00:14:47.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-07-11T00:14:47.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T00:14:55.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-07-11T00:14:55.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T00:15:05.840 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-07-11T00:15:14.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-07-11T00:15:14.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T00:15:17.904 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-07-11T00:15:29.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-07-11T00:15:29.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T00:15:55.932 DEBUG:teuthology.orchestra.remote:timed out 2023-07-11T00:16:01.826 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-07-11T00:16:02.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-07-11T00:16:02.228 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.4.0-g84139c18d56f"... 2023-07-11T00:16:02.229 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-07-11T00:16:02.272 INFO:teuthology.orchestra.run.smithi184.stdout:6.4.0-g84139c18d56f 2023-07-11T00:16:02.273 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-g84139c18d56f vs 6.4.0-g84139c18d56f 2023-07-11T00:16:02.273 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-11T00:16:02.273 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-11T00:16:03.274 DEBUG:teuthology.parallel:result is None 2023-07-11T00:16:07.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-07-11T00:16:07.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T00:16:08.185 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-07-11T00:16:08.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-07-11T00:16:08.578 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.4.0-g84139c18d56f"... 2023-07-11T00:16:08.578 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2023-07-11T00:16:08.623 INFO:teuthology.orchestra.run.smithi022.stdout:6.4.0-g84139c18d56f 2023-07-11T00:16:08.624 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-g84139c18d56f vs 6.4.0-g84139c18d56f 2023-07-11T00:16:08.624 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-11T00:16:08.624 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-11T00:16:09.625 DEBUG:teuthology.parallel:result is None 2023-07-11T00:16:09.626 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-11T00:16:09.635 INFO:teuthology.task.internal:Creating test directory... 2023-07-11T00:16:09.635 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-11T00:16:09.640 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-11T00:16:09.690 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-11T00:16:09.702 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-11T00:16:09.719 INFO:teuthology.task.internal:Creating archive directory... 2023-07-11T00:16:09.719 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-11T00:16:09.724 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-11T00:16:09.786 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-11T00:16:09.798 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-11T00:16:09.799 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-11T00:16:09.803 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-11T00:16:09.925 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-11T00:16:09.936 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-11T00:16:09.968 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-11T00:16:09.973 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-11T00:16:09.976 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-11T00:16:09.987 INFO:teuthology.task.internal:Configuring sudo... 2023-07-11T00:16:09.987 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-11T00:16:09.991 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-11T00:16:10.060 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-11T00:16:10.073 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-11T00:16:10.074 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-11T00:16:10.077 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-11T00:16:10.122 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-11T00:16:10.233 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-11T00:16:10.303 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-11T00:16:10.381 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-11T00:16:10.450 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:16:10.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-11T00:16:10.521 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-11T00:16:10.600 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-11T00:16:10.669 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-11T00:16:10.745 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-11T00:16:10.812 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:16:10.813 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-11T00:16:10.882 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2023-07-11T00:16:10.887 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2023-07-11T00:16:10.988 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-11T00:16:11.057 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-11T00:16:11.462 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-11T00:16:11.476 INFO:teuthology.task.internal:Starting timer... 2023-07-11T00:16:11.477 INFO:teuthology.run_tasks:Running task pcp... 2023-07-11T00:16:11.488 INFO:teuthology.run_tasks:Running task selinux... 2023-07-11T00:16:11.502 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-11T00:16:11.504 DEBUG:teuthology.orchestra.run.smithi022:> sudo service auditd rotate 2023-07-11T00:16:11.675 INFO:teuthology.orchestra.run.smithi022.stdout:Rotating logs: 2023-07-11T00:16:11.678 DEBUG:teuthology.orchestra.run.smithi184:> sudo service auditd rotate 2023-07-11T00:16:11.803 INFO:teuthology.orchestra.run.smithi184.stdout:Rotating logs: 2023-07-11T00:16:11.804 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-11T00:16:11.804 DEBUG:teuthology.orchestra.run.smithi022:> /usr/sbin/getenforce 2023-07-11T00:16:11.860 INFO:teuthology.orchestra.run.smithi022.stdout:Permissive 2023-07-11T00:16:11.861 DEBUG:teuthology.orchestra.run.smithi184:> /usr/sbin/getenforce 2023-07-11T00:16:11.913 INFO:teuthology.orchestra.run.smithi184.stdout:Permissive 2023-07-11T00:16:11.913 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi022.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi184.front.sepia.ceph.com': 'permissive'} 2023-07-11T00:16:11.914 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-11T00:16:11.985 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-11T00:16:11.986 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-11T00:16:12.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-11T00:16:12.056 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-11T00:16:12.057 DEBUG:teuthology.orchestra.run.smithi022:> sudo /usr/sbin/setenforce permissive 2023-07-11T00:16:12.125 DEBUG:teuthology.orchestra.run.smithi184:> sudo /usr/sbin/setenforce permissive 2023-07-11T00:16:12.194 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-11T00:16:12.203 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-07-11T00:16:12.204 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-11T00:16:12.224 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-11T00:16:12.225 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-11T00:26:22.351 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2023-07-11T00:26:22.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-07-11T00:26:22.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T00:26:22.446 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-07-11T00:26:22.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-07-11T00:26:22.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-07-11T00:26:22.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T00:26:22.654 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-07-11T00:26:22.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-07-11T00:26:22.765 INFO:teuthology.run_tasks:Running task clock... 2023-07-11T00:26:22.776 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-11T00:26:22.777 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-11T00:26:22.778 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-11T00:26:22.784 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-11T00:26:22.784 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-11T00:26:22.854 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-11T00:26:22.878 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-11T00:26:22.889 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-11T00:26:22.911 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-11T00:26:22.977 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: ntpd: command not found 2023-07-11T00:26:22.999 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: ntpd: command not found 2023-07-11T00:26:23.006 INFO:teuthology.orchestra.run.smithi022.stdout:506 Cannot talk to daemon 2023-07-11T00:26:23.026 INFO:teuthology.orchestra.run.smithi184.stdout:506 Cannot talk to daemon 2023-07-11T00:26:23.039 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-11T00:26:23.058 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-11T00:26:23.072 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-11T00:26:23.090 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-11T00:26:23.159 INFO:teuthology.orchestra.run.smithi022.stderr:bash: ntpq: command not found 2023-07-11T00:26:23.165 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-11T00:26:23.166 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2023-07-11T00:26:23.166 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-11T00:26:23.166 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-11T00:26:23.166 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-11T00:26:23.166 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-11T00:26:23.181 INFO:teuthology.orchestra.run.smithi184.stderr:bash: ntpq: command not found 2023-07-11T00:26:23.188 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-11T00:26:23.189 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2023-07-11T00:26:23.189 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-11T00:26:23.189 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-11T00:26:23.189 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-11T00:26:23.189 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-11T00:26:23.190 INFO:teuthology.run_tasks:Running task install... 2023-07-11T00:26:23.207 DEBUG:teuthology.task.install:project ceph 2023-07-11T00:26:23.208 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}} 2023-07-11T00:26:23.208 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'} 2023-07-11T00:26:23.208 INFO:teuthology.task.install:Using flavor: default 2023-07-11T00:26:23.214 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-11T00:26:23.214 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-11T00:26:23.215 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2', 'tag': None, 'wait_for_package': False} 2023-07-11T00:26:23.216 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-11T00:26:23.218 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2', 'tag': None, 'wait_for_package': False} 2023-07-11T00:26:23.218 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-11T00:26:23.357 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/ 2023-07-11T00:26:23.358 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4828.gb5891ed6 2023-07-11T00:26:23.429 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/ 2023-07-11T00:26:23.429 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4828.gb5891ed6 2023-07-11T00:26:23.541 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-11T00:26:23.542 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:26:23.542 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-11T00:26:23.610 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-11T00:26:23.611 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:26:23.611 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-11T00:26:23.612 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-11T00:26:23.613 DEBUG:teuthology.orchestra.run.smithi184:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-11T00:26:23.685 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-11T00:26:23.686 DEBUG:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-11T00:26:23.724 DEBUG:teuthology.orchestra.run.smithi184:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-11T00:26:23.797 DEBUG:teuthology.orchestra.run.smithi022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-11T00:26:23.819 DEBUG:teuthology.orchestra.run.smithi184:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-11T00:26:23.886 INFO:teuthology.orchestra.run.smithi184.stdout:check_obsoletes = 1 2023-07-11T00:26:23.889 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum clean all 2023-07-11T00:26:23.893 DEBUG:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-11T00:26:23.963 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2023-07-11T00:26:23.966 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum clean all 2023-07-11T00:26:24.233 INFO:teuthology.orchestra.run.smithi184.stdout:73 files removed 2023-07-11T00:26:24.268 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-11T00:26:24.336 INFO:teuthology.orchestra.run.smithi022.stdout:73 files removed 2023-07-11T00:26:24.372 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-11T00:26:25.120 INFO:teuthology.orchestra.run.smithi184.stdout:ceph packages for x86_64 257 kB/s | 81 kB 00:00 2023-07-11T00:26:25.586 INFO:teuthology.orchestra.run.smithi022.stdout:ceph packages for x86_64 125 kB/s | 81 kB 00:00 2023-07-11T00:26:25.788 INFO:teuthology.orchestra.run.smithi184.stdout:ceph noarch packages 15 kB/s | 9.4 kB 00:00 2023-07-11T00:26:26.278 INFO:teuthology.orchestra.run.smithi022.stdout:ceph noarch packages 14 kB/s | 9.4 kB 00:00 2023-07-11T00:26:26.630 INFO:teuthology.orchestra.run.smithi184.stdout:ceph source packages 1.8 kB/s | 1.5 kB 00:00 2023-07-11T00:26:26.995 INFO:teuthology.orchestra.run.smithi022.stdout:ceph source packages 2.2 kB/s | 1.5 kB 00:00 2023-07-11T00:26:28.172 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - AppStream 20 MB/s | 31 MB 00:01 2023-07-11T00:26:28.578 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - AppStream 20 MB/s | 31 MB 00:01 2023-07-11T00:26:35.839 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - BaseOS 24 MB/s | 41 MB 00:01 2023-07-11T00:26:36.662 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - BaseOS 24 MB/s | 41 MB 00:01 2023-07-11T00:26:42.514 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - Extras 43 kB/s | 18 kB 00:00 2023-07-11T00:26:43.065 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.6 kB 00:00 2023-07-11T00:26:43.895 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - Extras 45 kB/s | 18 kB 00:00 2023-07-11T00:26:44.313 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - Extras common packages 28 kB/s | 6.6 kB 00:00 2023-07-11T00:26:45.601 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - PowerTools 2.6 MB/s | 6.3 MB 00:02 2023-07-11T00:26:46.765 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - PowerTools 2.7 MB/s | 6.3 MB 00:02 2023-07-11T00:26:49.544 INFO:teuthology.orchestra.run.smithi184.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-11T00:26:50.215 INFO:teuthology.orchestra.run.smithi022.stdout:Copr repo for python3-asyncssh owned by ceph 1.7 kB/s | 3.5 kB 00:02 2023-07-11T00:26:53.007 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 5.9 MB/s | 16 MB 00:02 2023-07-11T00:26:53.339 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 4.3 MB/s | 16 MB 00:03 2023-07-11T00:26:57.640 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 549 kB/s | 24 kB 00:00 2023-07-11T00:26:57.669 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 390 kB/s | 24 kB 00:00 2023-07-11T00:27:01.669 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-11T00:27:01.669 INFO:teuthology.orchestra.run.smithi184.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-11T00:27:01.683 INFO:teuthology.orchestra.run.smithi184.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-11T00:27:01.683 INFO:teuthology.orchestra.run.smithi184.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-11T00:27:01.684 INFO:teuthology.orchestra.run.smithi184.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-11T00:27:01.684 INFO:teuthology.orchestra.run.smithi184.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-11T00:27:01.685 INFO:teuthology.orchestra.run.smithi184.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-11T00:27:01.687 INFO:teuthology.orchestra.run.smithi184.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-11T00:27:01.690 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-11T00:27:01.691 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-11T00:27:01.875 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-07-11T00:27:01.890 INFO:teuthology.orchestra.run.smithi184.stdout:==================================================================================================== 2023-07-11T00:27:01.890 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-07-11T00:27:01.890 INFO:teuthology.orchestra.run.smithi184.stdout:==================================================================================================== 2023-07-11T00:27:01.890 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-07-11T00:27:01.891 INFO:teuthology.orchestra.run.smithi184.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-11T00:27:01.891 INFO:teuthology.orchestra.run.smithi184.stdout: ceph x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.4 k 2023-07-11T00:27:01.891 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 5.4 M 2023-07-11T00:27:01.891 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 848 k 2023-07-11T00:27:01.891 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 165 k 2023-07-11T00:27:01.891 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 1.5 M 2023-07-11T00:27:01.891 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 129 k 2023-07-11T00:27:01.892 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 1.7 M 2023-07-11T00:27:01.892 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 7.4 M 2023-07-11T00:27:01.892 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 47 k 2023-07-11T00:27:01.892 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 13 M 2023-07-11T00:27:01.892 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 48 M 2023-07-11T00:27:01.893 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 258 k 2023-07-11T00:27:01.893 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 164 k 2023-07-11T00:27:01.893 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 258 k 2023-07-11T00:27:01.893 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 18 k 2023-07-11T00:27:01.893 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-11T00:27:01.893 INFO:teuthology.orchestra.run.smithi184.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-11T00:27:01.893 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-11T00:27:01.894 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 31 k 2023-07-11T00:27:01.894 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 771 k 2023-07-11T00:27:01.894 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 139 k 2023-07-11T00:27:01.894 INFO:teuthology.orchestra.run.smithi184.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-11T00:27:01.895 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-11T00:27:01.895 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-11T00:27:01.895 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-11T00:27:01.895 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-11T00:27:01.895 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-11T00:27:01.896 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 197 k 2023-07-11T00:27:01.896 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 371 k 2023-07-11T00:27:01.896 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 364 k 2023-07-11T00:27:01.896 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 107 k 2023-07-11T00:27:01.896 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 94 k 2023-07-11T00:27:01.896 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.4 M 2023-07-11T00:27:01.896 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 180 k 2023-07-11T00:27:01.896 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-11T00:27:01.897 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2023-07-11T00:27:01.897 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-11T00:27:01.897 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-11T00:27:01.897 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-11T00:27:01.897 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-11T00:27:01.897 INFO:teuthology.orchestra.run.smithi184.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-11T00:27:01.898 INFO:teuthology.orchestra.run.smithi184.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-11T00:27:01.898 INFO:teuthology.orchestra.run.smithi184.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-11T00:27:01.898 INFO:teuthology.orchestra.run.smithi184.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-11T00:27:01.898 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.7 M 2023-07-11T00:27:01.898 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.6 M 2023-07-11T00:27:01.898 INFO:teuthology.orchestra.run.smithi184.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-11T00:27:01.899 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-11T00:27:01.899 INFO:teuthology.orchestra.run.smithi184.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-11T00:27:01.899 INFO:teuthology.orchestra.run.smithi184.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-11T00:27:01.899 INFO:teuthology.orchestra.run.smithi184.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-11T00:27:01.899 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-11T00:27:01.900 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-07-11T00:27:01.900 INFO:teuthology.orchestra.run.smithi184.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-11T00:27:01.900 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 22 M 2023-07-11T00:27:01.900 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 23 k 2023-07-11T00:27:01.900 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 2.3 M 2023-07-11T00:27:01.901 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 240 k 2023-07-11T00:27:01.901 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 4.6 M 2023-07-11T00:27:01.901 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 18 M 2023-07-11T00:27:01.901 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 15 k 2023-07-11T00:27:01.901 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 24 k 2023-07-11T00:27:01.901 INFO:teuthology.orchestra.run.smithi184.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-11T00:27:01.901 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-11T00:27:01.901 INFO:teuthology.orchestra.run.smithi184.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-11T00:27:01.902 INFO:teuthology.orchestra.run.smithi184.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-11T00:27:01.902 INFO:teuthology.orchestra.run.smithi184.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-11T00:27:01.902 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 137 k 2023-07-11T00:27:01.902 INFO:teuthology.orchestra.run.smithi184.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-11T00:27:01.902 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-11T00:27:01.902 INFO:teuthology.orchestra.run.smithi184.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-11T00:27:01.902 INFO:teuthology.orchestra.run.smithi184.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-11T00:27:01.902 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-11T00:27:01.903 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-11T00:27:01.903 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 473 k 2023-07-11T00:27:01.903 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-11T00:27:01.903 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.7 M 2023-07-11T00:27:01.903 INFO:teuthology.orchestra.run.smithi184.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-11T00:27:01.903 INFO:teuthology.orchestra.run.smithi184.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-11T00:27:01.903 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-11T00:27:01.904 INFO:teuthology.orchestra.run.smithi184.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-11T00:27:01.904 INFO:teuthology.orchestra.run.smithi184.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-11T00:27:01.904 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-11T00:27:01.904 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-11T00:27:01.904 INFO:teuthology.orchestra.run.smithi184.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-11T00:27:01.904 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-11T00:27:01.904 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-11T00:27:01.904 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-11T00:27:01.905 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-11T00:27:01.905 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-11T00:27:01.905 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-11T00:27:01.905 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-11T00:27:01.905 INFO:teuthology.orchestra.run.smithi184.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-11T00:27:01.905 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-11T00:27:01.905 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 45 k 2023-07-11T00:27:01.905 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 122 k 2023-07-11T00:27:01.906 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-11T00:27:01.906 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-11T00:27:01.906 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-11T00:27:01.906 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-11T00:27:01.906 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-11T00:27:01.906 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-11T00:27:01.906 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-11T00:27:01.906 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-11T00:27:01.907 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-11T00:27:01.907 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-11T00:27:01.907 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-11T00:27:01.907 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-11T00:27:01.907 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-11T00:27:01.907 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-11T00:27:01.907 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-11T00:27:01.907 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-11T00:27:01.908 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-11T00:27:01.908 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-11T00:27:01.908 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-11T00:27:01.908 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-11T00:27:01.908 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-11T00:27:01.908 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-11T00:27:01.908 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-11T00:27:01.909 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-11T00:27:01.909 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-11T00:27:01.909 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-11T00:27:01.909 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-11T00:27:01.909 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-11T00:27:01.909 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-11T00:27:01.909 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-11T00:27:01.909 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-11T00:27:01.910 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-11T00:27:01.910 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-11T00:27:01.910 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-11T00:27:01.910 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-11T00:27:01.910 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-11T00:27:01.910 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-11T00:27:01.910 INFO:teuthology.orchestra.run.smithi184.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-11T00:27:01.910 INFO:teuthology.orchestra.run.smithi184.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-11T00:27:01.911 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-11T00:27:01.911 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-11T00:27:01.911 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-11T00:27:01.911 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-11T00:27:01.911 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-11T00:27:01.911 INFO:teuthology.orchestra.run.smithi184.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-11T00:27:01.911 INFO:teuthology.orchestra.run.smithi184.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-11T00:27:01.911 INFO:teuthology.orchestra.run.smithi184.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-11T00:27:01.912 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-11T00:27:01.912 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-11T00:27:01.912 INFO:teuthology.orchestra.run.smithi184.stdout:Enabling module streams: 2023-07-11T00:27:01.912 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql 10 2023-07-11T00:27:01.912 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:27:01.912 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-07-11T00:27:01.912 INFO:teuthology.orchestra.run.smithi184.stdout:==================================================================================================== 2023-07-11T00:27:01.913 INFO:teuthology.orchestra.run.smithi184.stdout:Install 128 Packages 2023-07-11T00:27:01.913 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 16 Packages 2023-07-11T00:27:01.913 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:27:01.913 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 212 M 2023-07-11T00:27:01.914 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-07-11T00:27:01.999 INFO:teuthology.orchestra.run.smithi022.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-11T00:27:02.000 INFO:teuthology.orchestra.run.smithi022.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-11T00:27:02.014 INFO:teuthology.orchestra.run.smithi022.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-11T00:27:02.014 INFO:teuthology.orchestra.run.smithi022.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-11T00:27:02.015 INFO:teuthology.orchestra.run.smithi022.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-11T00:27:02.016 INFO:teuthology.orchestra.run.smithi022.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-11T00:27:02.017 INFO:teuthology.orchestra.run.smithi022.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-11T00:27:02.019 INFO:teuthology.orchestra.run.smithi022.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-11T00:27:02.022 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-11T00:27:02.023 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-11T00:27:02.224 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-07-11T00:27:02.239 INFO:teuthology.orchestra.run.smithi022.stdout:==================================================================================================== 2023-07-11T00:27:02.239 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2023-07-11T00:27:02.239 INFO:teuthology.orchestra.run.smithi022.stdout:==================================================================================================== 2023-07-11T00:27:02.239 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-07-11T00:27:02.240 INFO:teuthology.orchestra.run.smithi022.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-11T00:27:02.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.4 k 2023-07-11T00:27:02.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 5.4 M 2023-07-11T00:27:02.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 848 k 2023-07-11T00:27:02.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 165 k 2023-07-11T00:27:02.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 1.5 M 2023-07-11T00:27:02.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 129 k 2023-07-11T00:27:02.241 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 1.7 M 2023-07-11T00:27:02.241 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 7.4 M 2023-07-11T00:27:02.241 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 47 k 2023-07-11T00:27:02.241 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 13 M 2023-07-11T00:27:02.241 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 48 M 2023-07-11T00:27:02.241 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 258 k 2023-07-11T00:27:02.241 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 164 k 2023-07-11T00:27:02.241 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 258 k 2023-07-11T00:27:02.242 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 18 k 2023-07-11T00:27:02.242 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-11T00:27:02.242 INFO:teuthology.orchestra.run.smithi022.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-11T00:27:02.242 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-11T00:27:02.242 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 31 k 2023-07-11T00:27:02.242 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 771 k 2023-07-11T00:27:02.243 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 139 k 2023-07-11T00:27:02.243 INFO:teuthology.orchestra.run.smithi022.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-11T00:27:02.243 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-11T00:27:02.243 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-11T00:27:02.243 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-11T00:27:02.244 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-11T00:27:02.244 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-11T00:27:02.244 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 197 k 2023-07-11T00:27:02.244 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 371 k 2023-07-11T00:27:02.244 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 364 k 2023-07-11T00:27:02.245 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 107 k 2023-07-11T00:27:02.245 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 94 k 2023-07-11T00:27:02.245 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.4 M 2023-07-11T00:27:02.245 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 180 k 2023-07-11T00:27:02.245 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-11T00:27:02.245 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2023-07-11T00:27:02.245 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-11T00:27:02.246 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-11T00:27:02.246 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-11T00:27:02.246 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-11T00:27:02.246 INFO:teuthology.orchestra.run.smithi022.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-11T00:27:02.246 INFO:teuthology.orchestra.run.smithi022.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-11T00:27:02.246 INFO:teuthology.orchestra.run.smithi022.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-11T00:27:02.246 INFO:teuthology.orchestra.run.smithi022.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-11T00:27:02.246 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.7 M 2023-07-11T00:27:02.247 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.6 M 2023-07-11T00:27:02.247 INFO:teuthology.orchestra.run.smithi022.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-11T00:27:02.247 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-11T00:27:02.247 INFO:teuthology.orchestra.run.smithi022.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-11T00:27:02.247 INFO:teuthology.orchestra.run.smithi022.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-11T00:27:02.247 INFO:teuthology.orchestra.run.smithi022.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-11T00:27:02.247 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-11T00:27:02.247 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2023-07-11T00:27:02.251 INFO:teuthology.orchestra.run.smithi022.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-11T00:27:02.251 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 22 M 2023-07-11T00:27:02.251 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 23 k 2023-07-11T00:27:02.251 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 2.3 M 2023-07-11T00:27:02.252 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 240 k 2023-07-11T00:27:02.252 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 4.6 M 2023-07-11T00:27:02.252 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 18 M 2023-07-11T00:27:02.252 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 15 k 2023-07-11T00:27:02.253 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 24 k 2023-07-11T00:27:02.253 INFO:teuthology.orchestra.run.smithi022.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-11T00:27:02.254 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-11T00:27:02.254 INFO:teuthology.orchestra.run.smithi022.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-11T00:27:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-11T00:27:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-11T00:27:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 137 k 2023-07-11T00:27:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-11T00:27:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-11T00:27:02.256 INFO:teuthology.orchestra.run.smithi022.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-11T00:27:02.256 INFO:teuthology.orchestra.run.smithi022.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-11T00:27:02.256 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-11T00:27:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-11T00:27:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 473 k 2023-07-11T00:27:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-11T00:27:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.7 M 2023-07-11T00:27:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-11T00:27:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-11T00:27:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-11T00:27:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-11T00:27:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-11T00:27:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-11T00:27:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-11T00:27:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-11T00:27:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-11T00:27:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-11T00:27:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-11T00:27:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-11T00:27:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-11T00:27:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-11T00:27:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-11T00:27:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-11T00:27:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-11T00:27:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 45 k 2023-07-11T00:27:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 122 k 2023-07-11T00:27:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-11T00:27:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-11T00:27:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-11T00:27:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-11T00:27:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-11T00:27:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-11T00:27:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-11T00:27:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-11T00:27:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-11T00:27:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-11T00:27:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-11T00:27:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-11T00:27:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-11T00:27:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-11T00:27:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-11T00:27:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-11T00:27:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-11T00:27:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-11T00:27:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-11T00:27:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-11T00:27:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-11T00:27:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-11T00:27:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-11T00:27:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-11T00:27:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-11T00:27:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-11T00:27:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-11T00:27:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-11T00:27:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-11T00:27:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-11T00:27:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-11T00:27:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-11T00:27:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-11T00:27:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-11T00:27:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-11T00:27:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-11T00:27:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-11T00:27:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-11T00:27:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-11T00:27:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-11T00:27:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-11T00:27:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-11T00:27:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-11T00:27:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-11T00:27:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-11T00:27:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-11T00:27:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-11T00:27:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-11T00:27:02.268 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-11T00:27:02.268 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling module streams: 2023-07-11T00:27:02.268 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql 10 2023-07-11T00:27:02.268 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:27:02.268 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-07-11T00:27:02.268 INFO:teuthology.orchestra.run.smithi022.stdout:==================================================================================================== 2023-07-11T00:27:02.268 INFO:teuthology.orchestra.run.smithi022.stdout:Install 128 Packages 2023-07-11T00:27:02.269 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 16 Packages 2023-07-11T00:27:02.269 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:27:02.269 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 212 M 2023-07-11T00:27:02.270 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-07-11T00:27:03.229 INFO:teuthology.orchestra.run.smithi184.stdout:(1/144): ceph-18.0.0-4828.gb5891ed6.el8.x86_64. 35 kB/s | 6.4 kB 00:00 2023-07-11T00:27:03.645 INFO:teuthology.orchestra.run.smithi184.stdout:(2/144): ceph-base-18.0.0-4828.gb5891ed6.el8.x8 8.9 MB/s | 5.4 MB 00:00 2023-07-11T00:27:03.704 INFO:teuthology.orchestra.run.smithi184.stdout:(3/144): ceph-immutable-object-cache-18.0.0-482 2.8 MB/s | 165 kB 00:00 2023-07-11T00:27:03.879 INFO:teuthology.orchestra.run.smithi184.stdout:(4/144): ceph-fuse-18.0.0-4828.gb5891ed6.el8.x8 1.3 MB/s | 848 kB 00:00 2023-07-11T00:27:03.963 INFO:teuthology.orchestra.run.smithi184.stdout:(5/144): ceph-mds-18.0.0-4828.gb5891ed6.el8.x86 8.9 MB/s | 2.3 MB 00:00 2023-07-11T00:27:04.316 INFO:teuthology.orchestra.run.smithi022.stdout:(1/144): ceph-18.0.0-4828.gb5891ed6.el8.x86_64. 20 kB/s | 6.4 kB 00:00 2023-07-11T00:27:04.646 INFO:teuthology.orchestra.run.smithi184.stdout:(6/144): ceph-mon-18.0.0-4828.gb5891ed6.el8.x86 6.8 MB/s | 4.6 MB 00:00 2023-07-11T00:27:04.675 INFO:teuthology.orchestra.run.smithi022.stdout:(2/144): ceph-fuse-18.0.0-4828.gb5891ed6.el8.x8 2.3 MB/s | 848 kB 00:00 2023-07-11T00:27:04.758 INFO:teuthology.orchestra.run.smithi022.stdout:(3/144): ceph-immutable-object-cache-18.0.0-482 1.9 MB/s | 165 kB 00:00 2023-07-11T00:27:04.897 INFO:teuthology.orchestra.run.smithi184.stdout:(7/144): ceph-common-18.0.0-4828.gb5891ed6.el8. 12 MB/s | 22 MB 00:01 2023-07-11T00:27:04.931 INFO:teuthology.orchestra.run.smithi184.stdout:(8/144): ceph-mgr-18.0.0-4828.gb5891ed6.el8.x86 1.5 MB/s | 1.5 MB 00:01 2023-07-11T00:27:05.056 INFO:teuthology.orchestra.run.smithi184.stdout:(9/144): ceph-selinux-18.0.0-4828.gb5891ed6.el8 194 kB/s | 24 kB 00:00 2023-07-11T00:27:05.217 INFO:teuthology.orchestra.run.smithi022.stdout:(4/144): ceph-base-18.0.0-4828.gb5891ed6.el8.x8 4.4 MB/s | 5.4 MB 00:01 2023-07-11T00:27:05.267 INFO:teuthology.orchestra.run.smithi022.stdout:(5/144): ceph-mds-18.0.0-4828.gb5891ed6.el8.x86 4.5 MB/s | 2.3 MB 00:00 2023-07-11T00:27:06.197 INFO:teuthology.orchestra.run.smithi184.stdout:(10/144): ceph-osd-18.0.0-4828.gb5891ed6.el8.x8 11 MB/s | 18 MB 00:01 2023-07-11T00:27:06.251 INFO:teuthology.orchestra.run.smithi022.stdout:(6/144): ceph-mon-18.0.0-4828.gb5891ed6.el8.x86 4.7 MB/s | 4.6 MB 00:00 2023-07-11T00:27:06.265 INFO:teuthology.orchestra.run.smithi184.stdout:(11/144): cephfs-mirror-18.0.0-4828.gb5891ed6.e 3.8 MB/s | 258 kB 00:00 2023-07-11T00:27:06.318 INFO:teuthology.orchestra.run.smithi022.stdout:(7/144): ceph-mgr-18.0.0-4828.gb5891ed6.el8.x86 1.4 MB/s | 1.5 MB 00:01 2023-07-11T00:27:06.323 INFO:teuthology.orchestra.run.smithi184.stdout:(12/144): libcephfs-devel-18.0.0-4828.gb5891ed6 536 kB/s | 31 kB 00:00 2023-07-11T00:27:06.432 INFO:teuthology.orchestra.run.smithi184.stdout:(13/144): libcephfs2-18.0.0-4828.gb5891ed6.el8. 7.0 MB/s | 771 kB 00:00 2023-07-11T00:27:06.490 INFO:teuthology.orchestra.run.smithi184.stdout:(14/144): libcephsqlite-18.0.0-4828.gb5891ed6.e 2.3 MB/s | 137 kB 00:00 2023-07-11T00:27:06.557 INFO:teuthology.orchestra.run.smithi184.stdout:(15/144): librados-devel-18.0.0-4828.gb5891ed6. 2.0 MB/s | 139 kB 00:00 2023-07-11T00:27:06.641 INFO:teuthology.orchestra.run.smithi184.stdout:(16/144): libradosstriper1-18.0.0-4828.gb5891ed 5.6 MB/s | 473 kB 00:00 2023-07-11T00:27:06.950 INFO:teuthology.orchestra.run.smithi184.stdout:(17/144): ceph-radosgw-18.0.0-4828.gb5891ed6.el 6.6 MB/s | 13 MB 00:02 2023-07-11T00:27:07.033 INFO:teuthology.orchestra.run.smithi184.stdout:(18/144): python3-ceph-argparse-18.0.0-4828.gb5 538 kB/s | 45 kB 00:00 2023-07-11T00:27:07.117 INFO:teuthology.orchestra.run.smithi184.stdout:(19/144): python3-ceph-common-18.0.0-4828.gb589 1.4 MB/s | 122 kB 00:00 2023-07-11T00:27:07.209 INFO:teuthology.orchestra.run.smithi184.stdout:(20/144): librgw2-18.0.0-4828.gb5891ed6.el8.x86 12 MB/s | 6.7 MB 00:00 2023-07-11T00:27:07.234 INFO:teuthology.orchestra.run.smithi184.stdout:(21/144): python3-cephfs-18.0.0-4828.gb5891ed6. 1.7 MB/s | 197 kB 00:00 2023-07-11T00:27:07.268 INFO:teuthology.orchestra.run.smithi184.stdout:(22/144): python3-rados-18.0.0-4828.gb5891ed6.e 6.2 MB/s | 371 kB 00:00 2023-07-11T00:27:07.301 INFO:teuthology.orchestra.run.smithi184.stdout:(23/144): python3-rbd-18.0.0-4828.gb5891ed6.el8 5.3 MB/s | 364 kB 00:00 2023-07-11T00:27:07.326 INFO:teuthology.orchestra.run.smithi184.stdout:(24/144): python3-rgw-18.0.0-4828.gb5891ed6.el8 1.8 MB/s | 107 kB 00:00 2023-07-11T00:27:07.343 INFO:teuthology.orchestra.run.smithi184.stdout:(25/144): rbd-fuse-18.0.0-4828.gb5891ed6.el8.x8 2.2 MB/s | 94 kB 00:00 2023-07-11T00:27:07.427 INFO:teuthology.orchestra.run.smithi184.stdout:(26/144): rbd-nbd-18.0.0-4828.gb5891ed6.el8.x86 2.1 MB/s | 180 kB 00:00 2023-07-11T00:27:07.510 INFO:teuthology.orchestra.run.smithi184.stdout:(27/144): ceph-grafana-dashboards-18.0.0-4828.g 277 kB/s | 23 kB 00:00 2023-07-11T00:27:07.611 INFO:teuthology.orchestra.run.smithi184.stdout:(28/144): rbd-mirror-18.0.0-4828.gb5891ed6.el8. 12 MB/s | 3.4 MB 00:00 2023-07-11T00:27:07.636 INFO:teuthology.orchestra.run.smithi184.stdout:(29/144): ceph-mgr-cephadm-18.0.0-4828.gb5891ed 1.0 MB/s | 129 kB 00:00 2023-07-11T00:27:07.778 INFO:teuthology.orchestra.run.smithi184.stdout:(30/144): ceph-mgr-dashboard-18.0.0-4828.gb5891 10 MB/s | 1.7 MB 00:00 2023-07-11T00:27:07.845 INFO:teuthology.orchestra.run.smithi184.stdout:(31/144): ceph-mgr-modules-core-18.0.0-4828.gb5 3.5 MB/s | 240 kB 00:00 2023-07-11T00:27:07.912 INFO:teuthology.orchestra.run.smithi184.stdout:(32/144): ceph-mgr-rook-18.0.0-4828.gb5891ed6.e 712 kB/s | 47 kB 00:00 2023-07-11T00:27:07.971 INFO:teuthology.orchestra.run.smithi184.stdout:(33/144): ceph-prometheus-alerts-18.0.0-4828.gb 250 kB/s | 15 kB 00:00 2023-07-11T00:27:08.054 INFO:teuthology.orchestra.run.smithi184.stdout:(34/144): ceph-volume-18.0.0-4828.gb5891ed6.el8 3.0 MB/s | 258 kB 00:00 2023-07-11T00:27:08.129 INFO:teuthology.orchestra.run.smithi184.stdout:(35/144): cephadm-18.0.0-4828.gb5891ed6.el8.noa 2.1 MB/s | 164 kB 00:00 2023-07-11T00:27:08.197 INFO:teuthology.orchestra.run.smithi184.stdout:(36/144): cephfs-top-18.0.0-4828.gb5891ed6.el8. 269 kB/s | 18 kB 00:00 2023-07-11T00:27:08.339 INFO:teuthology.orchestra.run.smithi184.stdout:(37/144): automake-1.16.1-7.el8.noarch.rpm 4.9 MB/s | 713 kB 00:00 2023-07-11T00:27:08.397 INFO:teuthology.orchestra.run.smithi184.stdout:(38/144): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-07-11T00:27:08.439 INFO:teuthology.orchestra.run.smithi184.stdout:(39/144): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-07-11T00:27:08.482 INFO:teuthology.orchestra.run.smithi184.stdout:(40/144): jq-1.6-7.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-07-11T00:27:08.582 INFO:teuthology.orchestra.run.smithi184.stdout:(41/144): ceph-mgr-diskprediction-local-18.0.0- 7.8 MB/s | 7.4 MB 00:00 2023-07-11T00:27:08.607 INFO:teuthology.orchestra.run.smithi184.stdout:(42/144): libpq-13.5-1.el8.x86_64.rpm 1.5 MB/s | 198 kB 00:00 2023-07-11T00:27:08.657 INFO:teuthology.orchestra.run.smithi184.stdout:(43/144): libtool-2.4.6-25.el8.x86_64.rpm 14 MB/s | 709 kB 00:00 2023-07-11T00:27:08.699 INFO:teuthology.orchestra.run.smithi184.stdout:(44/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-07-11T00:27:08.733 INFO:teuthology.orchestra.run.smithi184.stdout:(45/144): librdkafka-0.11.4-3.el8.x86_64.rpm 2.3 MB/s | 354 kB 00:00 2023-07-11T00:27:08.758 INFO:teuthology.orchestra.run.smithi184.stdout:(46/144): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-07-11T00:27:08.884 INFO:teuthology.orchestra.run.smithi022.stdout:(8/144): ceph-osd-18.0.0-4828.gb5891ed6.el8.x86 6.7 MB/s | 18 MB 00:02 2023-07-11T00:27:08.918 INFO:teuthology.orchestra.run.smithi022.stdout:(9/144): ceph-selinux-18.0.0-4828.gb5891ed6.el8 738 kB/s | 24 kB 00:00 2023-07-11T00:27:08.950 INFO:teuthology.orchestra.run.smithi184.stdout:(47/144): openblas-0.3.15-4.el8.x86_64.rpm 22 MB/s | 4.7 MB 00:00 2023-07-11T00:27:09.026 INFO:teuthology.orchestra.run.smithi184.stdout:(48/144): openblas-threads-0.3.15-4.el8.x86_64. 18 MB/s | 4.9 MB 00:00 2023-07-11T00:27:09.068 INFO:teuthology.orchestra.run.smithi184.stdout:(49/144): postgresql-10.23-1.module_el8+300+2c5 13 MB/s | 1.6 MB 00:00 2023-07-11T00:27:09.110 INFO:teuthology.orchestra.run.smithi184.stdout:(50/144): postgresql-contrib-10.23-1.module_el8 11 MB/s | 903 kB 00:00 2023-07-11T00:27:09.293 INFO:teuthology.orchestra.run.smithi184.stdout:(51/144): postgresql-server-10.23-1.module_el8+ 23 MB/s | 5.1 MB 00:00 2023-07-11T00:27:09.441 INFO:teuthology.orchestra.run.smithi184.stdout:(52/144): python3-babel-2.5.1-7.el8.noarch.rpm 14 MB/s | 4.8 MB 00:00 2023-07-11T00:27:09.477 INFO:teuthology.orchestra.run.smithi184.stdout:(53/144): python3-jinja2-2.10.1-3.el8.noarch.rp 2.9 MB/s | 538 kB 00:00 2023-07-11T00:27:09.502 INFO:teuthology.orchestra.run.smithi184.stdout:(54/144): python3-jsonpatch-1.21-2.el8.noarch.r 433 kB/s | 27 kB 00:00 2023-07-11T00:27:09.528 INFO:teuthology.orchestra.run.smithi184.stdout:(55/144): python3-jsonpointer-1.10-11.el8.noarc 398 kB/s | 20 kB 00:00 2023-07-11T00:27:09.553 INFO:teuthology.orchestra.run.smithi184.stdout:(56/144): python3-mako-1.0.6-14.el8.noarch.rpm 3.1 MB/s | 157 kB 00:00 2023-07-11T00:27:09.580 INFO:teuthology.orchestra.run.smithi184.stdout:(57/144): python3-markupsafe-0.23-19.el8.x86_64 772 kB/s | 39 kB 00:00 2023-07-11T00:27:09.629 INFO:teuthology.orchestra.run.smithi184.stdout:(58/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 4.4 MB/s | 225 kB 00:00 2023-07-11T00:27:09.671 INFO:teuthology.orchestra.run.smithi184.stdout:(59/144): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-07-11T00:27:09.730 INFO:teuthology.orchestra.run.smithi184.stdout:(60/144): python3-numpy-1.14.3-10.el8.x86_64.rp 21 MB/s | 3.7 MB 00:00 2023-07-11T00:27:09.755 INFO:teuthology.orchestra.run.smithi184.stdout:(61/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.2 MB/s | 103 kB 00:00 2023-07-11T00:27:09.780 INFO:teuthology.orchestra.run.smithi184.stdout:(62/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-07-11T00:27:09.785 INFO:teuthology.orchestra.run.smithi022.stdout:(10/144): ceph-common-18.0.0-4828.gb5891ed6.el8 3.8 MB/s | 22 MB 00:05 2023-07-11T00:27:09.806 INFO:teuthology.orchestra.run.smithi184.stdout:(63/144): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2023-07-11T00:27:09.822 INFO:teuthology.orchestra.run.smithi184.stdout:(64/144): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-07-11T00:27:09.873 INFO:teuthology.orchestra.run.smithi184.stdout:(65/144): python3-werkzeug-0.12.2-4.el8.noarch. 8.9 MB/s | 457 kB 00:00 2023-07-11T00:27:09.914 INFO:teuthology.orchestra.run.smithi184.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-07-11T00:27:09.966 INFO:teuthology.orchestra.run.smithi022.stdout:(11/144): cephfs-mirror-18.0.0-4828.gb5891ed6.e 1.4 MB/s | 258 kB 00:00 2023-07-11T00:27:09.973 INFO:teuthology.orchestra.run.smithi184.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2023-07-11T00:27:10.015 INFO:teuthology.orchestra.run.smithi184.stdout:(68/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2023-07-11T00:27:10.085 INFO:teuthology.orchestra.run.smithi022.stdout:(12/144): libcephfs-devel-18.0.0-4828.gb5891ed6 260 kB/s | 31 kB 00:00 2023-07-11T00:27:10.190 INFO:teuthology.orchestra.run.smithi184.stdout:(69/144): elfutils-libelf-devel-0.189-2.el8.x86 352 kB/s | 61 kB 00:00 2023-07-11T00:27:10.270 INFO:teuthology.orchestra.run.smithi022.stdout:(13/144): libcephfs2-18.0.0-4828.gb5891ed6.el8. 4.1 MB/s | 771 kB 00:00 2023-07-11T00:27:10.342 INFO:teuthology.orchestra.run.smithi184.stdout:(70/144): python3-scipy-1.0.0-21.module_el8.5.0 26 MB/s | 14 MB 00:00 2023-07-11T00:27:10.411 INFO:teuthology.orchestra.run.smithi022.stdout:(14/144): ceph-radosgw-18.0.0-4828.gb5891ed6.el 3.3 MB/s | 13 MB 00:04 2023-07-11T00:27:10.436 INFO:teuthology.orchestra.run.smithi022.stdout:(15/144): libcephsqlite-18.0.0-4828.gb5891ed6.e 823 kB/s | 137 kB 00:00 2023-07-11T00:27:10.462 INFO:teuthology.orchestra.run.smithi022.stdout:(16/144): librados-devel-18.0.0-4828.gb5891ed6. 2.7 MB/s | 139 kB 00:00 2023-07-11T00:27:10.492 INFO:teuthology.orchestra.run.smithi184.stdout:(71/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 321 kB/s | 48 kB 00:00 2023-07-11T00:27:10.545 INFO:teuthology.orchestra.run.smithi022.stdout:(17/144): libradosstriper1-18.0.0-4828.gb5891ed 4.3 MB/s | 473 kB 00:00 2023-07-11T00:27:10.558 INFO:teuthology.orchestra.run.smithi184.stdout:(72/144): fuse-2.9.7-17.el8.x86_64.rpm 226 kB/s | 83 kB 00:00 2023-07-11T00:27:10.612 INFO:teuthology.orchestra.run.smithi022.stdout:(18/144): python3-ceph-argparse-18.0.0-4828.gb5 670 kB/s | 45 kB 00:00 2023-07-11T00:27:10.687 INFO:teuthology.orchestra.run.smithi022.stdout:(19/144): python3-ceph-common-18.0.0-4828.gb589 1.6 MB/s | 122 kB 00:00 2023-07-11T00:27:10.700 INFO:teuthology.orchestra.run.smithi184.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 132 kB/s | 19 kB 00:00 2023-07-11T00:27:10.763 INFO:teuthology.orchestra.run.smithi022.stdout:(20/144): python3-cephfs-18.0.0-4828.gb5891ed6. 2.6 MB/s | 197 kB 00:00 2023-07-11T00:27:10.842 INFO:teuthology.orchestra.run.smithi184.stdout:(74/144): libcom_err-devel-1.45.6-5.el8.x86_64. 274 kB/s | 39 kB 00:00 2023-07-11T00:27:10.879 INFO:teuthology.orchestra.run.smithi022.stdout:(21/144): python3-rados-18.0.0-4828.gb5891ed6.e 3.1 MB/s | 371 kB 00:00 2023-07-11T00:27:10.997 INFO:teuthology.orchestra.run.smithi022.stdout:(22/144): python3-rbd-18.0.0-4828.gb5891ed6.el8 3.0 MB/s | 364 kB 00:00 2023-07-11T00:27:11.017 INFO:teuthology.orchestra.run.smithi184.stdout:(75/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.0 MB/s | 561 kB 00:00 2023-07-11T00:27:11.072 INFO:teuthology.orchestra.run.smithi022.stdout:(23/144): python3-rgw-18.0.0-4828.gb5891ed6.el8 1.4 MB/s | 107 kB 00:00 2023-07-11T00:27:11.134 INFO:teuthology.orchestra.run.smithi184.stdout:(76/144): libgfortran-8.5.0-20.el8.x86_64.rpm 2.2 MB/s | 645 kB 00:00 2023-07-11T00:27:11.155 INFO:teuthology.orchestra.run.smithi022.stdout:(24/144): rbd-fuse-18.0.0-4828.gb5891ed6.el8.x8 1.1 MB/s | 94 kB 00:00 2023-07-11T00:27:11.234 INFO:teuthology.orchestra.run.smithi184.stdout:(77/144): libquadmath-8.5.0-20.el8.x86_64.rpm 795 kB/s | 172 kB 00:00 2023-07-11T00:27:11.268 INFO:teuthology.orchestra.run.smithi184.stdout:(78/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 352 kB/s | 47 kB 00:00 2023-07-11T00:27:11.552 INFO:teuthology.orchestra.run.smithi184.stdout:(79/144): libsepol-devel-2.9-3.el8.x86_64.rpm 307 kB/s | 87 kB 00:00 2023-07-11T00:27:11.619 INFO:teuthology.orchestra.run.smithi184.stdout:(80/144): libselinux-devel-2.9-8.el8.x86_64.rpm 522 kB/s | 200 kB 00:00 2023-07-11T00:27:11.744 INFO:teuthology.orchestra.run.smithi184.stdout:(81/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 518 kB/s | 99 kB 00:00 2023-07-11T00:27:11.769 INFO:teuthology.orchestra.run.smithi184.stdout:(82/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 120 kB/s | 18 kB 00:00 2023-07-11T00:27:11.806 INFO:teuthology.orchestra.run.smithi022.stdout:(25/144): librgw2-18.0.0-4828.gb5891ed6.el8.x86 5.0 MB/s | 6.7 MB 00:01 2023-07-11T00:27:11.919 INFO:teuthology.orchestra.run.smithi184.stdout:(83/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 251 kB/s | 44 kB 00:00 2023-07-11T00:27:11.981 INFO:teuthology.orchestra.run.smithi022.stdout:(26/144): rbd-mirror-18.0.0-4828.gb5891ed6.el8. 4.2 MB/s | 3.4 MB 00:00 2023-07-11T00:27:12.006 INFO:teuthology.orchestra.run.smithi022.stdout:(27/144): rbd-nbd-18.0.0-4828.gb5891ed6.el8.x86 899 kB/s | 180 kB 00:00 2023-07-11T00:27:12.048 INFO:teuthology.orchestra.run.smithi022.stdout:(28/144): ceph-grafana-dashboards-18.0.0-4828.g 345 kB/s | 23 kB 00:00 2023-07-11T00:27:12.095 INFO:teuthology.orchestra.run.smithi022.stdout:(29/144): ceph-mgr-cephadm-18.0.0-4828.gb5891ed 1.4 MB/s | 129 kB 00:00 2023-07-11T00:27:12.178 INFO:teuthology.orchestra.run.smithi184.stdout:(84/144): pcre2-devel-10.32-3.el8.x86_64.rpm 2.3 MB/s | 605 kB 00:00 2023-07-11T00:27:12.399 INFO:teuthology.orchestra.run.smithi022.stdout:(30/144): ceph-mgr-dashboard-18.0.0-4828.gb5891 4.9 MB/s | 1.7 MB 00:00 2023-07-11T00:27:12.470 INFO:teuthology.orchestra.run.smithi184.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 786 kB/s | 229 kB 00:00 2023-07-11T00:27:12.492 INFO:teuthology.orchestra.run.smithi022.stdout:(31/144): ceph-mgr-modules-core-18.0.0-4828.gb5 2.6 MB/s | 240 kB 00:00 2023-07-11T00:27:12.545 INFO:teuthology.orchestra.run.smithi184.stdout:(86/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 4.1 MB/s | 3.2 MB 00:00 2023-07-11T00:27:12.566 INFO:teuthology.orchestra.run.smithi022.stdout:(32/144): ceph-mgr-rook-18.0.0-4828.gb5891ed6.e 632 kB/s | 47 kB 00:00 2023-07-11T00:27:12.633 INFO:teuthology.orchestra.run.smithi022.stdout:(33/144): ceph-prometheus-alerts-18.0.0-4828.gb 218 kB/s | 15 kB 00:00 2023-07-11T00:27:12.717 INFO:teuthology.orchestra.run.smithi022.stdout:(34/144): ceph-volume-18.0.0-4828.gb5891ed6.el8 3.0 MB/s | 258 kB 00:00 2023-07-11T00:27:12.804 INFO:teuthology.orchestra.run.smithi184.stdout:(87/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 662 kB/s | 220 kB 00:00 2023-07-11T00:27:12.920 INFO:teuthology.orchestra.run.smithi184.stdout:(88/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 664 kB/s | 249 kB 00:00 2023-07-11T00:27:12.925 INFO:teuthology.orchestra.run.smithi022.stdout:(35/144): cephadm-18.0.0-4828.gb5891ed6.el8.noa 788 kB/s | 164 kB 00:00 2023-07-11T00:27:12.992 INFO:teuthology.orchestra.run.smithi022.stdout:(36/144): cephfs-top-18.0.0-4828.gb5891ed6.el8. 270 kB/s | 18 kB 00:00 2023-07-11T00:27:13.046 INFO:teuthology.orchestra.run.smithi184.stdout:(89/144): python3-jwt-1.6.1-2.el8.noarch.rpm 341 kB/s | 43 kB 00:00 2023-07-11T00:27:13.159 INFO:teuthology.orchestra.run.smithi022.stdout:(37/144): automake-1.16.1-7.el8.noarch.rpm 4.2 MB/s | 713 kB 00:00 2023-07-11T00:27:13.228 INFO:teuthology.orchestra.run.smithi022.stdout:(38/144): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-07-11T00:27:13.263 INFO:teuthology.orchestra.run.smithi184.stdout:(90/144): python3-cryptography-3.2.1-6.el8.x86_ 1.4 MB/s | 641 kB 00:00 2023-07-11T00:27:13.363 INFO:teuthology.orchestra.run.smithi184.stdout:(91/144): python3-oauthlib-2.1.0-1.el8.noarch.r 489 kB/s | 155 kB 00:00 2023-07-11T00:27:13.455 INFO:teuthology.orchestra.run.smithi184.stdout:(92/144): python3-pycparser-2.14-14.el8.noarch. 569 kB/s | 109 kB 00:00 2023-07-11T00:27:13.556 INFO:teuthology.orchestra.run.smithi184.stdout:(93/144): python3-requests-oauthlib-1.0.0-1.el8 222 kB/s | 43 kB 00:00 2023-07-11T00:27:13.614 INFO:teuthology.orchestra.run.smithi184.stdout:(94/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 471 kB/s | 74 kB 00:00 2023-07-11T00:27:13.660 INFO:teuthology.orchestra.run.smithi022.stdout:(39/144): ceph-test-18.0.0-4828.gb5891ed6.el8.x 10 MB/s | 48 MB 00:04 2023-07-11T00:27:13.702 INFO:teuthology.orchestra.run.smithi022.stdout:(40/144): flex-2.6.1-9.el8.x86_64.rpm 673 kB/s | 320 kB 00:00 2023-07-11T00:27:13.798 INFO:teuthology.orchestra.run.smithi184.stdout:(95/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 240 kB/s | 58 kB 00:00 2023-07-11T00:27:13.802 INFO:teuthology.orchestra.run.smithi022.stdout:(41/144): ceph-mgr-diskprediction-local-18.0.0- 4.3 MB/s | 7.4 MB 00:01 2023-07-11T00:27:13.827 INFO:teuthology.orchestra.run.smithi022.stdout:(42/144): libpq-13.5-1.el8.x86_64.rpm 1.5 MB/s | 198 kB 00:00 2023-07-11T00:27:13.886 INFO:teuthology.orchestra.run.smithi022.stdout:(43/144): jq-1.6-7.el8.x86_64.rpm 899 kB/s | 202 kB 00:00 2023-07-11T00:27:13.920 INFO:teuthology.orchestra.run.smithi022.stdout:(44/144): libtool-2.4.6-25.el8.x86_64.rpm 7.5 MB/s | 709 kB 00:00 2023-07-11T00:27:13.962 INFO:teuthology.orchestra.run.smithi022.stdout:(45/144): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-07-11T00:27:13.987 INFO:teuthology.orchestra.run.smithi022.stdout:(46/144): librdkafka-0.11.4-3.el8.x86_64.rpm 1.9 MB/s | 354 kB 00:00 2023-07-11T00:27:14.012 INFO:teuthology.orchestra.run.smithi022.stdout:(47/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.0 MB/s | 259 kB 00:00 2023-07-11T00:27:14.032 INFO:teuthology.orchestra.run.smithi184.stdout:(96/144): gperftools-libs-2.7-9.el8.x86_64.rpm 735 kB/s | 306 kB 00:00 2023-07-11T00:27:14.073 INFO:teuthology.orchestra.run.smithi184.stdout:(97/144): liboath-2.6.2-3.el8.x86_64.rpm 214 kB/s | 59 kB 00:00 2023-07-11T00:27:14.132 INFO:teuthology.orchestra.run.smithi184.stdout:(98/144): libunwind-1.3.1-3.el8.x86_64.rpm 750 kB/s | 75 kB 00:00 2023-07-11T00:27:14.224 INFO:teuthology.orchestra.run.smithi184.stdout:(99/144): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 476 kB/s | 44 kB 00:00 2023-07-11T00:27:14.316 INFO:teuthology.orchestra.run.smithi184.stdout:(100/144): python3-beautifulsoup4-4.6.3-2.el8.1 2.0 MB/s | 185 kB 00:00 2023-07-11T00:27:14.337 INFO:teuthology.orchestra.run.smithi022.stdout:(48/144): openblas-threads-0.3.15-4.el8.x86_64. 14 MB/s | 4.9 MB 00:00 2023-07-11T00:27:14.391 INFO:teuthology.orchestra.run.smithi184.stdout:(101/144): python3-cachetools-3.1.1-4.el8.noarc 440 kB/s | 33 kB 00:00 2023-07-11T00:27:14.413 INFO:teuthology.orchestra.run.smithi022.stdout:(49/144): openblas-0.3.15-4.el8.x86_64.rpm 10 MB/s | 4.7 MB 00:00 2023-07-11T00:27:14.455 INFO:teuthology.orchestra.run.smithi022.stdout:(50/144): postgresql-contrib-10.23-1.module_el8 7.6 MB/s | 903 kB 00:00 2023-07-11T00:27:14.474 INFO:teuthology.orchestra.run.smithi184.stdout:(102/144): python3-asyncssh-2.7.0-2.el8.noarch. 1.2 MB/s | 476 kB 00:00 2023-07-11T00:27:14.613 INFO:teuthology.orchestra.run.smithi022.stdout:(51/144): postgresql-10.23-1.module_el8+300+2c5 2.6 MB/s | 1.6 MB 00:00 2023-07-11T00:27:14.633 INFO:teuthology.orchestra.run.smithi184.stdout:(103/144): python3-certifi-2018.10.15-7.el8.noa 67 kB/s | 16 kB 00:00 2023-07-11T00:27:14.659 INFO:teuthology.orchestra.run.smithi184.stdout:(104/144): python3-cheroot-8.5.2-1.el8.noarch.r 939 kB/s | 173 kB 00:00 2023-07-11T00:27:14.722 INFO:teuthology.orchestra.run.smithi022.stdout:(52/144): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-07-11T00:27:14.742 INFO:teuthology.orchestra.run.smithi184.stdout:(105/144): python3-google-auth-1.1.1-10.el8.noa 979 kB/s | 81 kB 00:00 2023-07-11T00:27:14.768 INFO:teuthology.orchestra.run.smithi184.stdout:(106/144): python3-cherrypy-18.4.0-1.el8.noarch 2.8 MB/s | 384 kB 00:00 2023-07-11T00:27:14.810 INFO:teuthology.orchestra.run.smithi184.stdout:(107/144): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-07-11T00:27:14.822 INFO:teuthology.orchestra.run.smithi022.stdout:(53/144): postgresql-server-10.23-1.module_el8+ 13 MB/s | 5.1 MB 00:00 2023-07-11T00:27:14.835 INFO:teuthology.orchestra.run.smithi184.stdout:(108/144): python3-jaraco-functools-2.0-4.el8.n 263 kB/s | 18 kB 00:00 2023-07-11T00:27:14.847 INFO:teuthology.orchestra.run.smithi022.stdout:(54/144): python3-jsonpatch-1.21-2.el8.noarch.r 213 kB/s | 27 kB 00:00 2023-07-11T00:27:14.875 INFO:teuthology.orchestra.run.smithi022.stdout:(55/144): python3-jsonpointer-1.10-11.el8.noarc 397 kB/s | 20 kB 00:00 2023-07-11T00:27:14.898 INFO:teuthology.orchestra.run.smithi022.stdout:(56/144): python3-jinja2-2.10.1-3.el8.noarch.rp 1.8 MB/s | 538 kB 00:00 2023-07-11T00:27:14.902 INFO:teuthology.orchestra.run.smithi184.stdout:(109/144): python3-logutils-0.3.5-11.el8.noarch 735 kB/s | 49 kB 00:00 2023-07-11T00:27:14.924 INFO:teuthology.orchestra.run.smithi022.stdout:(57/144): python3-mako-1.0.6-14.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2023-07-11T00:27:14.948 INFO:teuthology.orchestra.run.smithi022.stdout:(58/144): python3-markupsafe-0.23-19.el8.x86_64 516 kB/s | 39 kB 00:00 2023-07-11T00:27:14.974 INFO:teuthology.orchestra.run.smithi022.stdout:(59/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 4.4 MB/s | 225 kB 00:00 2023-07-11T00:27:14.977 INFO:teuthology.orchestra.run.smithi184.stdout:(110/144): python3-more-itertools-7.2.0-3.el8.n 782 kB/s | 59 kB 00:00 2023-07-11T00:27:14.999 INFO:teuthology.orchestra.run.smithi022.stdout:(60/144): python3-prettytable-0.7.2-14.el8.noar 875 kB/s | 44 kB 00:00 2023-07-11T00:27:15.044 INFO:teuthology.orchestra.run.smithi184.stdout:(111/144): python3-natsort-7.1.1-2.el8.noarch.r 910 kB/s | 60 kB 00:00 2023-07-11T00:27:15.169 INFO:teuthology.orchestra.run.smithi184.stdout:(112/144): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2023-07-11T00:27:15.172 INFO:teuthology.orchestra.run.smithi022.stdout:(61/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 522 kB/s | 103 kB 00:00 2023-07-11T00:27:15.200 INFO:teuthology.orchestra.run.smithi022.stdout:(62/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 630 kB/s | 126 kB 00:00 2023-07-11T00:27:15.225 INFO:teuthology.orchestra.run.smithi022.stdout:(63/144): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2023-07-11T00:27:15.245 INFO:teuthology.orchestra.run.smithi184.stdout:(113/144): python3-portend-2.6-1.el8.noarch.rpm 209 kB/s | 16 kB 00:00 2023-07-11T00:27:15.250 INFO:teuthology.orchestra.run.smithi022.stdout:(64/144): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-07-11T00:27:15.301 INFO:teuthology.orchestra.run.smithi022.stdout:(65/144): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-07-11T00:27:15.328 INFO:teuthology.orchestra.run.smithi184.stdout:(114/144): python3-kubernetes-11.0.0-6.el8.noar 2.2 MB/s | 1.2 MB 00:00 2023-07-11T00:27:15.354 INFO:teuthology.orchestra.run.smithi184.stdout:(115/144): python3-repoze-lru-0.7-6.el8.noarch. 309 kB/s | 34 kB 00:00 2023-07-11T00:27:15.359 INFO:teuthology.orchestra.run.smithi022.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-07-11T00:27:15.410 INFO:teuthology.orchestra.run.smithi022.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-07-11T00:27:15.445 INFO:teuthology.orchestra.run.smithi184.stdout:(116/144): python3-rsa-4.8-1.el8.noarch.rpm 673 kB/s | 61 kB 00:00 2023-07-11T00:27:15.452 INFO:teuthology.orchestra.run.smithi022.stdout:(68/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2023-07-11T00:27:15.479 INFO:teuthology.orchestra.run.smithi184.stdout:(117/144): python3-routes-2.4.1-12.el8.noarch.r 1.3 MB/s | 196 kB 00:00 2023-07-11T00:27:15.539 INFO:teuthology.orchestra.run.smithi184.stdout:(118/144): python3-simplegeneric-0.8.1-17.el8.n 203 kB/s | 19 kB 00:00 2023-07-11T00:27:15.580 INFO:teuthology.orchestra.run.smithi184.stdout:(119/144): python3-singledispatch-3.4.0.3-18.el 239 kB/s | 24 kB 00:00 2023-07-11T00:27:15.835 INFO:teuthology.orchestra.run.smithi022.stdout:(69/144): python3-scipy-1.0.0-21.module_el8.5.0 22 MB/s | 14 MB 00:00 2023-07-11T00:27:15.861 INFO:teuthology.orchestra.run.smithi022.stdout:(70/144): elfutils-libelf-devel-0.189-2.el8.x86 151 kB/s | 61 kB 00:00 2023-07-11T00:27:15.988 INFO:teuthology.orchestra.run.smithi022.stdout:(71/144): python3-numpy-1.14.3-10.el8.x86_64.rp 3.5 MB/s | 3.7 MB 00:01 2023-07-11T00:27:16.011 INFO:teuthology.orchestra.run.smithi022.stdout:(72/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 320 kB/s | 48 kB 00:00 2023-07-11T00:27:16.048 INFO:teuthology.orchestra.run.smithi184.stdout:(120/144): ceph-test-18.0.0-4828.gb5891ed6.el8. 4.3 MB/s | 48 MB 00:10 2023-07-11T00:27:16.072 INFO:teuthology.orchestra.run.smithi184.stdout:(121/144): python3-tempora-1.14.1-5.el8.noarch. 55 kB/s | 29 kB 00:00 2023-07-11T00:27:16.078 INFO:teuthology.orchestra.run.smithi022.stdout:(73/144): fuse-2.9.7-17.el8.x86_64.rpm 343 kB/s | 83 kB 00:00 2023-07-11T00:27:16.098 INFO:teuthology.orchestra.run.smithi184.stdout:(122/144): python3-trustme-0.6.0-4.el8.noarch.r 53 kB/s | 27 kB 00:00 2023-07-11T00:27:16.165 INFO:teuthology.orchestra.run.smithi184.stdout:(123/144): python3-websocket-client-0.56.0-5.el 924 kB/s | 61 kB 00:00 2023-07-11T00:27:16.187 INFO:teuthology.orchestra.run.smithi022.stdout:(74/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 106 kB/s | 19 kB 00:00 2023-07-11T00:27:16.220 INFO:teuthology.orchestra.run.smithi022.stdout:(75/144): libcom_err-devel-1.45.6-5.el8.x86_64. 273 kB/s | 39 kB 00:00 2023-07-11T00:27:16.224 INFO:teuthology.orchestra.run.smithi184.stdout:(124/144): python3-webtest-2.0.33-1.el8.noarch. 1.4 MB/s | 85 kB 00:00 2023-07-11T00:27:16.248 INFO:teuthology.orchestra.run.smithi184.stdout:(125/144): python3-webob-1.8.5-1.el8.1.noarch.r 1.6 MB/s | 251 kB 00:00 2023-07-11T00:27:16.282 INFO:teuthology.orchestra.run.smithi184.stdout:(126/144): python3-zc-lockfile-2.0-2.el8.noarch 393 kB/s | 23 kB 00:00 2023-07-11T00:27:16.323 INFO:teuthology.orchestra.run.smithi184.stdout:(127/144): python3-waitress-1.4.3-1.el8.noarch. 926 kB/s | 255 kB 00:00 2023-07-11T00:27:16.404 INFO:teuthology.orchestra.run.smithi022.stdout:(76/144): libquadmath-8.5.0-20.el8.x86_64.rpm 940 kB/s | 172 kB 00:00 2023-07-11T00:27:16.437 INFO:teuthology.orchestra.run.smithi022.stdout:(77/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.2 MB/s | 561 kB 00:00 2023-07-11T00:27:16.541 INFO:teuthology.orchestra.run.smithi184.stdout:(128/144): thrift-0.13.0-2.el8.x86_64.rpm 5.9 MB/s | 1.7 MB 00:00 2023-07-11T00:27:16.546 INFO:teuthology.orchestra.run.smithi022.stdout:(78/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 331 kB/s | 47 kB 00:00 2023-07-11T00:27:16.625 INFO:teuthology.orchestra.run.smithi184.stdout:(129/144): librbd1-18.0.0-4828.gb5891ed6.el8.x8 12 MB/s | 3.6 MB 00:00 2023-07-11T00:27:16.638 INFO:teuthology.orchestra.run.smithi022.stdout:(79/144): libgfortran-8.5.0-20.el8.x86_64.rpm 1.4 MB/s | 645 kB 00:00 2023-07-11T00:27:16.750 INFO:teuthology.orchestra.run.smithi184.stdout:(130/144): NetworkManager-initscripts-updown-1. 689 kB/s | 143 kB 00:00 2023-07-11T00:27:16.763 INFO:teuthology.orchestra.run.smithi022.stdout:(80/144): libselinux-devel-2.9-8.el8.x86_64.rpm 615 kB/s | 200 kB 00:00 2023-07-11T00:27:16.788 INFO:teuthology.orchestra.run.smithi022.stdout:(81/144): libsepol-devel-2.9-3.el8.x86_64.rpm 359 kB/s | 87 kB 00:00 2023-07-11T00:27:16.816 INFO:teuthology.orchestra.run.smithi184.stdout:(131/144): elfutils-debuginfod-client-0.189-2.e 396 kB/s | 76 kB 00:00 2023-07-11T00:27:16.831 INFO:teuthology.orchestra.run.smithi022.stdout:(82/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 518 kB/s | 99 kB 00:00 2023-07-11T00:27:16.931 INFO:teuthology.orchestra.run.smithi022.stdout:(83/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 108 kB/s | 18 kB 00:00 2023-07-11T00:27:16.956 INFO:teuthology.orchestra.run.smithi022.stdout:(84/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 262 kB/s | 44 kB 00:00 2023-07-11T00:27:16.967 INFO:teuthology.orchestra.run.smithi184.stdout:(132/144): librados2-18.0.0-4828.gb5891ed6.el8. 5.3 MB/s | 3.7 MB 00:00 2023-07-11T00:27:16.992 INFO:teuthology.orchestra.run.smithi184.stdout:(133/144): elfutils-libelf-0.189-2.el8.x86_64.r 958 kB/s | 232 kB 00:00 2023-07-11T00:27:17.126 INFO:teuthology.orchestra.run.smithi184.stdout:(134/144): elfutils-libs-0.189-2.el8.x86_64.rpm 980 kB/s | 302 kB 00:00 2023-07-11T00:27:17.206 INFO:teuthology.orchestra.run.smithi022.stdout:(85/144): pcre2-devel-10.32-3.el8.x86_64.rpm 2.1 MB/s | 605 kB 00:00 2023-07-11T00:27:17.273 INFO:teuthology.orchestra.run.smithi022.stdout:(86/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 724 kB/s | 229 kB 00:00 2023-07-11T00:27:17.284 INFO:teuthology.orchestra.run.smithi184.stdout:(135/144): iproute-6.2.0-2.el8.x86_64.rpm 2.7 MB/s | 880 kB 00:00 2023-07-11T00:27:17.318 INFO:teuthology.orchestra.run.smithi184.stdout:(136/144): libblkid-2.32.1-42.el8.x86_64.rpm 677 kB/s | 220 kB 00:00 2023-07-11T00:27:17.468 INFO:teuthology.orchestra.run.smithi184.stdout:(137/144): libfdisk-2.32.1-42.el8.x86_64.rpm 741 kB/s | 253 kB 00:00 2023-07-11T00:27:17.490 INFO:teuthology.orchestra.run.smithi022.stdout:(87/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 778 kB/s | 220 kB 00:00 2023-07-11T00:27:17.543 INFO:teuthology.orchestra.run.smithi184.stdout:(138/144): libsmartcols-2.32.1-42.el8.x86_64.rp 796 kB/s | 179 kB 00:00 2023-07-11T00:27:17.549 INFO:teuthology.orchestra.run.smithi022.stdout:(88/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 4.4 MB/s | 3.2 MB 00:00 2023-07-11T00:27:17.574 INFO:teuthology.orchestra.run.smithi022.stdout:(89/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 828 kB/s | 249 kB 00:00 2023-07-11T00:27:17.610 INFO:teuthology.orchestra.run.smithi184.stdout:(139/144): libmount-2.32.1-42.el8.x86_64.rpm 726 kB/s | 236 kB 00:00 2023-07-11T00:27:17.686 INFO:teuthology.orchestra.run.smithi184.stdout:(140/144): libuuid-2.32.1-42.el8.x86_64.rpm 454 kB/s | 98 kB 00:00 2023-07-11T00:27:17.716 INFO:teuthology.orchestra.run.smithi022.stdout:(90/144): python3-jwt-1.6.1-2.el8.noarch.rpm 256 kB/s | 43 kB 00:00 2023-07-11T00:27:17.825 INFO:teuthology.orchestra.run.smithi022.stdout:(91/144): python3-oauthlib-2.1.0-1.el8.noarch.r 619 kB/s | 155 kB 00:00 2023-07-11T00:27:17.827 INFO:teuthology.orchestra.run.smithi184.stdout:(141/144): util-linux-user-2.32.1-42.el8.x86_64 472 kB/s | 102 kB 00:00 2023-07-11T00:27:17.850 INFO:teuthology.orchestra.run.smithi022.stdout:(92/144): python3-cryptography-3.2.1-6.el8.x86_ 1.7 MB/s | 641 kB 00:00 2023-07-11T00:27:17.975 INFO:teuthology.orchestra.run.smithi022.stdout:(93/144): python3-pycparser-2.14-14.el8.noarch. 421 kB/s | 109 kB 00:00 2023-07-11T00:27:18.000 INFO:teuthology.orchestra.run.smithi022.stdout:(94/144): python3-requests-oauthlib-1.0.0-1.el8 243 kB/s | 43 kB 00:00 2023-07-11T00:27:18.026 INFO:teuthology.orchestra.run.smithi022.stdout:(95/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 425 kB/s | 74 kB 00:00 2023-07-11T00:27:18.036 INFO:teuthology.orchestra.run.smithi184.stdout:(142/144): util-linux-2.32.1-42.el8.x86_64.rpm 5.3 MB/s | 2.6 MB 00:00 2023-07-11T00:27:18.070 INFO:teuthology.orchestra.run.smithi184.stdout:(143/144): xfsdump-3.1.8-6.el8.x86_64.rpm 870 kB/s | 334 kB 00:00 2023-07-11T00:27:18.135 INFO:teuthology.orchestra.run.smithi022.stdout:(96/144): liboath-2.6.2-3.el8.x86_64.rpm 543 kB/s | 59 kB 00:00 2023-07-11T00:27:18.185 INFO:teuthology.orchestra.run.smithi022.stdout:(97/144): gperftools-libs-2.7-9.el8.x86_64.rpm 1.6 MB/s | 306 kB 00:00 2023-07-11T00:27:18.210 INFO:teuthology.orchestra.run.smithi022.stdout:(98/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 248 kB/s | 58 kB 00:00 2023-07-11T00:27:18.235 INFO:teuthology.orchestra.run.smithi022.stdout:(99/144): libunwind-1.3.1-3.el8.x86_64.rpm 750 kB/s | 75 kB 00:00 2023-07-11T00:27:18.261 INFO:teuthology.orchestra.run.smithi022.stdout:(100/144): python3-bcrypt-3.1.6-2.el8.1.x86_64. 875 kB/s | 44 kB 00:00 2023-07-11T00:27:18.294 INFO:teuthology.orchestra.run.smithi022.stdout:(101/144): python3-asyncssh-2.7.0-2.el8.noarch. 4.3 MB/s | 476 kB 00:00 2023-07-11T00:27:18.320 INFO:teuthology.orchestra.run.smithi022.stdout:(102/144): python3-cachetools-3.1.1-4.el8.noarc 564 kB/s | 33 kB 00:00 2023-07-11T00:27:18.345 INFO:teuthology.orchestra.run.smithi022.stdout:(103/144): python3-certifi-2018.10.15-7.el8.noa 328 kB/s | 16 kB 00:00 2023-07-11T00:27:18.353 INFO:teuthology.orchestra.run.smithi184.stdout:(144/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 2.1 MB/s | 1.1 MB 00:00 2023-07-11T00:27:18.357 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-07-11T00:27:18.358 INFO:teuthology.orchestra.run.smithi184.stdout:Total 13 MB/s | 212 MB 00:16 2023-07-11T00:27:18.370 INFO:teuthology.orchestra.run.smithi022.stdout:(104/144): python3-cheroot-8.5.2-1.el8.noarch.r 3.4 MB/s | 173 kB 00:00 2023-07-11T00:27:18.404 INFO:teuthology.orchestra.run.smithi022.stdout:(105/144): python3-beautifulsoup4-4.6.3-2.el8.1 1.1 MB/s | 185 kB 00:00 2023-07-11T00:27:18.429 INFO:teuthology.orchestra.run.smithi022.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 1.4 MB/s | 81 kB 00:00 2023-07-11T00:27:18.454 INFO:teuthology.orchestra.run.smithi022.stdout:(107/144): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2023-07-11T00:27:18.480 INFO:teuthology.orchestra.run.smithi022.stdout:(108/144): python3-jaraco-functools-2.0-4.el8.n 352 kB/s | 18 kB 00:00 2023-07-11T00:27:18.513 INFO:teuthology.orchestra.run.smithi022.stdout:(109/144): python3-cherrypy-18.4.0-1.el8.noarch 2.2 MB/s | 384 kB 00:00 2023-07-11T00:27:18.541 INFO:teuthology.orchestra.run.smithi022.stdout:(110/144): python3-logutils-0.3.5-11.el8.noarch 837 kB/s | 49 kB 00:00 2023-07-11T00:27:18.564 INFO:teuthology.orchestra.run.smithi022.stdout:(111/144): python3-more-itertools-7.2.0-3.el8.n 1.2 MB/s | 59 kB 00:00 2023-07-11T00:27:18.589 INFO:teuthology.orchestra.run.smithi022.stdout:(112/144): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2023-07-11T00:27:18.631 INFO:teuthology.orchestra.run.smithi022.stdout:(113/144): python3-kubernetes-11.0.0-6.el8.noar 6.6 MB/s | 1.2 MB 00:00 2023-07-11T00:27:18.656 INFO:teuthology.orchestra.run.smithi022.stdout:(114/144): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-07-11T00:27:18.682 INFO:teuthology.orchestra.run.smithi022.stdout:(115/144): python3-repoze-lru-0.7-6.el8.noarch. 672 kB/s | 34 kB 00:00 2023-07-11T00:27:18.709 INFO:teuthology.orchestra.run.smithi022.stdout:(116/144): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2023-07-11T00:27:18.740 INFO:teuthology.orchestra.run.smithi022.stdout:(117/144): python3-routes-2.4.1-12.el8.noarch.r 2.3 MB/s | 196 kB 00:00 2023-07-11T00:27:18.766 INFO:teuthology.orchestra.run.smithi022.stdout:(118/144): python3-rsa-4.8-1.el8.noarch.rpm 736 kB/s | 61 kB 00:00 2023-07-11T00:27:18.791 INFO:teuthology.orchestra.run.smithi022.stdout:(119/144): python3-simplegeneric-0.8.1-17.el8.n 224 kB/s | 19 kB 00:00 2023-07-11T00:27:18.816 INFO:teuthology.orchestra.run.smithi022.stdout:(120/144): python3-singledispatch-3.4.0.3-18.el 479 kB/s | 24 kB 00:00 2023-07-11T00:27:18.841 INFO:teuthology.orchestra.run.smithi022.stdout:(121/144): python3-tempora-1.14.1-5.el8.noarch. 391 kB/s | 29 kB 00:00 2023-07-11T00:27:18.868 INFO:teuthology.orchestra.run.smithi022.stdout:(122/144): python3-trustme-0.6.0-4.el8.noarch.r 356 kB/s | 27 kB 00:00 2023-07-11T00:27:18.894 INFO:teuthology.orchestra.run.smithi022.stdout:(123/144): python3-waitress-1.4.3-1.el8.noarch. 4.8 MB/s | 255 kB 00:00 2023-07-11T00:27:18.919 INFO:teuthology.orchestra.run.smithi022.stdout:(124/144): python3-webob-1.8.5-1.el8.1.noarch.r 3.2 MB/s | 251 kB 00:00 2023-07-11T00:27:18.944 INFO:teuthology.orchestra.run.smithi022.stdout:(125/144): python3-websocket-client-0.56.0-5.el 815 kB/s | 61 kB 00:00 2023-07-11T00:27:18.970 INFO:teuthology.orchestra.run.smithi022.stdout:(126/144): python3-zc-lockfile-2.0-2.el8.noarch 460 kB/s | 23 kB 00:00 2023-07-11T00:27:18.995 INFO:teuthology.orchestra.run.smithi022.stdout:(127/144): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2023-07-11T00:27:19.328 INFO:teuthology.orchestra.run.smithi022.stdout:(128/144): thrift-0.13.0-2.el8.x86_64.rpm 4.5 MB/s | 1.7 MB 00:00 2023-07-11T00:27:19.637 INFO:teuthology.orchestra.run.smithi022.stdout:(129/144): NetworkManager-initscripts-updown-1. 465 kB/s | 143 kB 00:00 2023-07-11T00:27:19.854 INFO:teuthology.orchestra.run.smithi022.stdout:(130/144): elfutils-debuginfod-client-0.189-2.e 350 kB/s | 76 kB 00:00 2023-07-11T00:27:20.054 INFO:teuthology.orchestra.run.smithi022.stdout:(131/144): elfutils-libelf-0.189-2.el8.x86_64.r 1.1 MB/s | 232 kB 00:00 2023-07-11T00:27:20.158 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-07-11T00:27:20.230 INFO:teuthology.orchestra.run.smithi022.stdout:(132/144): librados2-18.0.0-4828.gb5891ed6.el8. 2.9 MB/s | 3.7 MB 00:01 2023-07-11T00:27:20.405 INFO:teuthology.orchestra.run.smithi022.stdout:(133/144): elfutils-libs-0.189-2.el8.x86_64.rpm 864 kB/s | 302 kB 00:00 2023-07-11T00:27:20.572 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-07-11T00:27:20.573 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-07-11T00:27:20.614 INFO:teuthology.orchestra.run.smithi022.stdout:(134/144): libblkid-2.32.1-42.el8.x86_64.rpm 1.0 MB/s | 220 kB 00:00 2023-07-11T00:27:20.672 INFO:teuthology.orchestra.run.smithi022.stdout:(135/144): librbd1-18.0.0-4828.gb5891ed6.el8.x8 2.1 MB/s | 3.6 MB 00:01 2023-07-11T00:27:20.706 INFO:teuthology.orchestra.run.smithi022.stdout:(136/144): iproute-6.2.0-2.el8.x86_64.rpm 1.8 MB/s | 880 kB 00:00 2023-07-11T00:27:20.873 INFO:teuthology.orchestra.run.smithi022.stdout:(137/144): libfdisk-2.32.1-42.el8.x86_64.rpm 980 kB/s | 253 kB 00:00 2023-07-11T00:27:20.908 INFO:teuthology.orchestra.run.smithi022.stdout:(138/144): libsmartcols-2.32.1-42.el8.x86_64.rp 897 kB/s | 179 kB 00:00 2023-07-11T00:27:21.002 INFO:teuthology.orchestra.run.smithi022.stdout:(139/144): libmount-2.32.1-42.el8.x86_64.rpm 726 kB/s | 236 kB 00:00 2023-07-11T00:27:21.050 INFO:teuthology.orchestra.run.smithi022.stdout:(140/144): libuuid-2.32.1-42.el8.x86_64.rpm 562 kB/s | 98 kB 00:00 2023-07-11T00:27:21.266 INFO:teuthology.orchestra.run.smithi022.stdout:(141/144): util-linux-user-2.32.1-42.el8.x86_64 384 kB/s | 102 kB 00:00 2023-07-11T00:27:21.325 INFO:teuthology.orchestra.run.smithi022.stdout:(142/144): xfsdump-3.1.8-6.el8.x86_64.rpm 1.2 MB/s | 334 kB 00:00 2023-07-11T00:27:21.558 INFO:teuthology.orchestra.run.smithi022.stdout:(143/144): util-linux-2.32.1-42.el8.x86_64.rpm 4.0 MB/s | 2.6 MB 00:00 2023-07-11T00:27:21.616 INFO:teuthology.orchestra.run.smithi022.stdout:(144/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 3.1 MB/s | 1.1 MB 00:00 2023-07-11T00:27:21.620 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-07-11T00:27:21.620 INFO:teuthology.orchestra.run.smithi022.stdout:Total 11 MB/s | 212 MB 00:19 2023-07-11T00:27:22.099 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-07-11T00:27:22.103 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-07-11T00:27:23.481 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-07-11T00:27:23.920 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-07-11T00:27:23.920 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-07-11T00:27:25.455 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-07-11T00:27:25.462 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-07-11T00:27:27.401 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-07-11T00:27:27.619 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-11T00:27:27.792 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-11T00:27:27.932 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-11T00:27:28.032 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-11T00:27:28.173 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-11T00:27:28.268 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-11T00:27:28.443 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-11T00:27:28.620 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-11T00:27:28.801 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-11T00:27:28.931 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-11T00:27:29.370 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-11T00:27:29.539 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-11T00:27:30.002 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-11T00:27:30.181 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-11T00:27:30.328 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-11T00:27:30.498 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-11T00:27:30.617 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-11T00:27:30.735 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-07-11T00:27:30.774 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-11T00:27:30.889 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-11T00:27:30.972 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-11T00:27:31.115 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-11T00:27:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-11T00:27:31.306 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-11T00:27:31.309 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-11T00:27:31.401 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-11T00:27:31.410 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-11T00:27:31.559 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-11T00:27:31.598 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-11T00:27:31.653 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-11T00:27:31.799 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-11T00:27:31.837 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-11T00:27:32.048 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-11T00:27:32.243 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-11T00:27:32.265 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-11T00:27:32.425 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-11T00:27:32.435 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-11T00:27:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-11T00:27:32.685 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-11T00:27:32.798 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-11T00:27:32.913 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-11T00:27:32.947 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-11T00:27:33.117 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-11T00:27:33.156 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-11T00:27:33.303 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-11T00:27:33.424 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-11T00:27:33.578 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-11T00:27:33.600 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-11T00:27:33.722 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-11T00:27:33.783 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-11T00:27:33.937 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-11T00:27:34.108 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-11T00:27:34.222 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-11T00:27:34.381 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-11T00:27:34.504 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-11T00:27:34.572 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-11T00:27:34.650 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-11T00:27:34.884 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-11T00:27:35.058 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-11T00:27:35.148 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-11T00:27:35.271 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-11T00:27:35.362 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-11T00:27:35.423 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-11T00:27:35.562 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-11T00:27:36.173 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-11T00:27:36.244 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-11T00:27:36.389 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-11T00:27:36.542 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-11T00:27:36.583 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-11T00:27:36.672 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-11T00:27:36.773 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-11T00:27:36.833 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-11T00:27:36.928 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-11T00:27:36.988 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-11T00:27:37.142 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-11T00:27:37.204 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-11T00:27:37.371 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 30/160 2023-07-11T00:27:37.471 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-11T00:27:37.509 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 31/160 2023-07-11T00:27:37.600 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-11T00:27:37.730 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 32/160 2023-07-11T00:27:37.771 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-11T00:27:37.916 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-11T00:27:38.630 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-11T00:27:38.791 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-11T00:27:38.816 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-11T00:27:39.146 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-11T00:27:39.432 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-11T00:27:39.557 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-11T00:27:39.607 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-11T00:27:39.724 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-11T00:27:40.601 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-11T00:27:41.225 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-11T00:27:41.417 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-11T00:27:41.585 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-11T00:27:41.703 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-11T00:27:41.773 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-11T00:27:41.999 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 30/160 2023-07-11T00:27:42.025 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-11T00:27:42.150 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 31/160 2023-07-11T00:27:42.197 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-11T00:27:42.376 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/160 2023-07-11T00:27:42.429 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 32/160 2023-07-11T00:27:42.554 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 40/160 2023-07-11T00:27:42.724 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 41/160 2023-07-11T00:27:42.906 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-11T00:27:43.087 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-11T00:27:43.287 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-11T00:27:43.386 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-11T00:27:43.545 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-11T00:27:43.567 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-11T00:27:43.630 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-11T00:27:43.758 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-11T00:27:43.924 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-11T00:27:43.937 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-11T00:27:44.256 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-11T00:27:44.449 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-11T00:27:44.536 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-11T00:27:44.796 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-11T00:27:44.825 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-11T00:27:45.029 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-11T00:27:45.357 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-11T00:27:45.576 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-11T00:27:45.734 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-11T00:27:45.883 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-11T00:27:46.058 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-11T00:27:46.265 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-11T00:27:46.469 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-11T00:27:46.649 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-11T00:27:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-11T00:27:46.795 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-11T00:27:46.967 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-11T00:27:46.996 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-11T00:27:47.143 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-11T00:27:47.204 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-11T00:27:47.304 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-11T00:27:47.414 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/160 2023-07-11T00:27:47.468 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-11T00:27:47.627 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 40/160 2023-07-11T00:27:47.688 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-11T00:27:47.855 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 41/160 2023-07-11T00:27:47.935 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-11T00:27:48.077 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-11T00:27:48.136 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-11T00:27:48.298 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-11T00:27:48.497 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-11T00:27:48.525 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-11T00:27:48.626 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-11T00:27:48.740 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-11T00:27:48.815 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-11T00:27:48.893 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-11T00:27:48.933 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-11T00:27:49.062 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-11T00:27:49.281 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-11T00:27:49.726 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-11T00:27:49.906 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-11T00:27:49.911 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-11T00:27:49.989 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-11T00:27:50.165 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-11T00:27:50.188 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 71/160 2023-07-11T00:27:50.196 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-11T00:27:50.424 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-11T00:27:50.519 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-11T00:27:50.738 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-11T00:27:50.921 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-11T00:27:51.000 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-11T00:27:51.170 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-11T00:27:51.170 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-11T00:27:51.329 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-11T00:27:51.367 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-11T00:27:51.532 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-11T00:27:51.623 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-11T00:27:51.723 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-11T00:27:51.829 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-11T00:27:51.931 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-11T00:27:52.110 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-11T00:27:52.280 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-11T00:27:52.456 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-11T00:27:52.655 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-11T00:27:52.817 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-11T00:27:53.020 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-11T00:27:53.092 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-11T00:27:53.264 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-11T00:27:53.471 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-11T00:27:53.526 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-11T00:27:53.679 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-11T00:27:53.724 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-11T00:27:53.921 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-11T00:27:54.088 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-11T00:27:54.201 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-11T00:27:54.350 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-11T00:27:54.440 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-11T00:27:54.554 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-11T00:27:54.673 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-11T00:27:54.919 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-11T00:27:55.251 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-11T00:27:55.448 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-11T00:27:55.483 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-11T00:27:55.638 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-11T00:27:55.663 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-11T00:27:55.738 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-11T00:27:55.779 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-11T00:27:55.961 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 71/160 2023-07-11T00:27:56.092 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-11T00:27:56.290 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-11T00:27:56.307 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-11T00:27:56.434 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-11T00:27:56.618 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-11T00:27:56.750 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-11T00:27:56.821 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-11T00:27:57.022 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-11T00:27:57.023 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-11T00:27:57.206 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-11T00:27:57.218 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-11T00:27:57.377 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-11T00:27:57.457 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-11T00:27:57.499 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-11T00:27:57.658 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-11T00:27:57.678 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-11T00:27:57.802 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-11T00:27:59.008 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-11T00:27:59.392 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-11T00:27:59.632 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-11T00:27:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-11T00:28:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-11T00:28:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-11T00:28:00.661 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-11T00:28:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-11T00:28:01.002 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-11T00:28:01.068 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-11T00:28:01.435 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-11T00:28:01.652 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-11T00:28:01.741 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-11T00:28:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-11T00:28:02.000 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-11T00:28:02.029 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-11T00:28:02.233 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-11T00:28:02.362 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-11T00:28:02.434 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-11T00:28:02.593 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-11T00:28:02.754 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-11T00:28:02.933 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-11T00:28:03.165 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-11T00:28:03.390 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-11T00:28:03.601 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-11T00:28:03.779 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-11T00:28:03.908 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-11T00:28:04.132 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-11T00:28:04.279 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-11T00:28:07.376 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-11T00:28:07.645 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-11T00:28:08.368 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-11T00:28:08.666 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-11T00:28:08.872 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-11T00:28:09.087 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-11T00:28:23.011 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-11T00:28:23.012 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /sys 2023-07-11T00:28:23.012 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /proc 2023-07-11T00:28:23.012 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /dev 2023-07-11T00:28:23.012 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /run 2023-07-11T00:28:23.012 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /mnt 2023-07-11T00:28:23.012 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /var/tmp 2023-07-11T00:28:23.013 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /home 2023-07-11T00:28:23.013 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /tmp 2023-07-11T00:28:23.013 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /dev 2023-07-11T00:28:23.013 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:28:23.413 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-11T00:28:25.130 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-11T00:28:25.366 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-11T00:28:25.633 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-11T00:28:25.813 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-11T00:28:26.340 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-11T00:28:26.530 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-11T00:28:26.579 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-11T00:28:26.773 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-11T00:28:26.975 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-11T00:28:27.146 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-11T00:28:27.240 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-11T00:28:27.533 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-11T00:28:27.772 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-11T00:28:28.377 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-11T00:28:28.552 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-11T00:28:28.671 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 113/160 2023-07-11T00:28:28.860 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 114/160 2023-07-11T00:28:29.088 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-11T00:28:29.346 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-11T00:28:29.573 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-11T00:28:30.510 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-11T00:28:30.510 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /sys 2023-07-11T00:28:30.510 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /proc 2023-07-11T00:28:30.511 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /dev 2023-07-11T00:28:30.511 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /run 2023-07-11T00:28:30.511 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /mnt 2023-07-11T00:28:30.511 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /var/tmp 2023-07-11T00:28:30.511 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /home 2023-07-11T00:28:30.511 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /tmp 2023-07-11T00:28:30.511 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /dev 2023-07-11T00:28:30.512 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:28:30.685 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-11T00:28:30.854 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-11T00:28:30.946 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-11T00:28:30.982 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-11T00:28:31.372 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 118/160 2023-07-11T00:28:31.574 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-11T00:28:31.638 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-11T00:28:31.829 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-11T00:28:31.855 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-11T00:28:32.074 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 121/160 2023-07-11T00:28:32.229 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-11T00:28:32.786 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-11T00:28:33.045 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-11T00:28:33.328 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-11T00:28:33.541 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-11T00:28:34.100 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-11T00:28:34.316 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-11T00:28:34.366 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-11T00:28:34.567 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-11T00:28:34.778 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-11T00:28:34.924 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-11T00:28:35.024 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-11T00:28:35.369 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-11T00:28:35.599 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-11T00:28:36.219 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-11T00:28:36.397 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-11T00:28:36.507 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 113/160 2023-07-11T00:28:36.731 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 114/160 2023-07-11T00:28:36.965 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-11T00:28:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-11T00:28:37.243 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-11T00:28:37.468 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-11T00:28:38.653 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-11T00:28:38.698 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 123/160 2023-07-11T00:28:38.846 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-11T00:28:38.931 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-11T00:28:38.972 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-11T00:28:38.991 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-11T00:28:39.170 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-11T00:28:39.239 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-11T00:28:39.369 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 118/160 2023-07-11T00:28:39.420 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-11T00:28:39.602 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-11T00:28:39.668 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-11T00:28:39.827 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-11T00:28:39.864 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-11T00:28:39.892 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-11T00:28:40.053 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-11T00:28:40.115 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 121/160 2023-07-11T00:28:40.331 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-11T00:28:40.350 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-11T00:28:40.640 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-11T00:28:41.863 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-11T00:28:42.158 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-11T00:28:42.368 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-11T00:28:42.550 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-11T00:28:42.707 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-11T00:28:42.895 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 134/160 2023-07-11T00:28:44.098 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-11T00:28:44.353 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-11T00:28:44.436 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-11T00:28:44.657 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-11T00:28:44.886 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 137/160 2023-07-11T00:28:45.087 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 138/160 2023-07-11T00:28:45.445 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 139/160 2023-07-11T00:28:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-11T00:28:45.712 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-11T00:28:45.868 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-11T00:28:45.892 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-11T00:28:46.091 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-11T00:28:46.384 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-11T00:28:46.492 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-11T00:28:46.743 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-11T00:28:46.769 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-11T00:28:46.928 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-11T00:28:47.106 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-11T00:28:47.246 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 123/160 2023-07-11T00:28:47.289 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-11T00:28:47.289 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-11T00:28:47.501 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-11T00:28:47.522 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-11T00:28:47.523 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-11T00:28:47.563 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-11T00:28:47.747 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-11T00:28:47.754 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-11T00:28:47.770 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-11T00:28:47.818 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-11T00:28:47.874 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-11T00:28:47.874 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-11T00:28:48.039 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-11T00:28:48.124 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-11T00:28:48.303 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-11T00:28:48.450 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-11T00:28:48.470 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-11T00:28:48.661 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-11T00:28:48.662 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-11T00:28:48.689 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-11T00:28:48.904 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-11T00:28:48.905 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-11T00:28:48.990 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-11T00:28:49.105 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-11T00:28:49.105 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-11T00:28:49.306 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-11T00:28:49.322 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-11T00:28:49.322 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-11T00:28:49.529 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-11T00:28:49.530 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-11T00:28:49.787 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-11T00:28:49.986 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-11T00:28:50.190 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-11T00:28:50.190 INFO:teuthology.orchestra.run.smithi184.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-11T00:28:50.190 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:28:50.610 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-11T00:28:50.919 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 1/160 2023-07-11T00:28:50.920 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2/160 2023-07-11T00:28:50.920 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 3/160 2023-07-11T00:28:50.920 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 4/160 2023-07-11T00:28:50.920 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 5/160 2023-07-11T00:28:50.920 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 6/160 2023-07-11T00:28:50.920 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 7/160 2023-07-11T00:28:50.920 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-11T00:28:50.921 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-11T00:28:50.921 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-11T00:28:50.921 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-11T00:28:50.921 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 12/160 2023-07-11T00:28:50.921 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 13/160 2023-07-11T00:28:50.921 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 14/160 2023-07-11T00:28:50.921 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 15/160 2023-07-11T00:28:50.921 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 16/160 2023-07-11T00:28:50.922 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 17/160 2023-07-11T00:28:50.922 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 18/160 2023-07-11T00:28:50.922 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 19/160 2023-07-11T00:28:50.922 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 20/160 2023-07-11T00:28:50.922 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 21/160 2023-07-11T00:28:50.922 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 22/160 2023-07-11T00:28:50.922 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 23/160 2023-07-11T00:28:50.923 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 24/160 2023-07-11T00:28:50.923 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 25/160 2023-07-11T00:28:50.923 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 26/160 2023-07-11T00:28:50.923 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 27/160 2023-07-11T00:28:50.923 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 28/160 2023-07-11T00:28:50.923 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 29/160 2023-07-11T00:28:50.923 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 30/160 2023-07-11T00:28:50.923 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 31/160 2023-07-11T00:28:50.932 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 32/160 2023-07-11T00:28:50.932 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 33/160 2023-07-11T00:28:50.932 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 34/160 2023-07-11T00:28:50.932 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 35/160 2023-07-11T00:28:50.933 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 36/160 2023-07-11T00:28:50.933 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 37/160 2023-07-11T00:28:50.933 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 38/160 2023-07-11T00:28:50.933 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-11T00:28:50.933 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-11T00:28:50.933 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-11T00:28:50.933 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-11T00:28:50.934 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-11T00:28:50.934 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-11T00:28:50.934 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-11T00:28:50.934 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-11T00:28:50.934 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-11T00:28:50.934 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-11T00:28:50.934 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-11T00:28:50.934 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-11T00:28:50.935 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-11T00:28:50.935 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-11T00:28:50.935 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-11T00:28:50.935 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-11T00:28:50.935 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-11T00:28:50.935 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-11T00:28:50.936 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-11T00:28:50.936 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-11T00:28:50.936 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-11T00:28:50.936 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-11T00:28:50.936 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-11T00:28:50.936 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-11T00:28:50.937 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-11T00:28:50.937 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-11T00:28:50.937 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-11T00:28:50.937 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-11T00:28:50.937 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-11T00:28:50.937 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-11T00:28:50.937 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-11T00:28:50.937 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-11T00:28:50.938 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-11T00:28:50.938 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-11T00:28:50.938 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-11T00:28:50.938 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-11T00:28:50.938 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-11T00:28:50.938 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-11T00:28:50.938 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-11T00:28:50.939 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-11T00:28:50.939 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-11T00:28:50.939 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-11T00:28:50.939 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-11T00:28:50.939 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-11T00:28:50.940 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-11T00:28:50.940 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-11T00:28:50.940 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-11T00:28:50.940 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-11T00:28:50.940 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-11T00:28:50.940 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-11T00:28:50.941 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-11T00:28:50.941 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-11T00:28:50.941 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-11T00:28:50.941 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-11T00:28:50.941 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-11T00:28:50.941 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-11T00:28:50.941 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-11T00:28:50.941 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-11T00:28:50.942 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-11T00:28:50.942 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-11T00:28:50.942 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-11T00:28:50.942 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-11T00:28:50.943 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-11T00:28:50.943 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-11T00:28:50.943 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-11T00:28:50.943 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-11T00:28:50.943 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-11T00:28:50.943 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-11T00:28:50.943 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-11T00:28:50.944 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-11T00:28:50.944 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-11T00:28:50.944 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-11T00:28:50.944 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-11T00:28:50.944 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-11T00:28:50.944 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-11T00:28:50.944 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-11T00:28:50.945 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-11T00:28:50.945 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-11T00:28:50.945 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-11T00:28:50.945 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/160 2023-07-11T00:28:50.945 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-11T00:28:50.945 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-11T00:28:50.945 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-11T00:28:50.946 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-11T00:28:50.946 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-11T00:28:50.946 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-11T00:28:50.947 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-11T00:28:50.947 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-11T00:28:50.947 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-11T00:28:50.947 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-11T00:28:50.947 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-11T00:28:50.948 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-11T00:28:50.948 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 131/160 2023-07-11T00:28:50.948 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-11T00:28:50.948 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-11T00:28:50.949 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-11T00:28:50.950 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-11T00:28:50.950 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-11T00:28:50.950 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-11T00:28:50.950 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-11T00:28:50.950 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-11T00:28:50.950 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-11T00:28:50.950 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-11T00:28:50.951 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-11T00:28:50.951 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-11T00:28:50.951 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-11T00:28:50.951 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-11T00:28:50.951 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-11T00:28:50.951 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-11T00:28:50.951 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-11T00:28:50.951 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-11T00:28:50.952 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-11T00:28:50.952 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-11T00:28:50.952 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-11T00:28:50.952 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-11T00:28:50.952 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-11T00:28:50.952 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-11T00:28:50.952 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-11T00:28:50.953 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-11T00:28:50.953 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-11T00:28:50.953 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-11T00:28:50.953 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-11T00:28:51.162 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-11T00:28:51.361 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-11T00:28:51.510 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-11T00:28:51.739 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 134/160 2023-07-11T00:28:52.986 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-11T00:28:53.029 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-11T00:28:53.029 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:28:53.029 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2023-07-11T00:28:53.029 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-11T00:28:53.029 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-11T00:28:53.030 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-11T00:28:53.030 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-11T00:28:53.030 INFO:teuthology.orchestra.run.smithi184.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-11T00:28:53.031 INFO:teuthology.orchestra.run.smithi184.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-11T00:28:53.031 INFO:teuthology.orchestra.run.smithi184.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-11T00:28:53.031 INFO:teuthology.orchestra.run.smithi184.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-11T00:28:53.032 INFO:teuthology.orchestra.run.smithi184.stdout: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.032 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.032 INFO:teuthology.orchestra.run.smithi184.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-11T00:28:53.032 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-11T00:28:53.033 INFO:teuthology.orchestra.run.smithi184.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-11T00:28:53.033 INFO:teuthology.orchestra.run.smithi184.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-11T00:28:53.033 INFO:teuthology.orchestra.run.smithi184.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-11T00:28:53.033 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-11T00:28:53.034 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-07-11T00:28:53.034 INFO:teuthology.orchestra.run.smithi184.stdout: automake-1.16.1-7.el8.noarch 2023-07-11T00:28:53.034 INFO:teuthology.orchestra.run.smithi184.stdout: bison-3.0.4-10.el8.x86_64 2023-07-11T00:28:53.034 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.035 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.036 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.036 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.036 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:28:53.036 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.037 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.037 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.037 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:28:53.037 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:28:53.038 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:28:53.038 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:28:53.038 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:28:53.038 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.039 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.039 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:28:53.039 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.039 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.040 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.040 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:28:53.040 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:28:53.040 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.041 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:28:53.041 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-11T00:28:53.041 INFO:teuthology.orchestra.run.smithi184.stdout: flex-2.6.1-9.el8.x86_64 2023-07-11T00:28:53.041 INFO:teuthology.orchestra.run.smithi184.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-11T00:28:53.042 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-11T00:28:53.042 INFO:teuthology.orchestra.run.smithi184.stdout: jq-1.6-7.el8.x86_64 2023-07-11T00:28:53.042 INFO:teuthology.orchestra.run.smithi184.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-11T00:28:53.042 INFO:teuthology.orchestra.run.smithi184.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-11T00:28:53.042 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-11T00:28:53.042 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.043 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.043 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.043 INFO:teuthology.orchestra.run.smithi184.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-11T00:28:53.043 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-11T00:28:53.043 INFO:teuthology.orchestra.run.smithi184.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-11T00:28:53.043 INFO:teuthology.orchestra.run.smithi184.stdout: libpq-13.5-1.el8.x86_64 2023-07-11T00:28:53.043 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-11T00:28:53.044 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-11T00:28:53.044 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.044 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.044 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-11T00:28:53.045 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.045 INFO:teuthology.orchestra.run.smithi184.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-11T00:28:53.046 INFO:teuthology.orchestra.run.smithi184.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-11T00:28:53.046 INFO:teuthology.orchestra.run.smithi184.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-11T00:28:53.046 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-11T00:28:53.047 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-11T00:28:53.047 INFO:teuthology.orchestra.run.smithi184.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-11T00:28:53.047 INFO:teuthology.orchestra.run.smithi184.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-11T00:28:53.047 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-11T00:28:53.047 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-11T00:28:53.048 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-11T00:28:53.048 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-11T00:28:53.048 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-11T00:28:53.048 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-11T00:28:53.049 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-11T00:28:53.049 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-11T00:28:53.049 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-11T00:28:53.049 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-11T00:28:53.049 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-11T00:28:53.049 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-11T00:28:53.050 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-11T00:28:53.050 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-11T00:28:53.050 INFO:teuthology.orchestra.run.smithi184.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-11T00:28:53.052 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-11T00:28:53.052 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.052 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.053 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.053 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-11T00:28:53.053 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-11T00:28:53.053 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-11T00:28:53.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-11T00:28:53.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-11T00:28:53.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-11T00:28:53.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-11T00:28:53.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-11T00:28:53.055 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-11T00:28:53.056 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-11T00:28:53.056 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-11T00:28:53.056 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-11T00:28:53.056 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-11T00:28:53.056 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-11T00:28:53.056 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-11T00:28:53.056 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-11T00:28:53.057 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-11T00:28:53.057 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-11T00:28:53.057 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-11T00:28:53.057 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-11T00:28:53.057 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-11T00:28:53.057 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-11T00:28:53.058 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend-2.6-1.el8.noarch 2023-07-11T00:28:53.058 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-11T00:28:53.058 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-11T00:28:53.058 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-11T00:28:53.059 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-11T00:28:53.059 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-11T00:28:53.059 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-11T00:28:53.059 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.059 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.060 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-11T00:28:53.060 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-11T00:28:53.060 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.060 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-11T00:28:53.060 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-11T00:28:53.060 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-11T00:28:53.061 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-11T00:28:53.061 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-11T00:28:53.061 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-11T00:28:53.061 INFO:teuthology.orchestra.run.smithi184.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-11T00:28:53.061 INFO:teuthology.orchestra.run.smithi184.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-11T00:28:53.061 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-11T00:28:53.061 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-11T00:28:53.061 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-11T00:28:53.062 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-11T00:28:53.062 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-11T00:28:53.062 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.062 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.062 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:28:53.062 INFO:teuthology.orchestra.run.smithi184.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-11T00:28:53.062 INFO:teuthology.orchestra.run.smithi184.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-11T00:28:53.063 INFO:teuthology.orchestra.run.smithi184.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-11T00:28:53.063 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-11T00:28:53.063 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-11T00:28:53.063 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-11T00:28:53.064 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:28:53.064 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-07-11T00:28:53.221 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-11T00:28:53.312 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-11T00:28:53.355 DEBUG:teuthology.parallel:result is None 2023-07-11T00:28:53.517 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-11T00:28:53.748 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 137/160 2023-07-11T00:28:53.991 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 138/160 2023-07-11T00:28:54.374 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 139/160 2023-07-11T00:28:54.632 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-11T00:28:54.770 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-11T00:28:54.803 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-11T00:28:54.998 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-11T00:28:55.228 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-11T00:28:55.339 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-11T00:28:55.579 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-11T00:28:55.605 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-11T00:28:55.814 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-11T00:28:56.027 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-11T00:28:56.201 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-11T00:28:56.201 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-11T00:28:56.508 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-11T00:28:56.508 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-11T00:28:56.773 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-11T00:28:56.800 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-11T00:28:56.913 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-11T00:28:56.913 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-11T00:28:57.179 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-11T00:28:57.357 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-11T00:28:57.531 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-11T00:28:57.747 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-11T00:28:57.748 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-11T00:28:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-11T00:28:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-11T00:28:58.174 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-11T00:28:58.174 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-11T00:28:58.381 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-11T00:28:58.382 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-11T00:28:58.591 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-11T00:28:58.592 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-11T00:28:58.819 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-11T00:28:59.013 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-11T00:28:59.229 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-11T00:28:59.229 INFO:teuthology.orchestra.run.smithi022.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-11T00:28:59.229 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:28:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 1/160 2023-07-11T00:28:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2/160 2023-07-11T00:28:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 3/160 2023-07-11T00:28:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 4/160 2023-07-11T00:28:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 5/160 2023-07-11T00:28:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 6/160 2023-07-11T00:28:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 7/160 2023-07-11T00:28:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-11T00:28:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-11T00:28:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-11T00:28:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-11T00:28:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 12/160 2023-07-11T00:28:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 13/160 2023-07-11T00:28:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 14/160 2023-07-11T00:28:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 15/160 2023-07-11T00:28:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 16/160 2023-07-11T00:28:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 17/160 2023-07-11T00:28:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 18/160 2023-07-11T00:28:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 19/160 2023-07-11T00:28:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 20/160 2023-07-11T00:28:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 21/160 2023-07-11T00:28:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 22/160 2023-07-11T00:28:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 23/160 2023-07-11T00:28:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 24/160 2023-07-11T00:28:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 25/160 2023-07-11T00:28:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 26/160 2023-07-11T00:28:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 27/160 2023-07-11T00:28:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 28/160 2023-07-11T00:28:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 29/160 2023-07-11T00:28:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 30/160 2023-07-11T00:28:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 31/160 2023-07-11T00:28:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 32/160 2023-07-11T00:28:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 33/160 2023-07-11T00:28:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 34/160 2023-07-11T00:28:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 35/160 2023-07-11T00:28:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 36/160 2023-07-11T00:28:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 37/160 2023-07-11T00:28:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 38/160 2023-07-11T00:28:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-11T00:28:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-11T00:28:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-11T00:28:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-11T00:28:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-11T00:28:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-11T00:28:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-11T00:28:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-11T00:28:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-11T00:28:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-11T00:28:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-11T00:28:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-11T00:28:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-11T00:28:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-11T00:28:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-11T00:28:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-11T00:28:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-11T00:28:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-11T00:28:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-11T00:28:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-11T00:28:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-11T00:28:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-11T00:28:59.966 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-11T00:28:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-11T00:28:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-11T00:28:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-11T00:28:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-11T00:28:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-11T00:28:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-11T00:28:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-11T00:28:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-11T00:28:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-11T00:28:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-11T00:28:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-11T00:28:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-11T00:28:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-11T00:28:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-11T00:28:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-11T00:28:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-11T00:28:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-11T00:28:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-11T00:28:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-11T00:28:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-11T00:28:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-11T00:28:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-11T00:28:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-11T00:28:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-11T00:28:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-11T00:28:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-11T00:28:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-11T00:28:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-11T00:28:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-11T00:28:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-11T00:28:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-11T00:28:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-11T00:28:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-11T00:28:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-11T00:28:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-11T00:28:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-11T00:28:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-11T00:28:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-11T00:28:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-11T00:28:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-11T00:28:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-11T00:28:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-11T00:28:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-11T00:28:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-11T00:28:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-11T00:28:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-11T00:28:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-11T00:28:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-11T00:28:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-11T00:28:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-11T00:28:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-11T00:28:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-11T00:28:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-11T00:28:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-11T00:28:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-11T00:28:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-11T00:28:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/160 2023-07-11T00:28:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-11T00:28:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-11T00:28:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-11T00:28:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-11T00:28:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-11T00:28:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-11T00:28:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-11T00:28:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-11T00:28:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-11T00:28:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-11T00:28:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-11T00:28:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-11T00:28:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 131/160 2023-07-11T00:28:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-11T00:28:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-11T00:28:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-11T00:28:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-11T00:28:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-11T00:28:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-11T00:28:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-11T00:28:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-11T00:28:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-11T00:28:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-11T00:28:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-11T00:28:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-11T00:28:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-11T00:28:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-11T00:28:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-11T00:28:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-11T00:28:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-11T00:28:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-11T00:28:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-11T00:28:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-11T00:28:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-11T00:28:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-11T00:28:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-11T00:28:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-11T00:28:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-11T00:28:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-11T00:28:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-11T00:28:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-11T00:29:02.099 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-11T00:29:02.100 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:02.100 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2023-07-11T00:29:02.100 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-11T00:29:02.100 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-11T00:29:02.100 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-11T00:29:02.101 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-11T00:29:02.101 INFO:teuthology.orchestra.run.smithi022.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-11T00:29:02.101 INFO:teuthology.orchestra.run.smithi022.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-11T00:29:02.101 INFO:teuthology.orchestra.run.smithi022.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-11T00:29:02.101 INFO:teuthology.orchestra.run.smithi022.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-11T00:29:02.101 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.102 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.102 INFO:teuthology.orchestra.run.smithi022.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-11T00:29:02.102 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-11T00:29:02.102 INFO:teuthology.orchestra.run.smithi022.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-11T00:29:02.103 INFO:teuthology.orchestra.run.smithi022.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-11T00:29:02.104 INFO:teuthology.orchestra.run.smithi022.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-11T00:29:02.104 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-11T00:29:02.104 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-07-11T00:29:02.104 INFO:teuthology.orchestra.run.smithi022.stdout: automake-1.16.1-7.el8.noarch 2023-07-11T00:29:02.104 INFO:teuthology.orchestra.run.smithi022.stdout: bison-3.0.4-10.el8.x86_64 2023-07-11T00:29:02.105 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.105 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.105 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.105 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.105 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:29:02.105 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.105 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.106 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.106 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:29:02.106 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:29:02.106 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:29:02.106 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:29:02.106 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:29:02.106 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.106 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.107 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:29:02.107 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.107 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.107 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.107 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:29:02.107 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:29:02.107 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.108 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-11T00:29:02.108 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-11T00:29:02.108 INFO:teuthology.orchestra.run.smithi022.stdout: flex-2.6.1-9.el8.x86_64 2023-07-11T00:29:02.118 INFO:teuthology.orchestra.run.smithi022.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-11T00:29:02.118 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-11T00:29:02.118 INFO:teuthology.orchestra.run.smithi022.stdout: jq-1.6-7.el8.x86_64 2023-07-11T00:29:02.119 INFO:teuthology.orchestra.run.smithi022.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-11T00:29:02.119 INFO:teuthology.orchestra.run.smithi022.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-11T00:29:02.119 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-11T00:29:02.119 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.119 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.119 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.119 INFO:teuthology.orchestra.run.smithi022.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-11T00:29:02.120 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-11T00:29:02.120 INFO:teuthology.orchestra.run.smithi022.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-11T00:29:02.120 INFO:teuthology.orchestra.run.smithi022.stdout: libpq-13.5-1.el8.x86_64 2023-07-11T00:29:02.120 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-11T00:29:02.120 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-11T00:29:02.120 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.120 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.121 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-11T00:29:02.121 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.121 INFO:teuthology.orchestra.run.smithi022.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-11T00:29:02.122 INFO:teuthology.orchestra.run.smithi022.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-11T00:29:02.122 INFO:teuthology.orchestra.run.smithi022.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-11T00:29:02.122 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-11T00:29:02.122 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-11T00:29:02.123 INFO:teuthology.orchestra.run.smithi022.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-11T00:29:02.123 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-11T00:29:02.123 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-11T00:29:02.123 INFO:teuthology.orchestra.run.smithi022.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-11T00:29:02.123 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-11T00:29:02.123 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-11T00:29:02.123 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-11T00:29:02.124 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-11T00:29:02.124 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-11T00:29:02.125 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-11T00:29:02.125 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-11T00:29:02.126 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-11T00:29:02.126 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-11T00:29:02.126 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-11T00:29:02.126 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-11T00:29:02.126 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-11T00:29:02.126 INFO:teuthology.orchestra.run.smithi022.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-11T00:29:02.126 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-11T00:29:02.127 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.127 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.127 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.127 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-11T00:29:02.127 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-11T00:29:02.128 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-11T00:29:02.128 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-11T00:29:02.128 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-11T00:29:02.128 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-11T00:29:02.129 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-11T00:29:02.129 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-11T00:29:02.129 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-11T00:29:02.129 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-11T00:29:02.129 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-11T00:29:02.129 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-11T00:29:02.129 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-11T00:29:02.130 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-11T00:29:02.130 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-11T00:29:02.130 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-11T00:29:02.130 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-11T00:29:02.130 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-11T00:29:02.130 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-11T00:29:02.130 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-11T00:29:02.131 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-11T00:29:02.131 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-11T00:29:02.131 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend-2.6-1.el8.noarch 2023-07-11T00:29:02.131 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-11T00:29:02.131 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-11T00:29:02.131 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-11T00:29:02.131 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-11T00:29:02.131 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-11T00:29:02.132 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-11T00:29:02.132 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.132 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.132 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-11T00:29:02.133 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-11T00:29:02.133 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.133 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-11T00:29:02.133 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-11T00:29:02.133 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-11T00:29:02.133 INFO:teuthology.orchestra.run.smithi022.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-11T00:29:02.133 INFO:teuthology.orchestra.run.smithi022.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-11T00:29:02.134 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-11T00:29:02.134 INFO:teuthology.orchestra.run.smithi022.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-11T00:29:02.134 INFO:teuthology.orchestra.run.smithi022.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-11T00:29:02.134 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-11T00:29:02.134 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-11T00:29:02.134 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-11T00:29:02.134 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-11T00:29:02.134 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-11T00:29:02.135 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.135 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.135 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-11T00:29:02.135 INFO:teuthology.orchestra.run.smithi022.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-11T00:29:02.135 INFO:teuthology.orchestra.run.smithi022.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-11T00:29:02.135 INFO:teuthology.orchestra.run.smithi022.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-11T00:29:02.136 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-11T00:29:02.136 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-11T00:29:02.137 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-11T00:29:02.137 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:02.137 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-07-11T00:29:02.415 DEBUG:teuthology.parallel:result is None 2023-07-11T00:29:02.416 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-11T00:29:02.566 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-11T00:29:02.624 INFO:teuthology.orchestra.run.smithi022.stdout:18.0.0-4828.gb5891ed6.el8 2023-07-11T00:29:02.625 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4828.gb5891ed6.el8 2023-07-11T00:29:02.625 INFO:teuthology.task.install:The correct ceph version 18.0.0-4828.gb5891ed6 is installed. 2023-07-11T00:29:02.625 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-11T00:29:02.781 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-11T00:29:02.846 INFO:teuthology.orchestra.run.smithi184.stdout:18.0.0-4828.gb5891ed6.el8 2023-07-11T00:29:02.846 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4828.gb5891ed6.el8 2023-07-11T00:29:02.846 INFO:teuthology.task.install:The correct ceph version 18.0.0-4828.gb5891ed6 is installed. 2023-07-11T00:29:02.847 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-11T00:29:02.848 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:02.848 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-11T00:29:02.923 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:02.924 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-11T00:29:02.999 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-11T00:29:03.000 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:03.000 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/daemon-helper 2023-07-11T00:29:03.071 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-11T00:29:03.182 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:03.183 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2023-07-11T00:29:03.252 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-11T00:29:03.360 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-11T00:29:03.361 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:03.361 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-11T00:29:03.432 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-11T00:29:03.544 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:03.545 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-11T00:29:03.612 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-11T00:29:03.722 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-11T00:29:03.723 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:03.723 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/stdin-killer 2023-07-11T00:29:03.800 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-11T00:29:03.917 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:03.917 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2023-07-11T00:29:03.985 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-11T00:29:04.097 INFO:teuthology.run_tasks:Running task ceph... 2023-07-11T00:29:04.202 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-11T00:29:04.203 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 777 /var/log/ceph 2023-07-11T00:29:04.209 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /var/log/ceph 2023-07-11T00:29:04.277 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-11T00:29:04.278 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-11T00:29:04.283 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-11T00:29:04.351 INFO:tasks.ceph:Creating extra log directories... 2023-07-11T00:29:04.352 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-11T00:29:04.358 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-11T00:29:04.433 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-11T00:29:04.433 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-11T00:29:04.434 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-11T00:29:04.434 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:04.434 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-11T00:29:04.481 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-11T00:29:04.698 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-11T00:29:04.770 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:04.789 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-11T00:29:04.836 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-11T00:29:05.038 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-11T00:29:05.122 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-11T00:29:05.123 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-11T00:29:05.123 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332904', 'branch': 'wip-pdonnell-testing-20230710.195410', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7332904', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20230710.195410'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20230710.195410', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 948, 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2', 'sleep_before_teardown': 0, 'subset': '199/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20230710.195410', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi022.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgQ+Ht0qTotK8GnC4IYq01T83FEdgqap91gwp4OMOmXOPD4O4LcXpUl8d24SvRCkWqATwgX78Lzpu5OFjJex4FgvrCaf7LoMXKFyO/QpOZ6q887UhVloedJKvVZNuF4Q20pWedq/Q1XxHOhXGxFldXosqzgvx8L36lg0pYZYurReMdxuyJd5iY9RqYEiBeyJqK7Dpdt348xplpJ/YNVcwsKfduz0UkrvscKG2pffRrSKvBve3mrHbIqr0vyt6Kg+MX51p82mmmojXrDsVEGgN2iaVEWaa63fmBdLWiu7hvcDkBf+oMwINNdexw6KFLZyypN0V3j8GaszpwaYZcewOwUO+g6x/RDUA6hBIKXBrPDjJTZj2eT+g5lJlO5oCsvXteLNQnBffgmOn9MsQZhxX66MlY4yajM35d8pQhA0jKXbSuqcZGcT3O2IAHxJNta6ROvtVy6WYDl1aRCYMRAVznYdgOTKOmsg1RP12qdj1nnhugRdtk/I4iUnycDD3XAPc=', 'smithi184.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBRJbe+IlVW3PTJ+9eYbpPw4xynyqBeuRskF8Ey3JtvaVxQQ4zYwN5Dh/OilOtJ08zFo7spbRsdehoWvjKTJOvbx09VMdUD/vVAW1wlvmYu8f0ThlrsoBGZfS+JtudDe4L5UOaE5jeGgNU9MRno7jFmxiznKBD9g4PMaCOGR2F6qjpIxVAWulh2nwvAIWyFpnrLvecAu/1jR0gNJZ9rqATVFvpUIzzhFXuH0NabL297nwMaDw6igA+6CGxOnz5pYZUbktgv+l/0FcqG0d0asfqz8lj9U5PIhBPm49UG19w9/HqjCUNL41zU3mUWlyV5pvUh25ZnczQ0d2b5DpC0gl+Qt1tzkiS4YoXXAh2mMeMVAsn4/P0Zq/7lE8HUxa90jb1tjVUCu1Q+qKL5bZjTo6q5vuQpdf1E/SLoNMzWDR7mTEvoTzioHlhSZx+n6tfAqlKBO2DdzxSVJnV2NmbnPfFYkA/C1tPW5HS7d20sg7Nyh1G75/bcsd9MV9vVz94C7M='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b53f236c1077f1d295baafb9e0ca9a4b447019d7', 'timestamp': '2023-07-10_22:55:54', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-11T00:29:05.125 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-11T00:29:05.131 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-11T00:29:05.176 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/run/ceph 2023-07-11T00:29:05.216 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/run/ceph 2023-07-11T00:29:05.284 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:05.285 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/scratch_devs of=/dev/stdout 2023-07-11T00:29:05.331 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-11T00:29:05.331 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 2023-07-11T00:29:05.422 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-11T00:29:05.423 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-11T00:29:05.423 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-07-11T00:29:05.423 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-11T00:29:05.423 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2023-07-11T00:29:05.424 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-07-11 00:28:59.439109087 +0000 2023-07-11T00:29:05.424 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-07-11 00:25:33.995871537 +0000 2023-07-11T00:29:05.424 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-07-11 00:25:33.995871537 +0000 2023-07-11T00:29:05.424 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2023-07-11 00:25:33.972871822 +0000 2023-07-11T00:29:05.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-11T00:29:05.493 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-07-11T00:29:05.494 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-07-11T00:29:05.494 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000163038 s, 3.1 MB/s 2023-07-11T00:29:05.496 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-11T00:29:05.549 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 2023-07-11T00:29:05.599 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-11T00:29:05.600 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-11T00:29:05.600 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-07-11T00:29:05.600 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-11T00:29:05.600 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2023-07-11T00:29:05.600 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-07-11 00:28:59.439109087 +0000 2023-07-11T00:29:05.601 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-07-11 00:25:34.855860906 +0000 2023-07-11T00:29:05.601 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-07-11 00:25:34.855860906 +0000 2023-07-11T00:29:05.601 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2023-07-11 00:25:34.834861165 +0000 2023-07-11T00:29:05.601 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-11T00:29:05.671 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-07-11T00:29:05.671 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-07-11T00:29:05.672 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.00021817 s, 2.3 MB/s 2023-07-11T00:29:05.674 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-11T00:29:05.724 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 2023-07-11T00:29:05.771 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-11T00:29:05.772 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-11T00:29:05.772 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-07-11T00:29:05.772 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-11T00:29:05.773 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2023-07-11T00:29:05.773 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-07-11 00:28:59.439109087 +0000 2023-07-11T00:29:05.773 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-07-11 00:25:35.707850373 +0000 2023-07-11T00:29:05.773 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-07-11 00:25:35.707850373 +0000 2023-07-11T00:29:05.773 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2023-07-11 00:25:35.685850645 +0000 2023-07-11T00:29:05.773 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-11T00:29:05.878 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-07-11T00:29:05.878 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-07-11T00:29:05.878 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000160383 s, 3.2 MB/s 2023-07-11T00:29:05.881 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-11T00:29:05.931 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 2023-07-11T00:29:05.978 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-11T00:29:05.978 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-11T00:29:05.978 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-07-11T00:29:05.978 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-11T00:29:05.978 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2023-07-11T00:29:05.979 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-07-11 00:28:59.440109074 +0000 2023-07-11T00:29:05.979 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-07-11 00:25:36.562839803 +0000 2023-07-11T00:29:05.979 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-07-11 00:25:36.562839803 +0000 2023-07-11T00:29:05.979 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2023-07-11 00:25:36.542840050 +0000 2023-07-11T00:29:05.979 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-11T00:29:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-07-11T00:29:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-07-11T00:29:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000183184 s, 2.8 MB/s 2023-07-11T00:29:06.088 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-11T00:29:06.138 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-11T00:29:06.139 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:06.139 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2023-07-11T00:29:06.190 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-11T00:29:06.191 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2023-07-11T00:29:06.246 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-11T00:29:06.246 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-11T00:29:06.247 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-07-11T00:29:06.247 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-11T00:29:06.247 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-07-11T00:29:06.247 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-07-11 00:28:50.413792762 +0000 2023-07-11T00:29:06.247 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-07-11 00:25:23.404744254 +0000 2023-07-11T00:29:06.247 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-07-11 00:25:23.404744254 +0000 2023-07-11T00:29:06.247 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2023-07-11 00:25:23.378744776 +0000 2023-07-11T00:29:06.248 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-11T00:29:06.323 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-07-11T00:29:06.324 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-07-11T00:29:06.324 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000371954 s, 1.4 MB/s 2023-07-11T00:29:06.326 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-11T00:29:06.380 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2023-07-11T00:29:06.432 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-11T00:29:06.432 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-11T00:29:06.432 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-07-11T00:29:06.433 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-11T00:29:06.433 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-07-11T00:29:06.433 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-07-11 00:28:50.413792762 +0000 2023-07-11T00:29:06.433 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-07-11 00:25:24.261727045 +0000 2023-07-11T00:29:06.433 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-07-11 00:25:24.261727045 +0000 2023-07-11T00:29:06.433 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2023-07-11 00:25:24.237727527 +0000 2023-07-11T00:29:06.434 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-11T00:29:06.508 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-07-11T00:29:06.508 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-07-11T00:29:06.508 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000308599 s, 1.7 MB/s 2023-07-11T00:29:06.511 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-11T00:29:06.561 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2023-07-11T00:29:06.649 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-11T00:29:06.649 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-11T00:29:06.649 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-07-11T00:29:06.649 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-11T00:29:06.650 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-07-11T00:29:06.650 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-07-11 00:28:50.413792762 +0000 2023-07-11T00:29:06.650 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-07-11 00:25:25.131709575 +0000 2023-07-11T00:29:06.650 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-07-11 00:25:25.131709575 +0000 2023-07-11T00:29:06.650 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2023-07-11 00:25:25.107710057 +0000 2023-07-11T00:29:06.653 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-11T00:29:06.759 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-07-11T00:29:06.759 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-07-11T00:29:06.760 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000287637 s, 1.8 MB/s 2023-07-11T00:29:06.761 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-11T00:29:06.810 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2023-07-11T00:29:06.894 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-11T00:29:06.895 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-11T00:29:06.895 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-07-11T00:29:06.895 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-11T00:29:06.895 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-07-11T00:29:06.895 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-07-11 00:28:50.414792742 +0000 2023-07-11T00:29:06.895 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-07-11 00:25:25.984692447 +0000 2023-07-11T00:29:06.896 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-07-11 00:25:25.984692447 +0000 2023-07-11T00:29:06.896 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2023-07-11 00:25:25.957692989 +0000 2023-07-11T00:29:06.896 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-11T00:29:07.000 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-07-11T00:29:07.000 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-07-11T00:29:07.000 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000300522 s, 1.7 MB/s 2023-07-11T00:29:07.002 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-11T00:29:07.051 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-11T00:29:07.053 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-11T00:29:07.053 INFO:tasks.ceph:Generating config... 2023-07-11T00:29:07.055 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-11T00:29:07.056 INFO:tasks.ceph:[client] debug client = 20 2023-07-11T00:29:07.056 INFO:tasks.ceph:[client] debug ms = 1 2023-07-11T00:29:07.057 INFO:tasks.ceph:[client] pid file = 2023-07-11T00:29:07.057 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-11T00:29:07.058 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-11T00:29:07.058 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-11T00:29:07.059 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-11T00:29:07.059 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-11T00:29:07.060 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-11T00:29:07.060 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-11T00:29:07.061 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-11T00:29:07.062 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-11T00:29:07.062 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-11T00:29:07.063 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-11T00:29:07.063 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-11T00:29:07.064 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-11T00:29:07.064 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-11T00:29:07.065 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-11T00:29:07.065 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-11T00:29:07.065 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-11T00:29:07.066 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-11T00:29:07.066 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-11T00:29:07.066 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-11T00:29:07.067 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-11T00:29:07.067 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-07-11T00:29:07.068 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-07-11T00:29:07.068 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-11T00:29:07.069 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-11T00:29:07.069 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-07-11T00:29:07.069 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-11T00:29:07.069 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-11T00:29:07.070 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-11T00:29:07.070 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-11T00:29:07.070 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-11T00:29:07.070 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-11T00:29:07.071 INFO:tasks.ceph:Setting up mon.a... 2023-07-11T00:29:07.071 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-11T00:29:07.181 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.keyring 2023-07-11T00:29:07.187 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-11T00:29:07.291 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-11T00:29:07.362 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.22'), ('mon.b', '172.21.15.184'), ('mon.c', '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]')] 2023-07-11T00:29:07.363 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.22,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-11T00:29:07.364 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:07.364 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-11T00:29:07.414 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.22 --add b 172.21.15.184 --addv c '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-11T00:29:07.509 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-11T00:29:07.510 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: generated fsid c306ab0a-3faf-4f52-9dba-c4f0807b892e 2023-07-11T00:29:07.510 INFO:teuthology.orchestra.run.smithi022.stdout:setting min_mon_release = pacific 2023-07-11T00:29:07.510 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 0 2023-07-11T00:29:07.510 INFO:teuthology.orchestra.run.smithi022.stdout:fsid c306ab0a-3faf-4f52-9dba-c4f0807b892e 2023-07-11T00:29:07.510 INFO:teuthology.orchestra.run.smithi022.stdout:last_changed 2023-07-11T00:29:07.507672+0000 2023-07-11T00:29:07.510 INFO:teuthology.orchestra.run.smithi022.stdout:created 2023-07-11T00:29:07.507672+0000 2023-07-11T00:29:07.511 INFO:teuthology.orchestra.run.smithi022.stdout:min_mon_release 16 (pacific) 2023-07-11T00:29:07.511 INFO:teuthology.orchestra.run.smithi022.stdout:election_strategy: 1 2023-07-11T00:29:07.511 INFO:teuthology.orchestra.run.smithi022.stdout:0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2023-07-11T00:29:07.511 INFO:teuthology.orchestra.run.smithi022.stdout:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2023-07-11T00:29:07.512 INFO:teuthology.orchestra.run.smithi022.stdout:2: [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] mon.c 2023-07-11T00:29:07.512 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-11T00:29:07.514 DEBUG:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-11T00:29:07.562 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c306ab0a-3faf-4f52-9dba-c4f0807b892e... 2023-07-11T00:29:07.564 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-11T00:29:07.607 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-11T00:29:07.724 INFO:teuthology.orchestra.run.smithi022.stdout:[global] 2023-07-11T00:29:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: chdir = "" 2023-07-11T00:29:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-11T00:29:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: auth supported = cephx 2023-07-11T00:29:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.725 INFO:teuthology.orchestra.run.smithi022.stdout: filestore xattr use omap = true 2023-07-11T00:29:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: mon clock drift allowed = 1.000 2023-07-11T00:29:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: osd crush chooseleaf type = 0 2023-07-11T00:29:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: auth debug = true 2023-07-11T00:29:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on old message = true 2023-07-11T00:29:07.726 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on bug = true 2023-07-11T00:29:07.727 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.727 INFO:teuthology.orchestra.run.smithi022.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-11T00:29:07.727 INFO:teuthology.orchestra.run.smithi022.stdout: mon pg warn max object skew = 0 2023-07-11T00:29:07.727 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.727 INFO:teuthology.orchestra.run.smithi022.stdout: # disable pg_autoscaler by default for new pools 2023-07-11T00:29:07.727 INFO:teuthology.orchestra.run.smithi022.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-11T00:29:07.727 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.728 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default size = 2 2023-07-11T00:29:07.728 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.728 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow primary affinity = true 2023-07-11T00:29:07.728 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow pg remap = true 2023-07-11T00:29:07.728 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on legacy crush tunables = false 2023-07-11T00:29:07.728 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on crush straw calc version zero = false 2023-07-11T00:29:07.729 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on no sortbitwise = false 2023-07-11T00:29:07.729 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on osd down out interval zero = false 2023-07-11T00:29:07.729 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on too few osds = false 2023-07-11T00:29:07.729 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-11T00:29:07.729 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-11T00:29:07.729 INFO:teuthology.orchestra.run.smithi022.stdout: mon_allow_pool_size_one = true 2023-07-11T00:29:07.730 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.730 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-11T00:29:07.730 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.730 INFO:teuthology.orchestra.run.smithi022.stdout: osd default data pool replay window = 5 2023-07-11T00:29:07.730 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.730 INFO:teuthology.orchestra.run.smithi022.stdout: mon allow pool delete = true 2023-07-11T00:29:07.730 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.731 INFO:teuthology.orchestra.run.smithi022.stdout: mon cluster log file level = debug 2023-07-11T00:29:07.731 INFO:teuthology.orchestra.run.smithi022.stdout: debug asserts on shutdown = true 2023-07-11T00:29:07.731 INFO:teuthology.orchestra.run.smithi022.stdout: mon health detail to clog = false 2023-07-11T00:29:07.731 INFO:teuthology.orchestra.run.smithi022.stdout: mon host = "172.21.15.22,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-07-11T00:29:07.731 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on skipped message = False 2023-07-11T00:29:07.731 INFO:teuthology.orchestra.run.smithi022.stdout: fsid = c306ab0a-3faf-4f52-9dba-c4f0807b892e 2023-07-11T00:29:07.731 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.732 INFO:teuthology.orchestra.run.smithi022.stdout:[osd] 2023-07-11T00:29:07.732 INFO:teuthology.orchestra.run.smithi022.stdout: osd journal size = 100 2023-07-11T00:29:07.732 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.732 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub load threshold = 5.0 2023-07-11T00:29:07.732 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub max interval = 600 2023-07-11T00:29:07.733 INFO:teuthology.orchestra.run.smithi022.stdout: osd mclock profile = high_recovery_ops 2023-07-11T00:29:07.733 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.733 INFO:teuthology.orchestra.run.smithi022.stdout: osd recover clone overlap = true 2023-07-11T00:29:07.733 INFO:teuthology.orchestra.run.smithi022.stdout: osd recovery max chunk = 1048576 2023-07-11T00:29:07.733 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.733 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug shutdown = true 2023-07-11T00:29:07.734 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug op order = true 2023-07-11T00:29:07.734 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug verify stray on activate = true 2023-07-11T00:29:07.734 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.734 INFO:teuthology.orchestra.run.smithi022.stdout: osd open classes on start = true 2023-07-11T00:29:07.735 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug pg log writeout = true 2023-07-11T00:29:07.735 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.735 INFO:teuthology.orchestra.run.smithi022.stdout: osd deep scrub update digest min age = 30 2023-07-11T00:29:07.735 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.735 INFO:teuthology.orchestra.run.smithi022.stdout: osd map max advance = 10 2023-07-11T00:29:07.735 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.735 INFO:teuthology.orchestra.run.smithi022.stdout: journal zero on create = true 2023-07-11T00:29:07.736 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.736 INFO:teuthology.orchestra.run.smithi022.stdout: filestore ondisk finisher threads = 3 2023-07-11T00:29:07.736 INFO:teuthology.orchestra.run.smithi022.stdout: filestore apply finisher threads = 3 2023-07-11T00:29:07.736 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.736 INFO:teuthology.orchestra.run.smithi022.stdout: bdev debug aio = true 2023-07-11T00:29:07.737 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug misdirected ops = true 2023-07-11T00:29:07.737 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore block size = 96636764160 2023-07-11T00:29:07.737 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore fsck on mount = True 2023-07-11T00:29:07.737 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluefs = 20 2023-07-11T00:29:07.737 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluestore = 20 2023-07-11T00:29:07.737 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-07-11T00:29:07.737 INFO:teuthology.orchestra.run.smithi022.stdout: debug osd = 20 2023-07-11T00:29:07.738 INFO:teuthology.orchestra.run.smithi022.stdout: debug rocksdb = 10 2023-07-11T00:29:07.738 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd backfillfull_ratio = 0.85 2023-07-11T00:29:07.740 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd full ratio = 0.9 2023-07-11T00:29:07.740 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd nearfull ratio = 0.8 2023-07-11T00:29:07.741 INFO:teuthology.orchestra.run.smithi022.stdout: osd failsafe full ratio = 0.95 2023-07-11T00:29:07.742 INFO:teuthology.orchestra.run.smithi022.stdout: osd objectstore = bluestore 2023-07-11T00:29:07.742 INFO:teuthology.orchestra.run.smithi022.stdout: osd op complaint time = 180 2023-07-11T00:29:07.742 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.742 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr] 2023-07-11T00:29:07.742 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-07-11T00:29:07.743 INFO:teuthology.orchestra.run.smithi022.stdout: debug mgr = 20 2023-07-11T00:29:07.743 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2023-07-11T00:29:07.743 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2023-07-11T00:29:07.743 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2023-07-11T00:29:07.743 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2023-07-11T00:29:07.743 INFO:teuthology.orchestra.run.smithi022.stdout: mgr/telemetry/nag = false 2023-07-11T00:29:07.743 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.743 INFO:teuthology.orchestra.run.smithi022.stdout:[mon] 2023-07-11T00:29:07.744 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-07-11T00:29:07.744 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2023-07-11T00:29:07.744 INFO:teuthology.orchestra.run.smithi022.stdout: debug paxos = 20 2023-07-11T00:29:07.744 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2023-07-11T00:29:07.744 INFO:teuthology.orchestra.run.smithi022.stdout: mon data avail warn = 5 2023-07-11T00:29:07.744 INFO:teuthology.orchestra.run.smithi022.stdout: mon mgr mkfs grace = 240 2023-07-11T00:29:07.744 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2023-07-11T00:29:07.745 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd reporter subtree level = osd 2023-07-11T00:29:07.745 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd prime pg temp = true 2023-07-11T00:29:07.745 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2023-07-11T00:29:07.745 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.745 INFO:teuthology.orchestra.run.smithi022.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-11T00:29:07.745 INFO:teuthology.orchestra.run.smithi022.stdout: auth mon ticket ttl = 660 # 11m 2023-07-11T00:29:07.745 INFO:teuthology.orchestra.run.smithi022.stdout: auth service ticket ttl = 240 # 4m 2023-07-11T00:29:07.745 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.746 INFO:teuthology.orchestra.run.smithi022.stdout: # don't complain about insecure global_id in the test suite 2023-07-11T00:29:07.746 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-11T00:29:07.746 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-11T00:29:07.746 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.746 INFO:teuthology.orchestra.run.smithi022.stdout: # 1m isn't quite enough 2023-07-11T00:29:07.746 INFO:teuthology.orchestra.run.smithi022.stdout: mon_down_mkfs_grace = 2m 2023-07-11T00:29:07.746 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.746 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_filestore_osds = false 2023-07-11T00:29:07.747 INFO:teuthology.orchestra.run.smithi022.stdout: mon op complaint time = 120 2023-07-11T00:29:07.747 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:07.747 INFO:teuthology.orchestra.run.smithi022.stdout:[client] 2023-07-11T00:29:07.747 INFO:teuthology.orchestra.run.smithi022.stdout: rgw cache enabled = true 2023-07-11T00:29:07.747 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable ops log = true 2023-07-11T00:29:07.747 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable usage log = true 2023-07-11T00:29:07.748 INFO:teuthology.orchestra.run.smithi022.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-11T00:29:07.748 INFO:teuthology.orchestra.run.smithi022.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-11T00:29:07.748 INFO:teuthology.orchestra.run.smithi022.stdout: client mount timeout = 600 2023-07-11T00:29:07.748 INFO:teuthology.orchestra.run.smithi022.stdout: debug client = 20 2023-07-11T00:29:07.749 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-07-11T00:29:07.749 INFO:teuthology.orchestra.run.smithi022.stdout: pid file = "" 2023-07-11T00:29:07.749 INFO:teuthology.orchestra.run.smithi022.stdout: rados mon op timeout = 900 2023-07-11T00:29:07.749 INFO:teuthology.orchestra.run.smithi022.stdout: rados osd op timeout = 900 2023-07-11T00:29:07.749 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.a] 2023-07-11T00:29:07.750 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.b] 2023-07-11T00:29:07.750 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.c] 2023-07-11T00:29:07.750 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a] 2023-07-11T00:29:07.750 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.c] 2023-07-11T00:29:07.750 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b] 2023-07-11T00:29:07.750 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.d] 2023-07-11T00:29:07.751 INFO:teuthology.orchestra.run.smithi022.stdout:[mds] 2023-07-11T00:29:07.751 INFO:teuthology.orchestra.run.smithi022.stdout: debug mds = 20 2023-07-11T00:29:07.751 INFO:teuthology.orchestra.run.smithi022.stdout: debug mds balancer = 20 2023-07-11T00:29:07.751 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-07-11T00:29:07.751 INFO:teuthology.orchestra.run.smithi022.stdout: mds debug frag = True 2023-07-11T00:29:07.751 INFO:teuthology.orchestra.run.smithi022.stdout: mds debug scatterstat = True 2023-07-11T00:29:07.752 INFO:teuthology.orchestra.run.smithi022.stdout: mds op complaint time = 180 2023-07-11T00:29:07.752 INFO:teuthology.orchestra.run.smithi022.stdout: mds verify scatter = True 2023-07-11T00:29:07.752 INFO:teuthology.orchestra.run.smithi022.stdout: osd op complaint time = 180 2023-07-11T00:29:07.752 INFO:teuthology.orchestra.run.smithi022.stdout: rados mon op timeout = 900 2023-07-11T00:29:07.752 INFO:teuthology.orchestra.run.smithi022.stdout: rados osd op timeout = 900 2023-07-11T00:29:07.753 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2023-07-11T00:29:07.753 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2023-07-11T00:29:07.753 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-11T00:29:07.754 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2023-07-11T00:29:07.754 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.754 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2023-07-11T00:29:07.754 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.754 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2023-07-11T00:29:07.754 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.754 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2023-07-11T00:29:07.755 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2023-07-11T00:29:07.755 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.755 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2023-07-11T00:29:07.755 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2023-07-11T00:29:07.755 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.755 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-11T00:29:07.755 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2023-07-11T00:29:07.755 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.756 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2023-07-11T00:29:07.756 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-11T00:29:07.756 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.756 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2023-07-11T00:29:07.756 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.756 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2023-07-11T00:29:07.756 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2023-07-11T00:29:07.756 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2023-07-11T00:29:07.757 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2023-07-11T00:29:07.757 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2023-07-11T00:29:07.757 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2023-07-11T00:29:07.757 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2023-07-11T00:29:07.757 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-11T00:29:07.757 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-11T00:29:07.757 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2023-07-11T00:29:07.758 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.758 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-11T00:29:07.758 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.758 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2023-07-11T00:29:07.758 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.758 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2023-07-11T00:29:07.758 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.758 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2023-07-11T00:29:07.759 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2023-07-11T00:29:07.759 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2023-07-11T00:29:07.759 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = "172.21.15.22,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-07-11T00:29:07.759 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on skipped message = False 2023-07-11T00:29:07.759 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = c306ab0a-3faf-4f52-9dba-c4f0807b892e 2023-07-11T00:29:07.759 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.759 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2023-07-11T00:29:07.759 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2023-07-11T00:29:07.760 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.760 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2023-07-11T00:29:07.760 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2023-07-11T00:29:07.760 INFO:teuthology.orchestra.run.smithi184.stdout: osd mclock profile = high_recovery_ops 2023-07-11T00:29:07.760 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.760 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2023-07-11T00:29:07.760 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2023-07-11T00:29:07.761 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.761 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2023-07-11T00:29:07.761 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2023-07-11T00:29:07.761 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2023-07-11T00:29:07.761 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.761 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2023-07-11T00:29:07.761 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2023-07-11T00:29:07.761 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.762 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2023-07-11T00:29:07.762 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.762 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2023-07-11T00:29:07.763 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.763 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2023-07-11T00:29:07.763 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.763 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2023-07-11T00:29:07.763 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2023-07-11T00:29:07.763 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.763 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2023-07-11T00:29:07.763 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2023-07-11T00:29:07.764 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore block size = 96636764160 2023-07-11T00:29:07.764 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore fsck on mount = True 2023-07-11T00:29:07.764 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluefs = 20 2023-07-11T00:29:07.764 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluestore = 20 2023-07-11T00:29:07.764 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-07-11T00:29:07.764 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2023-07-11T00:29:07.764 INFO:teuthology.orchestra.run.smithi184.stdout: debug rocksdb = 10 2023-07-11T00:29:07.765 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull_ratio = 0.85 2023-07-11T00:29:07.765 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.9 2023-07-11T00:29:07.765 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.8 2023-07-11T00:29:07.765 INFO:teuthology.orchestra.run.smithi184.stdout: osd failsafe full ratio = 0.95 2023-07-11T00:29:07.765 INFO:teuthology.orchestra.run.smithi184.stdout: osd objectstore = bluestore 2023-07-11T00:29:07.766 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-07-11T00:29:07.766 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.766 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2023-07-11T00:29:07.766 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-07-11T00:29:07.766 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2023-07-11T00:29:07.766 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-07-11T00:29:07.766 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-07-11T00:29:07.766 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-07-11T00:29:07.767 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-07-11T00:29:07.767 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2023-07-11T00:29:07.767 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.767 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2023-07-11T00:29:07.767 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-07-11T00:29:07.767 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-07-11T00:29:07.767 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2023-07-11T00:29:07.767 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-07-11T00:29:07.768 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2023-07-11T00:29:07.768 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2023-07-11T00:29:07.768 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-07-11T00:29:07.768 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2023-07-11T00:29:07.768 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2023-07-11T00:29:07.768 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-07-11T00:29:07.768 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.768 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-11T00:29:07.769 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2023-07-11T00:29:07.769 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2023-07-11T00:29:07.769 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.769 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2023-07-11T00:29:07.769 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-11T00:29:07.769 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-11T00:29:07.769 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.769 INFO:teuthology.orchestra.run.smithi184.stdout: # 1m isn't quite enough 2023-07-11T00:29:07.770 INFO:teuthology.orchestra.run.smithi184.stdout: mon_down_mkfs_grace = 2m 2023-07-11T00:29:07.770 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.770 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_filestore_osds = false 2023-07-11T00:29:07.770 INFO:teuthology.orchestra.run.smithi184.stdout: mon op complaint time = 120 2023-07-11T00:29:07.770 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-11T00:29:07.770 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2023-07-11T00:29:07.770 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2023-07-11T00:29:07.770 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2023-07-11T00:29:07.771 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2023-07-11T00:29:07.771 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-11T00:29:07.771 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-11T00:29:07.771 INFO:teuthology.orchestra.run.smithi184.stdout: client mount timeout = 600 2023-07-11T00:29:07.771 INFO:teuthology.orchestra.run.smithi184.stdout: debug client = 20 2023-07-11T00:29:07.771 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-07-11T00:29:07.771 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = "" 2023-07-11T00:29:07.772 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-07-11T00:29:07.772 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-07-11T00:29:07.772 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2023-07-11T00:29:07.772 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.b] 2023-07-11T00:29:07.772 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.c] 2023-07-11T00:29:07.772 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2023-07-11T00:29:07.773 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2023-07-11T00:29:07.773 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2023-07-11T00:29:07.774 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2023-07-11T00:29:07.774 INFO:teuthology.orchestra.run.smithi184.stdout:[mds] 2023-07-11T00:29:07.774 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds = 20 2023-07-11T00:29:07.774 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds balancer = 20 2023-07-11T00:29:07.774 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-07-11T00:29:07.774 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug frag = True 2023-07-11T00:29:07.774 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug scatterstat = True 2023-07-11T00:29:07.774 INFO:teuthology.orchestra.run.smithi184.stdout: mds op complaint time = 180 2023-07-11T00:29:07.775 INFO:teuthology.orchestra.run.smithi184.stdout: mds verify scatter = True 2023-07-11T00:29:07.775 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-07-11T00:29:07.776 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-07-11T00:29:07.776 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-07-11T00:29:07.778 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-11T00:29:07.778 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-11T00:29:07.896 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-11T00:29:07.897 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:07.897 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-11T00:29:07.944 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:07.945 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-11T00:29:08.032 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi022.front.sepia.ceph.com 2023-07-11T00:29:08.032 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:08.032 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-11T00:29:08.033 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-11T00:29:08.170 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:08.171 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-11T00:29:08.258 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi184.front.sepia.ceph.com 2023-07-11T00:29:08.259 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:08.260 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-11T00:29:08.260 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-11T00:29:08.364 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:08.364 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-11T00:29:08.450 INFO:tasks.ceph:Setting up mon nodes... 2023-07-11T00:29:08.451 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-11T00:29:08.452 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-11T00:29:08.580 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-11T00:29:08.587 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-11T00:29:09.408 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-11T00:29:09.415 INFO:tasks.ceph:Setting up mds nodes... 2023-07-11T00:29:09.416 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-11T00:29:09.542 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-11T00:29:09.547 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-11T00:29:09.619 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-11T00:29:09.743 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-11T00:29:09.748 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-11T00:29:09.818 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-11T00:29:09.948 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-11T00:29:09.954 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-11T00:29:10.023 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-11T00:29:10.143 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-11T00:29:10.147 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-11T00:29:10.215 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-11T00:29:10.216 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-11T00:29:10.318 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-11T00:29:10.348 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-11T00:29:10.452 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-11T00:29:10.483 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-11T00:29:10.578 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-11T00:29:10.608 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-11T00:29:10.704 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-11T00:29:10.736 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-11T00:29:10.736 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-11T00:29:10.736 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-11T00:29:10.806 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-11T00:29:10.806 INFO:tasks.ceph:role: osd.0 2023-07-11T00:29:10.807 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com 2023-07-11T00:29:10.807 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-11T00:29:10.876 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-11T00:29:10.877 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-11T00:29:10.877 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-11T00:29:10.877 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-11T00:29:10.877 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-11T00:29:10.877 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2023-07-11T00:29:10.878 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-11T00:29:10.878 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-11T00:29:10.878 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-11T00:29:10.878 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-11T00:29:10.900 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2023-07-11T00:29:10.904 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2023-07-11T00:29:10.905 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-11T00:29:11.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-11T00:29:11.087 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-11T00:29:11.156 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-11T00:29:11.157 INFO:tasks.ceph:role: osd.1 2023-07-11T00:29:11.157 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com 2023-07-11T00:29:11.158 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-11T00:29:11.226 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-11T00:29:11.226 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-11T00:29:11.227 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-11T00:29:11.227 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-11T00:29:11.227 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-11T00:29:11.227 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2023-07-11T00:29:11.227 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-11T00:29:11.227 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-11T00:29:11.227 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-11T00:29:11.228 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-11T00:29:11.250 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2023-07-11T00:29:11.254 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2023-07-11T00:29:11.255 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-11T00:29:11.360 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-11T00:29:11.438 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-11T00:29:11.508 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-11T00:29:11.508 INFO:tasks.ceph:role: osd.2 2023-07-11T00:29:11.508 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com 2023-07-11T00:29:11.509 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-11T00:29:11.577 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-11T00:29:11.577 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-11T00:29:11.578 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-11T00:29:11.578 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-11T00:29:11.578 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-11T00:29:11.578 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2023-07-11T00:29:11.578 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-11T00:29:11.578 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-11T00:29:11.578 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-11T00:29:11.578 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-11T00:29:11.601 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2023-07-11T00:29:11.605 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2023-07-11T00:29:11.606 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-11T00:29:11.712 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-11T00:29:11.788 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-11T00:29:11.858 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-11T00:29:11.859 INFO:tasks.ceph:role: osd.3 2023-07-11T00:29:11.859 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com 2023-07-11T00:29:11.859 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-11T00:29:11.929 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-11T00:29:11.929 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-11T00:29:11.929 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-11T00:29:11.929 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-11T00:29:11.930 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-11T00:29:11.930 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2023-07-11T00:29:11.930 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-11T00:29:11.930 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-11T00:29:11.930 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-11T00:29:11.930 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-11T00:29:11.953 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2023-07-11T00:29:11.956 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2023-07-11T00:29:11.956 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-11T00:29:12.062 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-11T00:29:12.139 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-11T00:29:12.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:12.261+0000 7fed520a8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-11T00:29:12.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:12.261+0000 7fed520a8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-11T00:29:12.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:12.261+0000 7fed520a8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-11T00:29:12.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:12.261+0000 7fed520a8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-11T00:29:12.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:12.261+0000 7fed520a8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-11T00:29:12.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:12.263+0000 7fed520a8640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-11T00:29:15.152 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-11T00:29:15.229 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-11T00:29:15.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:15.336+0000 7fccc5164640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-11T00:29:15.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:15.337+0000 7fccc5164640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-11T00:29:15.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:15.337+0000 7fccc5164640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-11T00:29:15.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:15.337+0000 7fccc5164640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-11T00:29:15.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:15.337+0000 7fccc5164640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-11T00:29:15.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:15.338+0000 7fccc5164640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-11T00:29:18.230 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-11T00:29:18.307 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-11T00:29:18.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:18.414+0000 7fb64e912640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-11T00:29:18.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:18.415+0000 7fb64e912640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-11T00:29:18.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:18.415+0000 7fb64e912640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-11T00:29:18.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:18.415+0000 7fb64e912640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-11T00:29:18.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:18.415+0000 7fb64e912640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-11T00:29:18.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:18.416+0000 7fb64e912640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-11T00:29:21.307 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-11T00:29:21.382 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-11T00:29:21.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:21.491+0000 7f6c5598d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-11T00:29:21.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:21.492+0000 7f6c5598d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-11T00:29:21.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:21.492+0000 7f6c5598d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-11T00:29:21.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:21.492+0000 7f6c5598d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-11T00:29:21.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:21.492+0000 7f6c5598d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-11T00:29:21.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:21.493+0000 7f6c5598d640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-11T00:29:24.390 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-11T00:29:24.465 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-11T00:29:24.543 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-11T00:29:24.543 INFO:tasks.ceph:role: osd.4 2023-07-11T00:29:24.544 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com 2023-07-11T00:29:24.544 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-11T00:29:24.623 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-11T00:29:24.623 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-11T00:29:24.623 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-11T00:29:24.623 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-11T00:29:24.624 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-11T00:29:24.624 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-07-11T00:29:24.624 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-11T00:29:24.624 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-11T00:29:24.624 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-11T00:29:24.624 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-11T00:29:25.063 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-07-11T00:29:25.066 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-07-11T00:29:25.067 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-11T00:29:25.264 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-11T00:29:25.341 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-11T00:29:25.409 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-11T00:29:25.410 INFO:tasks.ceph:role: osd.5 2023-07-11T00:29:25.410 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com 2023-07-11T00:29:25.410 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-11T00:29:25.489 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-11T00:29:25.490 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-11T00:29:25.490 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-11T00:29:25.490 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-11T00:29:25.490 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-11T00:29:25.490 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-07-11T00:29:25.490 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-11T00:29:25.491 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-11T00:29:25.491 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-11T00:29:25.491 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-11T00:29:25.902 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-07-11T00:29:25.906 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-07-11T00:29:25.907 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-11T00:29:26.036 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-11T00:29:26.114 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-11T00:29:26.182 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-11T00:29:26.183 INFO:tasks.ceph:role: osd.6 2023-07-11T00:29:26.183 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com 2023-07-11T00:29:26.184 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-11T00:29:26.261 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-11T00:29:26.261 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-11T00:29:26.261 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-11T00:29:26.262 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-11T00:29:26.262 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-11T00:29:26.262 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-07-11T00:29:26.262 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-11T00:29:26.262 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-11T00:29:26.262 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-11T00:29:26.262 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-11T00:29:26.705 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-07-11T00:29:26.708 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-07-11T00:29:26.709 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-11T00:29:26.904 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-11T00:29:26.984 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-11T00:29:27.052 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-11T00:29:27.052 INFO:tasks.ceph:role: osd.7 2023-07-11T00:29:27.053 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com 2023-07-11T00:29:27.053 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-11T00:29:27.130 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-11T00:29:27.130 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-11T00:29:27.130 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-11T00:29:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-11T00:29:27.131 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-11T00:29:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-07-11T00:29:27.131 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-11T00:29:27.131 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-11T00:29:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-11T00:29:27.131 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-11T00:29:27.573 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-07-11T00:29:27.576 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-07-11T00:29:27.577 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-11T00:29:27.702 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-11T00:29:27.778 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-11T00:29:27.911 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:27.907+0000 7f2f155a8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-11T00:29:27.912 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:27.907+0000 7f2f155a8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-11T00:29:27.912 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:27.907+0000 7f2f155a8640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-11T00:29:27.912 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:27.907+0000 7f2f155a8640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-11T00:29:27.912 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:27.907+0000 7f2f155a8640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-11T00:29:27.913 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:27.909+0000 7f2f155a8640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-11T00:29:30.782 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-11T00:29:30.855 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-11T00:29:30.963 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:30.959+0000 7fa726ae6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-11T00:29:30.964 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:30.959+0000 7fa726ae6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-11T00:29:30.964 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:30.959+0000 7fa726ae6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-11T00:29:30.964 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:30.959+0000 7fa726ae6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-11T00:29:30.964 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:30.959+0000 7fa726ae6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-11T00:29:30.966 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:30.961+0000 7fa726ae6640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-11T00:29:33.833 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-11T00:29:33.903 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-11T00:29:34.007 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:34.004+0000 7ff6aef28640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-11T00:29:34.008 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:34.005+0000 7ff6aef28640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-11T00:29:34.008 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:34.005+0000 7ff6aef28640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-11T00:29:34.008 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:34.005+0000 7ff6aef28640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-11T00:29:34.008 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:34.005+0000 7ff6aef28640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-11T00:29:34.010 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:34.006+0000 7ff6aef28640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-11T00:29:35.127 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:29:35.137 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:29:36.896 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-11T00:29:36.966 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-11T00:29:37.072 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:37.066+0000 7f2283cc4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-11T00:29:37.073 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:37.067+0000 7f2283cc4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-11T00:29:37.073 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:37.067+0000 7f2283cc4640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-11T00:29:37.074 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:37.067+0000 7f2283cc4640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-11T00:29:37.074 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:37.067+0000 7f2283cc4640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-11T00:29:37.074 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:37.069+0000 7f2283cc4640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-11T00:29:39.945 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-11T00:29:40.017 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-11T00:29:40.017 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:40.018 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-11T00:29:40.094 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:40.094 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-11T00:29:40.165 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:40.165 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-11T00:29:40.274 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:40.274 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-11T00:29:40.385 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:40.385 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-11T00:29:40.496 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:40.497 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-11T00:29:40.606 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:40.606 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-11T00:29:40.715 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:40.715 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-11T00:29:40.785 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:40.786 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-11T00:29:40.896 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:40.897 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-11T00:29:41.003 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:41.003 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-11T00:29:41.114 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:41.115 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-11T00:29:41.223 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:41.224 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-11T00:29:41.331 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:41.331 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-11T00:29:41.439 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:41.439 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-11T00:29:41.489 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:41.490 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-11T00:29:41.538 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:41.538 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-11T00:29:41.584 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:41.585 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-11T00:29:41.678 INFO:tasks.ceph:Adding keys to all mons... 2023-07-11T00:29:41.678 DEBUG:teuthology.orchestra.run.smithi022:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-11T00:29:41.694 DEBUG:teuthology.orchestra.run.smithi184:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-11T00:29:41.747 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.y] 2023-07-11T00:29:41.748 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBUoqxkaKyKIhAAYpRtjFhpOYFaTsYgHLptDg== 2023-07-11T00:29:41.748 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a] 2023-07-11T00:29:41.748 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBVoqxkcr9IIBAAqKIJX9ebddhQKcwNMjXIww== 2023-07-11T00:29:41.748 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.c] 2023-07-11T00:29:41.749 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBVoqxk/bU7LBAAKC6KUWaNWvqFpv3AKrwtnQ== 2023-07-11T00:29:41.749 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.0] 2023-07-11T00:29:41.749 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBYoqxkTCGgDxAAMG0ukMoXlziubvhE21b5UA== 2023-07-11T00:29:41.749 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.1] 2023-07-11T00:29:41.749 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBboqxkwSojFBAANmcZAYcHo5ms91KeZWaQbg== 2023-07-11T00:29:41.749 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.2] 2023-07-11T00:29:41.749 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBeoqxkGNjLGBAAUda/8QAOLpFCARS36ldkPA== 2023-07-11T00:29:41.750 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.3] 2023-07-11T00:29:41.750 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBhoqxkEe1jHRAAnpiNgcbSMPnF9FTm8ac5Nw== 2023-07-11T00:29:41.756 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.x] 2023-07-11T00:29:41.757 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBVoqxkx4lHGBAAHVaHNFYD0IuPzwzaJHuh7g== 2023-07-11T00:29:41.757 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b] 2023-07-11T00:29:41.757 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBVoqxkhOd0OBAApX3sp19vAM1rQA71VBpj4Q== 2023-07-11T00:29:41.757 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.d] 2023-07-11T00:29:41.757 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBWoqxkEAl0CBAAVl//C25jJlXrH3H+5c6ezA== 2023-07-11T00:29:41.757 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.4] 2023-07-11T00:29:41.757 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBnoqxkhREdNhAAjkVt+mjdFkq0PJ+sMeHb0Q== 2023-07-11T00:29:41.757 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.5] 2023-07-11T00:29:41.758 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBqoqxk261HORAAJJ1AZ3GTUT/gLpUUY2tKJA== 2023-07-11T00:29:41.758 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.6] 2023-07-11T00:29:41.758 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBuoqxkHtRdABAASL66oeSUw5Z9uDNoCe9aQA== 2023-07-11T00:29:41.758 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.7] 2023-07-11T00:29:41.758 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBxoqxkUbsTBBAAlowrIlbptumsnh/2Iq8FOg== 2023-07-11T00:29:41.758 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2023-07-11T00:29:41.758 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBWoqxkYp7gEhAAkay8GXLqeoGhPULEEnwHBw== 2023-07-11T00:29:41.758 INFO:teuthology.orchestra.run.smithi022.stdout:[client.2] 2023-07-11T00:29:41.759 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBWoqxkiADkGhAA+trkhPA5iVs+gWxE2E/OJA== 2023-07-11T00:29:41.759 INFO:teuthology.orchestra.run.smithi022.stdout:[client.1] 2023-07-11T00:29:41.759 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBWoqxkFf9pIhAAL8QYQeU/JEpI5IPKrvoWgA== 2023-07-11T00:29:41.759 INFO:teuthology.orchestra.run.smithi022.stdout:[client.3] 2023-07-11T00:29:41.759 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBWoqxkc0TeKRAAv1RuG03Ynt7zvyqG5UHj9A== 2023-07-11T00:29:41.782 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.y] 2023-07-11T00:29:41.782 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBUoqxkaKyKIhAAYpRtjFhpOYFaTsYgHLptDg== 2023-07-11T00:29:41.782 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2023-07-11T00:29:41.782 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBVoqxkcr9IIBAAqKIJX9ebddhQKcwNMjXIww== 2023-07-11T00:29:41.783 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2023-07-11T00:29:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBVoqxk/bU7LBAAKC6KUWaNWvqFpv3AKrwtnQ== 2023-07-11T00:29:41.783 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.0] 2023-07-11T00:29:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBYoqxkTCGgDxAAMG0ukMoXlziubvhE21b5UA== 2023-07-11T00:29:41.783 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.1] 2023-07-11T00:29:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBboqxkwSojFBAANmcZAYcHo5ms91KeZWaQbg== 2023-07-11T00:29:41.783 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.2] 2023-07-11T00:29:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBeoqxkGNjLGBAAUda/8QAOLpFCARS36ldkPA== 2023-07-11T00:29:41.784 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.3] 2023-07-11T00:29:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBhoqxkEe1jHRAAnpiNgcbSMPnF9FTm8ac5Nw== 2023-07-11T00:29:41.784 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.x] 2023-07-11T00:29:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBVoqxkx4lHGBAAHVaHNFYD0IuPzwzaJHuh7g== 2023-07-11T00:29:41.784 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2023-07-11T00:29:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBVoqxkhOd0OBAApX3sp19vAM1rQA71VBpj4Q== 2023-07-11T00:29:41.785 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2023-07-11T00:29:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBWoqxkEAl0CBAAVl//C25jJlXrH3H+5c6ezA== 2023-07-11T00:29:41.785 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.4] 2023-07-11T00:29:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBnoqxkhREdNhAAjkVt+mjdFkq0PJ+sMeHb0Q== 2023-07-11T00:29:41.785 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.5] 2023-07-11T00:29:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBqoqxk261HORAAJJ1AZ3GTUT/gLpUUY2tKJA== 2023-07-11T00:29:41.785 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.6] 2023-07-11T00:29:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBuoqxkHtRdABAASL66oeSUw5Z9uDNoCe9aQA== 2023-07-11T00:29:41.786 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.7] 2023-07-11T00:29:41.786 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBxoqxkUbsTBBAAlowrIlbptumsnh/2Iq8FOg== 2023-07-11T00:29:41.786 INFO:teuthology.orchestra.run.smithi184.stdout:[client.0] 2023-07-11T00:29:41.786 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBWoqxkYp7gEhAAkay8GXLqeoGhPULEEnwHBw== 2023-07-11T00:29:41.786 INFO:teuthology.orchestra.run.smithi184.stdout:[client.2] 2023-07-11T00:29:41.786 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBWoqxkiADkGhAA+trkhPA5iVs+gWxE2E/OJA== 2023-07-11T00:29:41.786 INFO:teuthology.orchestra.run.smithi184.stdout:[client.1] 2023-07-11T00:29:41.786 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBWoqxkFf9pIhAAL8QYQeU/JEpI5IPKrvoWgA== 2023-07-11T00:29:41.787 INFO:teuthology.orchestra.run.smithi184.stdout:[client.3] 2023-07-11T00:29:41.787 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBWoqxkc0TeKRAAv1RuG03Ynt7zvyqG5UHj9A== 2023-07-11T00:29:41.788 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-11T00:29:41.805 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-11T00:29:41.936 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-11T00:29:41.941 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-11T00:29:42.052 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-11T00:29:42.057 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-11T00:29:42.166 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-11T00:29:42.173 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-11T00:29:42.282 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-11T00:29:42.287 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-11T00:29:42.394 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-11T00:29:42.399 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-11T00:29:42.505 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-11T00:29:42.510 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-11T00:29:42.620 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-11T00:29:42.624 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-11T00:29:42.732 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-11T00:29:42.740 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-11T00:29:42.853 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-11T00:29:42.860 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-11T00:29:42.972 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-11T00:29:42.979 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-11T00:29:43.087 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-11T00:29:43.093 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-11T00:29:43.200 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-11T00:29:43.206 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-11T00:29:43.314 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-11T00:29:43.319 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-11T00:29:43.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-11T00:29:43.432 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-11T00:29:43.543 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-11T00:29:43.548 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-11T00:29:43.659 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-11T00:29:43.665 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-11T00:29:43.777 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-11T00:29:43.781 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-11T00:29:43.898 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-11T00:29:43.899 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-11T00:29:43.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-11T00:29:44.096 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-11T00:29:44.168 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-11T00:29:44.238 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-11T00:29:44.363 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-11T00:29:44.433 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-11T00:29:44.502 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-11T00:29:44.624 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-11T00:29:44.693 DEBUG:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-11T00:29:44.698 DEBUG:teuthology.orchestra.run.smithi184:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-11T00:29:44.742 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-11T00:29:44.742 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-11T00:29:44.743 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-11T00:29:44.785 INFO:tasks.ceph.mon.a:Started 2023-07-11T00:29:44.786 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-11T00:29:44.786 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-11T00:29:44.791 INFO:tasks.ceph.mon.b:Started 2023-07-11T00:29:44.791 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-11T00:29:44.791 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-11T00:29:44.795 INFO:tasks.ceph.mon.c:Started 2023-07-11T00:29:44.795 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-11T00:29:44.796 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-11T00:29:44.796 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-11T00:29:44.802 INFO:tasks.ceph.mgr.y:Started 2023-07-11T00:29:44.802 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-11T00:29:44.803 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-11T00:29:44.807 INFO:tasks.ceph.mgr.x:Started 2023-07-11T00:29:44.807 INFO:tasks.ceph:Setting crush tunables to default 2023-07-11T00:29:44.807 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd crush tunables default 2023-07-11T00:29:45.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.018+0000 7f9aaa9ff700 1 Processor -- start 2023-07-11T00:29:45.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.018+0000 7f9aaa9ff700 1 -- start start 2023-07-11T00:29:45.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.019+0000 7f9aaa9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aa40d2320 0x7f9aa40b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:45.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.019+0000 7f9aaa9ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9aa40b4be0 0x7f9aa40b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:45.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.019+0000 7f9aaa9ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa415fcc0 con 0x7f9aa415f8f0 2023-07-11T00:29:45.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.019+0000 7f9aaa9ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa40b5060 con 0x7f9aa40b4be0 2023-07-11T00:29:45.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.019+0000 7f9aaa9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa40cedd0 con 0x7f9aa40d2320 2023-07-11T00:29:45.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.019+0000 7f9aa8f9c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9aa40b4be0 0x7f9aa40b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:45.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.019+0000 7f9aa3fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9aa415f8f0 0x7f9aa40cd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41554/0 (socket says 172.21.15.22:41554) 2023-07-11T00:29:45.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.019+0000 7f9aa3fff700 1 -- 172.21.15.22:0/2963396684 learned_addr learned my addr 172.21.15.22:0/2963396684 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:29:45.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.019+0000 7f9aa37fe700 1 --2- 172.21.15.22:0/2963396684 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aa40d2320 0x7f9aa40b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:45.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.020+0000 7f9aa8f9c700 1 -- 172.21.15.22:0/2963396684 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aa40d2320 msgr2=0x7f9aa40b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:29:45.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.020+0000 7f9aa8f9c700 1 --2- 172.21.15.22:0/2963396684 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aa40d2320 0x7f9aa40b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:45.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.020+0000 7f9aa8f9c700 1 -- 172.21.15.22:0/2963396684 >> v1:172.21.15.22:6789/0 conn(0x7f9aa415f8f0 legacy=0x7f9aa40cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:45.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.020+0000 7f9aa8f9c700 1 -- 172.21.15.22:0/2963396684 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa40d2a20 con 0x7f9aa40b4be0 2023-07-11T00:29:45.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.020+0000 7f9aa2ffd700 1 -- 172.21.15.22:0/2963396684 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362260511 0 0) 0x7f9aa415fcc0 con 0x7f9aa415f8f0 2023-07-11T00:29:45.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.020+0000 7f9aa8f9c700 1 --2- 172.21.15.22:0/2963396684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9aa40b4be0 0x7f9aa40b5a70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009d90 tx=0x7f9a9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b888cadad75b7ec8 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:45.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.020+0000 7f9aa2ffd700 1 -- 172.21.15.22:0/2963396684 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c00e070 con 0x7f9aa40b4be0 2023-07-11T00:29:45.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.020+0000 7f9aa2ffd700 1 -- 172.21.15.22:0/2963396684 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9c00bb20 con 0x7f9aa40b4be0 2023-07-11T00:29:45.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.020+0000 7f9aa2ffd700 1 -- 172.21.15.22:0/2963396684 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c012430 con 0x7f9aa40b4be0 2023-07-11T00:29:45.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.021+0000 7f9aaa9ff700 1 -- 172.21.15.22:0/2963396684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9aa40b4be0 msgr2=0x7f9aa40b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:45.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.021+0000 7f9aaa9ff700 1 --2- 172.21.15.22:0/2963396684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9aa40b4be0 0x7f9aa40b5a70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009d90 tx=0x7f9a9c00b330 comp rx=0 tx=0).stop 2023-07-11T00:29:45.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.021+0000 7f9aaa9ff700 1 -- 172.21.15.22:0/2963396684 shutdown_connections 2023-07-11T00:29:45.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.021+0000 7f9aaa9ff700 1 --2- 172.21.15.22:0/2963396684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9aa40b4be0 0x7f9aa40b5a70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:45.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.021+0000 7f9aaa9ff700 1 --2- 172.21.15.22:0/2963396684 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aa40d2320 0x7f9aa40b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:45.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.021+0000 7f9aaa9ff700 1 -- 172.21.15.22:0/2963396684 >> 172.21.15.22:0/2963396684 conn(0x7f9aa4071660 msgr2=0x7f9aa4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:45.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.021+0000 7f9aaa9ff700 1 -- 172.21.15.22:0/2963396684 shutdown_connections 2023-07-11T00:29:45.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.021+0000 7f9aaa9ff700 1 -- 172.21.15.22:0/2963396684 wait complete. 2023-07-11T00:29:45.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.023+0000 7f9aaa9ff700 1 Processor -- start 2023-07-11T00:29:45.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.023+0000 7f9aaa9ff700 1 -- start start 2023-07-11T00:29:45.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.024+0000 7f9aaa9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9aa40b4be0 0x7f9aa4152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:45.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.024+0000 7f9aaa9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aa40d2320 0x7f9aa41415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:45.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.024+0000 7f9aaa9ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9aa415f8f0 0x7f9aa40cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:45.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.024+0000 7f9aaa9ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa4154710 con 0x7f9aa415f8f0 2023-07-11T00:29:45.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.024+0000 7f9aaa9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa4141b30 con 0x7f9aa40b4be0 2023-07-11T00:29:45.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.024+0000 7f9aaa9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa4154940 con 0x7f9aa40d2320 2023-07-11T00:29:45.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.024+0000 7f9aa8f9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9aa415f8f0 0x7f9aa40cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:45.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.024+0000 7f9aa8f9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9aa415f8f0 0x7f9aa40cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41480/0 (socket says 172.21.15.22:41480) 2023-07-11T00:29:45.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.024+0000 7f9aa8f9c700 1 -- 172.21.15.22:0/1394704409 learned_addr learned my addr 172.21.15.22:0/1394704409 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:29:45.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.024+0000 7f9aa37fe700 1 --2- 172.21.15.22:0/1394704409 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aa40d2320 0x7f9aa41415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:45.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.024+0000 7f9aa3fff700 1 --2- 172.21.15.22:0/1394704409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9aa40b4be0 0x7f9aa4152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:45.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.024+0000 7f9aa8f9c700 1 -- 172.21.15.22:0/1394704409 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aa40d2320 msgr2=0x7f9aa41415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:45.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.024+0000 7f9aa8f9c700 1 --2- 172.21.15.22:0/1394704409 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aa40d2320 0x7f9aa41415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:45.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.024+0000 7f9aa8f9c700 1 -- 172.21.15.22:0/1394704409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9aa40b4be0 msgr2=0x7f9aa4152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:45.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.024+0000 7f9aa8f9c700 1 --2- 172.21.15.22:0/1394704409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9aa40b4be0 0x7f9aa4152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:45.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.024+0000 7f9aa8f9c700 1 -- 172.21.15.22:0/1394704409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c009a70 con 0x7f9aa415f8f0 2023-07-11T00:29:45.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.025+0000 7f9aa8f9c700 1 --2- 172.21.15.22:0/1394704409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9aa415f8f0 0x7f9aa40cc590 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40b5810 tx=0x7f9a9c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:45.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.025+0000 7f9aa0ff9700 1 -- 172.21.15.22:0/1394704409 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c012430 con 0x7f9aa415f8f0 2023-07-11T00:29:45.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.025+0000 7f9aa0ff9700 1 -- 172.21.15.22:0/1394704409 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9c020070 con 0x7f9aa415f8f0 2023-07-11T00:29:45.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.025+0000 7f9aaa9ff700 1 -- 172.21.15.22:0/1394704409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa4154c20 con 0x7f9aa415f8f0 2023-07-11T00:29:45.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.025+0000 7f9aa0ff9700 1 -- 172.21.15.22:0/1394704409 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c004280 con 0x7f9aa415f8f0 2023-07-11T00:29:45.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.025+0000 7f9aaa9ff700 1 -- 172.21.15.22:0/1394704409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa41551e0 con 0x7f9aa415f8f0 2023-07-11T00:29:45.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.025+0000 7f9aa0ff9700 1 -- 172.21.15.22:0/1394704409 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9a9c0046e0 con 0x7f9aa415f8f0 2023-07-11T00:29:45.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.025+0000 7f9aa0ff9700 1 -- 172.21.15.22:0/1394704409 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9a9c022070 con 0x7f9aa415f8f0 2023-07-11T00:29:45.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.026+0000 7f9aaa9ff700 1 -- 172.21.15.22:0/1394704409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa40ccfe0 con 0x7f9aa415f8f0 2023-07-11T00:29:45.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.029+0000 7f9aa0ff9700 1 -- 172.21.15.22:0/1394704409 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f9a9c02c060 con 0x7f9aa415f8f0 2023-07-11T00:29:45.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.108+0000 7f9aaa9ff700 1 -- 172.21.15.22:0/1394704409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f9aa404ea60 con 0x7f9aa415f8f0 2023-07-11T00:29:45.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.111+0000 7f9aa0ff9700 1 -- 172.21.15.22:0/1394704409 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9a9c035090 con 0x7f9aa415f8f0 2023-07-11T00:29:45.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.112+0000 7f9aaa9ff700 1 -- 172.21.15.22:0/1394704409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9aa415f8f0 msgr2=0x7f9aa40cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:45.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.112+0000 7f9aaa9ff700 1 --2- 172.21.15.22:0/1394704409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9aa415f8f0 0x7f9aa40cc590 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40b5810 tx=0x7f9a9c004ad0 comp rx=0 tx=0).stop 2023-07-11T00:29:45.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.112+0000 7f9aaa9ff700 1 -- 172.21.15.22:0/1394704409 shutdown_connections 2023-07-11T00:29:45.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.112+0000 7f9aaa9ff700 1 --2- 172.21.15.22:0/1394704409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9aa415f8f0 0x7f9aa40cc590 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:45.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.112+0000 7f9aaa9ff700 1 --2- 172.21.15.22:0/1394704409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9aa40b4be0 0x7f9aa4152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:45.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.112+0000 7f9aaa9ff700 1 --2- 172.21.15.22:0/1394704409 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aa40d2320 0x7f9aa41415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:45.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.112+0000 7f9aaa9ff700 1 -- 172.21.15.22:0/1394704409 >> 172.21.15.22:0/1394704409 conn(0x7f9aa4071660 msgr2=0x7f9aa40b5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:45.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.113+0000 7f9aaa9ff700 1 -- 172.21.15.22:0/1394704409 shutdown_connections 2023-07-11T00:29:45.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:45.113+0000 7f9aaa9ff700 1 -- 172.21.15.22:0/1394704409 wait complete. 2023-07-11T00:29:45.117 INFO:teuthology.orchestra.run.smithi022.stderr:adjusted tunables profile to default 2023-07-11T00:29:45.133 INFO:tasks.ceph:check_enable_crimson: False 2023-07-11T00:29:45.133 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-11T00:29:45.134 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:45.135 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-11T00:29:45.187 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:45.185+0000 7fd06088c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-11T00:29:45.209 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:45.209 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-11T00:29:45.283 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:45.283 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-11T00:29:45.322 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:45.320+0000 7f16c5235200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-11T00:29:45.378 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:29:45.379 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-11T00:29:45.439 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:45.437+0000 7fd06088c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-11T00:29:45.455 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:45.456 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-11T00:29:45.531 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:45.529+0000 7f16c5235200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-11T00:29:45.546 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:45.546 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-11T00:29:45.624 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:45.625 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-11T00:29:45.693 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:29:45.694 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-11T00:29:45.802 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new abf82eea-e633-4560-8c0c-3d84c1b2e588 0 2023-07-11T00:29:45.895 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:45.893+0000 7fd06088c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-11T00:29:46.034 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:46.032+0000 7f16c5235200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-11T00:29:46.036 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.034+0000 7f50a57ff700 1 Processor -- start 2023-07-11T00:29:46.037 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.034+0000 7f50a57ff700 1 -- start start 2023-07-11T00:29:46.038 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.035+0000 7f50a57ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f50a00b8260 0x7f50a00cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:46.038 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.035+0000 7f50a57ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a0160a00 con 0x7f50a00b4d20 2023-07-11T00:29:46.038 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.035+0000 7f50a57ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a0160ce0 con 0x7f50a00d25c0 2023-07-11T00:29:46.038 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.035+0000 7f50a57ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a00cd280 con 0x7f50a00b8260 2023-07-11T00:29:46.040 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.035+0000 7f509e7fc700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f50a00d25c0 0x7f50a00b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:54208/0 (socket says 172.21.15.184:54208) 2023-07-11T00:29:46.041 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.035+0000 7f509e7fc700 1 -- 172.21.15.184:0/2800622305 learned_addr learned my addr 172.21.15.184:0/2800622305 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-07-11T00:29:46.041 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.035+0000 7f509f7fe700 1 --1- 172.21.15.184:0/2800622305 >> v1:172.21.15.22:6789/0 conn(0x7f50a00b4d20 0x7f50a00d0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.184:53282/0 (socket says 172.21.15.184:53282) 2023-07-11T00:29:46.041 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.035+0000 7f509effd700 1 --2- 172.21.15.184:0/2800622305 >> v2:172.21.15.184:3300/0 conn(0x7f50a00b8260 0x7f50a00cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:46.041 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.036+0000 7f509dffb700 1 -- 172.21.15.184:0/2800622305 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171021950 0 0) 0x7f50a0160ce0 con 0x7f50a00d25c0 2023-07-11T00:29:46.041 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.036+0000 7f509dffb700 1 -- 172.21.15.184:0/2800622305 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50880035b0 con 0x7f50a00d25c0 2023-07-11T00:29:46.042 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.036+0000 7f509dffb700 1 -- 172.21.15.184:0/2800622305 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055462649 0 0) 0x7f50a0160a00 con 0x7f50a00b4d20 2023-07-11T00:29:46.042 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.036+0000 7f509dffb700 1 -- 172.21.15.184:0/2800622305 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50a0160ce0 con 0x7f50a00b4d20 2023-07-11T00:29:46.042 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.036+0000 7f509effd700 1 -- 172.21.15.184:0/2800622305 >> v1:172.21.15.184:6789/0 conn(0x7f50a00d25c0 legacy=0x7f50a00b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.042 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.036+0000 7f509effd700 1 -- 172.21.15.184:0/2800622305 >> v1:172.21.15.22:6789/0 conn(0x7f50a00b4d20 legacy=0x7f50a00d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.042 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.036+0000 7f509effd700 1 -- 172.21.15.184:0/2800622305 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a00cd560 con 0x7f50a00b8260 2023-07-11T00:29:46.042 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.036+0000 7f509effd700 1 --2- 172.21.15.184:0/2800622305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a00b8260 0x7f50a00cede0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5090009840 tx=0x7f5090009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be1d60a47cf4ed40 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:46.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.036+0000 7f509dffb700 1 -- 172.21.15.184:0/2800622305 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090011830 con 0x7f50a00b8260 2023-07-11T00:29:46.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.037+0000 7f509dffb700 1 -- 172.21.15.184:0/2800622305 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090011990 con 0x7f50a00b8260 2023-07-11T00:29:46.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.037+0000 7f509dffb700 1 -- 172.21.15.184:0/2800622305 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090011d20 con 0x7f50a00b8260 2023-07-11T00:29:46.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.037+0000 7f50a57ff700 1 -- 172.21.15.184:0/2800622305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a00b8260 msgr2=0x7f50a00cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.037+0000 7f50a57ff700 1 --2- 172.21.15.184:0/2800622305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a00b8260 0x7f50a00cede0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5090009840 tx=0x7f5090009b50 comp rx=0 tx=0).stop 2023-07-11T00:29:46.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.037+0000 7f50a57ff700 1 -- 172.21.15.184:0/2800622305 shutdown_connections 2023-07-11T00:29:46.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.037+0000 7f50a57ff700 1 --2- 172.21.15.184:0/2800622305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a00b8260 0x7f50a00cede0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.037+0000 7f50a57ff700 1 -- 172.21.15.184:0/2800622305 >> 172.21.15.184:0/2800622305 conn(0x7f50a00722b0 msgr2=0x7f50a00cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:46.044 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.037+0000 7f50a57ff700 1 -- 172.21.15.184:0/2800622305 shutdown_connections 2023-07-11T00:29:46.044 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.037+0000 7f50a57ff700 1 -- 172.21.15.184:0/2800622305 wait complete. 2023-07-11T00:29:46.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.039+0000 7f50a57ff700 1 Processor -- start 2023-07-11T00:29:46.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.039+0000 7f50a57ff700 1 -- start start 2023-07-11T00:29:46.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.040+0000 7f50a57ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a00b8260 0x7f50a015a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:46.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.040+0000 7f50a57ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a00d25c0 0x7f50a00c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:46.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.040+0000 7f50a57ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50a015a3c0 0x7f50a00c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:46.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.040+0000 7f50a57ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a01e7f90 con 0x7f50a015a3c0 2023-07-11T00:29:46.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.040+0000 7f50a57ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a00c9ab0 con 0x7f50a00d25c0 2023-07-11T00:29:46.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.040+0000 7f50a57ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a015b130 con 0x7f50a00b8260 2023-07-11T00:29:46.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.040+0000 7f509e7fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a00d25c0 0x7f50a00c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:46.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.040+0000 7f509effd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a00b8260 0x7f50a015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:46.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.040+0000 7f509e7fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a00d25c0 0x7f50a00c9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:45444/0 (socket says 172.21.15.184:45444) 2023-07-11T00:29:46.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.040+0000 7f509e7fc700 1 -- 172.21.15.184:0/3446520075 learned_addr learned my addr 172.21.15.184:0/3446520075 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-11T00:29:46.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.040+0000 7f509effd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a00b8260 0x7f50a015a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:56124/0 (socket says 172.21.15.184:56124) 2023-07-11T00:29:46.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.041+0000 7f509effd700 1 -- 172.21.15.184:0/3446520075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a00d25c0 msgr2=0x7f50a00c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.041+0000 7f509effd700 1 --2- 172.21.15.184:0/3446520075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a00d25c0 0x7f50a00c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.041+0000 7f509effd700 1 -- 172.21.15.184:0/3446520075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50a015a3c0 msgr2=0x7f50a00c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.041+0000 7f509effd700 1 --2- 172.21.15.184:0/3446520075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50a015a3c0 0x7f50a00c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.041+0000 7f509effd700 1 -- 172.21.15.184:0/3446520075 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50900094a0 con 0x7f50a00b8260 2023-07-11T00:29:46.049 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.041+0000 7f509effd700 1 --2- 172.21.15.184:0/3446520075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a00b8260 0x7f50a015a830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5090016000 tx=0x7f5090004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:46.049 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.041+0000 7f50877fe700 1 -- 172.21.15.184:0/3446520075 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509001a760 con 0x7f50a00b8260 2023-07-11T00:29:46.049 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.041+0000 7f50877fe700 1 -- 172.21.15.184:0/3446520075 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509001a8c0 con 0x7f50a00b8260 2023-07-11T00:29:46.049 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.041+0000 7f50a57ff700 1 -- 172.21.15.184:0/3446520075 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a015e750 con 0x7f50a00b8260 2023-07-11T00:29:46.049 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.041+0000 7f50877fe700 1 -- 172.21.15.184:0/3446520075 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509001ac70 con 0x7f50a00b8260 2023-07-11T00:29:46.049 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.041+0000 7f50a57ff700 1 -- 172.21.15.184:0/3446520075 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a01e5db0 con 0x7f50a00b8260 2023-07-11T00:29:46.050 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.042+0000 7f50877fe700 1 -- 172.21.15.184:0/3446520075 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5090022070 con 0x7f50a00b8260 2023-07-11T00:29:46.050 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.042+0000 7f50877fe700 1 -- 172.21.15.184:0/3446520075 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f509002d3f0 con 0x7f50a00b8260 2023-07-11T00:29:46.051 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.042+0000 7f50a57ff700 1 -- 172.21.15.184:0/3446520075 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a015ec30 con 0x7f50a00b8260 2023-07-11T00:29:46.051 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.045+0000 7f50877fe700 1 -- 172.21.15.184:0/3446520075 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f50a015ec30 con 0x7f50a00b8260 2023-07-11T00:29:46.134 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.131+0000 7f50a57ff700 1 -- 172.21.15.184:0/3446520075 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "abf82eea-e633-4560-8c0c-3d84c1b2e588", "id": 0} v 0) v1 -- 0x7f50a004ea60 con 0x7f50a00b8260 2023-07-11T00:29:46.138 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.136+0000 7f50877fe700 1 -- 172.21.15.184:0/3446520075 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "abf82eea-e633-4560-8c0c-3d84c1b2e588", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5090029070 con 0x7f50a00b8260 2023-07-11T00:29:46.139 INFO:teuthology.orchestra.run.smithi184.stdout:0 2023-07-11T00:29:46.140 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.137+0000 7f50a57ff700 1 -- 172.21.15.184:0/3446520075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a00b8260 msgr2=0x7f50a015a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.140 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.137+0000 7f50a57ff700 1 --2- 172.21.15.184:0/3446520075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a00b8260 0x7f50a015a830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5090016000 tx=0x7f5090004750 comp rx=0 tx=0).stop 2023-07-11T00:29:46.140 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.137+0000 7f50a57ff700 1 -- 172.21.15.184:0/3446520075 shutdown_connections 2023-07-11T00:29:46.140 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.137+0000 7f50a57ff700 1 --2- 172.21.15.184:0/3446520075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a00b8260 0x7f50a015a830 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.140 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.137+0000 7f50a57ff700 1 --2- 172.21.15.184:0/3446520075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50a015a3c0 0x7f50a00c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.141 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.137+0000 7f50a57ff700 1 --2- 172.21.15.184:0/3446520075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a00d25c0 0x7f50a00c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.141 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.137+0000 7f50a57ff700 1 -- 172.21.15.184:0/3446520075 >> 172.21.15.184:0/3446520075 conn(0x7f50a00b4d20 msgr2=0x7f50a00d0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:46.141 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.137+0000 7f50a57ff700 1 -- 172.21.15.184:0/3446520075 shutdown_connections 2023-07-11T00:29:46.141 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.137+0000 7f50a57ff700 1 -- 172.21.15.184:0/3446520075 wait complete. 2023-07-11T00:29:46.157 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new ad893bc1-d378-46b2-ba64-ae1284ddbe40 1 2023-07-11T00:29:46.349 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.347+0000 7fb271fff700 1 Processor -- start 2023-07-11T00:29:46.350 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.347+0000 7fb271fff700 1 -- start start 2023-07-11T00:29:46.351 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.348+0000 7fb271fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb26c0d25c0 0x7fb26c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:46.351 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.348+0000 7fb271fff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26c160a00 con 0x7fb26c0b4d20 2023-07-11T00:29:46.351 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.348+0000 7fb271fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26c160ce0 con 0x7fb26c0b8260 2023-07-11T00:29:46.352 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.348+0000 7fb271fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26c0cd280 con 0x7fb26c0d25c0 2023-07-11T00:29:46.352 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.348+0000 7fb26bfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb26c0d25c0 0x7fb26c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:46.352 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.348+0000 7fb26b7fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb26c0b8260 0x7fb26c0b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:54210/0 (socket says 172.21.15.184:54210) 2023-07-11T00:29:46.352 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.348+0000 7fb26b7fe700 1 -- 172.21.15.184:0/2330039953 learned_addr learned my addr 172.21.15.184:0/2330039953 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-07-11T00:29:46.353 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.349+0000 7fb26bfff700 1 -- 172.21.15.184:0/2330039953 >> v1:172.21.15.184:6789/0 conn(0x7fb26c0b8260 legacy=0x7fb26c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.354 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.349+0000 7fb26bfff700 1 -- 172.21.15.184:0/2330039953 >> v1:172.21.15.22:6789/0 conn(0x7fb26c0b4d20 legacy=0x7fb26c0d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.354 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.349+0000 7fb26bfff700 1 -- 172.21.15.184:0/2330039953 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c0cd560 con 0x7fb26c0d25c0 2023-07-11T00:29:46.354 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.349+0000 7fb26bfff700 1 --2- 172.21.15.184:0/2330039953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb26c0d25c0 0x7fb26c0cede0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb264009d90 tx=0x7fb26400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dadc9cc428014f4a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:46.354 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.349+0000 7fb26affd700 1 -- 172.21.15.184:0/2330039953 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26400e070 con 0x7fb26c0d25c0 2023-07-11T00:29:46.354 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.349+0000 7fb26affd700 1 -- 172.21.15.184:0/2330039953 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26400bbd0 con 0x7fb26c0d25c0 2023-07-11T00:29:46.354 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.349+0000 7fb26affd700 1 -- 172.21.15.184:0/2330039953 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264012430 con 0x7fb26c0d25c0 2023-07-11T00:29:46.354 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.350+0000 7fb271fff700 1 -- 172.21.15.184:0/2330039953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb26c0d25c0 msgr2=0x7fb26c0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.355 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.350+0000 7fb271fff700 1 --2- 172.21.15.184:0/2330039953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb26c0d25c0 0x7fb26c0cede0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb264009d90 tx=0x7fb26400b330 comp rx=0 tx=0).stop 2023-07-11T00:29:46.355 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.350+0000 7fb271fff700 1 -- 172.21.15.184:0/2330039953 shutdown_connections 2023-07-11T00:29:46.355 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.350+0000 7fb271fff700 1 --2- 172.21.15.184:0/2330039953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb26c0d25c0 0x7fb26c0cede0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.355 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.350+0000 7fb271fff700 1 -- 172.21.15.184:0/2330039953 >> 172.21.15.184:0/2330039953 conn(0x7fb26c0722b0 msgr2=0x7fb26c0cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:46.355 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.350+0000 7fb271fff700 1 -- 172.21.15.184:0/2330039953 shutdown_connections 2023-07-11T00:29:46.355 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.350+0000 7fb271fff700 1 -- 172.21.15.184:0/2330039953 wait complete. 2023-07-11T00:29:46.357 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.352+0000 7fb271fff700 1 Processor -- start 2023-07-11T00:29:46.357 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.352+0000 7fb271fff700 1 -- start start 2023-07-11T00:29:46.357 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.353+0000 7fb271fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb26c0b8260 0x7fb26c0ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:46.357 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.353+0000 7fb271fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb26c0d25c0 0x7fb26c0cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:46.358 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.353+0000 7fb271fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb26c0c9290 0x7fb26c0c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:46.358 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.353+0000 7fb271fff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c145e50 con 0x7fb26c0c9290 2023-07-11T00:29:46.358 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.353+0000 7fb271fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c0cd0b0 con 0x7fb26c0b8260 2023-07-11T00:29:46.358 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.353+0000 7fb271fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c0cc530 con 0x7fb26c0d25c0 2023-07-11T00:29:46.358 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.354+0000 7fb26b7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb26c0b8260 0x7fb26c0ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:46.358 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.354+0000 7fb263fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb26c0d25c0 0x7fb26c0cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:46.358 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.354+0000 7fb26b7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb26c0b8260 0x7fb26c0ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:45468/0 (socket says 172.21.15.184:45468) 2023-07-11T00:29:46.359 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.354+0000 7fb26b7fe700 1 -- 172.21.15.184:0/1890286285 learned_addr learned my addr 172.21.15.184:0/1890286285 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-11T00:29:46.359 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.354+0000 7fb26bfff700 1 --2- 172.21.15.184:0/1890286285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb26c0c9290 0x7fb26c0c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:46.359 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.354+0000 7fb26b7fe700 1 -- 172.21.15.184:0/1890286285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb26c0d25c0 msgr2=0x7fb26c0cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.359 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.354+0000 7fb26b7fe700 1 --2- 172.21.15.184:0/1890286285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb26c0d25c0 0x7fb26c0cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.359 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.354+0000 7fb26b7fe700 1 -- 172.21.15.184:0/1890286285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb26c0c9290 msgr2=0x7fb26c0c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.359 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.354+0000 7fb26b7fe700 1 --2- 172.21.15.184:0/1890286285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb26c0c9290 0x7fb26c0c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.359 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.354+0000 7fb26b7fe700 1 -- 172.21.15.184:0/1890286285 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb264009a70 con 0x7fb26c0b8260 2023-07-11T00:29:46.359 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.354+0000 7fb263fff700 1 --2- 172.21.15.184:0/1890286285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb26c0d25c0 0x7fb26c0cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:29:46.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.354+0000 7fb26bfff700 1 --2- 172.21.15.184:0/1890286285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb26c0c9290 0x7fb26c0c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:29:46.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.354+0000 7fb26b7fe700 1 --2- 172.21.15.184:0/1890286285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb26c0b8260 0x7fb26c0ca100 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00c550 tx=0x7fb25c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:46.361 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.355+0000 7fb268ff9700 1 -- 172.21.15.184:0/1890286285 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c005d70 con 0x7fb26c0b8260 2023-07-11T00:29:46.361 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.355+0000 7fb268ff9700 1 -- 172.21.15.184:0/1890286285 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25c0070d0 con 0x7fb26c0b8260 2023-07-11T00:29:46.361 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.355+0000 7fb268ff9700 1 -- 172.21.15.184:0/1890286285 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c007440 con 0x7fb26c0b8260 2023-07-11T00:29:46.361 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.355+0000 7fb271fff700 1 -- 172.21.15.184:0/1890286285 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26c0cc810 con 0x7fb26c0b8260 2023-07-11T00:29:46.361 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.355+0000 7fb271fff700 1 -- 172.21.15.184:0/1890286285 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26c0ccdd0 con 0x7fb26c0b8260 2023-07-11T00:29:46.362 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.355+0000 7fb268ff9700 1 -- 172.21.15.184:0/1890286285 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb25c01c440 con 0x7fb26c0b8260 2023-07-11T00:29:46.362 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.355+0000 7fb268ff9700 1 -- 172.21.15.184:0/1890286285 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fb25c0127b0 con 0x7fb26c0b8260 2023-07-11T00:29:46.362 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.356+0000 7fb271fff700 1 -- 172.21.15.184:0/1890286285 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26c0cd8d0 con 0x7fb26c0b8260 2023-07-11T00:29:46.362 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.359+0000 7fb268ff9700 1 -- 172.21.15.184:0/1890286285 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7fb25c021060 con 0x7fb26c0b8260 2023-07-11T00:29:46.449 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.445+0000 7fb271fff700 1 -- 172.21.15.184:0/1890286285 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ad893bc1-d378-46b2-ba64-ae1284ddbe40", "id": 1} v 0) v1 -- 0x7fb26c04ea60 con 0x7fb26c0b8260 2023-07-11T00:29:46.452 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.449+0000 7fb268ff9700 1 -- 172.21.15.184:0/1890286285 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad893bc1-d378-46b2-ba64-ae1284ddbe40", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb25c017070 con 0x7fb26c0b8260 2023-07-11T00:29:46.453 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-07-11T00:29:46.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.450+0000 7fb271fff700 1 -- 172.21.15.184:0/1890286285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb26c0b8260 msgr2=0x7fb26c0ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.450+0000 7fb271fff700 1 --2- 172.21.15.184:0/1890286285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb26c0b8260 0x7fb26c0ca100 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00c550 tx=0x7fb25c00c860 comp rx=0 tx=0).stop 2023-07-11T00:29:46.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.450+0000 7fb271fff700 1 -- 172.21.15.184:0/1890286285 shutdown_connections 2023-07-11T00:29:46.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.450+0000 7fb271fff700 1 --2- 172.21.15.184:0/1890286285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb26c0c9290 0x7fb26c0c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.450+0000 7fb271fff700 1 --2- 172.21.15.184:0/1890286285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb26c0b8260 0x7fb26c0ca100 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.450+0000 7fb271fff700 1 --2- 172.21.15.184:0/1890286285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb26c0d25c0 0x7fb26c0cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.455 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.450+0000 7fb271fff700 1 -- 172.21.15.184:0/1890286285 >> 172.21.15.184:0/1890286285 conn(0x7fb26c0b4d20 msgr2=0x7fb26c0d0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:46.455 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.450+0000 7fb271fff700 1 -- 172.21.15.184:0/1890286285 shutdown_connections 2023-07-11T00:29:46.455 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.451+0000 7fb271fff700 1 -- 172.21.15.184:0/1890286285 wait complete. 2023-07-11T00:29:46.470 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new e4e14ad2-14ce-486d-ac23-d7c5652be546 2 2023-07-11T00:29:46.529 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:46.525+0000 7fd06088c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-11T00:29:46.661 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:46.658+0000 7f16c5235200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-11T00:29:46.663 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.660+0000 7fdd37dff700 1 Processor -- start 2023-07-11T00:29:46.663 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.660+0000 7fdd37dff700 1 -- start start 2023-07-11T00:29:46.665 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.661+0000 7fdd37dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdd300d2320 0x7fdd300b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:46.666 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.662+0000 7fdd37dff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3015fcc0 con 0x7fdd3015f8f0 2023-07-11T00:29:46.666 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.662+0000 7fdd37dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd300d2a20 con 0x7fdd300b4be0 2023-07-11T00:29:46.666 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.662+0000 7fdd37dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd300b5000 con 0x7fdd300d2320 2023-07-11T00:29:46.667 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.662+0000 7fdd3539a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdd300d2320 0x7fdd300b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:46.667 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.662+0000 7fdd3639c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fdd300b4be0 0x7fdd300b5a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:54212/0 (socket says 172.21.15.184:54212) 2023-07-11T00:29:46.667 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.662+0000 7fdd3639c700 1 -- 172.21.15.184:0/2690412010 learned_addr learned my addr 172.21.15.184:0/2690412010 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-07-11T00:29:46.667 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.662+0000 7fdd3539a700 1 -- 172.21.15.184:0/2690412010 >> v1:172.21.15.184:6789/0 conn(0x7fdd300b4be0 legacy=0x7fdd300b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.667 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.662+0000 7fdd3539a700 1 -- 172.21.15.184:0/2690412010 >> v1:172.21.15.22:6789/0 conn(0x7fdd3015f8f0 legacy=0x7fdd300cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.662+0000 7fdd34b99700 1 -- 172.21.15.184:0/2690412010 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256437932 0 0) 0x7fdd300d2a20 con 0x7fdd300b4be0 2023-07-11T00:29:46.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.662+0000 7fdd3539a700 1 -- 172.21.15.184:0/2690412010 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd300cedd0 con 0x7fdd300d2320 2023-07-11T00:29:46.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.663+0000 7fdd3539a700 1 --2- 172.21.15.184:0/2690412010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd300d2320 0x7fdd300b46a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdd20009840 tx=0x7fdd20009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae1be8ad9c24ca6f server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:46.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.663+0000 7fdd34b99700 1 -- 172.21.15.184:0/2690412010 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20004230 con 0x7fdd300d2320 2023-07-11T00:29:46.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.663+0000 7fdd34b99700 1 -- 172.21.15.184:0/2690412010 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd20004390 con 0x7fdd300d2320 2023-07-11T00:29:46.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.663+0000 7fdd34b99700 1 -- 172.21.15.184:0/2690412010 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd200036a0 con 0x7fdd300d2320 2023-07-11T00:29:46.671 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.663+0000 7fdd37dff700 1 -- 172.21.15.184:0/2690412010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd300d2320 msgr2=0x7fdd300b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.671 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.663+0000 7fdd37dff700 1 --2- 172.21.15.184:0/2690412010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd300d2320 0x7fdd300b46a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdd20009840 tx=0x7fdd20009b50 comp rx=0 tx=0).stop 2023-07-11T00:29:46.672 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.663+0000 7fdd37dff700 1 -- 172.21.15.184:0/2690412010 shutdown_connections 2023-07-11T00:29:46.672 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.663+0000 7fdd37dff700 1 --2- 172.21.15.184:0/2690412010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd300d2320 0x7fdd300b46a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.672 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.664+0000 7fdd37dff700 1 -- 172.21.15.184:0/2690412010 >> 172.21.15.184:0/2690412010 conn(0x7fdd30071660 msgr2=0x7fdd30071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:46.672 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.664+0000 7fdd37dff700 1 -- 172.21.15.184:0/2690412010 shutdown_connections 2023-07-11T00:29:46.672 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.664+0000 7fdd37dff700 1 -- 172.21.15.184:0/2690412010 wait complete. 2023-07-11T00:29:46.672 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.665+0000 7fdd37dff700 1 Processor -- start 2023-07-11T00:29:46.672 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.665+0000 7fdd37dff700 1 -- start start 2023-07-11T00:29:46.672 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.666+0000 7fdd37dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd300b4be0 0x7fdd301f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:46.673 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.666+0000 7fdd37dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd300d2320 0x7fdd301550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:46.673 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.666+0000 7fdd37dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd3015f8f0 0x7fdd3015aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:46.673 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.666+0000 7fdd37dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd301e5c50 con 0x7fdd300b4be0 2023-07-11T00:29:46.673 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.666+0000 7fdd37dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd301f2b20 con 0x7fdd300d2320 2023-07-11T00:29:46.673 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.666+0000 7fdd37dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd301e6070 con 0x7fdd3015f8f0 2023-07-11T00:29:46.673 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.666+0000 7fdd3539a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd300d2320 0x7fdd301550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:46.673 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.667+0000 7fdd3539a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd300d2320 0x7fdd301550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:45484/0 (socket says 172.21.15.184:45484) 2023-07-11T00:29:46.674 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.667+0000 7fdd3639c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd3015f8f0 0x7fdd3015aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:46.674 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.667+0000 7fdd3539a700 1 -- 172.21.15.184:0/733963557 learned_addr learned my addr 172.21.15.184:0/733963557 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-11T00:29:46.674 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.667+0000 7fdd35b9b700 1 --2- 172.21.15.184:0/733963557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd300b4be0 0x7fdd301f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:46.674 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.667+0000 7fdd3539a700 1 -- 172.21.15.184:0/733963557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd3015f8f0 msgr2=0x7fdd3015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.674 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.667+0000 7fdd3539a700 1 --2- 172.21.15.184:0/733963557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd3015f8f0 0x7fdd3015aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.674 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.667+0000 7fdd3539a700 1 -- 172.21.15.184:0/733963557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd300b4be0 msgr2=0x7fdd301f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.674 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.667+0000 7fdd3539a700 1 --2- 172.21.15.184:0/733963557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd300b4be0 0x7fdd301f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.674 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.667+0000 7fdd3539a700 1 -- 172.21.15.184:0/733963557 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd200094a0 con 0x7fdd300d2320 2023-07-11T00:29:46.675 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.667+0000 7fdd3539a700 1 --2- 172.21.15.184:0/733963557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd300d2320 0x7fdd301550e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdd200090b0 tx=0x7fdd20004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:46.675 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.667+0000 7fdd267fc700 1 -- 172.21.15.184:0/733963557 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20011630 con 0x7fdd300d2320 2023-07-11T00:29:46.675 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.667+0000 7fdd267fc700 1 -- 172.21.15.184:0/733963557 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2001f070 con 0x7fdd300d2320 2023-07-11T00:29:46.675 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.667+0000 7fdd37dff700 1 -- 172.21.15.184:0/733963557 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd301e4fd0 con 0x7fdd300d2320 2023-07-11T00:29:46.675 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.668+0000 7fdd267fc700 1 -- 172.21.15.184:0/733963557 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20011a10 con 0x7fdd300d2320 2023-07-11T00:29:46.675 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.668+0000 7fdd37dff700 1 -- 172.21.15.184:0/733963557 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd301e5590 con 0x7fdd300d2320 2023-07-11T00:29:46.675 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.668+0000 7fdd267fc700 1 -- 172.21.15.184:0/733963557 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdd20026480 con 0x7fdd300d2320 2023-07-11T00:29:46.675 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.668+0000 7fdd267fc700 1 -- 172.21.15.184:0/733963557 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fdd20021070 con 0x7fdd300d2320 2023-07-11T00:29:46.676 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.669+0000 7fdd37dff700 1 -- 172.21.15.184:0/733963557 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd301e5d90 con 0x7fdd300d2320 2023-07-11T00:29:46.676 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.671+0000 7fdd267fc700 1 -- 172.21.15.184:0/733963557 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7fdd301e5d90 con 0x7fdd300d2320 2023-07-11T00:29:46.760 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.757+0000 7fdd37dff700 1 -- 172.21.15.184:0/733963557 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e4e14ad2-14ce-486d-ac23-d7c5652be546", "id": 2} v 0) v1 -- 0x7fdd3004ea60 con 0x7fdd300d2320 2023-07-11T00:29:46.764 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.761+0000 7fdd267fc700 1 -- 172.21.15.184:0/733963557 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e4e14ad2-14ce-486d-ac23-d7c5652be546", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdd2002b020 con 0x7fdd300d2320 2023-07-11T00:29:46.765 INFO:teuthology.orchestra.run.smithi184.stdout:2 2023-07-11T00:29:46.766 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.762+0000 7fdd37dff700 1 -- 172.21.15.184:0/733963557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd300d2320 msgr2=0x7fdd301550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.766 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.762+0000 7fdd37dff700 1 --2- 172.21.15.184:0/733963557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd300d2320 0x7fdd301550e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdd200090b0 tx=0x7fdd20004750 comp rx=0 tx=0).stop 2023-07-11T00:29:46.766 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.762+0000 7fdd37dff700 1 -- 172.21.15.184:0/733963557 shutdown_connections 2023-07-11T00:29:46.766 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.762+0000 7fdd37dff700 1 --2- 172.21.15.184:0/733963557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd3015f8f0 0x7fdd3015aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.766 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.762+0000 7fdd37dff700 1 --2- 172.21.15.184:0/733963557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd300b4be0 0x7fdd301f25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.768 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.762+0000 7fdd37dff700 1 --2- 172.21.15.184:0/733963557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd300d2320 0x7fdd301550e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.768 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.762+0000 7fdd37dff700 1 -- 172.21.15.184:0/733963557 >> 172.21.15.184:0/733963557 conn(0x7fdd30071660 msgr2=0x7fdd3015cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:46.768 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.763+0000 7fdd37dff700 1 -- 172.21.15.184:0/733963557 shutdown_connections 2023-07-11T00:29:46.769 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.763+0000 7fdd37dff700 1 -- 172.21.15.184:0/733963557 wait complete. 2023-07-11T00:29:46.772 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:46.769+0000 7fd06088c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-11T00:29:46.782 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 4845d466-fe99-42e5-a783-337f0cc8a20c 3 2023-07-11T00:29:46.911 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:46.908+0000 7f16c5235200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-11T00:29:46.982 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.975+0000 7f9289dff700 1 Processor -- start 2023-07-11T00:29:46.983 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.975+0000 7f9289dff700 1 -- start start 2023-07-11T00:29:46.983 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.976+0000 7f9289dff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f92840d2320 0x7f92840b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:46.983 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.976+0000 7f9289dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f92840b4be0 0x7f92840b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:46.983 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.976+0000 7f9289dff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f928415fcc0 con 0x7f928415f8f0 2023-07-11T00:29:46.983 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.976+0000 7f9289dff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92840b5000 con 0x7f92840d2320 2023-07-11T00:29:46.983 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.976+0000 7f9289dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92840cedd0 con 0x7f92840b4be0 2023-07-11T00:29:46.983 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.976+0000 7f9283fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f92840b4be0 0x7f92840b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:46.984 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.976+0000 7f9283fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f92840b4be0 0x7f92840b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:45492/0 (socket says 172.21.15.184:45492) 2023-07-11T00:29:46.984 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.976+0000 7f9283fff700 1 -- 172.21.15.184:0/566961279 learned_addr learned my addr 172.21.15.184:0/566961279 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-11T00:29:46.984 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.976+0000 7f9282ffd700 1 --2- 172.21.15.184:0/566961279 >> v2:172.21.15.22:3300/0 conn(0x7f92840d2320 0x7f92840b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:46.986 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.977+0000 7f9283fff700 1 -- 172.21.15.184:0/566961279 >> v2:172.21.15.22:3300/0 conn(0x7f92840d2320 msgr2=0x7f92840b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:29:46.987 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.977+0000 7f9283fff700 1 --2- 172.21.15.184:0/566961279 >> v2:172.21.15.22:3300/0 conn(0x7f92840d2320 0x7f92840b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.987 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.977+0000 7f9283fff700 1 -- 172.21.15.184:0/566961279 >> v1:172.21.15.22:6789/0 conn(0x7f928415f8f0 legacy=0x7f92840cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.987 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.977+0000 7f9283fff700 1 -- 172.21.15.184:0/566961279 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92840d2a20 con 0x7f92840b4be0 2023-07-11T00:29:46.987 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.977+0000 7f9283fff700 1 --2- 172.21.15.184:0/566961279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92840b4be0 0x7f92840b5a70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f92840b8d70 tx=0x7f927c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4797aac4ce3b3a55 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:46.987 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.977+0000 7f92827fc700 1 -- 172.21.15.184:0/566961279 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c00e070 con 0x7f92840b4be0 2023-07-11T00:29:46.988 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.977+0000 7f92827fc700 1 -- 172.21.15.184:0/566961279 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927c00b910 con 0x7f92840b4be0 2023-07-11T00:29:46.989 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.977+0000 7f92827fc700 1 -- 172.21.15.184:0/566961279 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c00bcc0 con 0x7f92840b4be0 2023-07-11T00:29:46.989 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.978+0000 7f9289dff700 1 -- 172.21.15.184:0/566961279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92840b4be0 msgr2=0x7f92840b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:46.989 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.978+0000 7f9289dff700 1 --2- 172.21.15.184:0/566961279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92840b4be0 0x7f92840b5a70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f92840b8d70 tx=0x7f927c00b330 comp rx=0 tx=0).stop 2023-07-11T00:29:46.989 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.978+0000 7f9289dff700 1 -- 172.21.15.184:0/566961279 shutdown_connections 2023-07-11T00:29:46.989 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.978+0000 7f9289dff700 1 --2- 172.21.15.184:0/566961279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92840b4be0 0x7f92840b5a70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.990 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.978+0000 7f9289dff700 1 --2- 172.21.15.184:0/566961279 >> v2:172.21.15.22:3300/0 conn(0x7f92840d2320 0x7f92840b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:46.990 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.978+0000 7f9289dff700 1 -- 172.21.15.184:0/566961279 >> 172.21.15.184:0/566961279 conn(0x7f9284071660 msgr2=0x7f9284071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:46.990 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.978+0000 7f9289dff700 1 -- 172.21.15.184:0/566961279 shutdown_connections 2023-07-11T00:29:46.990 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.978+0000 7f9289dff700 1 -- 172.21.15.184:0/566961279 wait complete. 2023-07-11T00:29:46.996 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.980+0000 7f9289dff700 1 Processor -- start 2023-07-11T00:29:46.996 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.980+0000 7f9289dff700 1 -- start start 2023-07-11T00:29:46.997 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.981+0000 7f9289dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92840b4be0 0x7f9284157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:46.997 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.981+0000 7f9289dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92840d2320 0x7f92840c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:46.997 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.981+0000 7f9289dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f928415f8f0 0x7f92841e6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:46.997 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.981+0000 7f9289dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92841578d0 con 0x7f92840d2320 2023-07-11T00:29:46.998 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.981+0000 7f9289dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92841f1c90 con 0x7f928415f8f0 2023-07-11T00:29:46.998 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.981+0000 7f9289dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92841f5790 con 0x7f92840b4be0 2023-07-11T00:29:46.998 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.981+0000 7f92837fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92840b4be0 0x7f9284157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:46.998 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.981+0000 7f9282ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92840d2320 0x7f92840c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:46.999 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.981+0000 7f9282ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92840d2320 0x7f92840c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.184:44052/0 (socket says 172.21.15.184:44052) 2023-07-11T00:29:47.000 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.981+0000 7f9282ffd700 1 -- 172.21.15.184:0/2866568348 learned_addr learned my addr 172.21.15.184:0/2866568348 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-11T00:29:47.000 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.981+0000 7f92837fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92840b4be0 0x7f9284157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:56148/0 (socket says 172.21.15.184:56148) 2023-07-11T00:29:47.000 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.981+0000 7f9283fff700 1 --2- 172.21.15.184:0/2866568348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f928415f8f0 0x7f92841e6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:47.001 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.982+0000 7f9282ffd700 1 -- 172.21.15.184:0/2866568348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92840b4be0 msgr2=0x7f9284157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.001 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.982+0000 7f9282ffd700 1 --2- 172.21.15.184:0/2866568348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92840b4be0 0x7f9284157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.002 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.982+0000 7f9282ffd700 1 -- 172.21.15.184:0/2866568348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f928415f8f0 msgr2=0x7f92841e6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.003 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.982+0000 7f9282ffd700 1 --2- 172.21.15.184:0/2866568348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f928415f8f0 0x7f92841e6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.003 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.982+0000 7f9282ffd700 1 -- 172.21.15.184:0/2866568348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c009b30 con 0x7f92840d2320 2023-07-11T00:29:47.003 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.982+0000 7f9282ffd700 1 --2- 172.21.15.184:0/2866568348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92840d2320 0x7f92840c9cf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f927800e9b0 tx=0x7f927800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:47.004 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.982+0000 7f926bfff700 1 -- 172.21.15.184:0/2866568348 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927800ee50 con 0x7f92840d2320 2023-07-11T00:29:47.004 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.982+0000 7f926bfff700 1 -- 172.21.15.184:0/2866568348 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927800c850 con 0x7f92840d2320 2023-07-11T00:29:47.004 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.982+0000 7f926bfff700 1 -- 172.21.15.184:0/2866568348 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927800cbc0 con 0x7f92840d2320 2023-07-11T00:29:47.004 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.982+0000 7f9289dff700 1 -- 172.21.15.184:0/2866568348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92841f5a70 con 0x7f92840d2320 2023-07-11T00:29:47.005 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.983+0000 7f9289dff700 1 -- 172.21.15.184:0/2866568348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92841f6030 con 0x7f92840d2320 2023-07-11T00:29:47.005 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.983+0000 7f926bfff700 1 -- 172.21.15.184:0/2866568348 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9278005d20 con 0x7f92840d2320 2023-07-11T00:29:47.005 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.983+0000 7f926bfff700 1 -- 172.21.15.184:0/2866568348 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f927800cd20 con 0x7f92840d2320 2023-07-11T00:29:47.005 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.983+0000 7f9289dff700 1 -- 172.21.15.184:0/2866568348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928404ea60 con 0x7f92840d2320 2023-07-11T00:29:47.005 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:46.986+0000 7f926bfff700 1 -- 172.21.15.184:0/2866568348 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f9278021060 con 0x7f92840d2320 2023-07-11T00:29:47.075 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.072+0000 7f9289dff700 1 -- 172.21.15.184:0/2866568348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4845d466-fe99-42e5-a783-337f0cc8a20c", "id": 3} v 0) v1 -- 0x7f92840d04b0 con 0x7f92840d2320 2023-07-11T00:29:47.078 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.075+0000 7f926bfff700 1 -- 172.21.15.184:0/2866568348 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4845d466-fe99-42e5-a783-337f0cc8a20c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9278029020 con 0x7f92840d2320 2023-07-11T00:29:47.079 INFO:teuthology.orchestra.run.smithi184.stdout:3 2023-07-11T00:29:47.080 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.076+0000 7f9289dff700 1 -- 172.21.15.184:0/2866568348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92840d2320 msgr2=0x7f92840c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.081 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.076+0000 7f9289dff700 1 --2- 172.21.15.184:0/2866568348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92840d2320 0x7f92840c9cf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f927800e9b0 tx=0x7f927800ecc0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.082 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.076+0000 7f9289dff700 1 -- 172.21.15.184:0/2866568348 shutdown_connections 2023-07-11T00:29:47.082 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.076+0000 7f9289dff700 1 --2- 172.21.15.184:0/2866568348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92840b4be0 0x7f9284157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.082 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.076+0000 7f9289dff700 1 --2- 172.21.15.184:0/2866568348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f928415f8f0 0x7f92841e6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.083 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.076+0000 7f9289dff700 1 --2- 172.21.15.184:0/2866568348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92840d2320 0x7f92840c9cf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.083 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.076+0000 7f9289dff700 1 -- 172.21.15.184:0/2866568348 >> 172.21.15.184:0/2866568348 conn(0x7f9284071660 msgr2=0x7f92840d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:47.083 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.076+0000 7f9289dff700 1 -- 172.21.15.184:0/2866568348 shutdown_connections 2023-07-11T00:29:47.084 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.076+0000 7f9289dff700 1 -- 172.21.15.184:0/2866568348 wait complete. 2023-07-11T00:29:47.096 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 07d4bc04-8ba6-4d2e-b9a9-679d1658df83 4 2023-07-11T00:29:47.244 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:47.241+0000 7fd06088c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-11T00:29:47.293 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.291+0000 7f5f8f1ff700 1 Processor -- start 2023-07-11T00:29:47.294 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.291+0000 7f5f8f1ff700 1 -- start start 2023-07-11T00:29:47.295 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.292+0000 7f5f8f1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5f880b8260 0x7f5f880cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:47.295 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.292+0000 7f5f8f1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f880b4d20 0x7f5f880d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:47.295 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.292+0000 7f5f8f1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f88160a00 con 0x7f5f880d25c0 2023-07-11T00:29:47.295 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.292+0000 7f5f8f1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f88160ce0 con 0x7f5f880b8260 2023-07-11T00:29:47.296 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.292+0000 7f5f8f1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880cd280 con 0x7f5f880b4d20 2023-07-11T00:29:47.296 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.292+0000 7f5f8d79c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f880b4d20 0x7f5f880d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:47.296 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.292+0000 7f5f8cf9b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5f880b8260 0x7f5f880cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:47.296 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.292+0000 7f5f87fff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f5f880d25c0 0x7f5f880b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:54228/0 (socket says 172.21.15.184:54228) 2023-07-11T00:29:47.296 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.292+0000 7f5f87fff700 1 -- 172.21.15.184:0/3433291323 learned_addr learned my addr 172.21.15.184:0/3433291323 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-07-11T00:29:47.298 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.293+0000 7f5f8cf9b700 1 -- 172.21.15.184:0/3433291323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f880b4d20 msgr2=0x7f5f880d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:29:47.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.293+0000 7f5f8cf9b700 1 --2- 172.21.15.184:0/3433291323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f880b4d20 0x7f5f880d0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.293+0000 7f5f8cf9b700 1 -- 172.21.15.184:0/3433291323 >> v1:172.21.15.184:6789/0 conn(0x7f5f880d25c0 legacy=0x7f5f880b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.293+0000 7f5f8cf9b700 1 -- 172.21.15.184:0/3433291323 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f880cd560 con 0x7f5f880b8260 2023-07-11T00:29:47.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.293+0000 7f5f877fe700 1 -- 172.21.15.184:0/3433291323 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839402287 0 0) 0x7f5f88160a00 con 0x7f5f880d25c0 2023-07-11T00:29:47.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.293+0000 7f5f8d79c700 1 --2- 172.21.15.184:0/3433291323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f880b4d20 0x7f5f880d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:29:47.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.293+0000 7f5f8cf9b700 1 --2- 172.21.15.184:0/3433291323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f880b8260 0x7f5f880cede0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009840 tx=0x7f5f7c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1a2c24fc27e3097 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:47.300 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.293+0000 7f5f877fe700 1 -- 172.21.15.184:0/3433291323 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c011830 con 0x7f5f880b8260 2023-07-11T00:29:47.300 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.293+0000 7f5f877fe700 1 -- 172.21.15.184:0/3433291323 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c011990 con 0x7f5f880b8260 2023-07-11T00:29:47.300 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.293+0000 7f5f877fe700 1 -- 172.21.15.184:0/3433291323 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c011d20 con 0x7f5f880b8260 2023-07-11T00:29:47.300 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.294+0000 7f5f8f1ff700 1 -- 172.21.15.184:0/3433291323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f880b8260 msgr2=0x7f5f880cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.301 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.294+0000 7f5f8f1ff700 1 --2- 172.21.15.184:0/3433291323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f880b8260 0x7f5f880cede0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009840 tx=0x7f5f7c009b50 comp rx=0 tx=0).stop 2023-07-11T00:29:47.301 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.294+0000 7f5f8f1ff700 1 -- 172.21.15.184:0/3433291323 shutdown_connections 2023-07-11T00:29:47.301 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.294+0000 7f5f8f1ff700 1 --2- 172.21.15.184:0/3433291323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f880b4d20 0x7f5f880d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.301 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.294+0000 7f5f8f1ff700 1 --2- 172.21.15.184:0/3433291323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f880b8260 0x7f5f880cede0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.301 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.294+0000 7f5f8f1ff700 1 -- 172.21.15.184:0/3433291323 >> 172.21.15.184:0/3433291323 conn(0x7f5f880722b0 msgr2=0x7f5f880cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:47.302 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.294+0000 7f5f8f1ff700 1 -- 172.21.15.184:0/3433291323 shutdown_connections 2023-07-11T00:29:47.302 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.294+0000 7f5f8f1ff700 1 -- 172.21.15.184:0/3433291323 wait complete. 2023-07-11T00:29:47.302 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.296+0000 7f5f8f1ff700 1 Processor -- start 2023-07-11T00:29:47.302 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.296+0000 7f5f8f1ff700 1 -- start start 2023-07-11T00:29:47.305 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.297+0000 7f5f8f1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f880b8260 0x7f5f881f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:47.305 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.297+0000 7f5f8f1ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f880d25c0 0x7f5f880c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:47.305 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.297+0000 7f5f8f1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f880c9280 0x7f5f880cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:47.305 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.297+0000 7f5f8f1ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880cbd30 con 0x7f5f880d25c0 2023-07-11T00:29:47.306 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.297+0000 7f5f8f1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880cb770 con 0x7f5f880b8260 2023-07-11T00:29:47.306 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.297+0000 7f5f8f1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880cba50 con 0x7f5f880c9280 2023-07-11T00:29:47.306 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.297+0000 7f5f8cf9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f880b8260 0x7f5f881f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:47.306 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.297+0000 7f5f8cf9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f880b8260 0x7f5f881f2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:45504/0 (socket says 172.21.15.184:45504) 2023-07-11T00:29:47.306 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.297+0000 7f5f8d79c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f880c9280 0x7f5f880cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:47.306 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.297+0000 7f5f8cf9b700 1 -- 172.21.15.184:0/3755462871 learned_addr learned my addr 172.21.15.184:0/3755462871 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-11T00:29:47.306 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.297+0000 7f5f87fff700 1 --2- 172.21.15.184:0/3755462871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f880d25c0 0x7f5f880c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:47.307 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.298+0000 7f5f8d79c700 1 -- 172.21.15.184:0/3755462871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f880b8260 msgr2=0x7f5f881f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.307 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.298+0000 7f5f8d79c700 1 --2- 172.21.15.184:0/3755462871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f880b8260 0x7f5f881f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.307 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.298+0000 7f5f8d79c700 1 -- 172.21.15.184:0/3755462871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f880d25c0 msgr2=0x7f5f880c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.307 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.298+0000 7f5f8d79c700 1 --2- 172.21.15.184:0/3755462871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f880d25c0 0x7f5f880c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.307 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.298+0000 7f5f8d79c700 1 -- 172.21.15.184:0/3755462871 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f80009a70 con 0x7f5f880c9280 2023-07-11T00:29:47.308 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.298+0000 7f5f8d79c700 1 --2- 172.21.15.184:0/3755462871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f880c9280 0x7f5f880cacb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000efc0 tx=0x7f5f8000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:47.308 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.298+0000 7f5f857fa700 1 -- 172.21.15.184:0/3755462871 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80009e80 con 0x7f5f880c9280 2023-07-11T00:29:47.308 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.298+0000 7f5f857fa700 1 -- 172.21.15.184:0/3755462871 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8000f040 con 0x7f5f880c9280 2023-07-11T00:29:47.308 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.298+0000 7f5f8f1ff700 1 -- 172.21.15.184:0/3755462871 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c0094a0 con 0x7f5f880c9280 2023-07-11T00:29:47.308 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.298+0000 7f5f857fa700 1 -- 172.21.15.184:0/3755462871 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8000ccd0 con 0x7f5f880c9280 2023-07-11T00:29:47.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.298+0000 7f5f8f1ff700 1 -- 172.21.15.184:0/3755462871 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f880c8820 con 0x7f5f880c9280 2023-07-11T00:29:47.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.298+0000 7f5f857fa700 1 -- 172.21.15.184:0/3755462871 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5f80003d20 con 0x7f5f880c9280 2023-07-11T00:29:47.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.299+0000 7f5f857fa700 1 -- 172.21.15.184:0/3755462871 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f5f8000ce30 con 0x7f5f880c9280 2023-07-11T00:29:47.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.300+0000 7f5f8f1ff700 1 -- 172.21.15.184:0/3755462871 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f880cd8d0 con 0x7f5f880c9280 2023-07-11T00:29:47.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.302+0000 7f5f857fa700 1 -- 172.21.15.184:0/3755462871 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f5f80018030 con 0x7f5f880c9280 2023-07-11T00:29:47.381 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:47.379+0000 7f16c5235200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-11T00:29:47.392 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.389+0000 7f5f8f1ff700 1 -- 172.21.15.184:0/3755462871 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "07d4bc04-8ba6-4d2e-b9a9-679d1658df83", "id": 4} v 0) v1 -- 0x7f5f8804ea60 con 0x7f5f880c9280 2023-07-11T00:29:47.395 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.393+0000 7f5f857fa700 1 -- 172.21.15.184:0/3755462871 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "07d4bc04-8ba6-4d2e-b9a9-679d1658df83", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5f8002b0b0 con 0x7f5f880c9280 2023-07-11T00:29:47.396 INFO:teuthology.orchestra.run.smithi184.stdout:4 2023-07-11T00:29:47.398 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.394+0000 7f5f8f1ff700 1 -- 172.21.15.184:0/3755462871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f880c9280 msgr2=0x7f5f880cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.398 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.394+0000 7f5f8f1ff700 1 --2- 172.21.15.184:0/3755462871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f880c9280 0x7f5f880cacb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000efc0 tx=0x7f5f8000c3a0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.398 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.394+0000 7f5f8f1ff700 1 -- 172.21.15.184:0/3755462871 shutdown_connections 2023-07-11T00:29:47.399 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.394+0000 7f5f8f1ff700 1 --2- 172.21.15.184:0/3755462871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f880c9280 0x7f5f880cacb0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.399 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.394+0000 7f5f8f1ff700 1 --2- 172.21.15.184:0/3755462871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f880b8260 0x7f5f881f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.399 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.394+0000 7f5f8f1ff700 1 --2- 172.21.15.184:0/3755462871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f880d25c0 0x7f5f880c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.400 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.394+0000 7f5f8f1ff700 1 -- 172.21.15.184:0/3755462871 >> 172.21.15.184:0/3755462871 conn(0x7f5f880b4d20 msgr2=0x7f5f8806b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:47.400 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.394+0000 7f5f8f1ff700 1 -- 172.21.15.184:0/3755462871 shutdown_connections 2023-07-11T00:29:47.401 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.394+0000 7f5f8f1ff700 1 -- 172.21.15.184:0/3755462871 wait complete. 2023-07-11T00:29:47.421 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 3ce2a7a0-15bd-40f6-9071-f14c4a96e64c 5 2023-07-11T00:29:47.616 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.614+0000 7f035b3ff700 1 Processor -- start 2023-07-11T00:29:47.617 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.614+0000 7f035b3ff700 1 -- start start 2023-07-11T00:29:47.620 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.615+0000 7f035b3ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f03540b8260 0x7f03540cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:47.620 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.615+0000 7f035b3ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f03540b4d20 0x7f03540d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:47.621 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.615+0000 7f035b3ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0354160a00 con 0x7f03540d25c0 2023-07-11T00:29:47.621 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.615+0000 7f035b3ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0354160ce0 con 0x7f03540b4d20 2023-07-11T00:29:47.621 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.615+0000 7f035b3ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03540cd280 con 0x7f03540b8260 2023-07-11T00:29:47.621 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.615+0000 7f035919b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f03540b8260 0x7f03540cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:47.622 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.615+0000 7f035919b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f03540b8260 0x7f03540cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:45516/0 (socket says 172.21.15.184:45516) 2023-07-11T00:29:47.622 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.615+0000 7f035919b700 1 -- 172.21.15.184:0/2853368792 learned_addr learned my addr 172.21.15.184:0/2853368792 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-11T00:29:47.622 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.615+0000 7f035999c700 1 --2- 172.21.15.184:0/2853368792 >> v2:172.21.15.22:3300/0 conn(0x7f03540b4d20 0x7f03540d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:47.622 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.616+0000 7f035919b700 1 -- 172.21.15.184:0/2853368792 >> v2:172.21.15.22:3300/0 conn(0x7f03540b4d20 msgr2=0x7f03540d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:29:47.623 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.616+0000 7f035919b700 1 --2- 172.21.15.184:0/2853368792 >> v2:172.21.15.22:3300/0 conn(0x7f03540b4d20 0x7f03540d0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.623 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.616+0000 7f035919b700 1 -- 172.21.15.184:0/2853368792 >> v1:172.21.15.22:6789/0 conn(0x7f03540d25c0 legacy=0x7f03540b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.623 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.616+0000 7f035919b700 1 -- 172.21.15.184:0/2853368792 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03540cd560 con 0x7f03540b8260 2023-07-11T00:29:47.627 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.616+0000 7f035919b700 1 --2- 172.21.15.184:0/2853368792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03540b8260 0x7f03540cede0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f03540b5780 tx=0x7f0350009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d276bb9498529ecc server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:47.627 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.616+0000 7f034bfff700 1 -- 172.21.15.184:0/2853368792 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350011830 con 0x7f03540b8260 2023-07-11T00:29:47.627 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.616+0000 7f034bfff700 1 -- 172.21.15.184:0/2853368792 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0350011990 con 0x7f03540b8260 2023-07-11T00:29:47.628 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.616+0000 7f034bfff700 1 -- 172.21.15.184:0/2853368792 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350011d20 con 0x7f03540b8260 2023-07-11T00:29:47.628 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.617+0000 7f035b3ff700 1 -- 172.21.15.184:0/2853368792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03540b8260 msgr2=0x7f03540cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.629 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.617+0000 7f035b3ff700 1 --2- 172.21.15.184:0/2853368792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03540b8260 0x7f03540cede0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f03540b5780 tx=0x7f0350009bd0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.629 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.617+0000 7f035b3ff700 1 -- 172.21.15.184:0/2853368792 shutdown_connections 2023-07-11T00:29:47.630 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.617+0000 7f035b3ff700 1 --2- 172.21.15.184:0/2853368792 >> v2:172.21.15.22:3300/0 conn(0x7f03540b4d20 0x7f03540d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.630 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.617+0000 7f035b3ff700 1 --2- 172.21.15.184:0/2853368792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03540b8260 0x7f03540cede0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.630 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.617+0000 7f035b3ff700 1 -- 172.21.15.184:0/2853368792 >> 172.21.15.184:0/2853368792 conn(0x7f03540722b0 msgr2=0x7f03540cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:47.631 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.617+0000 7f035b3ff700 1 -- 172.21.15.184:0/2853368792 shutdown_connections 2023-07-11T00:29:47.631 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.617+0000 7f035b3ff700 1 -- 172.21.15.184:0/2853368792 wait complete. 2023-07-11T00:29:47.635 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.619+0000 7f035b3ff700 1 Processor -- start 2023-07-11T00:29:47.635 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.620+0000 7f035b3ff700 1 -- start start 2023-07-11T00:29:47.635 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.621+0000 7f035b3ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03540b8260 0x7f035415f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:47.635 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.621+0000 7f035b3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03540d25c0 0x7f03540cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:47.636 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.621+0000 7f035b3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03540cacb0 0x7f03541e83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:47.636 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.621+0000 7f035b3ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03540cbda0 con 0x7f03540b8260 2023-07-11T00:29:47.637 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.621+0000 7f035b3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03540cb120 con 0x7f03540d25c0 2023-07-11T00:29:47.637 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.621+0000 7f035b3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03540cb400 con 0x7f03540cacb0 2023-07-11T00:29:47.637 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.621+0000 7f035899a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03540d25c0 0x7f03540cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:47.639 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.621+0000 7f035919b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03540b8260 0x7f035415f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:47.639 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.621+0000 7f035999c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03540cacb0 0x7f03541e83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:47.639 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.621+0000 7f035899a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03540d25c0 0x7f03540cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:45522/0 (socket says 172.21.15.184:45522) 2023-07-11T00:29:47.639 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.621+0000 7f035899a700 1 -- 172.21.15.184:0/233547875 learned_addr learned my addr 172.21.15.184:0/233547875 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-11T00:29:47.640 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.621+0000 7f035919b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03540b8260 0x7f035415f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.184:44082/0 (socket says 172.21.15.184:44082) 2023-07-11T00:29:47.641 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.622+0000 7f035899a700 1 -- 172.21.15.184:0/233547875 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03540cacb0 msgr2=0x7f03541e83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.641 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.622+0000 7f035899a700 1 --2- 172.21.15.184:0/233547875 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03540cacb0 0x7f03541e83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.641 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.622+0000 7f035899a700 1 -- 172.21.15.184:0/233547875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03540b8260 msgr2=0x7f035415f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.641 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.622+0000 7f035899a700 1 --2- 172.21.15.184:0/233547875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03540b8260 0x7f035415f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.642 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.622+0000 7f035899a700 1 -- 172.21.15.184:0/233547875 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0350009550 con 0x7f03540d25c0 2023-07-11T00:29:47.642 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.622+0000 7f035999c700 1 --2- 172.21.15.184:0/233547875 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03540cacb0 0x7f03541e83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:29:47.643 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.622+0000 7f035899a700 1 --2- 172.21.15.184:0/233547875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03540d25c0 0x7f03540cc1c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f034400c4e0 tx=0x7f034400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:47.643 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.622+0000 7f0349ffb700 1 -- 172.21.15.184:0/233547875 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03440052d0 con 0x7f03540d25c0 2023-07-11T00:29:47.644 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.622+0000 7f0349ffb700 1 -- 172.21.15.184:0/233547875 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0344005430 con 0x7f03540d25c0 2023-07-11T00:29:47.644 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.622+0000 7f035b3ff700 1 -- 172.21.15.184:0/233547875 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03540cb6e0 con 0x7f03540d25c0 2023-07-11T00:29:47.644 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.622+0000 7f0349ffb700 1 -- 172.21.15.184:0/233547875 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03440038c0 con 0x7f03540d25c0 2023-07-11T00:29:47.644 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.622+0000 7f035b3ff700 1 -- 172.21.15.184:0/233547875 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03541e88e0 con 0x7f03540d25c0 2023-07-11T00:29:47.645 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.622+0000 7f0349ffb700 1 -- 172.21.15.184:0/233547875 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0344003d20 con 0x7f03540d25c0 2023-07-11T00:29:47.645 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.622+0000 7f0349ffb700 1 -- 172.21.15.184:0/233547875 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f0344011d60 con 0x7f03540d25c0 2023-07-11T00:29:47.645 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.624+0000 7f035b3ff700 1 -- 172.21.15.184:0/233547875 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03540cbee0 con 0x7f03540d25c0 2023-07-11T00:29:47.645 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.626+0000 7f0349ffb700 1 -- 172.21.15.184:0/233547875 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f03540cbee0 con 0x7f03540d25c0 2023-07-11T00:29:47.717 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.713+0000 7f035b3ff700 1 -- 172.21.15.184:0/233547875 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3ce2a7a0-15bd-40f6-9071-f14c4a96e64c", "id": 5} v 0) v1 -- 0x7f035404ea60 con 0x7f03540d25c0 2023-07-11T00:29:47.721 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.717+0000 7f0349ffb700 1 -- 172.21.15.184:0/233547875 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ce2a7a0-15bd-40f6-9071-f14c4a96e64c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0344017070 con 0x7f03540d25c0 2023-07-11T00:29:47.722 INFO:teuthology.orchestra.run.smithi184.stdout:5 2023-07-11T00:29:47.722 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.718+0000 7f035b3ff700 1 -- 172.21.15.184:0/233547875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03540d25c0 msgr2=0x7f03540cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.723 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.718+0000 7f035b3ff700 1 --2- 172.21.15.184:0/233547875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03540d25c0 0x7f03540cc1c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f034400c4e0 tx=0x7f034400c7f0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.723 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.718+0000 7f035b3ff700 1 -- 172.21.15.184:0/233547875 shutdown_connections 2023-07-11T00:29:47.723 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.718+0000 7f035b3ff700 1 --2- 172.21.15.184:0/233547875 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03540cacb0 0x7f03541e83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.723 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.718+0000 7f035b3ff700 1 --2- 172.21.15.184:0/233547875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03540b8260 0x7f035415f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.723 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.718+0000 7f035b3ff700 1 --2- 172.21.15.184:0/233547875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03540d25c0 0x7f03540cc1c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.723 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.718+0000 7f035b3ff700 1 -- 172.21.15.184:0/233547875 >> 172.21.15.184:0/233547875 conn(0x7f03540b4d20 msgr2=0x7f03540b63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:47.723 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.718+0000 7f035b3ff700 1 -- 172.21.15.184:0/233547875 shutdown_connections 2023-07-11T00:29:47.723 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.718+0000 7f035b3ff700 1 -- 172.21.15.184:0/233547875 wait complete. 2023-07-11T00:29:47.738 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 10a29618-c952-46b4-8b57-2a31fa82cd1e 6 2023-07-11T00:29:47.945 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.942+0000 7f7c31dff700 1 Processor -- start 2023-07-11T00:29:47.946 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.943+0000 7f7c31dff700 1 -- start start 2023-07-11T00:29:47.947 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.944+0000 7f7c31dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c2c0b4d20 0x7f7c2c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:47.947 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.944+0000 7f7c31dff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c160a00 con 0x7f7c2c0b8260 2023-07-11T00:29:47.947 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.944+0000 7f7c31dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c160ce0 con 0x7f7c2c0d25c0 2023-07-11T00:29:47.947 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.944+0000 7f7c31dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0cd280 con 0x7f7c2c0b4d20 2023-07-11T00:29:47.947 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.944+0000 7f7c2affd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c2c0b4d20 0x7f7c2c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:47.947 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.944+0000 7f7c2affd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c2c0b4d20 0x7f7c2c0cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:56188/0 (socket says 172.21.15.184:56188) 2023-07-11T00:29:47.947 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.944+0000 7f7c2bfff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f7c2c0d25c0 0x7f7c2c0d0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:54238/0 (socket says 172.21.15.184:54238) 2023-07-11T00:29:47.948 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.944+0000 7f7c2affd700 1 -- 172.21.15.184:0/1405572299 learned_addr learned my addr 172.21.15.184:0/1405572299 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-11T00:29:47.949 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.944+0000 7f7c2affd700 1 -- 172.21.15.184:0/1405572299 >> v1:172.21.15.184:6789/0 conn(0x7f7c2c0d25c0 legacy=0x7f7c2c0d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.949 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.944+0000 7f7c2affd700 1 -- 172.21.15.184:0/1405572299 >> v1:172.21.15.22:6789/0 conn(0x7f7c2c0b8260 legacy=0x7f7c2c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.949 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.944+0000 7f7c2affd700 1 -- 172.21.15.184:0/1405572299 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c0cd560 con 0x7f7c2c0b4d20 2023-07-11T00:29:47.949 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.945+0000 7f7c2affd700 1 --2- 172.21.15.184:0/1405572299 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c2c0b4d20 0x7f7c2c0cede0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009920 tx=0x7f7c20009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e1fdf802495cd9c server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:47.950 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.945+0000 7f7c2a7fc700 1 -- 172.21.15.184:0/1405572299 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2000ba60 con 0x7f7c2c0b4d20 2023-07-11T00:29:47.950 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.945+0000 7f7c2a7fc700 1 -- 172.21.15.184:0/1405572299 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2000bbc0 con 0x7f7c2c0b4d20 2023-07-11T00:29:47.950 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.945+0000 7f7c2a7fc700 1 -- 172.21.15.184:0/1405572299 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c20009e70 con 0x7f7c2c0b4d20 2023-07-11T00:29:47.950 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.946+0000 7f7c31dff700 1 -- 172.21.15.184:0/1405572299 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c2c0b4d20 msgr2=0x7f7c2c0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.950 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.946+0000 7f7c31dff700 1 --2- 172.21.15.184:0/1405572299 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c2c0b4d20 0x7f7c2c0cede0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009920 tx=0x7f7c20009c30 comp rx=0 tx=0).stop 2023-07-11T00:29:47.950 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.946+0000 7f7c31dff700 1 -- 172.21.15.184:0/1405572299 shutdown_connections 2023-07-11T00:29:47.950 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.946+0000 7f7c31dff700 1 --2- 172.21.15.184:0/1405572299 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c2c0b4d20 0x7f7c2c0cede0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.950 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.946+0000 7f7c31dff700 1 -- 172.21.15.184:0/1405572299 >> 172.21.15.184:0/1405572299 conn(0x7f7c2c0722b0 msgr2=0x7f7c2c0cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:47.951 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.946+0000 7f7c31dff700 1 -- 172.21.15.184:0/1405572299 shutdown_connections 2023-07-11T00:29:47.951 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.946+0000 7f7c31dff700 1 -- 172.21.15.184:0/1405572299 wait complete. 2023-07-11T00:29:47.954 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.948+0000 7f7c31dff700 1 Processor -- start 2023-07-11T00:29:47.954 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.948+0000 7f7c31dff700 1 -- start start 2023-07-11T00:29:47.955 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.949+0000 7f7c31dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c2c0b8260 0x7f7c2c155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:47.955 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.949+0000 7f7c31dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c2c0d25c0 0x7f7c2c144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:47.955 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.949+0000 7f7c31dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c2c1e7170 0x7f7c2c145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:47.955 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.949+0000 7f7c31dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c156410 con 0x7f7c2c1e7170 2023-07-11T00:29:47.955 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.949+0000 7f7c31dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c1e76e0 con 0x7f7c2c0d25c0 2023-07-11T00:29:47.956 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.949+0000 7f7c31dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c1e79c0 con 0x7f7c2c0b8260 2023-07-11T00:29:47.956 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.949+0000 7f7c2b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c2c0b8260 0x7f7c2c155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:47.956 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.949+0000 7f7c2b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c2c0b8260 0x7f7c2c155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:56194/0 (socket says 172.21.15.184:56194) 2023-07-11T00:29:47.956 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.949+0000 7f7c2b7fe700 1 -- 172.21.15.184:0/264140042 learned_addr learned my addr 172.21.15.184:0/264140042 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-11T00:29:47.956 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.949+0000 7f7c2affd700 1 --2- 172.21.15.184:0/264140042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c2c0d25c0 0x7f7c2c144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:47.956 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.949+0000 7f7c2bfff700 1 --2- 172.21.15.184:0/264140042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c2c1e7170 0x7f7c2c145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:47.957 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.949+0000 7f7c2b7fe700 1 -- 172.21.15.184:0/264140042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c2c0d25c0 msgr2=0x7f7c2c144ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.957 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.949+0000 7f7c2b7fe700 1 --2- 172.21.15.184:0/264140042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c2c0d25c0 0x7f7c2c144ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.957 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.949+0000 7f7c2b7fe700 1 -- 172.21.15.184:0/264140042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c2c1e7170 msgr2=0x7f7c2c145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:47.957 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.949+0000 7f7c2b7fe700 1 --2- 172.21.15.184:0/264140042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c2c1e7170 0x7f7c2c145020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:47.957 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.949+0000 7f7c2b7fe700 1 -- 172.21.15.184:0/264140042 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c20009550 con 0x7f7c2c0b8260 2023-07-11T00:29:47.957 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.949+0000 7f7c2bfff700 1 --2- 172.21.15.184:0/264140042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c2c1e7170 0x7f7c2c145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:29:47.957 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.950+0000 7f7c2b7fe700 1 --2- 172.21.15.184:0/264140042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c2c0b8260 0x7f7c2c155940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00c4e0 tx=0x7f7c1c00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:47.958 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.950+0000 7f7c13fff700 1 -- 172.21.15.184:0/264140042 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0052d0 con 0x7f7c2c0b8260 2023-07-11T00:29:47.958 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.950+0000 7f7c13fff700 1 -- 172.21.15.184:0/264140042 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c005430 con 0x7f7c2c0b8260 2023-07-11T00:29:47.958 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.950+0000 7f7c13fff700 1 -- 172.21.15.184:0/264140042 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0038c0 con 0x7f7c2c0b8260 2023-07-11T00:29:47.958 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.950+0000 7f7c31dff700 1 -- 172.21.15.184:0/264140042 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c1e7ca0 con 0x7f7c2c0b8260 2023-07-11T00:29:47.958 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.950+0000 7f7c31dff700 1 -- 172.21.15.184:0/264140042 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c1e8260 con 0x7f7c2c0b8260 2023-07-11T00:29:47.959 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.950+0000 7f7c13fff700 1 -- 172.21.15.184:0/264140042 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7c1c003d20 con 0x7f7c2c0b8260 2023-07-11T00:29:47.959 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.950+0000 7f7c13fff700 1 -- 172.21.15.184:0/264140042 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f7c1c011e00 con 0x7f7c2c0b8260 2023-07-11T00:29:47.959 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.951+0000 7f7c31dff700 1 -- 172.21.15.184:0/264140042 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c1e8450 con 0x7f7c2c0b8260 2023-07-11T00:29:47.959 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:47.954+0000 7f7c13fff700 1 -- 172.21.15.184:0/264140042 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f7c1c017070 con 0x7f7c2c0b8260 2023-07-11T00:29:48.044 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.041+0000 7f7c31dff700 1 -- 172.21.15.184:0/264140042 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "10a29618-c952-46b4-8b57-2a31fa82cd1e", "id": 6} v 0) v1 -- 0x7f7c2c04ea60 con 0x7f7c2c0b8260 2023-07-11T00:29:48.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.045+0000 7f7c13fff700 1 -- 172.21.15.184:0/264140042 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "10a29618-c952-46b4-8b57-2a31fa82cd1e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7c1c011590 con 0x7f7c2c0b8260 2023-07-11T00:29:48.048 INFO:teuthology.orchestra.run.smithi184.stdout:6 2023-07-11T00:29:48.049 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.046+0000 7f7c31dff700 1 -- 172.21.15.184:0/264140042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c2c0b8260 msgr2=0x7f7c2c155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:48.049 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.046+0000 7f7c31dff700 1 --2- 172.21.15.184:0/264140042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c2c0b8260 0x7f7c2c155940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00c4e0 tx=0x7f7c1c00c7f0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.050 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.047+0000 7f7c31dff700 1 -- 172.21.15.184:0/264140042 shutdown_connections 2023-07-11T00:29:48.050 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.047+0000 7f7c31dff700 1 --2- 172.21.15.184:0/264140042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c2c0b8260 0x7f7c2c155940 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.050 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.047+0000 7f7c31dff700 1 --2- 172.21.15.184:0/264140042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c2c1e7170 0x7f7c2c145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.050 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.047+0000 7f7c31dff700 1 --2- 172.21.15.184:0/264140042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c2c0d25c0 0x7f7c2c144ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.050 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.047+0000 7f7c31dff700 1 -- 172.21.15.184:0/264140042 >> 172.21.15.184:0/264140042 conn(0x7f7c2c0b4d20 msgr2=0x7f7c2c0d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:48.051 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.047+0000 7f7c31dff700 1 -- 172.21.15.184:0/264140042 shutdown_connections 2023-07-11T00:29:48.051 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.047+0000 7f7c31dff700 1 -- 172.21.15.184:0/264140042 wait complete. 2023-07-11T00:29:48.069 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new b83ace85-e5fc-42b5-8db9-6ac4c187acad 7 2023-07-11T00:29:48.092 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:48.090+0000 7fd06088c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-11T00:29:48.189 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:48.186+0000 7fd06088c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-11T00:29:48.255 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:48.253+0000 7f16c5235200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-11T00:29:48.261 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.259+0000 7f6ae7dff700 1 Processor -- start 2023-07-11T00:29:48.262 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.259+0000 7f6ae7dff700 1 -- start start 2023-07-11T00:29:48.263 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.260+0000 7f6ae7dff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ae00b8260 0x7f6ae00cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:48.263 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.260+0000 7f6ae7dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ae00d25c0 0x7f6ae00b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:48.263 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.260+0000 7f6ae7dff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae0160a00 con 0x7f6ae00b4b50 2023-07-11T00:29:48.263 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.260+0000 7f6ae7dff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae00b4fd0 con 0x7f6ae00b8260 2023-07-11T00:29:48.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.260+0000 7f6ae7dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae0160ce0 con 0x7f6ae00d25c0 2023-07-11T00:29:48.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.260+0000 7f6ae539a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ae00d25c0 0x7f6ae00b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:48.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.260+0000 7f6ae539a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ae00d25c0 0x7f6ae00b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:56206/0 (socket says 172.21.15.184:56206) 2023-07-11T00:29:48.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.260+0000 7f6ae539a700 1 -- 172.21.15.184:0/3408648954 learned_addr learned my addr 172.21.15.184:0/3408648954 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-11T00:29:48.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.260+0000 7f6ae5b9b700 1 --2- 172.21.15.184:0/3408648954 >> v2:172.21.15.22:3300/0 conn(0x7f6ae00b8260 0x7f6ae00cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:48.265 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.261+0000 7f6ae539a700 1 -- 172.21.15.184:0/3408648954 >> v2:172.21.15.22:3300/0 conn(0x7f6ae00b8260 msgr2=0x7f6ae00cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:29:48.265 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.261+0000 7f6ae539a700 1 --2- 172.21.15.184:0/3408648954 >> v2:172.21.15.22:3300/0 conn(0x7f6ae00b8260 0x7f6ae00cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.261+0000 7f6ae539a700 1 -- 172.21.15.184:0/3408648954 >> v1:172.21.15.22:6789/0 conn(0x7f6ae00b4b50 legacy=0x7f6ae006b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:48.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.261+0000 7f6ae539a700 1 -- 172.21.15.184:0/3408648954 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae00cd280 con 0x7f6ae00d25c0 2023-07-11T00:29:48.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.261+0000 7f6ae539a700 1 --2- 172.21.15.184:0/3408648954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ae00d25c0 0x7f6ae00b4610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00098f0 tx=0x7f6ad0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54a52d247dda1779 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:48.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.261+0000 7f6ae4b99700 1 -- 172.21.15.184:0/3408648954 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0011830 con 0x7f6ae00d25c0 2023-07-11T00:29:48.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.261+0000 7f6ae4b99700 1 -- 172.21.15.184:0/3408648954 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad0011990 con 0x7f6ae00d25c0 2023-07-11T00:29:48.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.261+0000 7f6ae4b99700 1 -- 172.21.15.184:0/3408648954 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0011d20 con 0x7f6ae00d25c0 2023-07-11T00:29:48.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.262+0000 7f6ae7dff700 1 -- 172.21.15.184:0/3408648954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ae00d25c0 msgr2=0x7f6ae00b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:48.267 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.262+0000 7f6ae7dff700 1 --2- 172.21.15.184:0/3408648954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ae00d25c0 0x7f6ae00b4610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00098f0 tx=0x7f6ad0009c00 comp rx=0 tx=0).stop 2023-07-11T00:29:48.267 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.262+0000 7f6ae7dff700 1 -- 172.21.15.184:0/3408648954 shutdown_connections 2023-07-11T00:29:48.267 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.262+0000 7f6ae7dff700 1 --2- 172.21.15.184:0/3408648954 >> v2:172.21.15.22:3300/0 conn(0x7f6ae00b8260 0x7f6ae00cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.267 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.262+0000 7f6ae7dff700 1 --2- 172.21.15.184:0/3408648954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ae00d25c0 0x7f6ae00b4610 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.267 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.262+0000 7f6ae7dff700 1 -- 172.21.15.184:0/3408648954 >> 172.21.15.184:0/3408648954 conn(0x7f6ae00722b0 msgr2=0x7f6ae00cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:48.267 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.262+0000 7f6ae7dff700 1 -- 172.21.15.184:0/3408648954 shutdown_connections 2023-07-11T00:29:48.267 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.262+0000 7f6ae7dff700 1 -- 172.21.15.184:0/3408648954 wait complete. 2023-07-11T00:29:48.269 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.264+0000 7f6ae7dff700 1 Processor -- start 2023-07-11T00:29:48.269 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.264+0000 7f6ae7dff700 1 -- start start 2023-07-11T00:29:48.269 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae7dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae00b8260 0x7f6ae01e6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:48.269 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae7dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae00d25c0 0x7f6ae00c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:48.270 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae7dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ae015c170 0x7f6ae00cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:48.270 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae7dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00c7660 con 0x7f6ae00b8260 2023-07-11T00:29:48.270 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae7dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00c7ca0 con 0x7f6ae00d25c0 2023-07-11T00:29:48.270 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae7dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae01e6e00 con 0x7f6ae015c170 2023-07-11T00:29:48.270 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae539a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae00d25c0 0x7f6ae00c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:48.270 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae639c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ae015c170 0x7f6ae00cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:48.270 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae5b9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae00b8260 0x7f6ae01e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:48.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae539a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae00d25c0 0x7f6ae00c7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:45544/0 (socket says 172.21.15.184:45544) 2023-07-11T00:29:48.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae5b9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae00b8260 0x7f6ae01e6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.184:44102/0 (socket says 172.21.15.184:44102) 2023-07-11T00:29:48.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae539a700 1 -- 172.21.15.184:0/1438858444 learned_addr learned my addr 172.21.15.184:0/1438858444 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-11T00:29:48.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae639c700 1 -- 172.21.15.184:0/1438858444 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae00d25c0 msgr2=0x7f6ae00c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:48.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae639c700 1 --2- 172.21.15.184:0/1438858444 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae00d25c0 0x7f6ae00c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae639c700 1 -- 172.21.15.184:0/1438858444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae00b8260 msgr2=0x7f6ae01e6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:48.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae639c700 1 --2- 172.21.15.184:0/1438858444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae00b8260 0x7f6ae01e6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae639c700 1 -- 172.21.15.184:0/1438858444 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad0009550 con 0x7f6ae015c170 2023-07-11T00:29:48.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae539a700 1 --2- 172.21.15.184:0/1438858444 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae00d25c0 0x7f6ae00c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:29:48.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.265+0000 7f6ae5b9b700 1 --2- 172.21.15.184:0/1438858444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae00b8260 0x7f6ae01e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:29:48.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.266+0000 7f6ae639c700 1 --2- 172.21.15.184:0/1438858444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ae015c170 0x7f6ae00cc0a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800cb90 tx=0x7f6ad800cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:48.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.266+0000 7f6ad67fc700 1 -- 172.21.15.184:0/1438858444 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8003c00 con 0x7f6ae015c170 2023-07-11T00:29:48.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.266+0000 7f6ad67fc700 1 -- 172.21.15.184:0/1438858444 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad8003d60 con 0x7f6ae015c170 2023-07-11T00:29:48.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.266+0000 7f6ae7dff700 1 -- 172.21.15.184:0/1438858444 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae01e70e0 con 0x7f6ae015c170 2023-07-11T00:29:48.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.266+0000 7f6ad67fc700 1 -- 172.21.15.184:0/1438858444 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad800aa80 con 0x7f6ae015c170 2023-07-11T00:29:48.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.266+0000 7f6ae7dff700 1 -- 172.21.15.184:0/1438858444 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae00c81d0 con 0x7f6ae015c170 2023-07-11T00:29:48.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.267+0000 7f6ad67fc700 1 -- 172.21.15.184:0/1438858444 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6ad80050d0 con 0x7f6ae015c170 2023-07-11T00:29:48.274 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.267+0000 7f6ad67fc700 1 -- 172.21.15.184:0/1438858444 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6ad8012b70 con 0x7f6ae015c170 2023-07-11T00:29:48.274 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.267+0000 7f6ae7dff700 1 -- 172.21.15.184:0/1438858444 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae00b5140 con 0x7f6ae015c170 2023-07-11T00:29:48.274 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.269+0000 7f6ad67fc700 1 -- 172.21.15.184:0/1438858444 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f6ad8012dd0 con 0x7f6ae015c170 2023-07-11T00:29:48.352 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:48.349+0000 7f16c5235200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-11T00:29:48.358 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.356+0000 7f6ae7dff700 1 -- 172.21.15.184:0/1438858444 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b83ace85-e5fc-42b5-8db9-6ac4c187acad", "id": 7} v 0) v1 -- 0x7f6ae004ea60 con 0x7f6ae015c170 2023-07-11T00:29:48.362 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.359+0000 7f6ad67fc700 1 -- 172.21.15.184:0/1438858444 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b83ace85-e5fc-42b5-8db9-6ac4c187acad", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6ad8005510 con 0x7f6ae015c170 2023-07-11T00:29:48.363 INFO:teuthology.orchestra.run.smithi184.stdout:7 2023-07-11T00:29:48.364 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.361+0000 7f6ae7dff700 1 -- 172.21.15.184:0/1438858444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ae015c170 msgr2=0x7f6ae00cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:48.364 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.361+0000 7f6ae7dff700 1 --2- 172.21.15.184:0/1438858444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ae015c170 0x7f6ae00cc0a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800cb90 tx=0x7f6ad800cea0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.364 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.361+0000 7f6ae7dff700 1 -- 172.21.15.184:0/1438858444 shutdown_connections 2023-07-11T00:29:48.364 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.361+0000 7f6ae7dff700 1 --2- 172.21.15.184:0/1438858444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ae015c170 0x7f6ae00cc0a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.364 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.361+0000 7f6ae7dff700 1 --2- 172.21.15.184:0/1438858444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ae00b8260 0x7f6ae01e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.364 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.361+0000 7f6ae7dff700 1 --2- 172.21.15.184:0/1438858444 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae00d25c0 0x7f6ae00c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.364 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.361+0000 7f6ae7dff700 1 -- 172.21.15.184:0/1438858444 >> 172.21.15.184:0/1438858444 conn(0x7f6ae00b4b50 msgr2=0x7f6ae00b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:48.365 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.361+0000 7f6ae7dff700 1 -- 172.21.15.184:0/1438858444 shutdown_connections 2023-07-11T00:29:48.365 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-11T00:29:48.361+0000 7f6ae7dff700 1 -- 172.21.15.184:0/1438858444 wait complete. 2023-07-11T00:29:48.365 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:48.362+0000 7fd06088c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-11T00:29:48.380 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-11T00:29:48.381 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-11T00:29:48.385 INFO:tasks.ceph.osd.0:Started 2023-07-11T00:29:48.386 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-11T00:29:48.387 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-11T00:29:48.392 INFO:tasks.ceph.osd.1:Started 2023-07-11T00:29:48.393 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-11T00:29:48.393 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-11T00:29:48.398 INFO:tasks.ceph.osd.2:Started 2023-07-11T00:29:48.398 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-11T00:29:48.398 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-11T00:29:48.404 INFO:tasks.ceph.osd.3:Started 2023-07-11T00:29:48.405 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-11T00:29:48.405 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-11T00:29:48.412 INFO:tasks.ceph.osd.4:Started 2023-07-11T00:29:48.412 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-11T00:29:48.413 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-11T00:29:48.419 INFO:tasks.ceph.osd.5:Started 2023-07-11T00:29:48.420 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-11T00:29:48.420 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-11T00:29:48.425 INFO:tasks.ceph.osd.6:Started 2023-07-11T00:29:48.426 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-11T00:29:48.426 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-11T00:29:48.432 INFO:tasks.ceph.osd.7:Started 2023-07-11T00:29:48.434 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:29:48.482 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:48.478+0000 7fd06088c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-11T00:29:48.556 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:48.552+0000 7f16c5235200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-11T00:29:48.654 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:48.651+0000 7f16c5235200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-11T00:29:48.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.717+0000 7f4121bff700 1 Processor -- start 2023-07-11T00:29:48.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.717+0000 7f4121bff700 1 -- start start 2023-07-11T00:29:48.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.719+0000 7f4121bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f411c15c460 0x7f411c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:48.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.719+0000 7f4121bff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f411c0cf8f0 0x7f411c15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:48.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.719+0000 7f4121bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411c0d1790 con 0x7f411c0d2640 2023-07-11T00:29:48.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.719+0000 7f4121bff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411c0cedd0 con 0x7f411c0cf8f0 2023-07-11T00:29:48.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.719+0000 7f4121bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411c0cd950 con 0x7f411c15c460 2023-07-11T00:29:48.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.719+0000 7f411bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f411c0cf8f0 0x7f411c15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:48.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.719+0000 7f411bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f411c0cf8f0 0x7f411c15fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41536/0 (socket says 172.21.15.22:41536) 2023-07-11T00:29:48.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.719+0000 7f411bfff700 1 -- 172.21.15.22:0/1260974417 learned_addr learned my addr 172.21.15.22:0/1260974417 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:29:48.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.719+0000 7f411b7fe700 1 --2- 172.21.15.22:0/1260974417 >> v2:172.21.15.184:3300/0 conn(0x7f411c15c460 0x7f411c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:48.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.719+0000 7f411bfff700 1 -- 172.21.15.22:0/1260974417 >> v2:172.21.15.184:3300/0 conn(0x7f411c15c460 msgr2=0x7f411c0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:29:48.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.719+0000 7f411bfff700 1 --2- 172.21.15.22:0/1260974417 >> v2:172.21.15.184:3300/0 conn(0x7f411c15c460 0x7f411c0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.719+0000 7f411bfff700 1 -- 172.21.15.22:0/1260974417 >> v1:172.21.15.184:6789/0 conn(0x7f411c0d2640 legacy=0x7f411c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:48.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.719+0000 7f411bfff700 1 -- 172.21.15.22:0/1260974417 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c0d14b0 con 0x7f411c0cf8f0 2023-07-11T00:29:48.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.720+0000 7f411bfff700 1 --2- 172.21.15.22:0/1260974417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411c0cf8f0 0x7f411c15fe20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f411c0b4f00 tx=0x7f411400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae67d5f18c812c65 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:48.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.720+0000 7f411a7fc700 1 -- 172.21.15.22:0/1260974417 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411400e070 con 0x7f411c0cf8f0 2023-07-11T00:29:48.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.720+0000 7f411a7fc700 1 -- 172.21.15.22:0/1260974417 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411400b9c0 con 0x7f411c0cf8f0 2023-07-11T00:29:48.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.720+0000 7f411a7fc700 1 -- 172.21.15.22:0/1260974417 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411400bd70 con 0x7f411c0cf8f0 2023-07-11T00:29:48.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.720+0000 7f4121bff700 1 -- 172.21.15.22:0/1260974417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411c0cf8f0 msgr2=0x7f411c15fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:48.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.720+0000 7f4121bff700 1 --2- 172.21.15.22:0/1260974417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411c0cf8f0 0x7f411c15fe20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f411c0b4f00 tx=0x7f411400b330 comp rx=0 tx=0).stop 2023-07-11T00:29:48.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.721+0000 7f4121bff700 1 -- 172.21.15.22:0/1260974417 shutdown_connections 2023-07-11T00:29:48.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.721+0000 7f4121bff700 1 --2- 172.21.15.22:0/1260974417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411c0cf8f0 0x7f411c15fe20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.721+0000 7f4121bff700 1 --2- 172.21.15.22:0/1260974417 >> v2:172.21.15.184:3300/0 conn(0x7f411c15c460 0x7f411c0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.721+0000 7f4121bff700 1 -- 172.21.15.22:0/1260974417 >> 172.21.15.22:0/1260974417 conn(0x7f411c071660 msgr2=0x7f411c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:48.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.721+0000 7f4121bff700 1 -- 172.21.15.22:0/1260974417 shutdown_connections 2023-07-11T00:29:48.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.721+0000 7f4121bff700 1 -- 172.21.15.22:0/1260974417 wait complete. 2023-07-11T00:29:48.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.722+0000 7f4121bff700 1 Processor -- start 2023-07-11T00:29:48.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.723+0000 7f4121bff700 1 -- start start 2023-07-11T00:29:48.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.723+0000 7f4121bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f411c0cf8f0 0x7f411c153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:48.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.724+0000 7f4121bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f411c0d2640 0x7f411c0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:48.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.724+0000 7f4121bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411c15c460 0x7f411c0c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:48.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.724+0000 7f4121bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c0c78a0 con 0x7f411c15c460 2023-07-11T00:29:48.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.724+0000 7f4121bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c0c7b80 con 0x7f411c0cf8f0 2023-07-11T00:29:48.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.724+0000 7f4121bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411c0c7e60 con 0x7f411c0d2640 2023-07-11T00:29:48.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.724+0000 7f411bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411c15c460 0x7f411c0c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:48.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.724+0000 7f411bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411c15c460 0x7f411c0c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41550/0 (socket says 172.21.15.22:41550) 2023-07-11T00:29:48.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.724+0000 7f411bfff700 1 -- 172.21.15.22:0/3027868543 learned_addr learned my addr 172.21.15.22:0/3027868543 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:29:48.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.724+0000 7f411b7fe700 1 --2- 172.21.15.22:0/3027868543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f411c0cf8f0 0x7f411c153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:48.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.724+0000 7f411affd700 1 --2- 172.21.15.22:0/3027868543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f411c0d2640 0x7f411c0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:48.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.724+0000 7f411bfff700 1 -- 172.21.15.22:0/3027868543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f411c0d2640 msgr2=0x7f411c0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:48.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.724+0000 7f411bfff700 1 --2- 172.21.15.22:0/3027868543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f411c0d2640 0x7f411c0cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.724+0000 7f411bfff700 1 -- 172.21.15.22:0/3027868543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f411c0cf8f0 msgr2=0x7f411c153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:48.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.724+0000 7f411bfff700 1 --2- 172.21.15.22:0/3027868543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f411c0cf8f0 0x7f411c153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.724+0000 7f411bfff700 1 -- 172.21.15.22:0/3027868543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4114009b30 con 0x7f411c15c460 2023-07-11T00:29:48.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.724+0000 7f411bfff700 1 --2- 172.21.15.22:0/3027868543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411c15c460 0x7f411c0c8940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f411c0d3c80 tx=0x7f4114004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:48.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.725+0000 7f4103fff700 1 -- 172.21.15.22:0/3027868543 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114004880 con 0x7f411c15c460 2023-07-11T00:29:48.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.725+0000 7f4103fff700 1 -- 172.21.15.22:0/3027868543 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41140099b0 con 0x7f411c15c460 2023-07-11T00:29:48.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.725+0000 7f4121bff700 1 -- 172.21.15.22:0/3027868543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411c0c8140 con 0x7f411c15c460 2023-07-11T00:29:48.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.725+0000 7f4103fff700 1 -- 172.21.15.22:0/3027868543 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411401b670 con 0x7f411c15c460 2023-07-11T00:29:48.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.725+0000 7f4121bff700 1 -- 172.21.15.22:0/3027868543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411c1f2980 con 0x7f411c15c460 2023-07-11T00:29:48.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.725+0000 7f4103fff700 1 -- 172.21.15.22:0/3027868543 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f411401bad0 con 0x7f411c15c460 2023-07-11T00:29:48.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.725+0000 7f4103fff700 1 -- 172.21.15.22:0/3027868543 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f4114024df0 con 0x7f411c15c460 2023-07-11T00:29:48.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.726+0000 7f4121bff700 1 -- 172.21.15.22:0/3027868543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411c0c8660 con 0x7f411c15c460 2023-07-11T00:29:48.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.729+0000 7f4103fff700 1 -- 172.21.15.22:0/3027868543 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f4114042b80 con 0x7f411c15c460 2023-07-11T00:29:48.770 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:48.768+0000 7fd06088c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-11T00:29:48.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.803+0000 7f4121bff700 1 -- 172.21.15.22:0/3027868543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f411c04ea60 con 0x7f411c15c460 2023-07-11T00:29:48.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.804+0000 7f4103fff700 1 -- 172.21.15.22:0/3027868543 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4114031030 con 0x7f411c15c460 2023-07-11T00:29:48.807 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:29:48.807 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":10,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:29:48.358468+0000","last_up_change":"0.000000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:29:48.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.805+0000 7f4121bff700 1 -- 172.21.15.22:0/3027868543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411c15c460 msgr2=0x7f411c0c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:48.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.805+0000 7f4121bff700 1 --2- 172.21.15.22:0/3027868543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411c15c460 0x7f411c0c8940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f411c0d3c80 tx=0x7f4114004ad0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.805+0000 7f4121bff700 1 -- 172.21.15.22:0/3027868543 shutdown_connections 2023-07-11T00:29:48.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.805+0000 7f4121bff700 1 --2- 172.21.15.22:0/3027868543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f411c15c460 0x7f411c0c8940 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.805+0000 7f4121bff700 1 --2- 172.21.15.22:0/3027868543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f411c0cf8f0 0x7f411c153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.805+0000 7f4121bff700 1 --2- 172.21.15.22:0/3027868543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f411c0d2640 0x7f411c0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.805+0000 7f4121bff700 1 -- 172.21.15.22:0/3027868543 >> 172.21.15.22:0/3027868543 conn(0x7f411c071660 msgr2=0x7f411c0cf070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:48.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.805+0000 7f4121bff700 1 -- 172.21.15.22:0/3027868543 shutdown_connections 2023-07-11T00:29:48.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:48.805+0000 7f4121bff700 1 -- 172.21.15.22:0/3027868543 wait complete. 2023-07-11T00:29:48.826 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-11T00:29:48.827 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-11T00:29:48.875 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:48.872+0000 7f16c5235200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-11T00:29:48.876 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:48.874+0000 7fd06088c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-11T00:29:48.976 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:48.973+0000 7f16c5235200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-11T00:29:48.979 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:48.977+0000 7fd06088c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-11T00:29:49.074 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:49.072+0000 7f16c5235200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-11T00:29:49.096 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:49.094+0000 7fd06088c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-11T00:29:49.109 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-07-11T00:29:49.103+0000 7f4e05600640 -1 Falling back to public interface 2023-07-11T00:29:49.111 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-07-11T00:29:49.109+0000 7f01ac3e9640 -1 Falling back to public interface 2023-07-11T00:29:49.128 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-07-11T00:29:49.116+0000 7f07fd7bf640 -1 Falling back to public interface 2023-07-11T00:29:49.128 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-07-11T00:29:49.124+0000 7f258dd99640 -1 Falling back to public interface 2023-07-11T00:29:49.133 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-07-11T00:29:49.131+0000 7fb225f87640 -1 Falling back to public interface 2023-07-11T00:29:49.143 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-07-11T00:29:49.134+0000 7f5a2403c640 -1 Falling back to public interface 2023-07-11T00:29:49.144 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-07-11T00:29:49.134+0000 7fd531a44640 -1 Falling back to public interface 2023-07-11T00:29:49.145 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-07-11T00:29:49.134+0000 7f7916114640 -1 Falling back to public interface 2023-07-11T00:29:49.190 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:49.187+0000 7f16c5235200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-11T00:29:49.339 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:49.337+0000 7fd06088c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-11T00:29:49.417 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:49.414+0000 7f16c5235200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-11T00:29:49.447 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:49.444+0000 7fd06088c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-11T00:29:49.520 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:49.517+0000 7f16c5235200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-11T00:29:49.634 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-11T00:29:49.811 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:49.809+0000 7fd06088c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-11T00:29:49.815 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.812+0000 7ff5975ff700 1 Processor -- start 2023-07-11T00:29:49.815 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.813+0000 7ff5975ff700 1 -- start start 2023-07-11T00:29:49.816 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.814+0000 7ff5975ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff5900d0980 0x7ff5900cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:49.817 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.814+0000 7ff5975ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5900cd570 con 0x7ff5900d3200 2023-07-11T00:29:49.817 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.814+0000 7ff5975ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5900d2720 con 0x7ff5900d3670 2023-07-11T00:29:49.817 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.814+0000 7ff5975ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5900b4fd0 con 0x7ff5900d0980 2023-07-11T00:29:49.817 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.814+0000 7ff59539b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff5900d0980 0x7ff5900cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:49.818 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.814+0000 7ff594b9a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff5900d3200 0x7ff5900d0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41576/0 (socket says 172.21.15.22:41576) 2023-07-11T00:29:49.818 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.814+0000 7ff594b9a700 1 -- 172.21.15.22:0/2858926721 learned_addr learned my addr 172.21.15.22:0/2858926721 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:29:49.819 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.815+0000 7ff59539b700 1 -- 172.21.15.22:0/2858926721 >> v1:172.21.15.184:6789/0 conn(0x7ff5900d3670 legacy=0x7ff5900b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:49.820 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.815+0000 7ff59539b700 1 -- 172.21.15.22:0/2858926721 >> v1:172.21.15.22:6789/0 conn(0x7ff5900d3200 legacy=0x7ff5900d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:49.820 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.815+0000 7ff59539b700 1 -- 172.21.15.22:0/2858926721 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5900d2a00 con 0x7ff5900d0980 2023-07-11T00:29:49.820 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.815+0000 7ff59539b700 1 --2- 172.21.15.22:0/2858926721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5900d0980 0x7ff5900cf8a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009840 tx=0x7ff58c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1680179e8d1d480c server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:49.821 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.815+0000 7ff587fff700 1 -- 172.21.15.22:0/2858926721 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c011830 con 0x7ff5900d0980 2023-07-11T00:29:49.821 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.815+0000 7ff587fff700 1 -- 172.21.15.22:0/2858926721 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c011990 con 0x7ff5900d0980 2023-07-11T00:29:49.821 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.815+0000 7ff587fff700 1 -- 172.21.15.22:0/2858926721 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c011d20 con 0x7ff5900d0980 2023-07-11T00:29:49.821 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.816+0000 7ff5975ff700 1 -- 172.21.15.22:0/2858926721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5900d0980 msgr2=0x7ff5900cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:49.821 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.816+0000 7ff5975ff700 1 --2- 172.21.15.22:0/2858926721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5900d0980 0x7ff5900cf8a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009840 tx=0x7ff58c009b50 comp rx=0 tx=0).stop 2023-07-11T00:29:49.822 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.816+0000 7ff5975ff700 1 -- 172.21.15.22:0/2858926721 shutdown_connections 2023-07-11T00:29:49.822 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.816+0000 7ff5975ff700 1 --2- 172.21.15.22:0/2858926721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5900d0980 0x7ff5900cf8a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:49.822 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.816+0000 7ff5975ff700 1 -- 172.21.15.22:0/2858926721 >> 172.21.15.22:0/2858926721 conn(0x7ff59006b3f0 msgr2=0x7ff59006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:49.822 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.816+0000 7ff5975ff700 1 -- 172.21.15.22:0/2858926721 shutdown_connections 2023-07-11T00:29:49.822 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.816+0000 7ff5975ff700 1 -- 172.21.15.22:0/2858926721 wait complete. 2023-07-11T00:29:49.825 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.818+0000 7ff5975ff700 1 Processor -- start 2023-07-11T00:29:49.826 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.818+0000 7ff5975ff700 1 -- start start 2023-07-11T00:29:49.826 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.819+0000 7ff5975ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5900d0980 0x7ff5900b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:49.826 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.819+0000 7ff5975ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5900d3200 0x7ff5900cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:49.827 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.819+0000 7ff5975ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5900d3670 0x7ff5900cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:49.827 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.819+0000 7ff5975ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5901484f0 con 0x7ff5900d3670 2023-07-11T00:29:49.827 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.819+0000 7ff5975ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59015f400 con 0x7ff5900d0980 2023-07-11T00:29:49.828 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.819+0000 7ff5975ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff590147bc0 con 0x7ff5900d3200 2023-07-11T00:29:49.829 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.819+0000 7ff595b9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5900d3670 0x7ff5900cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:49.829 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.819+0000 7ff595b9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5900d3670 0x7ff5900cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41566/0 (socket says 172.21.15.22:41566) 2023-07-11T00:29:49.829 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.819+0000 7ff595b9c700 1 -- 172.21.15.22:0/3429835567 learned_addr learned my addr 172.21.15.22:0/3429835567 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:29:49.829 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.819+0000 7ff59539b700 1 --2- 172.21.15.22:0/3429835567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5900d0980 0x7ff5900b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:49.830 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.819+0000 7ff594b9a700 1 --2- 172.21.15.22:0/3429835567 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5900d3200 0x7ff5900cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:49.830 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.820+0000 7ff595b9c700 1 -- 172.21.15.22:0/3429835567 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5900d3200 msgr2=0x7ff5900cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:49.830 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.820+0000 7ff595b9c700 1 --2- 172.21.15.22:0/3429835567 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5900d3200 0x7ff5900cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:49.830 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.820+0000 7ff595b9c700 1 -- 172.21.15.22:0/3429835567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5900d0980 msgr2=0x7ff5900b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:49.830 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.820+0000 7ff595b9c700 1 --2- 172.21.15.22:0/3429835567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5900d0980 0x7ff5900b0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:49.831 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.820+0000 7ff595b9c700 1 -- 172.21.15.22:0/3429835567 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c0094a0 con 0x7ff5900d3670 2023-07-11T00:29:49.831 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.820+0000 7ff594b9a700 1 --2- 172.21.15.22:0/3429835567 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5900d3200 0x7ff5900cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:29:49.831 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.820+0000 7ff595b9c700 1 --2- 172.21.15.22:0/3429835567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5900d3670 0x7ff5900cc160 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff58800cc50 tx=0x7ff58800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:49.832 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.820+0000 7ff585ffb700 1 -- 172.21.15.22:0/3429835567 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff588003c00 con 0x7ff5900d3670 2023-07-11T00:29:49.832 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.820+0000 7ff585ffb700 1 -- 172.21.15.22:0/3429835567 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff588003d60 con 0x7ff5900d3670 2023-07-11T00:29:49.832 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.820+0000 7ff585ffb700 1 -- 172.21.15.22:0/3429835567 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58800ab60 con 0x7ff5900d3670 2023-07-11T00:29:49.832 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.820+0000 7ff5975ff700 1 -- 172.21.15.22:0/3429835567 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff590147ea0 con 0x7ff5900d3670 2023-07-11T00:29:49.832 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.820+0000 7ff5975ff700 1 -- 172.21.15.22:0/3429835567 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5901e4a80 con 0x7ff5900d3670 2023-07-11T00:29:49.833 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.820+0000 7ff585ffb700 1 -- 172.21.15.22:0/3429835567 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff5880050d0 con 0x7ff5900d3670 2023-07-11T00:29:49.833 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.821+0000 7ff585ffb700 1 -- 172.21.15.22:0/3429835567 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff588012650 con 0x7ff5900d3670 2023-07-11T00:29:49.833 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.821+0000 7ff5975ff700 1 -- 172.21.15.22:0/3429835567 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5900d24f0 con 0x7ff5900d3670 2023-07-11T00:29:49.833 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.824+0000 7ff585ffb700 1 -- 172.21.15.22:0/3429835567 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7ff588005380 con 0x7ff5900d3670 2023-07-11T00:29:49.877 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:49.874+0000 7f16c5235200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-11T00:29:49.902 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.899+0000 7ff5975ff700 1 -- 172.21.15.22:0/3429835567 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff590148660 con 0x7ff5900d3670 2023-07-11T00:29:49.903 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.900+0000 7ff585ffb700 1 -- 172.21.15.22:0/3429835567 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff588005520 con 0x7ff5900d3670 2023-07-11T00:29:49.903 INFO:teuthology.misc.health.smithi022.stdout: 2023-07-11T00:29:49.903 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":10,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:29:48.358468+0000","last_up_change":"0.000000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:29:49.904 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.901+0000 7ff5975ff700 1 -- 172.21.15.22:0/3429835567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5900d3670 msgr2=0x7ff5900cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:49.904 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.901+0000 7ff5975ff700 1 --2- 172.21.15.22:0/3429835567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5900d3670 0x7ff5900cc160 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff58800cc50 tx=0x7ff58800cf60 comp rx=0 tx=0).stop 2023-07-11T00:29:49.904 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.901+0000 7ff5975ff700 1 -- 172.21.15.22:0/3429835567 shutdown_connections 2023-07-11T00:29:49.904 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.901+0000 7ff5975ff700 1 --2- 172.21.15.22:0/3429835567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5900d3670 0x7ff5900cc160 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:49.905 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.901+0000 7ff5975ff700 1 --2- 172.21.15.22:0/3429835567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5900d0980 0x7ff5900b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:49.905 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.901+0000 7ff5975ff700 1 --2- 172.21.15.22:0/3429835567 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5900d3200 0x7ff5900cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:49.905 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.901+0000 7ff5975ff700 1 -- 172.21.15.22:0/3429835567 >> 172.21.15.22:0/3429835567 conn(0x7ff59006b3f0 msgr2=0x7ff5900b3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:49.906 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.901+0000 7ff5975ff700 1 -- 172.21.15.22:0/3429835567 shutdown_connections 2023-07-11T00:29:49.906 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:49.901+0000 7ff5975ff700 1 -- 172.21.15.22:0/3429835567 wait complete. 2023-07-11T00:29:49.907 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:49.905+0000 7fd06088c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-11T00:29:49.922 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-11T00:29:49.968 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:49.965+0000 7f16c5235200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-11T00:29:50.564 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:50.562+0000 7fd06088c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-11T00:29:50.592 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:50.589+0000 7f16c5235200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-11T00:29:50.956 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:50.954+0000 7fd06088c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-11T00:29:50.979 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:50.976+0000 7f16c5235200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-11T00:29:51.144 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:51.141+0000 7fd06088c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-11T00:29:51.161 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:51.158+0000 7f16c5235200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-11T00:29:51.605 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:51.603+0000 7f16c5235200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-11T00:29:51.611 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:51.608+0000 7fd06088c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-11T00:29:51.795 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:51.793+0000 7f16c5235200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-11T00:29:51.810 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:51.808+0000 7fd06088c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-11T00:29:52.077 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:52.071+0000 7f16c5235200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-11T00:29:52.102 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:52.099+0000 7fd06088c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-11T00:29:52.474 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:52.472+0000 7f16c5235200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-11T00:29:52.505 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-07-11T00:29:52.503+0000 7fd06088c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-11T00:29:52.617 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-07-11T00:29:52.615+0000 7f4e05600640 -1 osd.1 0 log_to_monitors true 2023-07-11T00:29:52.639 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-07-11T00:29:52.636+0000 7f01ac3e9640 -1 osd.5 0 log_to_monitors true 2023-07-11T00:29:52.671 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-07-11T00:29:52.668+0000 7f07fd7bf640 -1 osd.3 0 log_to_monitors true 2023-07-11T00:29:52.705 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-07-11T00:29:52.702+0000 7f7916114640 -1 osd.7 0 log_to_monitors true 2023-07-11T00:29:52.705 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-07-11T00:29:52.703+0000 7fd531a44640 -1 osd.6 0 log_to_monitors true 2023-07-11T00:29:52.733 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-07-11T00:29:52.730+0000 7fb225f87640 -1 osd.2 0 log_to_monitors true 2023-07-11T00:29:52.959 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-07-11T00:29:52.956+0000 7f5a2403c640 -1 osd.4 0 log_to_monitors true 2023-07-11T00:29:52.979 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-07-11T00:29:52.975+0000 7f258dd99640 -1 osd.0 0 log_to_monitors true 2023-07-11T00:29:53.496 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:53.493+0000 7f167edfa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-11T00:29:53.498 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-07-11T00:29:53.495+0000 7f167edfa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-11T00:29:56.026 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-07-11T00:29:56.023+0000 7fb214df7700 -1 osd.2 0 waiting for initial osdmap 2023-07-11T00:29:56.053 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-07-11T00:29:56.050+0000 7fb20c5fa700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-11T00:29:56.091 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-07-11T00:29:56.088+0000 7f4df43f7700 -1 osd.1 0 waiting for initial osdmap 2023-07-11T00:29:56.092 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-07-11T00:29:56.090+0000 7f07ec5f7700 -1 osd.3 0 waiting for initial osdmap 2023-07-11T00:29:56.105 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-07-11T00:29:56.103+0000 7f4debbfa700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-11T00:29:56.109 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-07-11T00:29:56.107+0000 7f07e3dfa700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-11T00:29:56.183 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-07-11T00:29:56.181+0000 7f257d3f8700 -1 osd.0 0 waiting for initial osdmap 2023-07-11T00:29:56.200 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-07-11T00:29:56.197+0000 7f25743fa700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-11T00:29:56.730 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-11T00:29:56.753 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-07-11T00:29:56.749+0000 7f019b1f7700 -1 osd.5 0 waiting for initial osdmap 2023-07-11T00:29:56.774 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-07-11T00:29:56.770+0000 7f5a137f8700 -1 osd.4 0 waiting for initial osdmap 2023-07-11T00:29:56.777 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-07-11T00:29:56.774+0000 7f01929fa700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-11T00:29:56.780 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-07-11T00:29:56.777+0000 7f79057f8700 -1 osd.7 0 waiting for initial osdmap 2023-07-11T00:29:56.789 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-07-11T00:29:56.787+0000 7fd5209f7700 -1 osd.6 0 waiting for initial osdmap 2023-07-11T00:29:56.795 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-07-11T00:29:56.792+0000 7f5a0a7fa700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-11T00:29:56.811 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-07-11T00:29:56.809+0000 7fd5181fa700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-11T00:29:56.812 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-07-11T00:29:56.809+0000 7f78fc7fa700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-11T00:29:56.915 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.913+0000 7f2b755ff700 1 Processor -- start 2023-07-11T00:29:56.916 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.913+0000 7f2b755ff700 1 -- start start 2023-07-11T00:29:56.918 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.914+0000 7f2b755ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2b700d0980 0x7f2b700cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:56.919 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.914+0000 7f2b755ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b700d3200 0x7f2b700d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:56.919 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.914+0000 7f2b755ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b700cd570 con 0x7f2b700d1290 2023-07-11T00:29:56.919 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.914+0000 7f2b755ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b700b4fd0 con 0x7f2b700d0980 2023-07-11T00:29:56.919 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.914+0000 7f2b755ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700d2720 con 0x7f2b700d3200 2023-07-11T00:29:56.919 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.915+0000 7f2b6effd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2b700d0980 0x7f2b700cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:56.919 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.915+0000 7f2b6e7fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b700d3200 0x7f2b700d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:56.920 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.915+0000 7f2b6effd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2b700d0980 0x7f2b700cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:35484/0 (socket says 172.21.15.22:35484) 2023-07-11T00:29:56.920 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.915+0000 7f2b6f7fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2b700d1290 0x7f2b700b5990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:48726/0 (socket says 172.21.15.22:48726) 2023-07-11T00:29:56.920 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.915+0000 7f2b6e7fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b700d3200 0x7f2b700d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:56340/0 (socket says 172.21.15.22:56340) 2023-07-11T00:29:56.920 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.915+0000 7f2b6effd700 1 -- 172.21.15.22:0/1737208761 learned_addr learned my addr 172.21.15.22:0/1737208761 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:29:56.920 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.915+0000 7f2b6dffb700 1 -- 172.21.15.22:0/1737208761 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581712771 0 0) 0x7f2b700cd570 con 0x7f2b700d1290 2023-07-11T00:29:56.920 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.915+0000 7f2b6dffb700 1 -- 172.21.15.22:0/1737208761 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b580035b0 con 0x7f2b700d1290 2023-07-11T00:29:56.921 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.915+0000 7f2b6e7fc700 1 -- 172.21.15.22:0/1737208761 >> v2:172.21.15.184:3300/0 conn(0x7f2b700d0980 msgr2=0x7f2b700cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:29:56.921 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.915+0000 7f2b6e7fc700 1 --2- 172.21.15.22:0/1737208761 >> v2:172.21.15.184:3300/0 conn(0x7f2b700d0980 0x7f2b700cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:56.921 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.915+0000 7f2b6e7fc700 1 -- 172.21.15.22:0/1737208761 >> v1:172.21.15.184:6789/0 conn(0x7f2b700d1290 legacy=0x7f2b700b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:56.921 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.915+0000 7f2b6e7fc700 1 -- 172.21.15.22:0/1737208761 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b700d2a00 con 0x7f2b700d3200 2023-07-11T00:29:56.921 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.915+0000 7f2b6effd700 1 --2- 172.21.15.22:0/1737208761 >> v2:172.21.15.184:3300/0 conn(0x7f2b700d0980 0x7f2b700cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:29:56.921 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.916+0000 7f2b6e7fc700 1 --2- 172.21.15.22:0/1737208761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b700d3200 0x7f2b700d0d50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009840 tx=0x7f2b64009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c20e79d180a018a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:56.921 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.916+0000 7f2b6dffb700 1 -- 172.21.15.22:0/1737208761 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64011830 con 0x7f2b700d3200 2023-07-11T00:29:56.922 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.916+0000 7f2b6dffb700 1 -- 172.21.15.22:0/1737208761 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b64011990 con 0x7f2b700d3200 2023-07-11T00:29:56.922 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.916+0000 7f2b6dffb700 1 -- 172.21.15.22:0/1737208761 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64011d20 con 0x7f2b700d3200 2023-07-11T00:29:56.925 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.916+0000 7f2b755ff700 1 -- 172.21.15.22:0/1737208761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b700d3200 msgr2=0x7f2b700d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:56.927 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.916+0000 7f2b755ff700 1 --2- 172.21.15.22:0/1737208761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b700d3200 0x7f2b700d0d50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009840 tx=0x7f2b64009b50 comp rx=0 tx=0).stop 2023-07-11T00:29:56.927 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.917+0000 7f2b755ff700 1 -- 172.21.15.22:0/1737208761 shutdown_connections 2023-07-11T00:29:56.927 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.917+0000 7f2b755ff700 1 --2- 172.21.15.22:0/1737208761 >> v2:172.21.15.184:3300/0 conn(0x7f2b700d0980 0x7f2b700cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:56.927 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.917+0000 7f2b755ff700 1 --2- 172.21.15.22:0/1737208761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b700d3200 0x7f2b700d0d50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:56.928 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.917+0000 7f2b755ff700 1 -- 172.21.15.22:0/1737208761 >> 172.21.15.22:0/1737208761 conn(0x7f2b7006b3f0 msgr2=0x7f2b7006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:56.928 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.917+0000 7f2b755ff700 1 -- 172.21.15.22:0/1737208761 shutdown_connections 2023-07-11T00:29:56.928 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.917+0000 7f2b755ff700 1 -- 172.21.15.22:0/1737208761 wait complete. 2023-07-11T00:29:56.928 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.919+0000 7f2b755ff700 1 Processor -- start 2023-07-11T00:29:56.928 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.919+0000 7f2b755ff700 1 -- start start 2023-07-11T00:29:56.929 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.920+0000 7f2b755ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b700d0980 0x7f2b701521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:56.929 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.920+0000 7f2b755ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b700d1290 0x7f2b70157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:56.929 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.920+0000 7f2b755ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b700d3200 0x7f2b700cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:56.930 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.920+0000 7f2b755ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b701542f0 con 0x7f2b700d1290 2023-07-11T00:29:56.930 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.921+0000 7f2b755ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b70152730 con 0x7f2b700d0980 2023-07-11T00:29:56.930 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.921+0000 7f2b755ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b701f2bb0 con 0x7f2b700d3200 2023-07-11T00:29:56.930 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.921+0000 7f2b6e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b700d1290 0x7f2b70157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:56.931 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.921+0000 7f2b6f7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b700d3200 0x7f2b700cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:56.931 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.921+0000 7f2b6effd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b700d0980 0x7f2b701521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:56.931 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.921+0000 7f2b6f7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b700d3200 0x7f2b700cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:56342/0 (socket says 172.21.15.22:56342) 2023-07-11T00:29:56.932 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.921+0000 7f2b6f7fe700 1 -- 172.21.15.22:0/2810247586 learned_addr learned my addr 172.21.15.22:0/2810247586 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:29:56.932 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.921+0000 7f2b6f7fe700 1 -- 172.21.15.22:0/2810247586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b700d0980 msgr2=0x7f2b701521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:56.932 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.921+0000 7f2b6f7fe700 1 --2- 172.21.15.22:0/2810247586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b700d0980 0x7f2b701521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:56.932 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.921+0000 7f2b6f7fe700 1 -- 172.21.15.22:0/2810247586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b700d1290 msgr2=0x7f2b70157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:56.933 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.921+0000 7f2b6f7fe700 1 --2- 172.21.15.22:0/2810247586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b700d1290 0x7f2b70157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:56.933 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.921+0000 7f2b6f7fe700 1 -- 172.21.15.22:0/2810247586 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b60009550 con 0x7f2b700d3200 2023-07-11T00:29:56.933 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.921+0000 7f2b6f7fe700 1 --2- 172.21.15.22:0/2810247586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b700d3200 0x7f2b700cbde0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800cbd0 tx=0x7f2b6800cee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:56.934 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.922+0000 7f2b577fe700 1 -- 172.21.15.22:0/2810247586 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6800aaa0 con 0x7f2b700d3200 2023-07-11T00:29:56.934 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.922+0000 7f2b577fe700 1 -- 172.21.15.22:0/2810247586 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6800ac00 con 0x7f2b700d3200 2023-07-11T00:29:56.934 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.922+0000 7f2b577fe700 1 -- 172.21.15.22:0/2810247586 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68007070 con 0x7f2b700d3200 2023-07-11T00:29:56.934 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.922+0000 7f2b755ff700 1 -- 172.21.15.22:0/2810247586 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b640094a0 con 0x7f2b700d3200 2023-07-11T00:29:56.935 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.922+0000 7f2b755ff700 1 -- 172.21.15.22:0/2810247586 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b701f20d0 con 0x7f2b700d3200 2023-07-11T00:29:56.935 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.923+0000 7f2b755ff700 1 -- 172.21.15.22:0/2810247586 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b70067920 con 0x7f2b700d3200 2023-07-11T00:29:56.936 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.924+0000 7f2b577fe700 1 -- 172.21.15.22:0/2810247586 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f2b680071d0 con 0x7f2b700d3200 2023-07-11T00:29:56.938 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.925+0000 7f2b577fe700 1 --2- 172.21.15.22:0/2810247586 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2b5c06ac50 0x7f2b5c06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:56.938 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.925+0000 7f2b577fe700 1 -- 172.21.15.22:0/2810247586 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f2b68088320 con 0x7f2b700d3200 2023-07-11T00:29:56.938 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.925+0000 7f2b6effd700 1 --2- 172.21.15.22:0/2810247586 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2b5c06ac50 0x7f2b5c06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:56.939 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.926+0000 7f2b6effd700 1 --2- 172.21.15.22:0/2810247586 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2b5c06ac50 0x7f2b5c06d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2b700ce540 tx=0x7f2b600092c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:56.939 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:56.930+0000 7f2b577fe700 1 -- 172.21.15.22:0/2810247586 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2b68054300 con 0x7f2b700d3200 2023-07-11T00:29:57.151 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:57.149+0000 7f2b755ff700 1 -- 172.21.15.22:0/2810247586 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b700cfd60 con 0x7f2b700d3200 2023-07-11T00:29:57.152 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:57.150+0000 7f2b577fe700 1 -- 172.21.15.22:0/2810247586 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10908 (secure 0 0 0) 0x7f2b68017030 con 0x7f2b700d3200 2023-07-11T00:29:57.153 INFO:teuthology.misc.health.smithi022.stdout: 2023-07-11T00:29:57.153 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":13,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:29:57.032284+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:29:57.155 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:57.153+0000 7f2b755ff700 1 -- 172.21.15.22:0/2810247586 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2b5c06ac50 msgr2=0x7f2b5c06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:57.156 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:57.153+0000 7f2b755ff700 1 --2- 172.21.15.22:0/2810247586 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2b5c06ac50 0x7f2b5c06d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2b700ce540 tx=0x7f2b600092c0 comp rx=0 tx=0).stop 2023-07-11T00:29:57.156 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:57.153+0000 7f2b755ff700 1 -- 172.21.15.22:0/2810247586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b700d3200 msgr2=0x7f2b700cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:57.156 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:57.153+0000 7f2b755ff700 1 --2- 172.21.15.22:0/2810247586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b700d3200 0x7f2b700cbde0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800cbd0 tx=0x7f2b6800cee0 comp rx=0 tx=0).stop 2023-07-11T00:29:57.157 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:57.153+0000 7f2b755ff700 1 -- 172.21.15.22:0/2810247586 shutdown_connections 2023-07-11T00:29:57.157 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:57.153+0000 7f2b755ff700 1 --2- 172.21.15.22:0/2810247586 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2b5c06ac50 0x7f2b5c06d100 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:57.157 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:57.153+0000 7f2b755ff700 1 --2- 172.21.15.22:0/2810247586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b700d3200 0x7f2b700cbde0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:57.157 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:57.153+0000 7f2b755ff700 1 --2- 172.21.15.22:0/2810247586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b700d0980 0x7f2b701521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:57.158 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:57.153+0000 7f2b755ff700 1 --2- 172.21.15.22:0/2810247586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b700d1290 0x7f2b70157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:57.158 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:57.153+0000 7f2b755ff700 1 -- 172.21.15.22:0/2810247586 >> 172.21.15.22:0/2810247586 conn(0x7f2b7006b3f0 msgr2=0x7f2b700b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:57.158 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:57.153+0000 7f2b755ff700 1 -- 172.21.15.22:0/2810247586 shutdown_connections 2023-07-11T00:29:57.159 INFO:teuthology.misc.health.smithi022.stderr:2023-07-11T00:29:57.153+0000 7f2b755ff700 1 -- 172.21.15.22:0/2810247586 wait complete. 2023-07-11T00:29:57.172 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-11T00:29:57.172 INFO:tasks.ceph:Creating RBD pool 2023-07-11T00:29:57.173 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-11T00:29:57.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.367+0000 7fd5481ff700 1 Processor -- start 2023-07-11T00:29:57.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.367+0000 7fd5481ff700 1 -- start start 2023-07-11T00:29:57.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.368+0000 7fd5481ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd54006bda0 0x7fd5400d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:57.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.368+0000 7fd5481ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd54006c210 0x7fd5400d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:57.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.368+0000 7fd5481ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5400d1490 con 0x7fd5400b4590 2023-07-11T00:29:57.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.368+0000 7fd5481ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54006b390 con 0x7fd54006c210 2023-07-11T00:29:57.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.368+0000 7fd5481ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54015d3d0 con 0x7fd54006bda0 2023-07-11T00:29:57.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.368+0000 7fd545f9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd5400b4590 0x7fd5400b4960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49938/0 (socket says 172.21.15.22:49938) 2023-07-11T00:29:57.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.369+0000 7fd545f9b700 1 -- 172.21.15.22:0/1381752821 learned_addr learned my addr 172.21.15.22:0/1381752821 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:29:57.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.369+0000 7fd54679c700 1 --2- 172.21.15.22:0/1381752821 >> v2:172.21.15.22:3300/0 conn(0x7fd54006c210 0x7fd5400d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:57.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.369+0000 7fd54579a700 1 --2- 172.21.15.22:0/1381752821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd54006bda0 0x7fd5400d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:57.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.369+0000 7fd544f99700 1 -- 172.21.15.22:0/1381752821 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227734508 0 0) 0x7fd5400d1490 con 0x7fd5400b4590 2023-07-11T00:29:57.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.369+0000 7fd544f99700 1 -- 172.21.15.22:0/1381752821 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd52c0035b0 con 0x7fd5400b4590 2023-07-11T00:29:57.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.369+0000 7fd54679c700 1 -- 172.21.15.22:0/1381752821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd54006bda0 msgr2=0x7fd5400d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:29:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.369+0000 7fd54679c700 1 --2- 172.21.15.22:0/1381752821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd54006bda0 0x7fd5400d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.369+0000 7fd54679c700 1 -- 172.21.15.22:0/1381752821 >> v1:172.21.15.22:6789/0 conn(0x7fd5400b4590 legacy=0x7fd5400b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.369+0000 7fd54679c700 1 -- 172.21.15.22:0/1381752821 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54015d6b0 con 0x7fd54006c210 2023-07-11T00:29:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.369+0000 7fd54679c700 1 --2- 172.21.15.22:0/1381752821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd54006c210 0x7fd5400d0f50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd538009d90 tx=0x7fd53800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07f5f44d294ed3e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.370+0000 7fd544f99700 1 -- 172.21.15.22:0/1381752821 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53800e070 con 0x7fd54006c210 2023-07-11T00:29:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.370+0000 7fd544f99700 1 -- 172.21.15.22:0/1381752821 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53800bb20 con 0x7fd54006c210 2023-07-11T00:29:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.370+0000 7fd544f99700 1 -- 172.21.15.22:0/1381752821 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538012430 con 0x7fd54006c210 2023-07-11T00:29:57.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.370+0000 7fd5481ff700 1 -- 172.21.15.22:0/1381752821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd54006c210 msgr2=0x7fd5400d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:57.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.370+0000 7fd5481ff700 1 --2- 172.21.15.22:0/1381752821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd54006c210 0x7fd5400d0f50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd538009d90 tx=0x7fd53800b330 comp rx=0 tx=0).stop 2023-07-11T00:29:57.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.370+0000 7fd5481ff700 1 -- 172.21.15.22:0/1381752821 shutdown_connections 2023-07-11T00:29:57.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.370+0000 7fd5481ff700 1 --2- 172.21.15.22:0/1381752821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd54006c210 0x7fd5400d0f50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:57.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.370+0000 7fd5481ff700 1 --2- 172.21.15.22:0/1381752821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd54006bda0 0x7fd5400d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:57.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.370+0000 7fd5481ff700 1 -- 172.21.15.22:0/1381752821 >> 172.21.15.22:0/1381752821 conn(0x7fd5400cf590 msgr2=0x7fd5400cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:57.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.370+0000 7fd5481ff700 1 -- 172.21.15.22:0/1381752821 shutdown_connections 2023-07-11T00:29:57.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.370+0000 7fd5481ff700 1 -- 172.21.15.22:0/1381752821 wait complete. 2023-07-11T00:29:57.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.372+0000 7fd5481ff700 1 Processor -- start 2023-07-11T00:29:57.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.372+0000 7fd5481ff700 1 -- start start 2023-07-11T00:29:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.373+0000 7fd5481ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd54006bda0 0x7fd5401e6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.373+0000 7fd5481ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd54006c210 0x7fd54014aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.373+0000 7fd5481ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5400b4590 0x7fd5401e7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.373+0000 7fd5481ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5401e5c00 con 0x7fd5400b4590 2023-07-11T00:29:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.373+0000 7fd5481ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5401e5ee0 con 0x7fd54006c210 2023-07-11T00:29:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.373+0000 7fd5481ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5401e61c0 con 0x7fd54006bda0 2023-07-11T00:29:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.373+0000 7fd54679c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5400b4590 0x7fd5401e7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.373+0000 7fd54679c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5400b4590 0x7fd5401e7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36796/0 (socket says 172.21.15.22:36796) 2023-07-11T00:29:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.373+0000 7fd54679c700 1 -- 172.21.15.22:0/4234771490 learned_addr learned my addr 172.21.15.22:0/4234771490 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:29:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.373+0000 7fd545f9b700 1 --2- 172.21.15.22:0/4234771490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd54006bda0 0x7fd5401e6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.373+0000 7fd54579a700 1 --2- 172.21.15.22:0/4234771490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd54006c210 0x7fd54014aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.374+0000 7fd54679c700 1 -- 172.21.15.22:0/4234771490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd54006bda0 msgr2=0x7fd5401e6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.374+0000 7fd54679c700 1 --2- 172.21.15.22:0/4234771490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd54006bda0 0x7fd5401e6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.374+0000 7fd54679c700 1 -- 172.21.15.22:0/4234771490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd54006c210 msgr2=0x7fd54014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:57.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.374+0000 7fd54679c700 1 --2- 172.21.15.22:0/4234771490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd54006c210 0x7fd54014aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:57.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.374+0000 7fd54679c700 1 -- 172.21.15.22:0/4234771490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd538009a70 con 0x7fd5400b4590 2023-07-11T00:29:57.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.374+0000 7fd54679c700 1 --2- 172.21.15.22:0/4234771490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5400b4590 0x7fd5401e7450 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd53800b370 tx=0x7fd538004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:57.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.374+0000 7fd5367fc700 1 -- 172.21.15.22:0/4234771490 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538012430 con 0x7fd5400b4590 2023-07-11T00:29:57.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.374+0000 7fd5367fc700 1 -- 172.21.15.22:0/4234771490 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd538020070 con 0x7fd5400b4590 2023-07-11T00:29:57.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.374+0000 7fd5481ff700 1 -- 172.21.15.22:0/4234771490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5401e64a0 con 0x7fd5400b4590 2023-07-11T00:29:57.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.374+0000 7fd5367fc700 1 -- 172.21.15.22:0/4234771490 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5380098f0 con 0x7fd5400b4590 2023-07-11T00:29:57.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.374+0000 7fd5481ff700 1 -- 172.21.15.22:0/4234771490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54014b3e0 con 0x7fd5400b4590 2023-07-11T00:29:57.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.375+0000 7fd5481ff700 1 -- 172.21.15.22:0/4234771490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5401e69c0 con 0x7fd5400b4590 2023-07-11T00:29:57.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.376+0000 7fd5367fc700 1 -- 172.21.15.22:0/4234771490 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fd538004040 con 0x7fd5400b4590 2023-07-11T00:29:57.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.377+0000 7fd5367fc700 1 --2- 172.21.15.22:0/4234771490 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd52406ac50 0x7fd52406d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:57.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.377+0000 7fd5367fc700 1 -- 172.21.15.22:0/4234771490 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fd538022070 con 0x7fd5400b4590 2023-07-11T00:29:57.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.378+0000 7fd545f9b700 1 --2- 172.21.15.22:0/4234771490 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd52406ac50 0x7fd52406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:57.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.378+0000 7fd545f9b700 1 --2- 172.21.15.22:0/4234771490 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd52406ac50 0x7fd52406d100 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd53c007fd0 tx=0x7fd53c007dc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:57.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.382+0000 7fd5367fc700 1 -- 172.21.15.22:0/4234771490 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd5401e69c0 con 0x7fd5400b4590 2023-07-11T00:29:57.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:57.590+0000 7fd5481ff700 1 -- 172.21.15.22:0/4234771490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fd5401e69c0 con 0x7fd5400b4590 2023-07-11T00:29:58.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.578+0000 7fd5367fc700 1 -- 172.21.15.22:0/4234771490 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7fd5401e69c0 con 0x7fd5400b4590 2023-07-11T00:29:58.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.582+0000 7fd5481ff700 1 -- 172.21.15.22:0/4234771490 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd52406ac50 msgr2=0x7fd52406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:58.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.582+0000 7fd5481ff700 1 --2- 172.21.15.22:0/4234771490 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd52406ac50 0x7fd52406d100 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd53c007fd0 tx=0x7fd53c007dc0 comp rx=0 tx=0).stop 2023-07-11T00:29:58.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.582+0000 7fd5481ff700 1 -- 172.21.15.22:0/4234771490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5400b4590 msgr2=0x7fd5401e7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:58.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.582+0000 7fd5481ff700 1 --2- 172.21.15.22:0/4234771490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5400b4590 0x7fd5401e7450 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd53800b370 tx=0x7fd538004ad0 comp rx=0 tx=0).stop 2023-07-11T00:29:58.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.583+0000 7fd5481ff700 1 -- 172.21.15.22:0/4234771490 shutdown_connections 2023-07-11T00:29:58.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.583+0000 7fd5481ff700 1 --2- 172.21.15.22:0/4234771490 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd52406ac50 0x7fd52406d100 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:58.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.583+0000 7fd5481ff700 1 --2- 172.21.15.22:0/4234771490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd54006bda0 0x7fd5401e6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:58.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.583+0000 7fd5481ff700 1 --2- 172.21.15.22:0/4234771490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5400b4590 0x7fd5401e7450 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:58.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.583+0000 7fd5481ff700 1 --2- 172.21.15.22:0/4234771490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd54006c210 0x7fd54014aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:58.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.583+0000 7fd5481ff700 1 -- 172.21.15.22:0/4234771490 >> 172.21.15.22:0/4234771490 conn(0x7fd5400cf590 msgr2=0x7fd5400b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:58.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.583+0000 7fd5481ff700 1 -- 172.21.15.22:0/4234771490 shutdown_connections 2023-07-11T00:29:58.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.583+0000 7fd5481ff700 1 -- 172.21.15.22:0/4234771490 wait complete. 2023-07-11T00:29:58.587 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'rbd' created 2023-07-11T00:29:58.606 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-11T00:29:58.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.806+0000 7f2e71bff700 1 Processor -- start 2023-07-11T00:29:58.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.806+0000 7f2e71bff700 1 -- start start 2023-07-11T00:29:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.808+0000 7f2e71bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e6c0b82c0 0x7f2e6c160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.808+0000 7f2e71bff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2e6c0b1f00 0x7f2e6c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.808+0000 7f2e71bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6c160db0 con 0x7f2e6c0cf4d0 2023-07-11T00:29:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.808+0000 7f2e71bff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6c0b8690 con 0x7f2e6c0b1f00 2023-07-11T00:29:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.808+0000 7f2e71bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c15fe20 con 0x7f2e6c0b82c0 2023-07-11T00:29:58.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.808+0000 7f2e6affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2e6c0b1f00 0x7f2e6c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.808+0000 7f2e6affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2e6c0b1f00 0x7f2e6c0ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36808/0 (socket says 172.21.15.22:36808) 2023-07-11T00:29:58.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.808+0000 7f2e6affd700 1 -- 172.21.15.22:0/3065393447 learned_addr learned my addr 172.21.15.22:0/3065393447 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:29:58.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.808+0000 7f2e6b7fe700 1 --2- 172.21.15.22:0/3065393447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e6c0b82c0 0x7f2e6c160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:58.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.808+0000 7f2e6affd700 1 -- 172.21.15.22:0/3065393447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e6c0b82c0 msgr2=0x7f2e6c160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:29:58.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.808+0000 7f2e6affd700 1 --2- 172.21.15.22:0/3065393447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e6c0b82c0 0x7f2e6c160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:58.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.808+0000 7f2e6affd700 1 -- 172.21.15.22:0/3065393447 >> v1:172.21.15.184:6789/0 conn(0x7f2e6c0cf4d0 legacy=0x7f2e6c0d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:58.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.808+0000 7f2e6affd700 1 -- 172.21.15.22:0/3065393447 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c1603e0 con 0x7f2e6c0b1f00 2023-07-11T00:29:58.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.809+0000 7f2e6affd700 1 --2- 172.21.15.22:0/3065393447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e6c0b1f00 0x7f2e6c0ceca0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2e600098f0 tx=0x7f2e60009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a880715def269934 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.809+0000 7f2e6a7fc700 1 -- 172.21.15.22:0/3065393447 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6000b8a0 con 0x7f2e6c0b1f00 2023-07-11T00:29:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.809+0000 7f2e6a7fc700 1 -- 172.21.15.22:0/3065393447 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6000ba00 con 0x7f2e6c0b1f00 2023-07-11T00:29:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.809+0000 7f2e6a7fc700 1 -- 172.21.15.22:0/3065393447 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6000bd90 con 0x7f2e6c0b1f00 2023-07-11T00:29:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.809+0000 7f2e71bff700 1 -- 172.21.15.22:0/3065393447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e6c0b1f00 msgr2=0x7f2e6c0ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.809+0000 7f2e71bff700 1 --2- 172.21.15.22:0/3065393447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e6c0b1f00 0x7f2e6c0ceca0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2e600098f0 tx=0x7f2e60009c00 comp rx=0 tx=0).stop 2023-07-11T00:29:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.810+0000 7f2e71bff700 1 -- 172.21.15.22:0/3065393447 shutdown_connections 2023-07-11T00:29:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.810+0000 7f2e71bff700 1 --2- 172.21.15.22:0/3065393447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e6c0b82c0 0x7f2e6c160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.810+0000 7f2e71bff700 1 --2- 172.21.15.22:0/3065393447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e6c0b1f00 0x7f2e6c0ceca0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:58.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.810+0000 7f2e71bff700 1 -- 172.21.15.22:0/3065393447 >> 172.21.15.22:0/3065393447 conn(0x7f2e6c071660 msgr2=0x7f2e6c071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:58.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.810+0000 7f2e71bff700 1 -- 172.21.15.22:0/3065393447 shutdown_connections 2023-07-11T00:29:58.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.810+0000 7f2e71bff700 1 -- 172.21.15.22:0/3065393447 wait complete. 2023-07-11T00:29:58.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.811+0000 7f2e71bff700 1 Processor -- start 2023-07-11T00:29:58.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.811+0000 7f2e71bff700 1 -- start start 2023-07-11T00:29:58.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.812+0000 7f2e71bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e6c0b1f00 0x7f2e6c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:58.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.812+0000 7f2e71bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e6c0b82c0 0x7f2e6c1598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:58.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.812+0000 7f2e71bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e6c0cf4d0 0x7f2e6c159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:58.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.812+0000 7f2e71bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c0c9530 con 0x7f2e6c0b82c0 2023-07-11T00:29:58.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.812+0000 7f2e71bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c0c8c90 con 0x7f2e6c0cf4d0 2023-07-11T00:29:58.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.812+0000 7f2e71bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c0c8f70 con 0x7f2e6c0b1f00 2023-07-11T00:29:58.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.813+0000 7f2e6affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e6c0b82c0 0x7f2e6c1598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:58.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.813+0000 7f2e6affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e6c0b82c0 0x7f2e6c1598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36822/0 (socket says 172.21.15.22:36822) 2023-07-11T00:29:58.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.813+0000 7f2e6affd700 1 -- 172.21.15.22:0/747427832 learned_addr learned my addr 172.21.15.22:0/747427832 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:29:58.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.813+0000 7f2e6b7fe700 1 --2- 172.21.15.22:0/747427832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e6c0b1f00 0x7f2e6c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:58.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.813+0000 7f2e6affd700 1 -- 172.21.15.22:0/747427832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e6c0b1f00 msgr2=0x7f2e6c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:58.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.813+0000 7f2e6affd700 1 --2- 172.21.15.22:0/747427832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e6c0b1f00 0x7f2e6c15bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:58.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.813+0000 7f2e6bfff700 1 --2- 172.21.15.22:0/747427832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e6c0cf4d0 0x7f2e6c159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:58.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.813+0000 7f2e6affd700 1 -- 172.21.15.22:0/747427832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e6c0cf4d0 msgr2=0x7f2e6c159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:58.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.813+0000 7f2e6affd700 1 --2- 172.21.15.22:0/747427832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e6c0cf4d0 0x7f2e6c159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:58.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.813+0000 7f2e6affd700 1 -- 172.21.15.22:0/747427832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e60009550 con 0x7f2e6c0b82c0 2023-07-11T00:29:58.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.813+0000 7f2e6b7fe700 1 --2- 172.21.15.22:0/747427832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e6c0b1f00 0x7f2e6c15bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:29:58.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.813+0000 7f2e6bfff700 1 --2- 172.21.15.22:0/747427832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e6c0cf4d0 0x7f2e6c159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:29:58.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.813+0000 7f2e6affd700 1 --2- 172.21.15.22:0/747427832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e6c0b82c0 0x7f2e6c1598f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2e60014040 tx=0x7f2e60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:58.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.814+0000 7f2e53fff700 1 -- 172.21.15.22:0/747427832 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e600036a0 con 0x7f2e6c0b82c0 2023-07-11T00:29:58.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.814+0000 7f2e53fff700 1 -- 172.21.15.22:0/747427832 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6001e070 con 0x7f2e6c0b82c0 2023-07-11T00:29:58.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.814+0000 7f2e71bff700 1 -- 172.21.15.22:0/747427832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6c0c9250 con 0x7f2e6c0b82c0 2023-07-11T00:29:58.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.814+0000 7f2e53fff700 1 -- 172.21.15.22:0/747427832 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60003a40 con 0x7f2e6c0b82c0 2023-07-11T00:29:58.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.814+0000 7f2e71bff700 1 -- 172.21.15.22:0/747427832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6c15c470 con 0x7f2e6c0b82c0 2023-07-11T00:29:58.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.815+0000 7f2e71bff700 1 -- 172.21.15.22:0/747427832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6c0c9fa0 con 0x7f2e6c0b82c0 2023-07-11T00:29:58.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.816+0000 7f2e53fff700 1 -- 172.21.15.22:0/747427832 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f2e60003ba0 con 0x7f2e6c0b82c0 2023-07-11T00:29:58.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.817+0000 7f2e53fff700 1 --2- 172.21.15.22:0/747427832 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2e5806ac50 0x7f2e5806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:58.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.817+0000 7f2e53fff700 1 -- 172.21.15.22:0/747427832 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 5188+0+0 (secure 0 0 0) 0x7f2e60020070 con 0x7f2e6c0b82c0 2023-07-11T00:29:58.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.817+0000 7f2e6b7fe700 1 --2- 172.21.15.22:0/747427832 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2e5806ac50 0x7f2e5806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:58.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.818+0000 7f2e6b7fe700 1 --2- 172.21.15.22:0/747427832 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2e5806ac50 0x7f2e5806d100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c15edf0 tx=0x7f2e5c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:58.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:58.822+0000 7f2e53fff700 1 -- 172.21.15.22:0/747427832 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2e6c0c9fa0 con 0x7f2e6c0b82c0 2023-07-11T00:29:59.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.030+0000 7f2e71bff700 1 -- 172.21.15.22:0/747427832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2e6c0c9fa0 con 0x7f2e6c0b82c0 2023-07-11T00:29:59.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.580+0000 7f2e53fff700 1 -- 172.21.15.22:0/747427832 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2e6c0c9fa0 con 0x7f2e6c0b82c0 2023-07-11T00:29:59.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.585+0000 7f2e71bff700 1 -- 172.21.15.22:0/747427832 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2e5806ac50 msgr2=0x7f2e5806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:59.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.585+0000 7f2e71bff700 1 --2- 172.21.15.22:0/747427832 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2e5806ac50 0x7f2e5806d100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c15edf0 tx=0x7f2e5c008040 comp rx=0 tx=0).stop 2023-07-11T00:29:59.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.585+0000 7f2e71bff700 1 -- 172.21.15.22:0/747427832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e6c0b82c0 msgr2=0x7f2e6c1598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:59.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.585+0000 7f2e71bff700 1 --2- 172.21.15.22:0/747427832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e6c0b82c0 0x7f2e6c1598f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2e60014040 tx=0x7f2e60004750 comp rx=0 tx=0).stop 2023-07-11T00:29:59.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.585+0000 7f2e71bff700 1 -- 172.21.15.22:0/747427832 shutdown_connections 2023-07-11T00:29:59.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.585+0000 7f2e71bff700 1 --2- 172.21.15.22:0/747427832 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2e5806ac50 0x7f2e5806d100 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:59.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.585+0000 7f2e71bff700 1 --2- 172.21.15.22:0/747427832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e6c0b1f00 0x7f2e6c15bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:59.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.585+0000 7f2e71bff700 1 --2- 172.21.15.22:0/747427832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e6c0cf4d0 0x7f2e6c159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:59.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.585+0000 7f2e71bff700 1 --2- 172.21.15.22:0/747427832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e6c0b82c0 0x7f2e6c1598f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:59.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.585+0000 7f2e71bff700 1 -- 172.21.15.22:0/747427832 >> 172.21.15.22:0/747427832 conn(0x7f2e6c071660 msgr2=0x7f2e6c15af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:59.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.585+0000 7f2e71bff700 1 -- 172.21.15.22:0/747427832 shutdown_connections 2023-07-11T00:29:59.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.585+0000 7f2e71bff700 1 -- 172.21.15.22:0/747427832 wait complete. 2023-07-11T00:29:59.590 INFO:teuthology.orchestra.run.smithi022.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-11T00:29:59.609 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-11T00:29:59.609 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-11T00:29:59.610 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-11T00:29:59.616 INFO:tasks.ceph.mds.a:Started 2023-07-11T00:29:59.616 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-11T00:29:59.617 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-11T00:29:59.622 INFO:tasks.ceph.mds.c:Started 2023-07-11T00:29:59.622 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-11T00:29:59.622 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-11T00:29:59.627 INFO:tasks.ceph.mds.b:Started 2023-07-11T00:29:59.628 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-11T00:29:59.629 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-11T00:29:59.633 INFO:tasks.ceph.mds.d:Started 2023-07-11T00:29:59.634 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-11T00:29:59.634 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:29:59.784 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-07-11T00:29:59.796 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-07-11T00:29:59.797 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-07-11T00:29:59.800 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-07-11T00:29:59.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.862+0000 7f9a64bff700 1 Processor -- start 2023-07-11T00:29:59.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.863+0000 7f9a64bff700 1 -- start start 2023-07-11T00:29:59.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.864+0000 7f9a64bff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9a6015c460 0x7f9a600b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:59.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.864+0000 7f9a64bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9a600d2640 0x7f9a600cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:59.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.864+0000 7f9a64bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a600cf720 0x7f9a600cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:59.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.864+0000 7f9a64bff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a600cedd0 con 0x7f9a6015c460 2023-07-11T00:29:59.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.864+0000 7f9a64bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a600d1790 con 0x7f9a600d2640 2023-07-11T00:29:59.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.864+0000 7f9a64bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a600cd950 con 0x7f9a600cf720 2023-07-11T00:29:59.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.864+0000 7f9a5e59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9a6015c460 0x7f9a600b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:59.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.864+0000 7f9a5dd9b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9a600d2640 0x7f9a600cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:59.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.864+0000 7f9a5e59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9a6015c460 0x7f9a600b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36854/0 (socket says 172.21.15.22:36854) 2023-07-11T00:29:59.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.864+0000 7f9a5e59c700 1 -- 172.21.15.22:0/377612201 learned_addr learned my addr 172.21.15.22:0/377612201 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:29:59.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.864+0000 7f9a5ed9d700 1 --2- 172.21.15.22:0/377612201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a600cf720 0x7f9a600cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:59.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.865+0000 7f9a5e59c700 1 -- 172.21.15.22:0/377612201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a600cf720 msgr2=0x7f9a600cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:29:59.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.865+0000 7f9a5e59c700 1 --2- 172.21.15.22:0/377612201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a600cf720 0x7f9a600cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:59.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.865+0000 7f9a5e59c700 1 -- 172.21.15.22:0/377612201 >> v2:172.21.15.184:3300/0 conn(0x7f9a600d2640 msgr2=0x7f9a600cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:29:59.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.865+0000 7f9a5e59c700 1 --2- 172.21.15.22:0/377612201 >> v2:172.21.15.184:3300/0 conn(0x7f9a600d2640 0x7f9a600cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:59.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.865+0000 7f9a5e59c700 1 -- 172.21.15.22:0/377612201 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a600d14b0 con 0x7f9a6015c460 2023-07-11T00:29:59.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.865+0000 7f9a5dd9b700 1 --2- 172.21.15.22:0/377612201 >> v2:172.21.15.184:3300/0 conn(0x7f9a600d2640 0x7f9a600cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:29:59.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.865+0000 7f9a5e59c700 1 --2- 172.21.15.22:0/377612201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6015c460 0x7f9a600b59d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9a6015fd80 tx=0x7f9a50009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a427c563d0f825 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:59.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.865+0000 7f9a5d59a700 1 -- 172.21.15.22:0/377612201 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a50011830 con 0x7f9a6015c460 2023-07-11T00:29:59.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.865+0000 7f9a5d59a700 1 -- 172.21.15.22:0/377612201 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a50011990 con 0x7f9a6015c460 2023-07-11T00:29:59.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.865+0000 7f9a5d59a700 1 -- 172.21.15.22:0/377612201 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a50011d20 con 0x7f9a6015c460 2023-07-11T00:29:59.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.866+0000 7f9a64bff700 1 -- 172.21.15.22:0/377612201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6015c460 msgr2=0x7f9a600b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:59.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.866+0000 7f9a64bff700 1 --2- 172.21.15.22:0/377612201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6015c460 0x7f9a600b59d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9a6015fd80 tx=0x7f9a50009bd0 comp rx=0 tx=0).stop 2023-07-11T00:29:59.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.866+0000 7f9a64bff700 1 -- 172.21.15.22:0/377612201 shutdown_connections 2023-07-11T00:29:59.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.866+0000 7f9a64bff700 1 --2- 172.21.15.22:0/377612201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a600cf720 0x7f9a600cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:59.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.866+0000 7f9a64bff700 1 --2- 172.21.15.22:0/377612201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6015c460 0x7f9a600b59d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:59.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.866+0000 7f9a64bff700 1 --2- 172.21.15.22:0/377612201 >> v2:172.21.15.184:3300/0 conn(0x7f9a600d2640 0x7f9a600cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:59.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.866+0000 7f9a64bff700 1 -- 172.21.15.22:0/377612201 >> 172.21.15.22:0/377612201 conn(0x7f9a60071660 msgr2=0x7f9a60071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:29:59.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.866+0000 7f9a64bff700 1 -- 172.21.15.22:0/377612201 shutdown_connections 2023-07-11T00:29:59.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.866+0000 7f9a64bff700 1 -- 172.21.15.22:0/377612201 wait complete. 2023-07-11T00:29:59.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.868+0000 7f9a64bff700 1 Processor -- start 2023-07-11T00:29:59.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.868+0000 7f9a64bff700 1 -- start start 2023-07-11T00:29:59.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.869+0000 7f9a64bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a600cf720 0x7f9a601f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:59.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.869+0000 7f9a64bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a600d2640 0x7f9a60151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:59.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.869+0000 7f9a64bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6015c460 0x7f9a601e6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:59.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.869+0000 7f9a64bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a601e6470 con 0x7f9a6015c460 2023-07-11T00:29:59.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.869+0000 7f9a64bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a601e6b20 con 0x7f9a600cf720 2023-07-11T00:29:59.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.869+0000 7f9a64bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a601f67e0 con 0x7f9a600d2640 2023-07-11T00:29:59.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.869+0000 7f9a5ed9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6015c460 0x7f9a601e6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:59.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.869+0000 7f9a5dd9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a600d2640 0x7f9a60151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:59.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.869+0000 7f9a5ed9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6015c460 0x7f9a601e6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36856/0 (socket says 172.21.15.22:36856) 2023-07-11T00:29:59.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.869+0000 7f9a5ed9d700 1 -- 172.21.15.22:0/2674320289 learned_addr learned my addr 172.21.15.22:0/2674320289 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:29:59.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.869+0000 7f9a5e59c700 1 --2- 172.21.15.22:0/2674320289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a600cf720 0x7f9a601f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:59.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.870+0000 7f9a5ed9d700 1 -- 172.21.15.22:0/2674320289 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a600d2640 msgr2=0x7f9a60151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:59.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.870+0000 7f9a5ed9d700 1 --2- 172.21.15.22:0/2674320289 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a600d2640 0x7f9a60151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:59.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.870+0000 7f9a5ed9d700 1 -- 172.21.15.22:0/2674320289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a600cf720 msgr2=0x7f9a601f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:29:59.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.870+0000 7f9a5ed9d700 1 --2- 172.21.15.22:0/2674320289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a600cf720 0x7f9a601f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:29:59.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.870+0000 7f9a5ed9d700 1 -- 172.21.15.22:0/2674320289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a540094a0 con 0x7f9a6015c460 2023-07-11T00:29:59.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.870+0000 7f9a5ed9d700 1 --2- 172.21.15.22:0/2674320289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6015c460 0x7f9a601e6fb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800ef00 tx=0x7f9a58009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:59.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.870+0000 7f9a4effd700 1 -- 172.21.15.22:0/2674320289 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a58010040 con 0x7f9a6015c460 2023-07-11T00:29:59.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.870+0000 7f9a4effd700 1 -- 172.21.15.22:0/2674320289 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5800b9e0 con 0x7f9a6015c460 2023-07-11T00:29:59.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.870+0000 7f9a4effd700 1 -- 172.21.15.22:0/2674320289 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a58009b20 con 0x7f9a6015c460 2023-07-11T00:29:59.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.870+0000 7f9a64bff700 1 -- 172.21.15.22:0/2674320289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a50009550 con 0x7f9a6015c460 2023-07-11T00:29:59.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.870+0000 7f9a64bff700 1 -- 172.21.15.22:0/2674320289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a601e6190 con 0x7f9a6015c460 2023-07-11T00:29:59.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.871+0000 7f9a64bff700 1 -- 172.21.15.22:0/2674320289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6004ea60 con 0x7f9a6015c460 2023-07-11T00:29:59.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.872+0000 7f9a4effd700 1 -- 172.21.15.22:0/2674320289 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f9a5801d400 con 0x7f9a6015c460 2023-07-11T00:29:59.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.873+0000 7f9a4effd700 1 --2- 172.21.15.22:0/2674320289 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9a4006ac50 0x7f9a4006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:29:59.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.873+0000 7f9a4effd700 1 -- 172.21.15.22:0/2674320289 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9a58089690 con 0x7f9a6015c460 2023-07-11T00:29:59.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.874+0000 7f9a5e59c700 1 --2- 172.21.15.22:0/2674320289 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9a4006ac50 0x7f9a4006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:29:59.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.874+0000 7f9a5e59c700 1 --2- 172.21.15.22:0/2674320289 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9a4006ac50 0x7f9a4006d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9a50014040 tx=0x7f9a50008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:29:59.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:29:59.878+0000 7f9a4effd700 1 -- 172.21.15.22:0/2674320289 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9a58054b60 con 0x7f9a6015c460 2023-07-11T00:30:00.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.095+0000 7f9a64bff700 1 -- 172.21.15.22:0/2674320289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a601e6c60 con 0x7f9a6015c460 2023-07-11T00:30:00.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.096+0000 7f9a4effd700 1 -- 172.21.15.22:0/2674320289 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+14605 (secure 0 0 0) 0x7f9a58018090 con 0x7f9a6015c460 2023-07-11T00:30:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:00.100 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":15,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:29:59.576514+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:30:00.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.099+0000 7f9a64bff700 1 -- 172.21.15.22:0/2674320289 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9a4006ac50 msgr2=0x7f9a4006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:00.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.099+0000 7f9a64bff700 1 --2- 172.21.15.22:0/2674320289 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9a4006ac50 0x7f9a4006d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9a50014040 tx=0x7f9a50008030 comp rx=0 tx=0).stop 2023-07-11T00:30:00.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.099+0000 7f9a64bff700 1 -- 172.21.15.22:0/2674320289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6015c460 msgr2=0x7f9a601e6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:00.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.099+0000 7f9a64bff700 1 --2- 172.21.15.22:0/2674320289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6015c460 0x7f9a601e6fb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800ef00 tx=0x7f9a58009f60 comp rx=0 tx=0).stop 2023-07-11T00:30:00.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.099+0000 7f9a64bff700 1 -- 172.21.15.22:0/2674320289 shutdown_connections 2023-07-11T00:30:00.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.099+0000 7f9a64bff700 1 --2- 172.21.15.22:0/2674320289 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9a4006ac50 0x7f9a4006d100 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.099+0000 7f9a64bff700 1 --2- 172.21.15.22:0/2674320289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a6015c460 0x7f9a601e6fb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.099+0000 7f9a64bff700 1 --2- 172.21.15.22:0/2674320289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a600cf720 0x7f9a601f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.099+0000 7f9a64bff700 1 --2- 172.21.15.22:0/2674320289 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a600d2640 0x7f9a60151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.099+0000 7f9a64bff700 1 -- 172.21.15.22:0/2674320289 >> 172.21.15.22:0/2674320289 conn(0x7f9a60071660 msgr2=0x7f9a600d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:00.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.099+0000 7f9a64bff700 1 -- 172.21.15.22:0/2674320289 shutdown_connections 2023-07-11T00:30:00.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.099+0000 7f9a64bff700 1 -- 172.21.15.22:0/2674320289 wait complete. 2023-07-11T00:30:00.120 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:29:57.631007+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:29:58.547599+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-11T00:30:00.121 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:30:00.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.329+0000 7fba9c5ff700 1 Processor -- start 2023-07-11T00:30:00.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.329+0000 7fba9c5ff700 1 -- start start 2023-07-11T00:30:00.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.331+0000 7fba9c5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba940b3ec0 0x7fba940cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:00.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.331+0000 7fba9c5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fba9406a640 0x7fba941573f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:00.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.331+0000 7fba9c5ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba940cb000 con 0x7fba9406e130 2023-07-11T00:30:00.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.331+0000 7fba9c5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba940ca8d0 con 0x7fba9406a640 2023-07-11T00:30:00.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.331+0000 7fba9c5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9415b6c0 con 0x7fba940b3ec0 2023-07-11T00:30:00.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.331+0000 7fba9a39b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba940b3ec0 0x7fba940cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:00.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.331+0000 7fba9a39b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba940b3ec0 0x7fba940cf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:34010/0 (socket says 172.21.15.22:34010) 2023-07-11T00:30:00.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.331+0000 7fba9a39b700 1 -- 172.21.15.22:0/1148579576 learned_addr learned my addr 172.21.15.22:0/1148579576 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:00.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.331+0000 7fba9ab9c700 1 --2- 172.21.15.22:0/1148579576 >> v2:172.21.15.184:3300/0 conn(0x7fba9406a640 0x7fba941573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:00.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.332+0000 7fba9a39b700 1 -- 172.21.15.22:0/1148579576 >> v2:172.21.15.184:3300/0 conn(0x7fba9406a640 msgr2=0x7fba941573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:00.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.332+0000 7fba9a39b700 1 --2- 172.21.15.22:0/1148579576 >> v2:172.21.15.184:3300/0 conn(0x7fba9406a640 0x7fba941573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.332+0000 7fba9a39b700 1 -- 172.21.15.22:0/1148579576 >> v1:172.21.15.184:6789/0 conn(0x7fba9406e130 legacy=0x7fba94069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:00.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.332+0000 7fba9a39b700 1 -- 172.21.15.22:0/1148579576 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba940c9460 con 0x7fba940b3ec0 2023-07-11T00:30:00.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.332+0000 7fba99399700 1 -- 172.21.15.22:0/1148579576 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514007030 0 0) 0x7fba940cb000 con 0x7fba9406e130 2023-07-11T00:30:00.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.332+0000 7fba9a39b700 1 --2- 172.21.15.22:0/1148579576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba940b3ec0 0x7fba940cf390 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fba900098f0 tx=0x7fba90009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79f9ed4b26adffb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:00.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.332+0000 7fba99399700 1 -- 172.21.15.22:0/1148579576 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90011830 con 0x7fba940b3ec0 2023-07-11T00:30:00.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.332+0000 7fba99399700 1 -- 172.21.15.22:0/1148579576 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba90011990 con 0x7fba940b3ec0 2023-07-11T00:30:00.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.332+0000 7fba99399700 1 -- 172.21.15.22:0/1148579576 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90011d20 con 0x7fba940b3ec0 2023-07-11T00:30:00.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.333+0000 7fba9c5ff700 1 -- 172.21.15.22:0/1148579576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba940b3ec0 msgr2=0x7fba940cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:00.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.333+0000 7fba9c5ff700 1 --2- 172.21.15.22:0/1148579576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba940b3ec0 0x7fba940cf390 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fba900098f0 tx=0x7fba90009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:00.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.333+0000 7fba9c5ff700 1 -- 172.21.15.22:0/1148579576 shutdown_connections 2023-07-11T00:30:00.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.333+0000 7fba9c5ff700 1 --2- 172.21.15.22:0/1148579576 >> v2:172.21.15.184:3300/0 conn(0x7fba9406a640 0x7fba941573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.333+0000 7fba9c5ff700 1 --2- 172.21.15.22:0/1148579576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba940b3ec0 0x7fba940cf390 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.333+0000 7fba9c5ff700 1 -- 172.21.15.22:0/1148579576 >> 172.21.15.22:0/1148579576 conn(0x7fba940b0fd0 msgr2=0x7fba940ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:00.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.333+0000 7fba9c5ff700 1 -- 172.21.15.22:0/1148579576 shutdown_connections 2023-07-11T00:30:00.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.333+0000 7fba9c5ff700 1 -- 172.21.15.22:0/1148579576 wait complete. 2023-07-11T00:30:00.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.335+0000 7fba9c5ff700 1 Processor -- start 2023-07-11T00:30:00.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.335+0000 7fba9c5ff700 1 -- start start 2023-07-11T00:30:00.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.336+0000 7fba9c5ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba9406a640 0x7fba941f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.336+0000 7fba9c5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba9406e130 0x7fba940ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.336+0000 7fba9c5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba940b3ec0 0x7fba9414db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.336+0000 7fba9c5ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba940cc540 con 0x7fba9406a640 2023-07-11T00:30:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.336+0000 7fba9c5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba940cc820 con 0x7fba940b3ec0 2023-07-11T00:30:00.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.336+0000 7fba9c5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba940ccb00 con 0x7fba9406e130 2023-07-11T00:30:00.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.336+0000 7fba9a39b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba9406a640 0x7fba941f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:00.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.336+0000 7fba99b9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba9406e130 0x7fba940ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:00.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.336+0000 7fba9ab9c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba940b3ec0 0x7fba9414db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:00.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.336+0000 7fba99b9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba9406e130 0x7fba940ab8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:34026/0 (socket says 172.21.15.22:34026) 2023-07-11T00:30:00.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.336+0000 7fba99b9a700 1 -- 172.21.15.22:0/2745463596 learned_addr learned my addr 172.21.15.22:0/2745463596 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:00.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.337+0000 7fba9ab9c700 1 -- 172.21.15.22:0/2745463596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba9406e130 msgr2=0x7fba940ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:00.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.337+0000 7fba9ab9c700 1 --2- 172.21.15.22:0/2745463596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba9406e130 0x7fba940ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.337+0000 7fba9ab9c700 1 -- 172.21.15.22:0/2745463596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba9406a640 msgr2=0x7fba941f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:00.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.337+0000 7fba9ab9c700 1 --2- 172.21.15.22:0/2745463596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba9406a640 0x7fba941f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.337+0000 7fba9ab9c700 1 -- 172.21.15.22:0/2745463596 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba90009550 con 0x7fba940b3ec0 2023-07-11T00:30:00.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.337+0000 7fba9ab9c700 1 --2- 172.21.15.22:0/2745463596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba940b3ec0 0x7fba9414db40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fba940c8db0 tx=0x7fba8c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:00.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.337+0000 7fba8affd700 1 -- 172.21.15.22:0/2745463596 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c00c940 con 0x7fba940b3ec0 2023-07-11T00:30:00.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.337+0000 7fba8affd700 1 -- 172.21.15.22:0/2745463596 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c00f040 con 0x7fba940b3ec0 2023-07-11T00:30:00.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.337+0000 7fba8affd700 1 -- 172.21.15.22:0/2745463596 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c00cce0 con 0x7fba940b3ec0 2023-07-11T00:30:00.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.337+0000 7fba9c5ff700 1 -- 172.21.15.22:0/2745463596 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba940ccde0 con 0x7fba940b3ec0 2023-07-11T00:30:00.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.338+0000 7fba9c5ff700 1 -- 172.21.15.22:0/2745463596 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba940abdf0 con 0x7fba940b3ec0 2023-07-11T00:30:00.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.339+0000 7fba9c5ff700 1 -- 172.21.15.22:0/2745463596 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba940cc680 con 0x7fba940b3ec0 2023-07-11T00:30:00.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.341+0000 7fba8affd700 1 -- 172.21.15.22:0/2745463596 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fba8c014480 con 0x7fba940b3ec0 2023-07-11T00:30:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.342+0000 7fba8affd700 1 --2- 172.21.15.22:0/2745463596 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fba7806ac50 0x7fba7806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.342+0000 7fba8affd700 1 -- 172.21.15.22:0/2745463596 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fba8c0899d0 con 0x7fba940b3ec0 2023-07-11T00:30:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.342+0000 7fba9a39b700 1 --2- 172.21.15.22:0/2745463596 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fba7806ac50 0x7fba7806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.343+0000 7fba9a39b700 1 --2- 172.21.15.22:0/2745463596 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fba7806ac50 0x7fba7806d100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fba90009c40 tx=0x7fba90008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:00.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.348+0000 7fba8affd700 1 -- 172.21.15.22:0/2745463596 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fba940cc680 con 0x7fba940b3ec0 2023-07-11T00:30:00.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.555+0000 7fba9c5ff700 1 -- 172.21.15.22:0/2745463596 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fba940cc680 con 0x7fba940b3ec0 2023-07-11T00:30:00.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.556+0000 7fba8affd700 1 -- 172.21.15.22:0/2745463596 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7fba940cc680 con 0x7fba940b3ec0 2023-07-11T00:30:00.559 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2023-07-11T00:30:00.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.558+0000 7fba9c5ff700 1 -- 172.21.15.22:0/2745463596 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fba7806ac50 msgr2=0x7fba7806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:00.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.558+0000 7fba9c5ff700 1 --2- 172.21.15.22:0/2745463596 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fba7806ac50 0x7fba7806d100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fba90009c40 tx=0x7fba90008030 comp rx=0 tx=0).stop 2023-07-11T00:30:00.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.558+0000 7fba9c5ff700 1 -- 172.21.15.22:0/2745463596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba940b3ec0 msgr2=0x7fba9414db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:00.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.558+0000 7fba9c5ff700 1 --2- 172.21.15.22:0/2745463596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba940b3ec0 0x7fba9414db40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fba940c8db0 tx=0x7fba8c00ee50 comp rx=0 tx=0).stop 2023-07-11T00:30:00.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.559+0000 7fba9c5ff700 1 -- 172.21.15.22:0/2745463596 shutdown_connections 2023-07-11T00:30:00.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.559+0000 7fba9c5ff700 1 --2- 172.21.15.22:0/2745463596 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fba7806ac50 0x7fba7806d100 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.559+0000 7fba9c5ff700 1 --2- 172.21.15.22:0/2745463596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba940b3ec0 0x7fba9414db40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.559+0000 7fba9c5ff700 1 --2- 172.21.15.22:0/2745463596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba9406a640 0x7fba941f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.559+0000 7fba9c5ff700 1 --2- 172.21.15.22:0/2745463596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba9406e130 0x7fba940ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.559+0000 7fba9c5ff700 1 -- 172.21.15.22:0/2745463596 >> 172.21.15.22:0/2745463596 conn(0x7fba940b0fd0 msgr2=0x7fba940b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:00.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.559+0000 7fba9c5ff700 1 -- 172.21.15.22:0/2745463596 shutdown_connections 2023-07-11T00:30:00.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.559+0000 7fba9c5ff700 1 -- 172.21.15.22:0/2745463596 wait complete. 2023-07-11T00:30:00.579 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:30:00.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.785+0000 7f4abdfff700 1 Processor -- start 2023-07-11T00:30:00.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.785+0000 7f4abdfff700 1 -- start start 2023-07-11T00:30:00.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.786+0000 7f4abdfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4ab80cfc60 0x7f4ab8167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:00.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.786+0000 7f4abdfff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab80d0b20 con 0x7f4ab80b8430 2023-07-11T00:30:00.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.786+0000 7f4abdfff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab80b4ee0 con 0x7f4ab80d3730 2023-07-11T00:30:00.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.786+0000 7f4abdfff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab80cda30 con 0x7f4ab80cfc60 2023-07-11T00:30:00.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.786+0000 7f4ab77fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4ab80b8430 0x7f4ab80cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48060/0 (socket says 172.21.15.22:48060) 2023-07-11T00:30:00.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.786+0000 7f4ab77fe700 1 -- 172.21.15.22:0/2882409393 learned_addr learned my addr 172.21.15.22:0/2882409393 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:00.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.786+0000 7f4ab7fff700 1 --2- 172.21.15.22:0/2882409393 >> v2:172.21.15.184:3300/0 conn(0x7f4ab80cfc60 0x7f4ab8167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:00.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.787+0000 7f4ab67fc700 1 -- 172.21.15.22:0/2882409393 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308465656 0 0) 0x7f4ab80d0b20 con 0x7f4ab80b8430 2023-07-11T00:30:00.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.787+0000 7f4ab67fc700 1 -- 172.21.15.22:0/2882409393 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aa00035b0 con 0x7f4ab80b8430 2023-07-11T00:30:00.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.787+0000 7f4ab67fc700 1 -- 172.21.15.22:0/2882409393 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912128249 0 0) 0x7f4ab80b4ee0 con 0x7f4ab80d3730 2023-07-11T00:30:00.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.787+0000 7f4ab67fc700 1 -- 172.21.15.22:0/2882409393 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ab80d0b20 con 0x7f4ab80d3730 2023-07-11T00:30:00.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.787+0000 7f4ab67fc700 1 -- 172.21.15.22:0/2882409393 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2119533686 0 0) 0x7f4aa00035b0 con 0x7f4ab80b8430 2023-07-11T00:30:00.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.787+0000 7f4ab67fc700 1 -- 172.21.15.22:0/2882409393 >> v2:172.21.15.184:3300/0 conn(0x7f4ab80cfc60 msgr2=0x7f4ab8167010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:00.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.787+0000 7f4ab67fc700 1 --2- 172.21.15.22:0/2882409393 >> v2:172.21.15.184:3300/0 conn(0x7f4ab80cfc60 0x7f4ab8167010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.787+0000 7f4ab67fc700 1 -- 172.21.15.22:0/2882409393 >> v1:172.21.15.184:6789/0 conn(0x7f4ab80d3730 legacy=0x7f4ab80cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:00.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.787+0000 7f4ab67fc700 1 -- 172.21.15.22:0/2882409393 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab80b51c0 con 0x7f4ab80b8430 2023-07-11T00:30:00.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.787+0000 7f4ab67fc700 1 -- 172.21.15.22:0/2882409393 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7f4aa8001670 con 0x7f4ab80b8430 2023-07-11T00:30:00.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.787+0000 7f4ab67fc700 1 -- 172.21.15.22:0/2882409393 >> v1:172.21.15.22:6789/0 conn(0x7f4ab80b8430 legacy=0x7f4ab80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:00.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.787+0000 7f4ab67fc700 1 --2- 172.21.15.22:0/2882409393 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4aa0004bf0 0x7f4aa0004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:00.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.787+0000 7f4ab67fc700 1 --2- 172.21.15.22:0/2882409393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4aa00037f0 0x7f4aa0003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:00.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.787+0000 7f4ab67fc700 1 --2- 172.21.15.22:0/2882409393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aa00041a0 0x7f4aa000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:00.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.787+0000 7f4ab67fc700 1 -- 172.21.15.22:0/2882409393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa000c0e0 con 0x7f4aa00041a0 2023-07-11T00:30:00.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.787+0000 7f4ab67fc700 1 -- 172.21.15.22:0/2882409393 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa000c250 con 0x7f4aa00037f0 2023-07-11T00:30:00.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.787+0000 7f4ab67fc700 1 -- 172.21.15.22:0/2882409393 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa000c410 con 0x7f4aa0004bf0 2023-07-11T00:30:00.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.788+0000 7f4ab7fff700 1 --2- 172.21.15.22:0/2882409393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aa00041a0 0x7f4aa000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:00.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.788+0000 7f4ab6ffd700 1 --2- 172.21.15.22:0/2882409393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4aa00037f0 0x7f4aa0003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:00.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.788+0000 7f4ab77fe700 1 --2- 172.21.15.22:0/2882409393 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4aa0004bf0 0x7f4aa0004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:00.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.788+0000 7f4ab7fff700 1 -- 172.21.15.22:0/2882409393 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4aa0004bf0 msgr2=0x7f4aa0004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:00.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.788+0000 7f4ab7fff700 1 --2- 172.21.15.22:0/2882409393 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4aa0004bf0 0x7f4aa0004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.788+0000 7f4ab7fff700 1 -- 172.21.15.22:0/2882409393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4aa00037f0 msgr2=0x7f4aa0003c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:00.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.788+0000 7f4ab7fff700 1 --2- 172.21.15.22:0/2882409393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4aa00037f0 0x7f4aa0003c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.788+0000 7f4ab7fff700 1 -- 172.21.15.22:0/2882409393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa00035b0 con 0x7f4aa00041a0 2023-07-11T00:30:00.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.788+0000 7f4ab7fff700 1 -- 172.21.15.22:0/2882409393 reap_dead start 2023-07-11T00:30:00.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.788+0000 7f4ab7fff700 1 --2- 172.21.15.22:0/2882409393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aa00041a0 0x7f4aa000ba10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0007360 tx=0x7f4aa0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd834f1a79734356 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:00.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.788+0000 7f4ab67fc700 1 -- 172.21.15.22:0/2882409393 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0007e80 con 0x7f4aa00041a0 2023-07-11T00:30:00.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.788+0000 7f4ab67fc700 1 -- 172.21.15.22:0/2882409393 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab0003a20 con 0x7f4aa00041a0 2023-07-11T00:30:00.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.788+0000 7f4ab67fc700 1 -- 172.21.15.22:0/2882409393 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0003dd0 con 0x7f4aa00041a0 2023-07-11T00:30:00.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.789+0000 7f4abdfff700 1 -- 172.21.15.22:0/2882409393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aa00041a0 msgr2=0x7f4aa000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:00.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.789+0000 7f4abdfff700 1 --2- 172.21.15.22:0/2882409393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aa00041a0 0x7f4aa000ba10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0007360 tx=0x7f4aa0005880 comp rx=0 tx=0).stop 2023-07-11T00:30:00.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.789+0000 7f4abdfff700 1 -- 172.21.15.22:0/2882409393 shutdown_connections 2023-07-11T00:30:00.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.789+0000 7f4abdfff700 1 --2- 172.21.15.22:0/2882409393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aa00041a0 0x7f4aa000ba10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.789+0000 7f4abdfff700 1 -- 172.21.15.22:0/2882409393 >> 172.21.15.22:0/2882409393 conn(0x7f4ab806b3f0 msgr2=0x7f4ab806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:00.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.789+0000 7f4abdfff700 1 -- 172.21.15.22:0/2882409393 shutdown_connections 2023-07-11T00:30:00.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.789+0000 7f4abdfff700 1 -- 172.21.15.22:0/2882409393 wait complete. 2023-07-11T00:30:00.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.791+0000 7f4abdfff700 1 Processor -- start 2023-07-11T00:30:00.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.791+0000 7f4abdfff700 1 -- start start 2023-07-11T00:30:00.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.792+0000 7f4abdfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4aa00041a0 0x7f4ab80d2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:00.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.792+0000 7f4abdfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ab8149ec0 0x7f4ab815c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:00.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.792+0000 7f4abdfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ab80c7440 0x7f4ab80c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:00.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.792+0000 7f4abdfff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab81f39e0 con 0x7f4ab80c7440 2023-07-11T00:30:00.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.792+0000 7f4abdfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80c7df0 con 0x7f4aa00041a0 2023-07-11T00:30:00.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.792+0000 7f4abdfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab81f2d60 con 0x7f4ab8149ec0 2023-07-11T00:30:00.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.792+0000 7f4ab7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ab80c7440 0x7f4ab80c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:00.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.792+0000 7f4ab77fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4aa00041a0 0x7f4ab80d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:00.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.792+0000 7f4ab77fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4aa00041a0 0x7f4ab80d2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:54334/0 (socket says 172.21.15.22:54334) 2023-07-11T00:30:00.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.792+0000 7f4ab7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ab80c7440 0x7f4ab80c78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41430/0 (socket says 172.21.15.22:41430) 2023-07-11T00:30:00.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.792+0000 7f4ab7fff700 1 -- 172.21.15.22:0/3868038661 learned_addr learned my addr 172.21.15.22:0/3868038661 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:00.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.792+0000 7f4ab6ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ab8149ec0 0x7f4ab815c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:00.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.793+0000 7f4ab7fff700 1 -- 172.21.15.22:0/3868038661 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ab8149ec0 msgr2=0x7f4ab815c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:00.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.793+0000 7f4ab7fff700 1 --2- 172.21.15.22:0/3868038661 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ab8149ec0 0x7f4ab815c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.793+0000 7f4ab7fff700 1 -- 172.21.15.22:0/3868038661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4aa00041a0 msgr2=0x7f4ab80d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:00.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.793+0000 7f4ab7fff700 1 --2- 172.21.15.22:0/3868038661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4aa00041a0 0x7f4ab80d2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:00.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.793+0000 7f4ab7fff700 1 -- 172.21.15.22:0/3868038661 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab81f3040 con 0x7f4ab80c7440 2023-07-11T00:30:00.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.793+0000 7f4ab77fe700 1 --2- 172.21.15.22:0/3868038661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4aa00041a0 0x7f4ab80d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:30:00.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.793+0000 7f4ab7fff700 1 --2- 172.21.15.22:0/3868038661 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ab80c7440 0x7f4ab80c78b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0007950 tx=0x7f4ab0004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:00.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.793+0000 7f4a9ffff700 1 -- 172.21.15.22:0/3868038661 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0007000 con 0x7f4ab80c7440 2023-07-11T00:30:00.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.793+0000 7f4a9ffff700 1 -- 172.21.15.22:0/3868038661 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab0004230 con 0x7f4ab80c7440 2023-07-11T00:30:00.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.793+0000 7f4abdfff700 1 -- 172.21.15.22:0/3868038661 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab81f3320 con 0x7f4ab80c7440 2023-07-11T00:30:00.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.793+0000 7f4a9ffff700 1 -- 172.21.15.22:0/3868038661 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab00045e0 con 0x7f4ab80c7440 2023-07-11T00:30:00.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.793+0000 7f4abdfff700 1 -- 172.21.15.22:0/3868038661 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab81f29f0 con 0x7f4ab80c7440 2023-07-11T00:30:00.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.794+0000 7f4abdfff700 1 -- 172.21.15.22:0/3868038661 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab81f3b20 con 0x7f4ab80c7440 2023-07-11T00:30:00.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.796+0000 7f4a9ffff700 1 -- 172.21.15.22:0/3868038661 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f4ab0004740 con 0x7f4ab80c7440 2023-07-11T00:30:00.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.797+0000 7f4a9ffff700 1 --2- 172.21.15.22:0/3868038661 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4aa406ac50 0x7f4aa406d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:00.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.797+0000 7f4a9ffff700 1 -- 172.21.15.22:0/3868038661 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4ab0089ff0 con 0x7f4ab80c7440 2023-07-11T00:30:00.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.797+0000 7f4ab77fe700 1 --2- 172.21.15.22:0/3868038661 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4aa406ac50 0x7f4aa406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:00.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.797+0000 7f4ab77fe700 1 --2- 172.21.15.22:0/3868038661 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4aa406ac50 0x7f4aa406d100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8000c00 tx=0x7f4aa8001e00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:00.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:00.803+0000 7f4a9ffff700 1 -- 172.21.15.22:0/3868038661 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f4ab81f3b20 con 0x7f4ab80c7440 2023-07-11T00:30:01.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.011+0000 7f4abdfff700 1 -- 172.21.15.22:0/3868038661 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ab81f3b20 con 0x7f4ab80c7440 2023-07-11T00:30:01.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.012+0000 7f4a9ffff700 1 -- 172.21.15.22:0/3868038661 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ab81f3b20 con 0x7f4ab80c7440 2023-07-11T00:30:01.014 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-07-11T00:30:01.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.014+0000 7f4abdfff700 1 -- 172.21.15.22:0/3868038661 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4aa406ac50 msgr2=0x7f4aa406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:01.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.014+0000 7f4abdfff700 1 --2- 172.21.15.22:0/3868038661 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4aa406ac50 0x7f4aa406d100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8000c00 tx=0x7f4aa8001e00 comp rx=0 tx=0).stop 2023-07-11T00:30:01.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.014+0000 7f4abdfff700 1 -- 172.21.15.22:0/3868038661 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ab80c7440 msgr2=0x7f4ab80c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:01.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.014+0000 7f4abdfff700 1 --2- 172.21.15.22:0/3868038661 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ab80c7440 0x7f4ab80c78b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0007950 tx=0x7f4ab0004b40 comp rx=0 tx=0).stop 2023-07-11T00:30:01.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.014+0000 7f4abdfff700 1 -- 172.21.15.22:0/3868038661 shutdown_connections 2023-07-11T00:30:01.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.014+0000 7f4abdfff700 1 --2- 172.21.15.22:0/3868038661 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4aa406ac50 0x7f4aa406d100 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.014+0000 7f4abdfff700 1 --2- 172.21.15.22:0/3868038661 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ab80c7440 0x7f4ab80c78b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.014+0000 7f4abdfff700 1 --2- 172.21.15.22:0/3868038661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4aa00041a0 0x7f4ab80d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.014+0000 7f4abdfff700 1 --2- 172.21.15.22:0/3868038661 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ab8149ec0 0x7f4ab815c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.014+0000 7f4abdfff700 1 -- 172.21.15.22:0/3868038661 >> 172.21.15.22:0/3868038661 conn(0x7f4ab806b3f0 msgr2=0x7f4ab80b6940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:01.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.014+0000 7f4abdfff700 1 -- 172.21.15.22:0/3868038661 shutdown_connections 2023-07-11T00:30:01.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.014+0000 7f4abdfff700 1 -- 172.21.15.22:0/3868038661 wait complete. 2023-07-11T00:30:01.039 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:30:01.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.240+0000 7fe6c3bff700 1 Processor -- start 2023-07-11T00:30:01.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.240+0000 7fe6c3bff700 1 -- start start 2023-07-11T00:30:01.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.241+0000 7fe6c3bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe6bc15c460 0x7fe6bc0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:01.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.241+0000 7fe6c3bff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe6bc0d2640 0x7fe6bc0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:01.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.241+0000 7fe6c3bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6bc0cf720 0x7fe6bc0cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:01.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.241+0000 7fe6c3bff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6bc0cedd0 con 0x7fe6bc0d2640 2023-07-11T00:30:01.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.241+0000 7fe6c3bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6bc0d1790 con 0x7fe6bc15c460 2023-07-11T00:30:01.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.241+0000 7fe6c3bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc0cd950 con 0x7fe6bc0cf720 2023-07-11T00:30:01.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.242+0000 7fe6c219c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6bc0cf720 0x7fe6bc0cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:01.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.242+0000 7fe6c199b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe6bc15c460 0x7fe6bc0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:01.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.242+0000 7fe6c199b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe6bc15c460 0x7fe6bc0b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:54342/0 (socket says 172.21.15.22:54342) 2023-07-11T00:30:01.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.242+0000 7fe6c219c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6bc0cf720 0x7fe6bc0cfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:34046/0 (socket says 172.21.15.22:34046) 2023-07-11T00:30:01.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.242+0000 7fe6c199b700 1 -- 172.21.15.22:0/2714787778 learned_addr learned my addr 172.21.15.22:0/2714787778 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:01.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.242+0000 7fe6c119a700 1 --2- 172.21.15.22:0/2714787778 >> v2:172.21.15.22:3300/0 conn(0x7fe6bc0d2640 0x7fe6bc0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:01.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.242+0000 7fe6c219c700 1 -- 172.21.15.22:0/2714787778 >> v2:172.21.15.184:3300/0 conn(0x7fe6bc15c460 msgr2=0x7fe6bc0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:01.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.242+0000 7fe6c219c700 1 --2- 172.21.15.22:0/2714787778 >> v2:172.21.15.184:3300/0 conn(0x7fe6bc15c460 0x7fe6bc0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.242+0000 7fe6c219c700 1 -- 172.21.15.22:0/2714787778 >> v2:172.21.15.22:3300/0 conn(0x7fe6bc0d2640 msgr2=0x7fe6bc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:01.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.242+0000 7fe6c219c700 1 --2- 172.21.15.22:0/2714787778 >> v2:172.21.15.22:3300/0 conn(0x7fe6bc0d2640 0x7fe6bc0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.242+0000 7fe6c219c700 1 -- 172.21.15.22:0/2714787778 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6bc0d14b0 con 0x7fe6bc0cf720 2023-07-11T00:30:01.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.242+0000 7fe6c199b700 1 --2- 172.21.15.22:0/2714787778 >> v2:172.21.15.184:3300/0 conn(0x7fe6bc15c460 0x7fe6bc0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:30:01.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.242+0000 7fe6c119a700 1 --2- 172.21.15.22:0/2714787778 >> v2:172.21.15.22:3300/0 conn(0x7fe6bc0d2640 0x7fe6bc0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:01.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.242+0000 7fe6c219c700 1 --2- 172.21.15.22:0/2714787778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6bc0cf720 0x7fe6bc0cfbc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc0b4f00 tx=0x7fe6b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1bb55241cbabb7e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:01.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.243+0000 7fe6c0999700 1 -- 172.21.15.22:0/2714787778 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400e070 con 0x7fe6bc0cf720 2023-07-11T00:30:01.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.243+0000 7fe6c0999700 1 -- 172.21.15.22:0/2714787778 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b400bb20 con 0x7fe6bc0cf720 2023-07-11T00:30:01.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.243+0000 7fe6c0999700 1 -- 172.21.15.22:0/2714787778 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4012430 con 0x7fe6bc0cf720 2023-07-11T00:30:01.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.243+0000 7fe6c3bff700 1 -- 172.21.15.22:0/2714787778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6bc0cf720 msgr2=0x7fe6bc0cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:01.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.243+0000 7fe6c3bff700 1 --2- 172.21.15.22:0/2714787778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6bc0cf720 0x7fe6bc0cfbc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc0b4f00 tx=0x7fe6b400b330 comp rx=0 tx=0).stop 2023-07-11T00:30:01.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.243+0000 7fe6c3bff700 1 -- 172.21.15.22:0/2714787778 shutdown_connections 2023-07-11T00:30:01.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.243+0000 7fe6c3bff700 1 --2- 172.21.15.22:0/2714787778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6bc0cf720 0x7fe6bc0cfbc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.243+0000 7fe6c3bff700 1 --2- 172.21.15.22:0/2714787778 >> v2:172.21.15.184:3300/0 conn(0x7fe6bc15c460 0x7fe6bc0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.243+0000 7fe6c3bff700 1 --2- 172.21.15.22:0/2714787778 >> v2:172.21.15.22:3300/0 conn(0x7fe6bc0d2640 0x7fe6bc0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.243+0000 7fe6c3bff700 1 -- 172.21.15.22:0/2714787778 >> 172.21.15.22:0/2714787778 conn(0x7fe6bc071660 msgr2=0x7fe6bc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:01.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.244+0000 7fe6c3bff700 1 -- 172.21.15.22:0/2714787778 shutdown_connections 2023-07-11T00:30:01.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.244+0000 7fe6c3bff700 1 -- 172.21.15.22:0/2714787778 wait complete. 2023-07-11T00:30:01.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.246+0000 7fe6c3bff700 1 Processor -- start 2023-07-11T00:30:01.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.246+0000 7fe6c3bff700 1 -- start start 2023-07-11T00:30:01.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.247+0000 7fe6c3bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6bc0cf720 0x7fe6bc1599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:01.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.247+0000 7fe6c3bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6bc0d2640 0x7fe6bc0c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:01.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.247+0000 7fe6c3bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6bc15c460 0x7fe6bc0c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.247+0000 7fe6c3bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc15b6a0 con 0x7fe6bc0d2640 2023-07-11T00:30:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.247+0000 7fe6c3bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc159540 con 0x7fe6bc0cf720 2023-07-11T00:30:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.247+0000 7fe6c3bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc158930 con 0x7fe6bc15c460 2023-07-11T00:30:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.248+0000 7fe6c119a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6bc0d2640 0x7fe6bc0c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.248+0000 7fe6c119a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6bc0d2640 0x7fe6bc0c66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41458/0 (socket says 172.21.15.22:41458) 2023-07-11T00:30:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.248+0000 7fe6c119a700 1 -- 172.21.15.22:0/3429838869 learned_addr learned my addr 172.21.15.22:0/3429838869 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.248+0000 7fe6c199b700 1 --2- 172.21.15.22:0/3429838869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6bc0cf720 0x7fe6bc1599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.248+0000 7fe6c219c700 1 --2- 172.21.15.22:0/3429838869 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6bc15c460 0x7fe6bc0c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:01.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.248+0000 7fe6c219c700 1 -- 172.21.15.22:0/3429838869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6bc0cf720 msgr2=0x7fe6bc1599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:01.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.248+0000 7fe6c219c700 1 --2- 172.21.15.22:0/3429838869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6bc0cf720 0x7fe6bc1599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.248+0000 7fe6c219c700 1 -- 172.21.15.22:0/3429838869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6bc0d2640 msgr2=0x7fe6bc0c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:01.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.248+0000 7fe6c219c700 1 --2- 172.21.15.22:0/3429838869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6bc0d2640 0x7fe6bc0c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.248+0000 7fe6c219c700 1 -- 172.21.15.22:0/3429838869 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b8009550 con 0x7fe6bc15c460 2023-07-11T00:30:01.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.249+0000 7fe6c219c700 1 --2- 172.21.15.22:0/3429838869 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6bc15c460 0x7fe6bc0c6bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4016000 tx=0x7fe6b4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:01.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.249+0000 7fe6b27fc700 1 -- 172.21.15.22:0/3429838869 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4004800 con 0x7fe6bc15c460 2023-07-11T00:30:01.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.249+0000 7fe6b27fc700 1 -- 172.21.15.22:0/3429838869 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b4020070 con 0x7fe6bc15c460 2023-07-11T00:30:01.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.249+0000 7fe6c3bff700 1 -- 172.21.15.22:0/3429838869 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b4009a70 con 0x7fe6bc15c460 2023-07-11T00:30:01.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.249+0000 7fe6b27fc700 1 -- 172.21.15.22:0/3429838869 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b40276c0 con 0x7fe6bc15c460 2023-07-11T00:30:01.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.249+0000 7fe6c3bff700 1 -- 172.21.15.22:0/3429838869 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6bc158ef0 con 0x7fe6bc15c460 2023-07-11T00:30:01.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.250+0000 7fe6c3bff700 1 -- 172.21.15.22:0/3429838869 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6bc0ce6d0 con 0x7fe6bc15c460 2023-07-11T00:30:01.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.251+0000 7fe6b27fc700 1 -- 172.21.15.22:0/3429838869 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe6b4012430 con 0x7fe6bc15c460 2023-07-11T00:30:01.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.252+0000 7fe6b27fc700 1 --2- 172.21.15.22:0/3429838869 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe6a006ace0 0x7fe6a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:01.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.252+0000 7fe6b27fc700 1 -- 172.21.15.22:0/3429838869 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe6b4022070 con 0x7fe6bc15c460 2023-07-11T00:30:01.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.252+0000 7fe6c199b700 1 --2- 172.21.15.22:0/3429838869 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe6a006ace0 0x7fe6a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:01.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.253+0000 7fe6c199b700 1 --2- 172.21.15.22:0/3429838869 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe6a006ace0 0x7fe6a006d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8006d30 tx=0x7fe6b80092c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:01.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.257+0000 7fe6b27fc700 1 -- 172.21.15.22:0/3429838869 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe6b40564c0 con 0x7fe6bc15c460 2023-07-11T00:30:01.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.505+0000 7fe6c3bff700 1 -- 172.21.15.22:0/3429838869 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6bc1596b0 con 0x7fe6bc15c460 2023-07-11T00:30:01.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.543+0000 7fe6b27fc700 1 -- 172.21.15.22:0/3429838869 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7fe6b4059ae0 con 0x7fe6bc15c460 2023-07-11T00:30:01.546 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:01.546 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3244868368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3244868368},{"type":"v1","addr":"172.21.15.22:6833","nonce":3244868368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/907204261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":907204261},{"type":"v1","addr":"172.21.15.184:6836","nonce":907204261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/1214375050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1214375050},{"type":"v1","addr":"172.21.15.22:6835","nonce":1214375050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3376322541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3376322541},{"type":"v1","addr":"172.21.15.184:6837","nonce":3376322541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-11T00:30:01.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.545+0000 7fe6c3bff700 1 -- 172.21.15.22:0/3429838869 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe6a006ace0 msgr2=0x7fe6a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:01.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.545+0000 7fe6c3bff700 1 --2- 172.21.15.22:0/3429838869 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe6a006ace0 0x7fe6a006d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8006d30 tx=0x7fe6b80092c0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.545+0000 7fe6c3bff700 1 -- 172.21.15.22:0/3429838869 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6bc15c460 msgr2=0x7fe6bc0c6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:01.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.545+0000 7fe6c3bff700 1 --2- 172.21.15.22:0/3429838869 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6bc15c460 0x7fe6bc0c6bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4016000 tx=0x7fe6b4004ad0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.545+0000 7fe6c3bff700 1 -- 172.21.15.22:0/3429838869 shutdown_connections 2023-07-11T00:30:01.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.545+0000 7fe6c3bff700 1 --2- 172.21.15.22:0/3429838869 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe6a006ace0 0x7fe6a006d190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.545+0000 7fe6c3bff700 1 --2- 172.21.15.22:0/3429838869 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6bc15c460 0x7fe6bc0c6bf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.545+0000 7fe6c3bff700 1 --2- 172.21.15.22:0/3429838869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6bc0cf720 0x7fe6bc1599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.545+0000 7fe6c3bff700 1 --2- 172.21.15.22:0/3429838869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6bc0d2640 0x7fe6bc0c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.545+0000 7fe6c3bff700 1 -- 172.21.15.22:0/3429838869 >> 172.21.15.22:0/3429838869 conn(0x7fe6bc071660 msgr2=0x7fe6bc0b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:01.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.545+0000 7fe6c3bff700 1 -- 172.21.15.22:0/3429838869 shutdown_connections 2023-07-11T00:30:01.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.545+0000 7fe6c3bff700 1 -- 172.21.15.22:0/3429838869 wait complete. 2023-07-11T00:30:01.550 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 3 2023-07-11T00:30:01.567 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:30:01.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.765+0000 7f9060fff700 1 Processor -- start 2023-07-11T00:30:01.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.765+0000 7f9060fff700 1 -- start start 2023-07-11T00:30:01.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.767+0000 7f9060fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f905c0d2640 0x7f905c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:01.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.767+0000 7f9060fff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f905c0d1790 con 0x7f905c15c460 2023-07-11T00:30:01.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.767+0000 7f9060fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f905c0cd950 con 0x7f905c0cf8f0 2023-07-11T00:30:01.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.767+0000 7f9060fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f905c0cedd0 con 0x7f905c0d2640 2023-07-11T00:30:01.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.767+0000 7f905a59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f905c15c460 0x7f905c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48074/0 (socket says 172.21.15.22:48074) 2023-07-11T00:30:01.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.767+0000 7f905a59c700 1 -- 172.21.15.22:0/2776698346 learned_addr learned my addr 172.21.15.22:0/2776698346 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:01.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.767+0000 7f9053fff700 1 --2- 172.21.15.22:0/2776698346 >> v2:172.21.15.184:3300/0 conn(0x7f905c0d2640 0x7f905c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:01.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.767+0000 7f9059d9b700 1 -- 172.21.15.22:0/2776698346 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3916863224 0 0) 0x7f905c0d1790 con 0x7f905c15c460 2023-07-11T00:30:01.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.767+0000 7f9059d9b700 1 -- 172.21.15.22:0/2776698346 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90480035b0 con 0x7f905c15c460 2023-07-11T00:30:01.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.768+0000 7f9053fff700 1 -- 172.21.15.22:0/2776698346 >> v1:172.21.15.184:6789/0 conn(0x7f905c0cf8f0 legacy=0x7f905c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:01.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.768+0000 7f9053fff700 1 -- 172.21.15.22:0/2776698346 >> v1:172.21.15.22:6789/0 conn(0x7f905c15c460 legacy=0x7f905c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:01.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.768+0000 7f9053fff700 1 -- 172.21.15.22:0/2776698346 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905c0d14b0 con 0x7f905c0d2640 2023-07-11T00:30:01.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.768+0000 7f9053fff700 1 --2- 172.21.15.22:0/2776698346 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f905c0d2640 0x7f905c0b59d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9044009840 tx=0x7f9044009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b37ccb9ebe4b956 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:01.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.768+0000 7f9059d9b700 1 -- 172.21.15.22:0/2776698346 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9044011830 con 0x7f905c0d2640 2023-07-11T00:30:01.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.768+0000 7f9059d9b700 1 -- 172.21.15.22:0/2776698346 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9044011990 con 0x7f905c0d2640 2023-07-11T00:30:01.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.768+0000 7f9059d9b700 1 -- 172.21.15.22:0/2776698346 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9044011d20 con 0x7f905c0d2640 2023-07-11T00:30:01.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.769+0000 7f9060fff700 1 -- 172.21.15.22:0/2776698346 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f905c0d2640 msgr2=0x7f905c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:01.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.769+0000 7f9060fff700 1 --2- 172.21.15.22:0/2776698346 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f905c0d2640 0x7f905c0b59d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9044009840 tx=0x7f9044009b50 comp rx=0 tx=0).stop 2023-07-11T00:30:01.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.769+0000 7f9060fff700 1 -- 172.21.15.22:0/2776698346 shutdown_connections 2023-07-11T00:30:01.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.769+0000 7f9060fff700 1 --2- 172.21.15.22:0/2776698346 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f905c0d2640 0x7f905c0b59d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.769+0000 7f9060fff700 1 -- 172.21.15.22:0/2776698346 >> 172.21.15.22:0/2776698346 conn(0x7f905c071660 msgr2=0x7f905c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:01.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.769+0000 7f9060fff700 1 -- 172.21.15.22:0/2776698346 shutdown_connections 2023-07-11T00:30:01.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.769+0000 7f9060fff700 1 -- 172.21.15.22:0/2776698346 wait complete. 2023-07-11T00:30:01.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.771+0000 7f9060fff700 1 Processor -- start 2023-07-11T00:30:01.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.771+0000 7f9060fff700 1 -- start start 2023-07-11T00:30:01.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.773+0000 7f9060fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f905c0cf8f0 0x7f905c1536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:01.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.773+0000 7f9060fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f905c0d2640 0x7f905c0c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:01.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.773+0000 7f9060fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f905c15c460 0x7f905c15d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:01.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.773+0000 7f9060fff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c1f2650 con 0x7f905c0d2640 2023-07-11T00:30:01.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.773+0000 7f9060fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c1f2930 con 0x7f905c15c460 2023-07-11T00:30:01.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.773+0000 7f9060fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905c15c8d0 con 0x7f905c0cf8f0 2023-07-11T00:30:01.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.773+0000 7f9053fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f905c0d2640 0x7f905c0c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:01.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.773+0000 7f9053fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f905c0d2640 0x7f905c0c66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41468/0 (socket says 172.21.15.22:41468) 2023-07-11T00:30:01.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.773+0000 7f9053fff700 1 -- 172.21.15.22:0/2568366692 learned_addr learned my addr 172.21.15.22:0/2568366692 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:01.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.773+0000 7f905ad9d700 1 --2- 172.21.15.22:0/2568366692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f905c15c460 0x7f905c15d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:01.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.773+0000 7f905a59c700 1 --2- 172.21.15.22:0/2568366692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f905c0cf8f0 0x7f905c1536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:01.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.773+0000 7f9053fff700 1 -- 172.21.15.22:0/2568366692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f905c0cf8f0 msgr2=0x7f905c1536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:01.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.773+0000 7f9053fff700 1 --2- 172.21.15.22:0/2568366692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f905c0cf8f0 0x7f905c1536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.773+0000 7f9053fff700 1 -- 172.21.15.22:0/2568366692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f905c15c460 msgr2=0x7f905c15d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:01.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.773+0000 7f9053fff700 1 --2- 172.21.15.22:0/2568366692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f905c15c460 0x7f905c15d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.773+0000 7f9053fff700 1 -- 172.21.15.22:0/2568366692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90440094a0 con 0x7f905c0d2640 2023-07-11T00:30:01.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.773+0000 7f905ad9d700 1 --2- 172.21.15.22:0/2568366692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f905c15c460 0x7f905c15d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:01.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.774+0000 7f9053fff700 1 --2- 172.21.15.22:0/2568366692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f905c0d2640 0x7f905c0c66b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9044009fd0 tx=0x7f9044004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:01.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.774+0000 7f9052ffd700 1 -- 172.21.15.22:0/2568366692 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90440038a0 con 0x7f905c0d2640 2023-07-11T00:30:01.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.774+0000 7f9052ffd700 1 -- 172.21.15.22:0/2568366692 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904401f070 con 0x7f905c0d2640 2023-07-11T00:30:01.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.774+0000 7f9052ffd700 1 -- 172.21.15.22:0/2568366692 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9044003c40 con 0x7f905c0d2640 2023-07-11T00:30:01.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.774+0000 7f9060fff700 1 -- 172.21.15.22:0/2568366692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f905c15cbb0 con 0x7f905c0d2640 2023-07-11T00:30:01.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.774+0000 7f9060fff700 1 -- 172.21.15.22:0/2568366692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f905c153c10 con 0x7f905c0d2640 2023-07-11T00:30:01.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.775+0000 7f9060fff700 1 -- 172.21.15.22:0/2568366692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f905c04ea60 con 0x7f905c0d2640 2023-07-11T00:30:01.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.777+0000 7f9052ffd700 1 -- 172.21.15.22:0/2568366692 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9044026480 con 0x7f905c0d2640 2023-07-11T00:30:01.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.777+0000 7f9052ffd700 1 --2- 172.21.15.22:0/2568366692 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f903c06ace0 0x7f903c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:01.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.778+0000 7f9052ffd700 1 -- 172.21.15.22:0/2568366692 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9044021070 con 0x7f905c0d2640 2023-07-11T00:30:01.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.778+0000 7f905a59c700 1 --2- 172.21.15.22:0/2568366692 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f903c06ace0 0x7f903c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:01.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.779+0000 7f905a59c700 1 --2- 172.21.15.22:0/2568366692 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f903c06ace0 0x7f903c06d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f904c0011e0 tx=0x7f904c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:01.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.781+0000 7f9052ffd700 1 -- 172.21.15.22:0/2568366692 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9044056120 con 0x7f905c0d2640 2023-07-11T00:30:01.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.990+0000 7f9060fff700 1 -- 172.21.15.22:0/2568366692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f905c0b4fa0 con 0x7f905c0d2640 2023-07-11T00:30:01.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.991+0000 7f9052ffd700 1 -- 172.21.15.22:0/2568366692 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14579 (secure 0 0 0) 0x7f9044015090 con 0x7f905c0d2640 2023-07-11T00:30:01.994 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:01.994 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":16,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:00.578718+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:30:01.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.994+0000 7f9060fff700 1 -- 172.21.15.22:0/2568366692 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f903c06ace0 msgr2=0x7f903c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:01.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.994+0000 7f9060fff700 1 --2- 172.21.15.22:0/2568366692 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f903c06ace0 0x7f903c06d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f904c0011e0 tx=0x7f904c009040 comp rx=0 tx=0).stop 2023-07-11T00:30:01.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.994+0000 7f9060fff700 1 -- 172.21.15.22:0/2568366692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f905c0d2640 msgr2=0x7f905c0c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:01.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.994+0000 7f9060fff700 1 --2- 172.21.15.22:0/2568366692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f905c0d2640 0x7f905c0c66b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9044009fd0 tx=0x7f9044004750 comp rx=0 tx=0).stop 2023-07-11T00:30:01.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.994+0000 7f9060fff700 1 -- 172.21.15.22:0/2568366692 shutdown_connections 2023-07-11T00:30:01.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.994+0000 7f9060fff700 1 --2- 172.21.15.22:0/2568366692 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f903c06ace0 0x7f903c06d190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.994+0000 7f9060fff700 1 --2- 172.21.15.22:0/2568366692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f905c0cf8f0 0x7f905c1536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.994+0000 7f9060fff700 1 --2- 172.21.15.22:0/2568366692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f905c15c460 0x7f905c15d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.994+0000 7f9060fff700 1 --2- 172.21.15.22:0/2568366692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f905c0d2640 0x7f905c0c66b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:01.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.994+0000 7f9060fff700 1 -- 172.21.15.22:0/2568366692 >> 172.21.15.22:0/2568366692 conn(0x7f905c071660 msgr2=0x7f905c0b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:01.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.994+0000 7f9060fff700 1 -- 172.21.15.22:0/2568366692 shutdown_connections 2023-07-11T00:30:01.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:01.994+0000 7f9060fff700 1 -- 172.21.15.22:0/2568366692 wait complete. 2023-07-11T00:30:02.015 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:29:57.631007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:29:58.547599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-11T00:30:02.017 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:30:02.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.219+0000 7f49bb1ff700 1 Processor -- start 2023-07-11T00:30:02.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.219+0000 7f49bb1ff700 1 -- start start 2023-07-11T00:30:02.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.220+0000 7f49bb1ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f49b40b8430 0x7f49b40cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:02.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.220+0000 7f49bb1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f49b40d3730 0x7f49b40cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:02.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.220+0000 7f49bb1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b40cfa90 0x7f49b415feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:02.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.220+0000 7f49bb1ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b40b8800 con 0x7f49b40b8430 2023-07-11T00:30:02.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.220+0000 7f49bb1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b40d0b20 con 0x7f49b40d3730 2023-07-11T00:30:02.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.220+0000 7f49bb1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b40cfeb0 con 0x7f49b40cfa90 2023-07-11T00:30:02.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.220+0000 7f49b8f9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f49b40b8430 0x7f49b40cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:02.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.220+0000 7f49b8f9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f49b40b8430 0x7f49b40cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41474/0 (socket says 172.21.15.22:41474) 2023-07-11T00:30:02.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.220+0000 7f49b8f9b700 1 -- 172.21.15.22:0/3090145152 learned_addr learned my addr 172.21.15.22:0/3090145152 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:02.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.221+0000 7f49b3fff700 1 --2- 172.21.15.22:0/3090145152 >> v2:172.21.15.184:3300/0 conn(0x7f49b40d3730 0x7f49b40cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:02.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.221+0000 7f49b979c700 1 --2- 172.21.15.22:0/3090145152 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b40cfa90 0x7f49b415feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:02.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.221+0000 7f49b8f9b700 1 -- 172.21.15.22:0/3090145152 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b40cfa90 msgr2=0x7f49b415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:02.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.221+0000 7f49b8f9b700 1 --2- 172.21.15.22:0/3090145152 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b40cfa90 0x7f49b415feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.221+0000 7f49b8f9b700 1 -- 172.21.15.22:0/3090145152 >> v2:172.21.15.184:3300/0 conn(0x7f49b40d3730 msgr2=0x7f49b40cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:02.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.221+0000 7f49b8f9b700 1 --2- 172.21.15.22:0/3090145152 >> v2:172.21.15.184:3300/0 conn(0x7f49b40d3730 0x7f49b40cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.221+0000 7f49b8f9b700 1 -- 172.21.15.22:0/3090145152 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b40b4ee0 con 0x7f49b40b8430 2023-07-11T00:30:02.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.221+0000 7f49b8f9b700 1 --2- 172.21.15.22:0/3090145152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49b40b8430 0x7f49b40cd320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f49b4160f50 tx=0x7f49a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b663fb73e3f39d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:02.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.221+0000 7f49b37fe700 1 -- 172.21.15.22:0/3090145152 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a8011830 con 0x7f49b40b8430 2023-07-11T00:30:02.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.221+0000 7f49b37fe700 1 -- 172.21.15.22:0/3090145152 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a8011990 con 0x7f49b40b8430 2023-07-11T00:30:02.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.221+0000 7f49b37fe700 1 -- 172.21.15.22:0/3090145152 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a8011d20 con 0x7f49b40b8430 2023-07-11T00:30:02.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.222+0000 7f49bb1ff700 1 -- 172.21.15.22:0/3090145152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49b40b8430 msgr2=0x7f49b40cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:02.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.222+0000 7f49bb1ff700 1 --2- 172.21.15.22:0/3090145152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49b40b8430 0x7f49b40cd320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f49b4160f50 tx=0x7f49a8009bd0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.222+0000 7f49bb1ff700 1 -- 172.21.15.22:0/3090145152 shutdown_connections 2023-07-11T00:30:02.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.222+0000 7f49bb1ff700 1 --2- 172.21.15.22:0/3090145152 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b40cfa90 0x7f49b415feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.222+0000 7f49bb1ff700 1 --2- 172.21.15.22:0/3090145152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49b40b8430 0x7f49b40cd320 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.222+0000 7f49bb1ff700 1 --2- 172.21.15.22:0/3090145152 >> v2:172.21.15.184:3300/0 conn(0x7f49b40d3730 0x7f49b40cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.222+0000 7f49bb1ff700 1 -- 172.21.15.22:0/3090145152 >> 172.21.15.22:0/3090145152 conn(0x7f49b406b3f0 msgr2=0x7f49b406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:02.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.222+0000 7f49bb1ff700 1 -- 172.21.15.22:0/3090145152 shutdown_connections 2023-07-11T00:30:02.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.222+0000 7f49bb1ff700 1 -- 172.21.15.22:0/3090145152 wait complete. 2023-07-11T00:30:02.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.224+0000 7f49bb1ff700 1 Processor -- start 2023-07-11T00:30:02.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.225+0000 7f49bb1ff700 1 -- start start 2023-07-11T00:30:02.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.226+0000 7f49bb1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b40b8430 0x7f49b415df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:02.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.226+0000 7f49bb1ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49b40cfa90 0x7f49b40c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:02.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.226+0000 7f49bb1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b40d3730 0x7f49b414ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:02.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.226+0000 7f49bb1ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b415cea0 con 0x7f49b40cfa90 2023-07-11T00:30:02.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.226+0000 7f49bb1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b415d180 con 0x7f49b40d3730 2023-07-11T00:30:02.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.226+0000 7f49bb1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b415d460 con 0x7f49b40b8430 2023-07-11T00:30:02.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.226+0000 7f49b8f9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b40b8430 0x7f49b415df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:02.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.226+0000 7f49b3fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49b40cfa90 0x7f49b40c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:02.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.226+0000 7f49b8f9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b40b8430 0x7f49b415df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:34064/0 (socket says 172.21.15.22:34064) 2023-07-11T00:30:02.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.226+0000 7f49b8f9b700 1 -- 172.21.15.22:0/346898814 learned_addr learned my addr 172.21.15.22:0/346898814 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:02.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.226+0000 7f49b979c700 1 --2- 172.21.15.22:0/346898814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b40d3730 0x7f49b414ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:02.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.227+0000 7f49b8f9b700 1 -- 172.21.15.22:0/346898814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b40d3730 msgr2=0x7f49b414ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:02.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.227+0000 7f49b8f9b700 1 --2- 172.21.15.22:0/346898814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b40d3730 0x7f49b414ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.227+0000 7f49b8f9b700 1 -- 172.21.15.22:0/346898814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49b40cfa90 msgr2=0x7f49b40c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:02.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.227+0000 7f49b8f9b700 1 --2- 172.21.15.22:0/346898814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49b40cfa90 0x7f49b40c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.227+0000 7f49b8f9b700 1 -- 172.21.15.22:0/346898814 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a8009550 con 0x7f49b40b8430 2023-07-11T00:30:02.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.227+0000 7f49b3fff700 1 --2- 172.21.15.22:0/346898814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49b40cfa90 0x7f49b40c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:30:02.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.227+0000 7f49b8f9b700 1 --2- 172.21.15.22:0/346898814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b40b8430 0x7f49b415df40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009c10 tx=0x7f49a8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:02.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.227+0000 7f49b17fa700 1 -- 172.21.15.22:0/346898814 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a8004450 con 0x7f49b40b8430 2023-07-11T00:30:02.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.227+0000 7f49b17fa700 1 -- 172.21.15.22:0/346898814 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a801e070 con 0x7f49b40b8430 2023-07-11T00:30:02.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.227+0000 7f49b17fa700 1 -- 172.21.15.22:0/346898814 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a80038e0 con 0x7f49b40b8430 2023-07-11T00:30:02.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.227+0000 7f49bb1ff700 1 -- 172.21.15.22:0/346898814 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b415d740 con 0x7f49b40b8430 2023-07-11T00:30:02.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.228+0000 7f49bb1ff700 1 -- 172.21.15.22:0/346898814 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b40c7710 con 0x7f49b40b8430 2023-07-11T00:30:02.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.228+0000 7f49bb1ff700 1 -- 172.21.15.22:0/346898814 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b415dc60 con 0x7f49b40b8430 2023-07-11T00:30:02.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.230+0000 7f49b17fa700 1 -- 172.21.15.22:0/346898814 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f49a8003a40 con 0x7f49b40b8430 2023-07-11T00:30:02.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.231+0000 7f49b17fa700 1 --2- 172.21.15.22:0/346898814 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f499806ace0 0x7f499806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:02.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.231+0000 7f49b17fa700 1 -- 172.21.15.22:0/346898814 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f49a808a1f0 con 0x7f49b40b8430 2023-07-11T00:30:02.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.231+0000 7f49b3fff700 1 --2- 172.21.15.22:0/346898814 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f499806ace0 0x7f499806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:02.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.232+0000 7f49b3fff700 1 --2- 172.21.15.22:0/346898814 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f499806ace0 0x7f499806d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f49b415fa90 tx=0x7f49a0009210 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:02.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.235+0000 7f49b17fa700 1 -- 172.21.15.22:0/346898814 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f49a8055660 con 0x7f49b40b8430 2023-07-11T00:30:02.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.439+0000 7f49bb1ff700 1 -- 172.21.15.22:0/346898814 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f49b415dc60 con 0x7f49b40b8430 2023-07-11T00:30:02.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.440+0000 7f49b17fa700 1 -- 172.21.15.22:0/346898814 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f49b415dc60 con 0x7f49b40b8430 2023-07-11T00:30:02.443 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2023-07-11T00:30:02.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.442+0000 7f49bb1ff700 1 -- 172.21.15.22:0/346898814 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f499806ace0 msgr2=0x7f499806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:02.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.442+0000 7f49bb1ff700 1 --2- 172.21.15.22:0/346898814 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f499806ace0 0x7f499806d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f49b415fa90 tx=0x7f49a0009210 comp rx=0 tx=0).stop 2023-07-11T00:30:02.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.442+0000 7f49bb1ff700 1 -- 172.21.15.22:0/346898814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b40b8430 msgr2=0x7f49b415df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:02.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.442+0000 7f49bb1ff700 1 --2- 172.21.15.22:0/346898814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b40b8430 0x7f49b415df40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009c10 tx=0x7f49a8004750 comp rx=0 tx=0).stop 2023-07-11T00:30:02.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.442+0000 7f49bb1ff700 1 -- 172.21.15.22:0/346898814 shutdown_connections 2023-07-11T00:30:02.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.442+0000 7f49bb1ff700 1 --2- 172.21.15.22:0/346898814 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f499806ace0 0x7f499806d190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.442+0000 7f49bb1ff700 1 --2- 172.21.15.22:0/346898814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b40b8430 0x7f49b415df40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.442+0000 7f49bb1ff700 1 --2- 172.21.15.22:0/346898814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b40d3730 0x7f49b414ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.442+0000 7f49bb1ff700 1 --2- 172.21.15.22:0/346898814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49b40cfa90 0x7f49b40c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.442+0000 7f49bb1ff700 1 -- 172.21.15.22:0/346898814 >> 172.21.15.22:0/346898814 conn(0x7f49b406b3f0 msgr2=0x7f49b40cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:02.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.442+0000 7f49bb1ff700 1 -- 172.21.15.22:0/346898814 shutdown_connections 2023-07-11T00:30:02.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.443+0000 7f49bb1ff700 1 -- 172.21.15.22:0/346898814 wait complete. 2023-07-11T00:30:02.462 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:30:02.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.666+0000 7fefa45ff700 1 Processor -- start 2023-07-11T00:30:02.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.666+0000 7fefa45ff700 1 -- start start 2023-07-11T00:30:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.667+0000 7fefa45ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef9c0d3730 0x7fef9c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.667+0000 7fefa45ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fef9c0cfa90 0x7fef9c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.667+0000 7fefa45ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0d0b20 con 0x7fef9c0b8430 2023-07-11T00:30:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.667+0000 7fefa45ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c0cda30 con 0x7fef9c0cfa90 2023-07-11T00:30:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.667+0000 7fefa45ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0b8800 con 0x7fef9c0d3730 2023-07-11T00:30:02.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.667+0000 7fefa1b9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef9c0d3730 0x7fef9c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:02.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.667+0000 7fefa2b9c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fef9c0cfa90 0x7fef9c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:02.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.667+0000 7fefa1b9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef9c0d3730 0x7fef9c0cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:34078/0 (socket says 172.21.15.22:34078) 2023-07-11T00:30:02.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.667+0000 7fefa1b9a700 1 -- 172.21.15.22:0/4277978591 learned_addr learned my addr 172.21.15.22:0/4277978591 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:02.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.667+0000 7fefa239b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fef9c0b8430 0x7fef9c0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:48336/0 (socket says 172.21.15.22:48336) 2023-07-11T00:30:02.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.668+0000 7fefa2b9c700 1 -- 172.21.15.22:0/4277978591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef9c0d3730 msgr2=0x7fef9c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:02.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.668+0000 7fefa2b9c700 1 --2- 172.21.15.22:0/4277978591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef9c0d3730 0x7fef9c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.668+0000 7fefa2b9c700 1 -- 172.21.15.22:0/4277978591 >> v1:172.21.15.184:6789/0 conn(0x7fef9c0b8430 legacy=0x7fef9c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:02.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.668+0000 7fefa2b9c700 1 -- 172.21.15.22:0/4277978591 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c0cfeb0 con 0x7fef9c0cfa90 2023-07-11T00:30:02.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.668+0000 7fefa2b9c700 1 --2- 172.21.15.22:0/4277978591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef9c0cfa90 0x7fef9c0d0fb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef94009d90 tx=0x7fef9400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52bb558646ebe7d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:02.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.668+0000 7fefa1399700 1 -- 172.21.15.22:0/4277978591 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9400e070 con 0x7fef9c0cfa90 2023-07-11T00:30:02.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.668+0000 7fefa1399700 1 -- 172.21.15.22:0/4277978591 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9400bb20 con 0x7fef9c0cfa90 2023-07-11T00:30:02.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.668+0000 7fefa1399700 1 -- 172.21.15.22:0/4277978591 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94012430 con 0x7fef9c0cfa90 2023-07-11T00:30:02.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.669+0000 7fefa45ff700 1 -- 172.21.15.22:0/4277978591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef9c0cfa90 msgr2=0x7fef9c0d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:02.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.669+0000 7fefa45ff700 1 --2- 172.21.15.22:0/4277978591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef9c0cfa90 0x7fef9c0d0fb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef94009d90 tx=0x7fef9400b330 comp rx=0 tx=0).stop 2023-07-11T00:30:02.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.669+0000 7fefa45ff700 1 -- 172.21.15.22:0/4277978591 shutdown_connections 2023-07-11T00:30:02.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.669+0000 7fefa45ff700 1 --2- 172.21.15.22:0/4277978591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef9c0cfa90 0x7fef9c0d0fb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.669+0000 7fefa45ff700 1 --2- 172.21.15.22:0/4277978591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef9c0d3730 0x7fef9c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.669+0000 7fefa45ff700 1 -- 172.21.15.22:0/4277978591 >> 172.21.15.22:0/4277978591 conn(0x7fef9c06b3f0 msgr2=0x7fef9c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:02.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.669+0000 7fefa45ff700 1 -- 172.21.15.22:0/4277978591 shutdown_connections 2023-07-11T00:30:02.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.669+0000 7fefa45ff700 1 -- 172.21.15.22:0/4277978591 wait complete. 2023-07-11T00:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.671+0000 7fefa45ff700 1 Processor -- start 2023-07-11T00:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.671+0000 7fefa45ff700 1 -- start start 2023-07-11T00:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.672+0000 7fefa45ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef9c0b8430 0x7fef9c14d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.672+0000 7fefa45ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef9c0cfa90 0x7fef9c0c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.672+0000 7fefa45ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef9c0d3730 0x7fef9c14f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.672+0000 7fefa45ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c14d5c0 con 0x7fef9c0b8430 2023-07-11T00:30:02.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.672+0000 7fefa45ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0c6ba0 con 0x7fef9c0cfa90 2023-07-11T00:30:02.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.672+0000 7fefa45ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c14ed50 con 0x7fef9c0d3730 2023-07-11T00:30:02.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.672+0000 7fefa239b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef9c0b8430 0x7fef9c14d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:02.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.672+0000 7fefa239b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef9c0b8430 0x7fef9c14d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41482/0 (socket says 172.21.15.22:41482) 2023-07-11T00:30:02.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.672+0000 7fefa239b700 1 -- 172.21.15.22:0/1083201969 learned_addr learned my addr 172.21.15.22:0/1083201969 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:02.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.672+0000 7fefa1b9a700 1 --2- 172.21.15.22:0/1083201969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef9c0cfa90 0x7fef9c0c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:02.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.672+0000 7fefa2b9c700 1 --2- 172.21.15.22:0/1083201969 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef9c0d3730 0x7fef9c14f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:02.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.672+0000 7fefa239b700 1 -- 172.21.15.22:0/1083201969 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef9c0d3730 msgr2=0x7fef9c14f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:02.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.672+0000 7fefa239b700 1 --2- 172.21.15.22:0/1083201969 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef9c0d3730 0x7fef9c14f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.672+0000 7fefa239b700 1 -- 172.21.15.22:0/1083201969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef9c0cfa90 msgr2=0x7fef9c0c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:02.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.672+0000 7fefa239b700 1 --2- 172.21.15.22:0/1083201969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef9c0cfa90 0x7fef9c0c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.672+0000 7fefa239b700 1 -- 172.21.15.22:0/1083201969 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef94009a70 con 0x7fef9c0b8430 2023-07-11T00:30:02.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.672+0000 7fefa1b9a700 1 --2- 172.21.15.22:0/1083201969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef9c0cfa90 0x7fef9c0c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:02.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.673+0000 7fefa239b700 1 --2- 172.21.15.22:0/1083201969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef9c0b8430 0x7fef9c14d080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef9800c520 tx=0x7fef9800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:02.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.673+0000 7fef92ffd700 1 -- 172.21.15.22:0/1083201969 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98005cb0 con 0x7fef9c0b8430 2023-07-11T00:30:02.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.673+0000 7fef92ffd700 1 -- 172.21.15.22:0/1083201969 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef98005e10 con 0x7fef9c0b8430 2023-07-11T00:30:02.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.673+0000 7fefa45ff700 1 -- 172.21.15.22:0/1083201969 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c14f030 con 0x7fef9c0b8430 2023-07-11T00:30:02.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.673+0000 7fef92ffd700 1 -- 172.21.15.22:0/1083201969 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef980072d0 con 0x7fef9c0b8430 2023-07-11T00:30:02.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.673+0000 7fefa45ff700 1 -- 172.21.15.22:0/1083201969 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c0c93c0 con 0x7fef9c0b8430 2023-07-11T00:30:02.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.674+0000 7fefa45ff700 1 -- 172.21.15.22:0/1083201969 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9c14f550 con 0x7fef9c0b8430 2023-07-11T00:30:02.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.675+0000 7fef92ffd700 1 -- 172.21.15.22:0/1083201969 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fef98007430 con 0x7fef9c0b8430 2023-07-11T00:30:02.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.676+0000 7fef92ffd700 1 --2- 172.21.15.22:0/1083201969 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fef8006ace0 0x7fef8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:02.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.676+0000 7fef92ffd700 1 -- 172.21.15.22:0/1083201969 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fef980885d0 con 0x7fef9c0b8430 2023-07-11T00:30:02.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.676+0000 7fefa1b9a700 1 --2- 172.21.15.22:0/1083201969 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fef8006ace0 0x7fef8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:02.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.677+0000 7fefa1b9a700 1 --2- 172.21.15.22:0/1083201969 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fef8006ace0 0x7fef8006d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef9c15f400 tx=0x7fef8c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:02.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.680+0000 7fef92ffd700 1 -- 172.21.15.22:0/1083201969 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fef9c14f550 con 0x7fef9c0b8430 2023-07-11T00:30:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.887+0000 7fefa45ff700 1 -- 172.21.15.22:0/1083201969 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef9c0c9550 con 0x7fef9c0b8430 2023-07-11T00:30:02.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.887+0000 7fef92ffd700 1 -- 172.21.15.22:0/1083201969 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef98017020 con 0x7fef9c0b8430 2023-07-11T00:30:02.890 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-07-11T00:30:02.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.890+0000 7fefa45ff700 1 -- 172.21.15.22:0/1083201969 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fef8006ace0 msgr2=0x7fef8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:02.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.890+0000 7fefa45ff700 1 --2- 172.21.15.22:0/1083201969 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fef8006ace0 0x7fef8006d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef9c15f400 tx=0x7fef8c008040 comp rx=0 tx=0).stop 2023-07-11T00:30:02.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.890+0000 7fefa45ff700 1 -- 172.21.15.22:0/1083201969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef9c0b8430 msgr2=0x7fef9c14d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:02.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.890+0000 7fefa45ff700 1 --2- 172.21.15.22:0/1083201969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef9c0b8430 0x7fef9c14d080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef9800c520 tx=0x7fef9800c8e0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.890+0000 7fefa45ff700 1 -- 172.21.15.22:0/1083201969 shutdown_connections 2023-07-11T00:30:02.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.890+0000 7fefa45ff700 1 --2- 172.21.15.22:0/1083201969 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fef8006ace0 0x7fef8006d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.890+0000 7fefa45ff700 1 --2- 172.21.15.22:0/1083201969 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef9c0d3730 0x7fef9c14f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.890+0000 7fefa45ff700 1 --2- 172.21.15.22:0/1083201969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef9c0b8430 0x7fef9c14d080 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.890+0000 7fefa45ff700 1 --2- 172.21.15.22:0/1083201969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef9c0cfa90 0x7fef9c0c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:02.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.890+0000 7fefa45ff700 1 -- 172.21.15.22:0/1083201969 >> 172.21.15.22:0/1083201969 conn(0x7fef9c06b3f0 msgr2=0x7fef9c0d1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:02.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.890+0000 7fefa45ff700 1 -- 172.21.15.22:0/1083201969 shutdown_connections 2023-07-11T00:30:02.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:02.890+0000 7fefa45ff700 1 -- 172.21.15.22:0/1083201969 wait complete. 2023-07-11T00:30:02.910 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-11T00:30:03.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.109+0000 7f881f1ff700 1 Processor -- start 2023-07-11T00:30:03.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.109+0000 7f881f1ff700 1 -- start start 2023-07-11T00:30:03.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.110+0000 7f881f1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f881815c460 0x7f88180b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:03.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.110+0000 7f881f1ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f88180d2640 0x7f88180cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:03.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.110+0000 7f881f1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88180d1790 con 0x7f88180cf720 2023-07-11T00:30:03.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.110+0000 7f881f1ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88180cedd0 con 0x7f88180d2640 2023-07-11T00:30:03.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.110+0000 7f881f1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88180cd950 con 0x7f881815c460 2023-07-11T00:30:03.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.110+0000 7f8817fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f88180d2640 0x7f88180cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:03.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.110+0000 7f8817fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f88180d2640 0x7f88180cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41496/0 (socket says 172.21.15.22:41496) 2023-07-11T00:30:03.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.110+0000 7f8817fff700 1 -- 172.21.15.22:0/2792380553 learned_addr learned my addr 172.21.15.22:0/2792380553 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:03.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.111+0000 7f881cf9b700 1 --2- 172.21.15.22:0/2792380553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f881815c460 0x7f88180b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:03.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.111+0000 7f8817fff700 1 -- 172.21.15.22:0/2792380553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f881815c460 msgr2=0x7f88180b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:03.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.111+0000 7f8817fff700 1 --2- 172.21.15.22:0/2792380553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f881815c460 0x7f88180b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.111+0000 7f8817fff700 1 -- 172.21.15.22:0/2792380553 >> v1:172.21.15.184:6789/0 conn(0x7f88180cf720 legacy=0x7f88180d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:03.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.111+0000 7f8817fff700 1 -- 172.21.15.22:0/2792380553 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88180d14b0 con 0x7f88180d2640 2023-07-11T00:30:03.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.111+0000 7f8817fff700 1 --2- 172.21.15.22:0/2792380553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88180d2640 0x7f88180cf1e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f88040098f0 tx=0x7f8804009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba9aea2f36da7fc server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:03.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.111+0000 7f88177fe700 1 -- 172.21.15.22:0/2792380553 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880400b8a0 con 0x7f88180d2640 2023-07-11T00:30:03.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.111+0000 7f88177fe700 1 -- 172.21.15.22:0/2792380553 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880400ba00 con 0x7f88180d2640 2023-07-11T00:30:03.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.111+0000 7f88177fe700 1 -- 172.21.15.22:0/2792380553 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880400bd90 con 0x7f88180d2640 2023-07-11T00:30:03.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.112+0000 7f881f1ff700 1 -- 172.21.15.22:0/2792380553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88180d2640 msgr2=0x7f88180cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:03.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.112+0000 7f881f1ff700 1 --2- 172.21.15.22:0/2792380553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88180d2640 0x7f88180cf1e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f88040098f0 tx=0x7f8804009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:03.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.112+0000 7f881f1ff700 1 -- 172.21.15.22:0/2792380553 shutdown_connections 2023-07-11T00:30:03.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.112+0000 7f881f1ff700 1 --2- 172.21.15.22:0/2792380553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f881815c460 0x7f88180b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.112+0000 7f881f1ff700 1 --2- 172.21.15.22:0/2792380553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88180d2640 0x7f88180cf1e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.112+0000 7f881f1ff700 1 -- 172.21.15.22:0/2792380553 >> 172.21.15.22:0/2792380553 conn(0x7f8818071660 msgr2=0x7f8818071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:03.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.112+0000 7f881f1ff700 1 -- 172.21.15.22:0/2792380553 shutdown_connections 2023-07-11T00:30:03.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.112+0000 7f881f1ff700 1 -- 172.21.15.22:0/2792380553 wait complete. 2023-07-11T00:30:03.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.114+0000 7f881f1ff700 1 Processor -- start 2023-07-11T00:30:03.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.115+0000 7f881f1ff700 1 -- start start 2023-07-11T00:30:03.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.116+0000 7f881f1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88180cf720 0x7f881814db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:03.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.116+0000 7f881f1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88180d2640 0x7f88180c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:03.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.116+0000 7f881f1ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f881815c460 0x7f88180ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:03.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.116+0000 7f881f1ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881814e770 con 0x7f881815c460 2023-07-11T00:30:03.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.116+0000 7f881f1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88180c7e60 con 0x7f88180cf720 2023-07-11T00:30:03.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.116+0000 7f881f1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88180c7b80 con 0x7f88180d2640 2023-07-11T00:30:03.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.116+0000 7f881d79c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f881815c460 0x7f88180ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:03.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.116+0000 7f8817fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88180d2640 0x7f88180c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:03.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.116+0000 7f881cf9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88180cf720 0x7f881814db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:03.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.116+0000 7f8817fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88180d2640 0x7f88180c9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:34100/0 (socket says 172.21.15.22:34100) 2023-07-11T00:30:03.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.116+0000 7f881d79c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f881815c460 0x7f88180ca3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41504/0 (socket says 172.21.15.22:41504) 2023-07-11T00:30:03.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.116+0000 7f8817fff700 1 -- 172.21.15.22:0/3064402616 learned_addr learned my addr 172.21.15.22:0/3064402616 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:03.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.117+0000 7f881d79c700 1 -- 172.21.15.22:0/3064402616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88180d2640 msgr2=0x7f88180c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:03.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.117+0000 7f881d79c700 1 --2- 172.21.15.22:0/3064402616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88180d2640 0x7f88180c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.117+0000 7f881d79c700 1 -- 172.21.15.22:0/3064402616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88180cf720 msgr2=0x7f881814db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:03.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.117+0000 7f881d79c700 1 --2- 172.21.15.22:0/3064402616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88180cf720 0x7f881814db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.117+0000 7f881d79c700 1 -- 172.21.15.22:0/3064402616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8804009550 con 0x7f881815c460 2023-07-11T00:30:03.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.117+0000 7f881d79c700 1 --2- 172.21.15.22:0/3064402616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f881815c460 0x7f88180ca3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f881000cae0 tx=0x7f881000cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:03.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.117+0000 7f88157fa700 1 -- 172.21.15.22:0/3064402616 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8810003c00 con 0x7f881815c460 2023-07-11T00:30:03.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.117+0000 7f88157fa700 1 -- 172.21.15.22:0/3064402616 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8810003d60 con 0x7f881815c460 2023-07-11T00:30:03.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.117+0000 7f881f1ff700 1 -- 172.21.15.22:0/3064402616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8818151320 con 0x7f881815c460 2023-07-11T00:30:03.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.117+0000 7f88157fa700 1 -- 172.21.15.22:0/3064402616 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881000aa20 con 0x7f881815c460 2023-07-11T00:30:03.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.117+0000 7f881f1ff700 1 -- 172.21.15.22:0/3064402616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88181518e0 con 0x7f881815c460 2023-07-11T00:30:03.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.118+0000 7f881f1ff700 1 -- 172.21.15.22:0/3064402616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8818151b00 con 0x7f881815c460 2023-07-11T00:30:03.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.120+0000 7f88157fa700 1 -- 172.21.15.22:0/3064402616 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f881000ab80 con 0x7f881815c460 2023-07-11T00:30:03.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.121+0000 7f88157fa700 1 --2- 172.21.15.22:0/3064402616 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87fc06ace0 0x7f87fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:03.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.121+0000 7f88157fa700 1 -- 172.21.15.22:0/3064402616 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8810088fa0 con 0x7f881815c460 2023-07-11T00:30:03.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.121+0000 7f881cf9b700 1 --2- 172.21.15.22:0/3064402616 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87fc06ace0 0x7f87fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:03.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.122+0000 7f881cf9b700 1 --2- 172.21.15.22:0/3064402616 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87fc06ace0 0x7f87fc06d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f880c006b20 tx=0x7f880c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:03.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.125+0000 7f88157fa700 1 -- 172.21.15.22:0/3064402616 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8810054390 con 0x7f881815c460 2023-07-11T00:30:03.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.336+0000 7f881f1ff700 1 -- 172.21.15.22:0/3064402616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f881804ea60 con 0x7f881815c460 2023-07-11T00:30:03.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.337+0000 7f88157fa700 1 -- 172.21.15.22:0/3064402616 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+126 (secure 0 0 0) 0x7f88100579b0 con 0x7f881815c460 2023-07-11T00:30:03.340 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:03.340 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-07-11T00:30:03.340 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:30:03.340 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-07-11T00:30:03.340 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": "rbd" 2023-07-11T00:30:03.340 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:30:03.341 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:30:03.341 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 2, 2023-07-11T00:30:03.341 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-07-11T00:30:03.341 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:30:03.341 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-07-11T00:30:03.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.339+0000 7f881f1ff700 1 -- 172.21.15.22:0/3064402616 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87fc06ace0 msgr2=0x7f87fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:03.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.339+0000 7f881f1ff700 1 --2- 172.21.15.22:0/3064402616 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87fc06ace0 0x7f87fc06d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f880c006b20 tx=0x7f880c008040 comp rx=0 tx=0).stop 2023-07-11T00:30:03.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.339+0000 7f881f1ff700 1 -- 172.21.15.22:0/3064402616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f881815c460 msgr2=0x7f88180ca3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:03.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.339+0000 7f881f1ff700 1 --2- 172.21.15.22:0/3064402616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f881815c460 0x7f88180ca3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f881000cae0 tx=0x7f881000cdf0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.339+0000 7f881f1ff700 1 -- 172.21.15.22:0/3064402616 shutdown_connections 2023-07-11T00:30:03.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.339+0000 7f881f1ff700 1 --2- 172.21.15.22:0/3064402616 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87fc06ace0 0x7f87fc06d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.339+0000 7f881f1ff700 1 --2- 172.21.15.22:0/3064402616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f881815c460 0x7f88180ca3f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.339+0000 7f881f1ff700 1 --2- 172.21.15.22:0/3064402616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88180cf720 0x7f881814db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.339+0000 7f881f1ff700 1 --2- 172.21.15.22:0/3064402616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88180d2640 0x7f88180c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.339+0000 7f881f1ff700 1 -- 172.21.15.22:0/3064402616 >> 172.21.15.22:0/3064402616 conn(0x7f8818071660 msgr2=0x7f881815c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:03.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.340+0000 7f881f1ff700 1 -- 172.21.15.22:0/3064402616 shutdown_connections 2023-07-11T00:30:03.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.340+0000 7f881f1ff700 1 -- 172.21.15.22:0/3064402616 wait complete. 2023-07-11T00:30:03.359 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-11T00:30:03.360 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-11T00:30:03.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.562+0000 7f20e4bff700 1 Processor -- start 2023-07-11T00:30:03.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.563+0000 7f20e4bff700 1 -- start start 2023-07-11T00:30:03.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.564+0000 7f20e4bff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f20e00cfbe0 0x7f20e0160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:03.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.564+0000 7f20e4bff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e0160db0 con 0x7f20e00b1f00 2023-07-11T00:30:03.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.564+0000 7f20e4bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e015fe20 con 0x7f20e00b82c0 2023-07-11T00:30:03.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.564+0000 7f20e4bff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e00b8690 con 0x7f20e00cfbe0 2023-07-11T00:30:03.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.564+0000 7f20d7fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f20e00b1f00 0x7f20e00cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48078/0 (socket says 172.21.15.22:48078) 2023-07-11T00:30:03.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.564+0000 7f20d7fff700 1 -- 172.21.15.22:0/2511298306 learned_addr learned my addr 172.21.15.22:0/2511298306 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:03.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.564+0000 7f20ded9d700 1 --2- 172.21.15.22:0/2511298306 >> v2:172.21.15.22:3300/0 conn(0x7f20e00cfbe0 0x7f20e0160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:03.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.564+0000 7f20ddd9b700 1 -- 172.21.15.22:0/2511298306 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001680679 0 0) 0x7f20c8001110 con 0x7f20e00b1f00 2023-07-11T00:30:03.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.565+0000 7f20ddd9b700 1 -- 172.21.15.22:0/2511298306 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20cc0035b0 con 0x7f20e00b1f00 2023-07-11T00:30:03.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.565+0000 7f20ddd9b700 1 -- 172.21.15.22:0/2511298306 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158331131 0 0) 0x7f20e015fe20 con 0x7f20e00b82c0 2023-07-11T00:30:03.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.565+0000 7f20ddd9b700 1 -- 172.21.15.22:0/2511298306 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20c8001110 con 0x7f20e00b82c0 2023-07-11T00:30:03.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.565+0000 7f20ded9d700 1 -- 172.21.15.22:0/2511298306 >> v1:172.21.15.184:6789/0 conn(0x7f20e00b82c0 legacy=0x7f20e00ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:03.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.565+0000 7f20ded9d700 1 -- 172.21.15.22:0/2511298306 >> v1:172.21.15.22:6789/0 conn(0x7f20e00b1f00 legacy=0x7f20e00cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:03.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.565+0000 7f20ded9d700 1 -- 172.21.15.22:0/2511298306 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e01603e0 con 0x7f20e00cfbe0 2023-07-11T00:30:03.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.565+0000 7f20ded9d700 1 --2- 172.21.15.22:0/2511298306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20e00cfbe0 0x7f20e0160870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009d90 tx=0x7f20d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e649928c37838d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:03.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.565+0000 7f20ddd9b700 1 -- 172.21.15.22:0/2511298306 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d800e070 con 0x7f20e00cfbe0 2023-07-11T00:30:03.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.565+0000 7f20ddd9b700 1 -- 172.21.15.22:0/2511298306 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d800bb20 con 0x7f20e00cfbe0 2023-07-11T00:30:03.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.565+0000 7f20ddd9b700 1 -- 172.21.15.22:0/2511298306 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8012430 con 0x7f20e00cfbe0 2023-07-11T00:30:03.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.566+0000 7f20e4bff700 1 -- 172.21.15.22:0/2511298306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20e00cfbe0 msgr2=0x7f20e0160870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:03.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.566+0000 7f20e4bff700 1 --2- 172.21.15.22:0/2511298306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20e00cfbe0 0x7f20e0160870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009d90 tx=0x7f20d800b330 comp rx=0 tx=0).stop 2023-07-11T00:30:03.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.566+0000 7f20e4bff700 1 -- 172.21.15.22:0/2511298306 shutdown_connections 2023-07-11T00:30:03.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.566+0000 7f20e4bff700 1 --2- 172.21.15.22:0/2511298306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20e00cfbe0 0x7f20e0160870 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.566+0000 7f20e4bff700 1 -- 172.21.15.22:0/2511298306 >> 172.21.15.22:0/2511298306 conn(0x7f20e0071660 msgr2=0x7f20e0071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:03.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.566+0000 7f20e4bff700 1 -- 172.21.15.22:0/2511298306 shutdown_connections 2023-07-11T00:30:03.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.566+0000 7f20e4bff700 1 -- 172.21.15.22:0/2511298306 wait complete. 2023-07-11T00:30:03.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.567+0000 7f20e4bff700 1 Processor -- start 2023-07-11T00:30:03.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.568+0000 7f20e4bff700 1 -- start start 2023-07-11T00:30:03.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20e4bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20e00b1f00 0x7f20e00ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:03.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20e4bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20e00b82c0 0x7f20e015ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:03.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20e4bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20e00cfbe0 0x7f20e0159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:03.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20e4bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e015c460 con 0x7f20e00b1f00 2023-07-11T00:30:03.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20e4bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e015c740 con 0x7f20e00b82c0 2023-07-11T00:30:03.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20e4bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e015ca20 con 0x7f20e00cfbe0 2023-07-11T00:30:03.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20de59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20e00b1f00 0x7f20e00ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:03.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20de59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20e00b1f00 0x7f20e00ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41520/0 (socket says 172.21.15.22:41520) 2023-07-11T00:30:03.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20de59c700 1 -- 172.21.15.22:0/165179983 learned_addr learned my addr 172.21.15.22:0/165179983 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:03.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20d7fff700 1 --2- 172.21.15.22:0/165179983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20e00b82c0 0x7f20e015ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:03.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20de59c700 1 -- 172.21.15.22:0/165179983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20e00cfbe0 msgr2=0x7f20e0159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:03.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20ded9d700 1 --2- 172.21.15.22:0/165179983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20e00cfbe0 0x7f20e0159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:03.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20de59c700 1 --2- 172.21.15.22:0/165179983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20e00cfbe0 0x7f20e0159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20de59c700 1 -- 172.21.15.22:0/165179983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20e00b82c0 msgr2=0x7f20e015ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:03.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20de59c700 1 --2- 172.21.15.22:0/165179983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20e00b82c0 0x7f20e015ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20de59c700 1 -- 172.21.15.22:0/165179983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d8009a70 con 0x7f20e00b1f00 2023-07-11T00:30:03.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20d7fff700 1 --2- 172.21.15.22:0/165179983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20e00b82c0 0x7f20e015ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:30:03.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.569+0000 7f20ded9d700 1 --2- 172.21.15.22:0/165179983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20e00cfbe0 0x7f20e0159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:30:03.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.570+0000 7f20de59c700 1 --2- 172.21.15.22:0/165179983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20e00b1f00 0x7f20e00ca700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f20d000c520 tx=0x7f20d000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:03.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.570+0000 7f20d6ffd700 1 -- 172.21.15.22:0/165179983 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d00052d0 con 0x7f20e00b1f00 2023-07-11T00:30:03.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.570+0000 7f20d6ffd700 1 -- 172.21.15.22:0/165179983 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d0005430 con 0x7f20e00b1f00 2023-07-11T00:30:03.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.570+0000 7f20e4bff700 1 -- 172.21.15.22:0/165179983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e015cd00 con 0x7f20e00b1f00 2023-07-11T00:30:03.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.570+0000 7f20d6ffd700 1 -- 172.21.15.22:0/165179983 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d00038c0 con 0x7f20e00b1f00 2023-07-11T00:30:03.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.570+0000 7f20e4bff700 1 -- 172.21.15.22:0/165179983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e00cac40 con 0x7f20e00b1f00 2023-07-11T00:30:03.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.571+0000 7f20e4bff700 1 -- 172.21.15.22:0/165179983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e015d220 con 0x7f20e00b1f00 2023-07-11T00:30:03.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.572+0000 7f20d6ffd700 1 -- 172.21.15.22:0/165179983 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f20d0003a20 con 0x7f20e00b1f00 2023-07-11T00:30:03.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.573+0000 7f20d6ffd700 1 --2- 172.21.15.22:0/165179983 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f20c006ace0 0x7f20c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:03.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.573+0000 7f20d6ffd700 1 -- 172.21.15.22:0/165179983 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f20d0088760 con 0x7f20e00b1f00 2023-07-11T00:30:03.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.573+0000 7f20d7fff700 1 --2- 172.21.15.22:0/165179983 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f20c006ace0 0x7f20c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:03.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.574+0000 7f20d7fff700 1 --2- 172.21.15.22:0/165179983 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f20c006ace0 0x7f20c006d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f20e015f110 tx=0x7f20c8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:03.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.577+0000 7f20d6ffd700 1 -- 172.21.15.22:0/165179983 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f20e015d220 con 0x7f20e00b1f00 2023-07-11T00:30:03.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.785+0000 7f20e4bff700 1 -- 172.21.15.22:0/165179983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f20e015d220 con 0x7f20e00b1f00 2023-07-11T00:30:03.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.879+0000 7f20d6ffd700 1 -- 172.21.15.22:0/165179983 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f20e015d220 con 0x7f20e00b1f00 2023-07-11T00:30:03.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.883+0000 7f20e4bff700 1 -- 172.21.15.22:0/165179983 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f20c006ace0 msgr2=0x7f20c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:03.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.883+0000 7f20e4bff700 1 --2- 172.21.15.22:0/165179983 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f20c006ace0 0x7f20c006d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f20e015f110 tx=0x7f20c8009040 comp rx=0 tx=0).stop 2023-07-11T00:30:03.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.883+0000 7f20e4bff700 1 -- 172.21.15.22:0/165179983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20e00b1f00 msgr2=0x7f20e00ca700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:03.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.883+0000 7f20e4bff700 1 --2- 172.21.15.22:0/165179983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20e00b1f00 0x7f20e00ca700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f20d000c520 tx=0x7f20d000c8e0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.883+0000 7f20e4bff700 1 -- 172.21.15.22:0/165179983 shutdown_connections 2023-07-11T00:30:03.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.883+0000 7f20e4bff700 1 --2- 172.21.15.22:0/165179983 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f20c006ace0 0x7f20c006d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.883+0000 7f20e4bff700 1 --2- 172.21.15.22:0/165179983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20e00cfbe0 0x7f20e0159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.883+0000 7f20e4bff700 1 --2- 172.21.15.22:0/165179983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20e00b1f00 0x7f20e00ca700 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.883+0000 7f20e4bff700 1 --2- 172.21.15.22:0/165179983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20e00b82c0 0x7f20e015ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:03.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.883+0000 7f20e4bff700 1 -- 172.21.15.22:0/165179983 >> 172.21.15.22:0/165179983 conn(0x7f20e0071660 msgr2=0x7f20e0072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:03.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.884+0000 7f20e4bff700 1 -- 172.21.15.22:0/165179983 shutdown_connections 2023-07-11T00:30:03.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:03.884+0000 7f20e4bff700 1 -- 172.21.15.22:0/165179983 wait complete. 2023-07-11T00:30:03.891 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-07-11T00:30:03.909 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-07-11T00:30:04.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.119+0000 7f7f2fdff700 1 Processor -- start 2023-07-11T00:30:04.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.119+0000 7f7f2fdff700 1 -- start start 2023-07-11T00:30:04.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.120+0000 7f7f2fdff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7f280cfc60 0x7f7f28167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:04.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.120+0000 7f7f2fdff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f280d0b20 con 0x7f7f280b8430 2023-07-11T00:30:04.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.120+0000 7f7f2fdff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f280b4ee0 con 0x7f7f280d3730 2023-07-11T00:30:04.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.120+0000 7f7f2fdff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f280cda30 con 0x7f7f280cfc60 2023-07-11T00:30:04.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.120+0000 7f7f2db9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7f280b8430 0x7f7f280cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48090/0 (socket says 172.21.15.22:48090) 2023-07-11T00:30:04.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.120+0000 7f7f2db9b700 1 -- 172.21.15.22:0/1493884570 learned_addr learned my addr 172.21.15.22:0/1493884570 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:04.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.121+0000 7f7f2e39c700 1 --2- 172.21.15.22:0/1493884570 >> v2:172.21.15.184:3300/0 conn(0x7f7f280cfc60 0x7f7f28167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:04.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.121+0000 7f7f2cb99700 1 -- 172.21.15.22:0/1493884570 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170165534 0 0) 0x7f7f280d0b20 con 0x7f7f280b8430 2023-07-11T00:30:04.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.121+0000 7f7f2cb99700 1 -- 172.21.15.22:0/1493884570 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f140035b0 con 0x7f7f280b8430 2023-07-11T00:30:04.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.121+0000 7f7f2cb99700 1 -- 172.21.15.22:0/1493884570 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840442958 0 0) 0x7f7f280b4ee0 con 0x7f7f280d3730 2023-07-11T00:30:04.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.121+0000 7f7f2cb99700 1 -- 172.21.15.22:0/1493884570 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f280d0b20 con 0x7f7f280d3730 2023-07-11T00:30:04.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.121+0000 7f7f2e39c700 1 -- 172.21.15.22:0/1493884570 >> v1:172.21.15.184:6789/0 conn(0x7f7f280d3730 legacy=0x7f7f280cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:04.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.121+0000 7f7f2e39c700 1 -- 172.21.15.22:0/1493884570 >> v1:172.21.15.22:6789/0 conn(0x7f7f280b8430 legacy=0x7f7f280cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:04.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.121+0000 7f7f2cb99700 1 -- 172.21.15.22:0/1493884570 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1658216040 0 0) 0x7f7f140035b0 con 0x7f7f280b8430 2023-07-11T00:30:04.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.121+0000 7f7f2e39c700 1 -- 172.21.15.22:0/1493884570 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f280b51c0 con 0x7f7f280cfc60 2023-07-11T00:30:04.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.121+0000 7f7f2e39c700 1 --2- 172.21.15.22:0/1493884570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f280cfc60 0x7f7f28167010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7f20009d90 tx=0x7f7f2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bd876bd5157b6ae server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:04.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.122+0000 7f7f2cb99700 1 -- 172.21.15.22:0/1493884570 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2000e070 con 0x7f7f280cfc60 2023-07-11T00:30:04.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.122+0000 7f7f2cb99700 1 -- 172.21.15.22:0/1493884570 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f20003a20 con 0x7f7f280cfc60 2023-07-11T00:30:04.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.122+0000 7f7f2cb99700 1 -- 172.21.15.22:0/1493884570 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24001670 con 0x7f7f280cfc60 2023-07-11T00:30:04.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.122+0000 7f7f2fdff700 1 -- 172.21.15.22:0/1493884570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f280cfc60 msgr2=0x7f7f28167010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:04.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.122+0000 7f7f2fdff700 1 --2- 172.21.15.22:0/1493884570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f280cfc60 0x7f7f28167010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7f20009d90 tx=0x7f7f2000b330 comp rx=0 tx=0).stop 2023-07-11T00:30:04.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.122+0000 7f7f2fdff700 1 -- 172.21.15.22:0/1493884570 shutdown_connections 2023-07-11T00:30:04.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.122+0000 7f7f2fdff700 1 --2- 172.21.15.22:0/1493884570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f280cfc60 0x7f7f28167010 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:04.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.122+0000 7f7f2fdff700 1 -- 172.21.15.22:0/1493884570 >> 172.21.15.22:0/1493884570 conn(0x7f7f2806b3f0 msgr2=0x7f7f2806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:04.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.122+0000 7f7f2fdff700 1 -- 172.21.15.22:0/1493884570 shutdown_connections 2023-07-11T00:30:04.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.123+0000 7f7f2fdff700 1 -- 172.21.15.22:0/1493884570 wait complete. 2023-07-11T00:30:04.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.124+0000 7f7f2fdff700 1 Processor -- start 2023-07-11T00:30:04.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.124+0000 7f7f2fdff700 1 -- start start 2023-07-11T00:30:04.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.125+0000 7f7f2fdff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f280b8430 0x7f7f28154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:04.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.125+0000 7f7f2fdff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f280cfc60 0x7f7f280b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:04.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.125+0000 7f7f2fdff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f280d3730 0x7f7f280b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:04.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.125+0000 7f7f2fdff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280c96d0 con 0x7f7f280cfc60 2023-07-11T00:30:04.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.125+0000 7f7f2fdff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f281f5e20 con 0x7f7f280d3730 2023-07-11T00:30:04.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.125+0000 7f7f2fdff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f281f5b40 con 0x7f7f280b8430 2023-07-11T00:30:04.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.126+0000 7f7f2db9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f280b8430 0x7f7f28154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:04.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.126+0000 7f7f2d39a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f280cfc60 0x7f7f280b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:04.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.126+0000 7f7f2db9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f280b8430 0x7f7f28154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:34116/0 (socket says 172.21.15.22:34116) 2023-07-11T00:30:04.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.126+0000 7f7f2db9b700 1 -- 172.21.15.22:0/78578088 learned_addr learned my addr 172.21.15.22:0/78578088 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:04.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.126+0000 7f7f2e39c700 1 --2- 172.21.15.22:0/78578088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f280d3730 0x7f7f280b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:04.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.126+0000 7f7f2db9b700 1 -- 172.21.15.22:0/78578088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f280d3730 msgr2=0x7f7f280b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:04.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.126+0000 7f7f2db9b700 1 --2- 172.21.15.22:0/78578088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f280d3730 0x7f7f280b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:04.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.126+0000 7f7f2db9b700 1 -- 172.21.15.22:0/78578088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f280cfc60 msgr2=0x7f7f280b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:04.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.126+0000 7f7f2db9b700 1 --2- 172.21.15.22:0/78578088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f280cfc60 0x7f7f280b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:04.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.126+0000 7f7f2db9b700 1 -- 172.21.15.22:0/78578088 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f20009a70 con 0x7f7f280b8430 2023-07-11T00:30:04.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.126+0000 7f7f2d39a700 1 --2- 172.21.15.22:0/78578088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f280cfc60 0x7f7f280b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:30:04.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.126+0000 7f7f2db9b700 1 --2- 172.21.15.22:0/78578088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f280b8430 0x7f7f28154d40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400c750 tx=0x7f7f2400ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:04.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.127+0000 7f7f1e7fc700 1 -- 172.21.15.22:0/78578088 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24004c80 con 0x7f7f280b8430 2023-07-11T00:30:04.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.127+0000 7f7f1e7fc700 1 -- 172.21.15.22:0/78578088 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f24004de0 con 0x7f7f280b8430 2023-07-11T00:30:04.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.127+0000 7f7f2fdff700 1 -- 172.21.15.22:0/78578088 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2815eb00 con 0x7f7f280b8430 2023-07-11T00:30:04.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.127+0000 7f7f1e7fc700 1 -- 172.21.15.22:0/78578088 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f240072d0 con 0x7f7f280b8430 2023-07-11T00:30:04.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.127+0000 7f7f2fdff700 1 -- 172.21.15.22:0/78578088 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2815f0c0 con 0x7f7f280b8430 2023-07-11T00:30:04.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.128+0000 7f7f2fdff700 1 -- 172.21.15.22:0/78578088 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2804ea60 con 0x7f7f280b8430 2023-07-11T00:30:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.129+0000 7f7f1e7fc700 1 -- 172.21.15.22:0/78578088 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f24007430 con 0x7f7f280b8430 2023-07-11T00:30:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.130+0000 7f7f1e7fc700 1 --2- 172.21.15.22:0/78578088 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7f0c06ace0 0x7f7f0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.130+0000 7f7f1e7fc700 1 -- 172.21.15.22:0/78578088 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f7f240894c0 con 0x7f7f280b8430 2023-07-11T00:30:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.130+0000 7f7f2d39a700 1 --2- 172.21.15.22:0/78578088 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7f0c06ace0 0x7f7f0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.131+0000 7f7f2d39a700 1 --2- 172.21.15.22:0/78578088 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7f0c06ace0 0x7f7f0c06d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f2815b680 tx=0x7f7f18009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:04.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.133+0000 7f7f1e7fc700 1 -- 172.21.15.22:0/78578088 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7f24058250 con 0x7f7f280b8430 2023-07-11T00:30:04.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.341+0000 7f7f2fdff700 1 -- 172.21.15.22:0/78578088 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f7f280729d0 con 0x7f7f280b8430 2023-07-11T00:30:04.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.887+0000 7f7f1e7fc700 1 -- 172.21.15.22:0/78578088 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f7f24057de0 con 0x7f7f280b8430 2023-07-11T00:30:04.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.894+0000 7f7f2fdff700 1 -- 172.21.15.22:0/78578088 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7f0c06ace0 msgr2=0x7f7f0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:04.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.894+0000 7f7f2fdff700 1 --2- 172.21.15.22:0/78578088 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7f0c06ace0 0x7f7f0c06d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f2815b680 tx=0x7f7f18009040 comp rx=0 tx=0).stop 2023-07-11T00:30:04.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.894+0000 7f7f2fdff700 1 -- 172.21.15.22:0/78578088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f280b8430 msgr2=0x7f7f28154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:04.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.894+0000 7f7f2fdff700 1 --2- 172.21.15.22:0/78578088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f280b8430 0x7f7f28154d40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400c750 tx=0x7f7f2400ca60 comp rx=0 tx=0).stop 2023-07-11T00:30:04.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.896+0000 7f7f2fdff700 1 -- 172.21.15.22:0/78578088 shutdown_connections 2023-07-11T00:30:04.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.896+0000 7f7f2fdff700 1 --2- 172.21.15.22:0/78578088 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7f0c06ace0 0x7f7f0c06d190 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f2815b680 tx=0x7f7f18009040 comp rx=0 tx=0).stop 2023-07-11T00:30:04.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.896+0000 7f7f2fdff700 1 --2- 172.21.15.22:0/78578088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f280b8430 0x7f7f28154d40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:04.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.896+0000 7f7f2fdff700 1 --2- 172.21.15.22:0/78578088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f280d3730 0x7f7f280b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:04.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.896+0000 7f7f2fdff700 1 --2- 172.21.15.22:0/78578088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f280cfc60 0x7f7f280b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:04.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.896+0000 7f7f2fdff700 1 -- 172.21.15.22:0/78578088 >> 172.21.15.22:0/78578088 conn(0x7f7f2806b3f0 msgr2=0x7f7f280cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:04.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.904+0000 7f7f2fdff700 1 -- 172.21.15.22:0/78578088 shutdown_connections 2023-07-11T00:30:04.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:04.906+0000 7f7f2fdff700 1 -- 172.21.15.22:0/78578088 wait complete. 2023-07-11T00:30:04.916 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-07-11T00:30:04.934 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-11T00:30:05.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.138+0000 7fa0523ff700 1 Processor -- start 2023-07-11T00:30:05.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.138+0000 7fa0523ff700 1 -- start start 2023-07-11T00:30:05.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.139+0000 7fa0523ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa04c0b8430 0x7fa04c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:05.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.139+0000 7fa0523ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa04c0d3730 0x7fa04c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:05.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.139+0000 7fa0523ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c0d0b20 con 0x7fa04c0cfa90 2023-07-11T00:30:05.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.139+0000 7fa0523ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04c0b8800 con 0x7fa04c0d3730 2023-07-11T00:30:05.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.139+0000 7fa0523ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04c0cfe90 con 0x7fa04c0b8430 2023-07-11T00:30:05.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.140+0000 7fa04b7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa04c0d3730 0x7fa04c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:05.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.140+0000 7fa05099c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa04c0cfa90 0x7fa04c15feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48106/0 (socket says 172.21.15.22:48106) 2023-07-11T00:30:05.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.140+0000 7fa05099c700 1 -- 172.21.15.22:0/1102034768 learned_addr learned my addr 172.21.15.22:0/1102034768 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:05.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.140+0000 7fa04bfff700 1 --2- 172.21.15.22:0/1102034768 >> v2:172.21.15.184:3300/0 conn(0x7fa04c0b8430 0x7fa04c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:05.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.140+0000 7fa04affd700 1 -- 172.21.15.22:0/1102034768 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248719995 0 0) 0x7fa04c0d0b20 con 0x7fa04c0cfa90 2023-07-11T00:30:05.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.140+0000 7fa04affd700 1 -- 172.21.15.22:0/1102034768 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0340035b0 con 0x7fa04c0cfa90 2023-07-11T00:30:05.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.140+0000 7fa04b7fe700 1 -- 172.21.15.22:0/1102034768 >> v2:172.21.15.184:3300/0 conn(0x7fa04c0b8430 msgr2=0x7fa04c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:05.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.140+0000 7fa04b7fe700 1 --2- 172.21.15.22:0/1102034768 >> v2:172.21.15.184:3300/0 conn(0x7fa04c0b8430 0x7fa04c0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:05.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.140+0000 7fa04b7fe700 1 -- 172.21.15.22:0/1102034768 >> v1:172.21.15.22:6789/0 conn(0x7fa04c0cfa90 legacy=0x7fa04c15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:05.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.140+0000 7fa04b7fe700 1 -- 172.21.15.22:0/1102034768 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c0b4ee0 con 0x7fa04c0d3730 2023-07-11T00:30:05.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.140+0000 7fa04b7fe700 1 --2- 172.21.15.22:0/1102034768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa04c0d3730 0x7fa04c0cf550 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa04c0cf520 tx=0x7fa040009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ca61f530a1adfe server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:05.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.141+0000 7fa04affd700 1 -- 172.21.15.22:0/1102034768 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040011830 con 0x7fa04c0d3730 2023-07-11T00:30:05.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.141+0000 7fa04affd700 1 -- 172.21.15.22:0/1102034768 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa040011990 con 0x7fa04c0d3730 2023-07-11T00:30:05.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.141+0000 7fa04affd700 1 -- 172.21.15.22:0/1102034768 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040011d20 con 0x7fa04c0d3730 2023-07-11T00:30:05.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.141+0000 7fa0523ff700 1 -- 172.21.15.22:0/1102034768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa04c0d3730 msgr2=0x7fa04c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:05.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.141+0000 7fa0523ff700 1 --2- 172.21.15.22:0/1102034768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa04c0d3730 0x7fa04c0cf550 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa04c0cf520 tx=0x7fa040009b20 comp rx=0 tx=0).stop 2023-07-11T00:30:05.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.141+0000 7fa0523ff700 1 -- 172.21.15.22:0/1102034768 shutdown_connections 2023-07-11T00:30:05.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.141+0000 7fa0523ff700 1 --2- 172.21.15.22:0/1102034768 >> v2:172.21.15.184:3300/0 conn(0x7fa04c0b8430 0x7fa04c0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:05.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.141+0000 7fa0523ff700 1 --2- 172.21.15.22:0/1102034768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa04c0d3730 0x7fa04c0cf550 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:05.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.141+0000 7fa0523ff700 1 -- 172.21.15.22:0/1102034768 >> 172.21.15.22:0/1102034768 conn(0x7fa04c06b3f0 msgr2=0x7fa04c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:05.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.141+0000 7fa0523ff700 1 -- 172.21.15.22:0/1102034768 shutdown_connections 2023-07-11T00:30:05.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.141+0000 7fa0523ff700 1 -- 172.21.15.22:0/1102034768 wait complete. 2023-07-11T00:30:05.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.143+0000 7fa0523ff700 1 Processor -- start 2023-07-11T00:30:05.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.143+0000 7fa0523ff700 1 -- start start 2023-07-11T00:30:05.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.144+0000 7fa0523ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa04c0b8430 0x7fa04c154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:05.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.144+0000 7fa0523ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa04c0cfa90 0x7fa04c0c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:05.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.144+0000 7fa0523ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa04c0d3730 0x7fa04c0b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:05.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.144+0000 7fa0523ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c1f5110 con 0x7fa04c0d3730 2023-07-11T00:30:05.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.144+0000 7fa0523ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c1f5360 con 0x7fa04c0b8430 2023-07-11T00:30:05.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.144+0000 7fa0523ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c1f5640 con 0x7fa04c0cfa90 2023-07-11T00:30:05.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.145+0000 7fa05099c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa04c0d3730 0x7fa04c0b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:05.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.145+0000 7fa04bfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa04c0b8430 0x7fa04c154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:05.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.145+0000 7fa04bfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa04c0b8430 0x7fa04c154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:54436/0 (socket says 172.21.15.22:54436) 2023-07-11T00:30:05.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.145+0000 7fa04bfff700 1 -- 172.21.15.22:0/1311444352 learned_addr learned my addr 172.21.15.22:0/1311444352 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:05.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.145+0000 7fa04b7fe700 1 --2- 172.21.15.22:0/1311444352 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa04c0cfa90 0x7fa04c0c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:05.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.145+0000 7fa05099c700 1 -- 172.21.15.22:0/1311444352 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa04c0cfa90 msgr2=0x7fa04c0c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:05.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.145+0000 7fa05099c700 1 --2- 172.21.15.22:0/1311444352 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa04c0cfa90 0x7fa04c0c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:05.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.145+0000 7fa05099c700 1 -- 172.21.15.22:0/1311444352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa04c0b8430 msgr2=0x7fa04c154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:05.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.145+0000 7fa05099c700 1 --2- 172.21.15.22:0/1311444352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa04c0b8430 0x7fa04c154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:05.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.145+0000 7fa05099c700 1 -- 172.21.15.22:0/1311444352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0400094a0 con 0x7fa04c0d3730 2023-07-11T00:30:05.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.145+0000 7fa04bfff700 1 --2- 172.21.15.22:0/1311444352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa04c0b8430 0x7fa04c154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:30:05.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.145+0000 7fa05099c700 1 --2- 172.21.15.22:0/1311444352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa04c0d3730 0x7fa04c0b36e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa04400ca80 tx=0x7fa04400cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:05.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.146+0000 7fa048ff9700 1 -- 172.21.15.22:0/1311444352 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04400a9e0 con 0x7fa04c0d3730 2023-07-11T00:30:05.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.146+0000 7fa048ff9700 1 -- 172.21.15.22:0/1311444352 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04400ab40 con 0x7fa04c0d3730 2023-07-11T00:30:05.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.146+0000 7fa048ff9700 1 -- 172.21.15.22:0/1311444352 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044012400 con 0x7fa04c0d3730 2023-07-11T00:30:05.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.146+0000 7fa0523ff700 1 -- 172.21.15.22:0/1311444352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04c1f5920 con 0x7fa04c0d3730 2023-07-11T00:30:05.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.146+0000 7fa0523ff700 1 -- 172.21.15.22:0/1311444352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04c1f5ee0 con 0x7fa04c0d3730 2023-07-11T00:30:05.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.147+0000 7fa0523ff700 1 -- 172.21.15.22:0/1311444352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04c04ea60 con 0x7fa04c0d3730 2023-07-11T00:30:05.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.148+0000 7fa048ff9700 1 -- 172.21.15.22:0/1311444352 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa04401b3b0 con 0x7fa04c0d3730 2023-07-11T00:30:05.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.149+0000 7fa048ff9700 1 --2- 172.21.15.22:0/1311444352 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa03806ace0 0x7fa03806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:05.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.149+0000 7fa048ff9700 1 -- 172.21.15.22:0/1311444352 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fa044088f10 con 0x7fa04c0d3730 2023-07-11T00:30:05.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.149+0000 7fa04bfff700 1 --2- 172.21.15.22:0/1311444352 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa03806ace0 0x7fa03806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:05.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.150+0000 7fa04bfff700 1 --2- 172.21.15.22:0/1311444352 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa03806ace0 0x7fa03806d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa04c15b180 tx=0x7fa03c009210 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:05.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.154+0000 7fa048ff9700 1 -- 172.21.15.22:0/1311444352 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa044054030 con 0x7fa04c0d3730 2023-07-11T00:30:05.263 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:30:05.269 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:30:05.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:05.407+0000 7fa0523ff700 1 -- 172.21.15.22:0/1311444352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa04c0cf110 con 0x7fa04c0d3730 2023-07-11T00:30:06.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.022+0000 7fa048ff9700 1 -- 172.21.15.22:0/1311444352 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa04405be60 con 0x7fa04c0d3730 2023-07-11T00:30:06.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.025+0000 7fa0523ff700 1 -- 172.21.15.22:0/1311444352 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa03806ace0 msgr2=0x7fa03806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:06.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.025+0000 7fa0523ff700 1 --2- 172.21.15.22:0/1311444352 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa03806ace0 0x7fa03806d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa04c15b180 tx=0x7fa03c009210 comp rx=0 tx=0).stop 2023-07-11T00:30:06.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.025+0000 7fa0523ff700 1 -- 172.21.15.22:0/1311444352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa04c0d3730 msgr2=0x7fa04c0b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:06.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.025+0000 7fa0523ff700 1 --2- 172.21.15.22:0/1311444352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa04c0d3730 0x7fa04c0b36e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa04400ca80 tx=0x7fa04400cd90 comp rx=0 tx=0).stop 2023-07-11T00:30:06.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.025+0000 7fa0523ff700 1 -- 172.21.15.22:0/1311444352 shutdown_connections 2023-07-11T00:30:06.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.025+0000 7fa0523ff700 1 --2- 172.21.15.22:0/1311444352 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa03806ace0 0x7fa03806d190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:06.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.025+0000 7fa0523ff700 1 --2- 172.21.15.22:0/1311444352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa04c0d3730 0x7fa04c0b36e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:06.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.025+0000 7fa0523ff700 1 --2- 172.21.15.22:0/1311444352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa04c0b8430 0x7fa04c154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:06.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.025+0000 7fa0523ff700 1 --2- 172.21.15.22:0/1311444352 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa04c0cfa90 0x7fa04c0c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:06.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.025+0000 7fa0523ff700 1 -- 172.21.15.22:0/1311444352 >> 172.21.15.22:0/1311444352 conn(0x7fa04c06b3f0 msgr2=0x7fa04c0b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:06.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.025+0000 7fa0523ff700 1 -- 172.21.15.22:0/1311444352 shutdown_connections 2023-07-11T00:30:06.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.025+0000 7fa0523ff700 1 -- 172.21.15.22:0/1311444352 wait complete. 2023-07-11T00:30:06.030 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 3 and data pool 4 2023-07-11T00:30:06.051 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-07-11T00:30:06.051 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-07-11T00:30:06.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.302+0000 7f04e5fff700 1 Processor -- start 2023-07-11T00:30:06.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.302+0000 7f04e5fff700 1 -- start start 2023-07-11T00:30:06.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.303+0000 7f04e5fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f04e00b82c0 0x7f04e0160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:06.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.303+0000 7f04e5fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f04e00b1f00 0x7f04e00ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:06.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.303+0000 7f04e5fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04e00cf4d0 0x7f04e00cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:06.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.303+0000 7f04e5fff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e00b8690 con 0x7f04e00b82c0 2023-07-11T00:30:06.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.303+0000 7f04e5fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e0160db0 con 0x7f04e00b1f00 2023-07-11T00:30:06.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.303+0000 7f04e5fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e00cfe90 con 0x7f04e00cf4d0 2023-07-11T00:30:06.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.303+0000 7f04df7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f04e00b82c0 0x7f04e0160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:06.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.303+0000 7f04df7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f04e00b82c0 0x7f04e0160870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41560/0 (socket says 172.21.15.22:41560) 2023-07-11T00:30:06.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.303+0000 7f04df7fe700 1 -- 172.21.15.22:0/2818468164 learned_addr learned my addr 172.21.15.22:0/2818468164 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:06.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.304+0000 7f04dffff700 1 --2- 172.21.15.22:0/2818468164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04e00cf4d0 0x7f04e00cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:06.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.304+0000 7f04deffd700 1 --2- 172.21.15.22:0/2818468164 >> v2:172.21.15.184:3300/0 conn(0x7f04e00b1f00 0x7f04e00ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:06.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.304+0000 7f04df7fe700 1 -- 172.21.15.22:0/2818468164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04e00cf4d0 msgr2=0x7f04e00cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:06.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.304+0000 7f04df7fe700 1 --2- 172.21.15.22:0/2818468164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04e00cf4d0 0x7f04e00cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:06.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.304+0000 7f04df7fe700 1 -- 172.21.15.22:0/2818468164 >> v2:172.21.15.184:3300/0 conn(0x7f04e00b1f00 msgr2=0x7f04e00ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.304+0000 7f04df7fe700 1 --2- 172.21.15.22:0/2818468164 >> v2:172.21.15.184:3300/0 conn(0x7f04e00b1f00 0x7f04e00ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.304+0000 7f04df7fe700 1 -- 172.21.15.22:0/2818468164 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e015fe20 con 0x7f04e00b82c0 2023-07-11T00:30:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.304+0000 7f04df7fe700 1 --2- 172.21.15.22:0/2818468164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04e00b82c0 0x7f04e0160870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f04e00d29a0 tx=0x7f04d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5c1ea7e2518350 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.304+0000 7f04de7fc700 1 -- 172.21.15.22:0/2818468164 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d000b870 con 0x7f04e00b82c0 2023-07-11T00:30:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.304+0000 7f04de7fc700 1 -- 172.21.15.22:0/2818468164 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d000b9d0 con 0x7f04e00b82c0 2023-07-11T00:30:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.304+0000 7f04de7fc700 1 -- 172.21.15.22:0/2818468164 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d000bd60 con 0x7f04e00b82c0 2023-07-11T00:30:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.305+0000 7f04e5fff700 1 -- 172.21.15.22:0/2818468164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04e00b82c0 msgr2=0x7f04e0160870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.305+0000 7f04e5fff700 1 --2- 172.21.15.22:0/2818468164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04e00b82c0 0x7f04e0160870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f04e00d29a0 tx=0x7f04d0009bd0 comp rx=0 tx=0).stop 2023-07-11T00:30:06.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.305+0000 7f04e5fff700 1 -- 172.21.15.22:0/2818468164 shutdown_connections 2023-07-11T00:30:06.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.305+0000 7f04e5fff700 1 --2- 172.21.15.22:0/2818468164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04e00cf4d0 0x7f04e00cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:06.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.305+0000 7f04e5fff700 1 --2- 172.21.15.22:0/2818468164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04e00b82c0 0x7f04e0160870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:06.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.305+0000 7f04e5fff700 1 --2- 172.21.15.22:0/2818468164 >> v2:172.21.15.184:3300/0 conn(0x7f04e00b1f00 0x7f04e00ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:06.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.305+0000 7f04e5fff700 1 -- 172.21.15.22:0/2818468164 >> 172.21.15.22:0/2818468164 conn(0x7f04e0071660 msgr2=0x7f04e0071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:06.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.305+0000 7f04e5fff700 1 -- 172.21.15.22:0/2818468164 shutdown_connections 2023-07-11T00:30:06.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.305+0000 7f04e5fff700 1 -- 172.21.15.22:0/2818468164 wait complete. 2023-07-11T00:30:06.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.307+0000 7f04e5fff700 1 Processor -- start 2023-07-11T00:30:06.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.307+0000 7f04e5fff700 1 -- start start 2023-07-11T00:30:06.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.308+0000 7f04e5fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04e00b1f00 0x7f04e00c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:06.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.308+0000 7f04e5fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04e00b82c0 0x7f04e015a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:06.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.308+0000 7f04e5fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04e00cf4d0 0x7f04e015add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:06.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.308+0000 7f04e5fff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e01f60b0 con 0x7f04e00b82c0 2023-07-11T00:30:06.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.308+0000 7f04e5fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e00cc9d0 con 0x7f04e00cf4d0 2023-07-11T00:30:06.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.308+0000 7f04e5fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e00c9400 con 0x7f04e00b1f00 2023-07-11T00:30:06.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.308+0000 7f04deffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04e00b82c0 0x7f04e015a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:06.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.308+0000 7f04deffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04e00b82c0 0x7f04e015a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41568/0 (socket says 172.21.15.22:41568) 2023-07-11T00:30:06.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.308+0000 7f04deffd700 1 -- 172.21.15.22:0/3959971036 learned_addr learned my addr 172.21.15.22:0/3959971036 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:06.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.308+0000 7f04df7fe700 1 --2- 172.21.15.22:0/3959971036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04e00b1f00 0x7f04e00c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:06.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.308+0000 7f04dffff700 1 --2- 172.21.15.22:0/3959971036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04e00cf4d0 0x7f04e015add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:06.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.308+0000 7f04deffd700 1 -- 172.21.15.22:0/3959971036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04e00b1f00 msgr2=0x7f04e00c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:06.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.308+0000 7f04deffd700 1 --2- 172.21.15.22:0/3959971036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04e00b1f00 0x7f04e00c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:06.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.308+0000 7f04deffd700 1 -- 172.21.15.22:0/3959971036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04e00cf4d0 msgr2=0x7f04e015add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:06.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.308+0000 7f04deffd700 1 --2- 172.21.15.22:0/3959971036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04e00cf4d0 0x7f04e015add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:06.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.309+0000 7f04deffd700 1 -- 172.21.15.22:0/3959971036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d0009550 con 0x7f04e00b82c0 2023-07-11T00:30:06.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.309+0000 7f04dffff700 1 --2- 172.21.15.22:0/3959971036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04e00cf4d0 0x7f04e015add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:06.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.309+0000 7f04deffd700 1 --2- 172.21.15.22:0/3959971036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04e00b82c0 0x7f04e015a890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f04d400d830 tx=0x7f04d400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:06.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.309+0000 7f04c7fff700 1 -- 172.21.15.22:0/3959971036 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d40125f0 con 0x7f04e00b82c0 2023-07-11T00:30:06.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.309+0000 7f04c7fff700 1 -- 172.21.15.22:0/3959971036 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d4012750 con 0x7f04e00b82c0 2023-07-11T00:30:06.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.309+0000 7f04c7fff700 1 -- 172.21.15.22:0/3959971036 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4012ae0 con 0x7f04e00b82c0 2023-07-11T00:30:06.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.309+0000 7f04e5fff700 1 -- 172.21.15.22:0/3959971036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e01f5dd0 con 0x7f04e00b82c0 2023-07-11T00:30:06.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.309+0000 7f04e5fff700 1 -- 172.21.15.22:0/3959971036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e01f2080 con 0x7f04e00b82c0 2023-07-11T00:30:06.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.310+0000 7f04e5fff700 1 -- 172.21.15.22:0/3959971036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e01f1c00 con 0x7f04e00b82c0 2023-07-11T00:30:06.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.311+0000 7f04c7fff700 1 -- 172.21.15.22:0/3959971036 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f04d4012c40 con 0x7f04e00b82c0 2023-07-11T00:30:06.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.312+0000 7f04c7fff700 1 --2- 172.21.15.22:0/3959971036 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f04cc06ace0 0x7f04cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:06.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.312+0000 7f04c7fff700 1 -- 172.21.15.22:0/3959971036 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f04d4089660 con 0x7f04e00b82c0 2023-07-11T00:30:06.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.312+0000 7f04df7fe700 1 --2- 172.21.15.22:0/3959971036 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f04cc06ace0 0x7f04cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:06.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.313+0000 7f04df7fe700 1 --2- 172.21.15.22:0/3959971036 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f04cc06ace0 0x7f04cc06d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f04d0014040 tx=0x7f04d0008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:06.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.316+0000 7f04c7fff700 1 -- 172.21.15.22:0/3959971036 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f04e01f1c00 con 0x7f04e00b82c0 2023-07-11T00:30:06.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.532+0000 7f04e5fff700 1 -- 172.21.15.22:0/3959971036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f04e01f1c00 con 0x7f04e00b82c0 2023-07-11T00:30:06.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.893+0000 7f04c7fff700 1 -- 172.21.15.22:0/3959971036 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f04e01f1c00 con 0x7f04e00b82c0 2023-07-11T00:30:06.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.896+0000 7f04e5fff700 1 -- 172.21.15.22:0/3959971036 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f04cc06ace0 msgr2=0x7f04cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:06.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.896+0000 7f04e5fff700 1 --2- 172.21.15.22:0/3959971036 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f04cc06ace0 0x7f04cc06d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f04d0014040 tx=0x7f04d0008030 comp rx=0 tx=0).stop 2023-07-11T00:30:06.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.896+0000 7f04e5fff700 1 -- 172.21.15.22:0/3959971036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04e00b82c0 msgr2=0x7f04e015a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:06.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.896+0000 7f04e5fff700 1 --2- 172.21.15.22:0/3959971036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04e00b82c0 0x7f04e015a890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f04d400d830 tx=0x7f04d400db40 comp rx=0 tx=0).stop 2023-07-11T00:30:06.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.896+0000 7f04e5fff700 1 -- 172.21.15.22:0/3959971036 shutdown_connections 2023-07-11T00:30:06.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.896+0000 7f04e5fff700 1 --2- 172.21.15.22:0/3959971036 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f04cc06ace0 0x7f04cc06d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:06.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.896+0000 7f04e5fff700 1 --2- 172.21.15.22:0/3959971036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04e00b1f00 0x7f04e00c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:06.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.896+0000 7f04e5fff700 1 --2- 172.21.15.22:0/3959971036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04e00cf4d0 0x7f04e015add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:06.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.896+0000 7f04e5fff700 1 --2- 172.21.15.22:0/3959971036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04e00b82c0 0x7f04e015a890 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:06.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.896+0000 7f04e5fff700 1 -- 172.21.15.22:0/3959971036 >> 172.21.15.22:0/3959971036 conn(0x7f04e0071660 msgr2=0x7f04e00b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:06.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.897+0000 7f04e5fff700 1 -- 172.21.15.22:0/3959971036 shutdown_connections 2023-07-11T00:30:06.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:06.897+0000 7f04e5fff700 1 -- 172.21.15.22:0/3959971036 wait complete. 2023-07-11T00:30:06.919 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-07-11T00:30:07.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.138+0000 7fe1bdbff700 1 Processor -- start 2023-07-11T00:30:07.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.138+0000 7fe1bdbff700 1 -- start start 2023-07-11T00:30:07.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.139+0000 7fe1bdbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1b815d380 0x7fe1b80cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:07.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.139+0000 7fe1bdbff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b80cdad0 con 0x7fe1b815c350 2023-07-11T00:30:07.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.139+0000 7fe1bdbff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b815d7f0 con 0x7fe1b80d3150 2023-07-11T00:30:07.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.139+0000 7fe1bdbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b80cf470 con 0x7fe1b815d380 2023-07-11T00:30:07.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.139+0000 7fe1b77fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe1b815c350 0x7fe1b80d07d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48114/0 (socket says 172.21.15.22:48114) 2023-07-11T00:30:07.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.139+0000 7fe1b77fe700 1 -- 172.21.15.22:0/217514290 learned_addr learned my addr 172.21.15.22:0/217514290 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:07.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.139+0000 7fe1b6ffd700 1 --2- 172.21.15.22:0/217514290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1b815d380 0x7fe1b80cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:07.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b67fc700 1 -- 172.21.15.22:0/217514290 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656808226 0 0) 0x7fe1b80cdad0 con 0x7fe1b815c350 2023-07-11T00:30:07.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b67fc700 1 -- 172.21.15.22:0/217514290 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1a00035b0 con 0x7fe1b815c350 2023-07-11T00:30:07.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b67fc700 1 -- 172.21.15.22:0/217514290 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322399021 0 0) 0x7fe1b815d7f0 con 0x7fe1b80d3150 2023-07-11T00:30:07.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b67fc700 1 -- 172.21.15.22:0/217514290 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1b80cdad0 con 0x7fe1b80d3150 2023-07-11T00:30:07.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b67fc700 1 -- 172.21.15.22:0/217514290 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3362379083 0 0) 0x7fe1a00035b0 con 0x7fe1b815c350 2023-07-11T00:30:07.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b67fc700 1 -- 172.21.15.22:0/217514290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1b815d380 msgr2=0x7fe1b80cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:07.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b67fc700 1 --2- 172.21.15.22:0/217514290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1b815d380 0x7fe1b80cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:07.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b67fc700 1 -- 172.21.15.22:0/217514290 >> v1:172.21.15.184:6789/0 conn(0x7fe1b80d3150 legacy=0x7fe1b80cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:07.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b67fc700 1 -- 172.21.15.22:0/217514290 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b80cd250 con 0x7fe1b815c350 2023-07-11T00:30:07.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b67fc700 1 -- 172.21.15.22:0/217514290 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7fe1a8001670 con 0x7fe1b815c350 2023-07-11T00:30:07.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b67fc700 1 -- 172.21.15.22:0/217514290 >> v1:172.21.15.22:6789/0 conn(0x7fe1b815c350 legacy=0x7fe1b80d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:07.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b67fc700 1 --2- 172.21.15.22:0/217514290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1a0003bc0 0x7fe1a0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:07.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b67fc700 1 --2- 172.21.15.22:0/217514290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1a0004850 0x7fe1a0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:07.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b67fc700 1 --2- 172.21.15.22:0/217514290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1a0005200 0x7fe1a000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b67fc700 1 -- 172.21.15.22:0/217514290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b80cf470 con 0x7fe1a0004850 2023-07-11T00:30:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b67fc700 1 -- 172.21.15.22:0/217514290 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a000c100 con 0x7fe1a0003bc0 2023-07-11T00:30:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b67fc700 1 -- 172.21.15.22:0/217514290 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a000c2c0 con 0x7fe1a0005200 2023-07-11T00:30:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.140+0000 7fe1b6ffd700 1 --2- 172.21.15.22:0/217514290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1b815d380 0x7fe1b80cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:30:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.141+0000 7fe1b77fe700 1 --2- 172.21.15.22:0/217514290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1a0003bc0 0x7fe1a0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.141+0000 7fe1b7fff700 1 --2- 172.21.15.22:0/217514290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1a0005200 0x7fe1a000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.141+0000 7fe1b6ffd700 1 --2- 172.21.15.22:0/217514290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1a0004850 0x7fe1a0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.141+0000 7fe1b7fff700 1 -- 172.21.15.22:0/217514290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1a0003bc0 msgr2=0x7fe1a0003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:07.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.141+0000 7fe1b7fff700 1 --2- 172.21.15.22:0/217514290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1a0003bc0 0x7fe1a0003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:07.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.141+0000 7fe1b7fff700 1 -- 172.21.15.22:0/217514290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1a0004850 msgr2=0x7fe1a0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:07.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.141+0000 7fe1b7fff700 1 --2- 172.21.15.22:0/217514290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1a0004850 0x7fe1a0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:07.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.141+0000 7fe1b7fff700 1 -- 172.21.15.22:0/217514290 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a00035b0 con 0x7fe1a0005200 2023-07-11T00:30:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.141+0000 7fe1b6ffd700 1 --2- 172.21.15.22:0/217514290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1a0004850 0x7fe1a0004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:30:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.141+0000 7fe1b7fff700 1 --2- 172.21.15.22:0/217514290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1a0005200 0x7fe1a000ba10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000c2f0 tx=0x7fe1a0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7cc4ccc8c5e9884 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.142+0000 7fe1b67fc700 1 -- 172.21.15.22:0/217514290 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0001f30 con 0x7fe1a0005200 2023-07-11T00:30:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.142+0000 7fe1b67fc700 1 -- 172.21.15.22:0/217514290 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b000ce90 con 0x7fe1a0005200 2023-07-11T00:30:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.142+0000 7fe1b67fc700 1 -- 172.21.15.22:0/217514290 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0003c40 con 0x7fe1a0005200 2023-07-11T00:30:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.142+0000 7fe1bdbff700 1 -- 172.21.15.22:0/217514290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1a0005200 msgr2=0x7fe1a000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.142+0000 7fe1bdbff700 1 --2- 172.21.15.22:0/217514290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1a0005200 0x7fe1a000ba10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000c2f0 tx=0x7fe1a0005880 comp rx=0 tx=0).stop 2023-07-11T00:30:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.142+0000 7fe1b7fff700 1 -- 172.21.15.22:0/217514290 reap_dead start 2023-07-11T00:30:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.142+0000 7fe1bdbff700 1 -- 172.21.15.22:0/217514290 shutdown_connections 2023-07-11T00:30:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.142+0000 7fe1bdbff700 1 -- 172.21.15.22:0/217514290 >> 172.21.15.22:0/217514290 conn(0x7fe1b806b460 msgr2=0x7fe1b806b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.142+0000 7fe1bdbff700 1 -- 172.21.15.22:0/217514290 shutdown_connections 2023-07-11T00:30:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.142+0000 7fe1bdbff700 1 -- 172.21.15.22:0/217514290 wait complete. 2023-07-11T00:30:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.144+0000 7fe1bdbff700 1 Processor -- start 2023-07-11T00:30:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.144+0000 7fe1bdbff700 1 -- start start 2023-07-11T00:30:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.145+0000 7fe1bdbff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1a0005200 0x7fe1b80b7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.145+0000 7fe1bdbff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1b814aeb0 0x7fe1b814b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.145+0000 7fe1bdbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1b80b5db0 0x7fe1b80b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.145+0000 7fe1bdbff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b80c9f00 con 0x7fe1b814aeb0 2023-07-11T00:30:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.145+0000 7fe1bdbff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b814b860 con 0x7fe1a0005200 2023-07-11T00:30:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.145+0000 7fe1bdbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b80b6ae0 con 0x7fe1b80b5db0 2023-07-11T00:30:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.146+0000 7fe1b6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1b814aeb0 0x7fe1b814b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.146+0000 7fe1b6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1b814aeb0 0x7fe1b814b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41582/0 (socket says 172.21.15.22:41582) 2023-07-11T00:30:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.146+0000 7fe1b6ffd700 1 -- 172.21.15.22:0/3530123744 learned_addr learned my addr 172.21.15.22:0/3530123744 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.146+0000 7fe1b77fe700 1 --2- 172.21.15.22:0/3530123744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1a0005200 0x7fe1b80b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.146+0000 7fe1b7fff700 1 --2- 172.21.15.22:0/3530123744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1b80b5db0 0x7fe1b80b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.146+0000 7fe1b6ffd700 1 -- 172.21.15.22:0/3530123744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1b80b5db0 msgr2=0x7fe1b80b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.146+0000 7fe1b6ffd700 1 --2- 172.21.15.22:0/3530123744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1b80b5db0 0x7fe1b80b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.146+0000 7fe1b6ffd700 1 -- 172.21.15.22:0/3530123744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1a0005200 msgr2=0x7fe1b80b7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.146+0000 7fe1b6ffd700 1 --2- 172.21.15.22:0/3530123744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1a0005200 0x7fe1b80b7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.146+0000 7fe1b6ffd700 1 -- 172.21.15.22:0/3530123744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b80b6dc0 con 0x7fe1b814aeb0 2023-07-11T00:30:07.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.146+0000 7fe1b6ffd700 1 --2- 172.21.15.22:0/3530123744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1b814aeb0 0x7fe1b814b320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac011c40 tx=0x7fe1ac011f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:07.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.147+0000 7fe19ffff700 1 -- 172.21.15.22:0/3530123744 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac00fa60 con 0x7fe1b814aeb0 2023-07-11T00:30:07.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.147+0000 7fe19ffff700 1 -- 172.21.15.22:0/3530123744 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac00fbc0 con 0x7fe1b814aeb0 2023-07-11T00:30:07.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.147+0000 7fe19ffff700 1 -- 172.21.15.22:0/3530123744 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac014440 con 0x7fe1b814aeb0 2023-07-11T00:30:07.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.147+0000 7fe1bdbff700 1 -- 172.21.15.22:0/3530123744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b80b70a0 con 0x7fe1b814aeb0 2023-07-11T00:30:07.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.147+0000 7fe1bdbff700 1 -- 172.21.15.22:0/3530123744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b80b7dd0 con 0x7fe1b814aeb0 2023-07-11T00:30:07.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.148+0000 7fe1bdbff700 1 -- 172.21.15.22:0/3530123744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b80ca070 con 0x7fe1b814aeb0 2023-07-11T00:30:07.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.149+0000 7fe19ffff700 1 -- 172.21.15.22:0/3530123744 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe1ac0145a0 con 0x7fe1b814aeb0 2023-07-11T00:30:07.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.150+0000 7fe19ffff700 1 --2- 172.21.15.22:0/3530123744 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe1a406ace0 0x7fe1a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:07.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.150+0000 7fe19ffff700 1 -- 172.21.15.22:0/3530123744 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6288+0+0 (secure 0 0 0) 0x7fe1ac089f10 con 0x7fe1b814aeb0 2023-07-11T00:30:07.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.150+0000 7fe1b77fe700 1 --2- 172.21.15.22:0/3530123744 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe1a406ace0 0x7fe1a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:07.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.151+0000 7fe1b77fe700 1 --2- 172.21.15.22:0/3530123744 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe1a406ace0 0x7fe1a406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8001eb0 tx=0x7fe1a8000f80 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:07.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.154+0000 7fe19ffff700 1 -- 172.21.15.22:0/3530123744 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe1ac054e60 con 0x7fe1b814aeb0 2023-07-11T00:30:07.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:07.361+0000 7fe1bdbff700 1 -- 172.21.15.22:0/3530123744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe1b80b7290 con 0x7fe1b814aeb0 2023-07-11T00:30:09.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.038+0000 7fe19ffff700 1 -- 172.21.15.22:0/3530123744 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7fe1ac022100 con 0x7fe1b814aeb0 2023-07-11T00:30:09.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.044+0000 7fe1bdbff700 1 -- 172.21.15.22:0/3530123744 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe1a406ace0 msgr2=0x7fe1a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:09.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.044+0000 7fe1bdbff700 1 --2- 172.21.15.22:0/3530123744 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe1a406ace0 0x7fe1a406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8001eb0 tx=0x7fe1a8000f80 comp rx=0 tx=0).stop 2023-07-11T00:30:09.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.044+0000 7fe1bdbff700 1 -- 172.21.15.22:0/3530123744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1b814aeb0 msgr2=0x7fe1b814b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:09.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.044+0000 7fe1bdbff700 1 --2- 172.21.15.22:0/3530123744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1b814aeb0 0x7fe1b814b320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac011c40 tx=0x7fe1ac011f50 comp rx=0 tx=0).stop 2023-07-11T00:30:09.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.045+0000 7fe1bdbff700 1 -- 172.21.15.22:0/3530123744 shutdown_connections 2023-07-11T00:30:09.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.045+0000 7fe1bdbff700 1 --2- 172.21.15.22:0/3530123744 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe1a406ace0 0x7fe1a406d190 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8001eb0 tx=0x7fe1a8000f80 comp rx=0 tx=0).stop 2023-07-11T00:30:09.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.045+0000 7fe1bdbff700 1 --2- 172.21.15.22:0/3530123744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1b80b5db0 0x7fe1b80b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:09.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.045+0000 7fe1bdbff700 1 --2- 172.21.15.22:0/3530123744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1a0005200 0x7fe1b80b7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:09.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.045+0000 7fe1bdbff700 1 --2- 172.21.15.22:0/3530123744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1b814aeb0 0x7fe1b814b320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:09.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.045+0000 7fe1bdbff700 1 -- 172.21.15.22:0/3530123744 >> 172.21.15.22:0/3530123744 conn(0x7fe1b806b460 msgr2=0x7fe1b815f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:09.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.052+0000 7fe1bdbff700 1 -- 172.21.15.22:0/3530123744 shutdown_connections 2023-07-11T00:30:09.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.054+0000 7fe1bdbff700 1 -- 172.21.15.22:0/3530123744 wait complete. 2023-07-11T00:30:09.059 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data_ec' created 2023-07-11T00:30:09.077 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-07-11T00:30:09.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.284+0000 7f93ff1ff700 1 Processor -- start 2023-07-11T00:30:09.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.284+0000 7f93ff1ff700 1 -- start start 2023-07-11T00:30:09.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.285+0000 7f93ff1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f93f80b82c0 0x7f93f8160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:09.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.285+0000 7f93ff1ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f8160db0 con 0x7f93f80b1f00 2023-07-11T00:30:09.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.285+0000 7f93ff1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f815fe20 con 0x7f93f80cf4d0 2023-07-11T00:30:09.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.285+0000 7f93ff1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f80b8690 con 0x7f93f80b82c0 2023-07-11T00:30:09.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.285+0000 7f93f7fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f93f80b1f00 0x7f93f80ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48122/0 (socket says 172.21.15.22:48122) 2023-07-11T00:30:09.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.285+0000 7f93f7fff700 1 -- 172.21.15.22:0/3058752449 learned_addr learned my addr 172.21.15.22:0/3058752449 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:09.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.285+0000 7f93fcf9b700 1 --2- 172.21.15.22:0/3058752449 >> v2:172.21.15.184:3300/0 conn(0x7f93f80b82c0 0x7f93f8160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:09.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.286+0000 7f93f77fe700 1 -- 172.21.15.22:0/3058752449 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516757913 0 0) 0x7f93e4001110 con 0x7f93f80b1f00 2023-07-11T00:30:09.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.286+0000 7f93f77fe700 1 -- 172.21.15.22:0/3058752449 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93e80035b0 con 0x7f93f80b1f00 2023-07-11T00:30:09.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.286+0000 7f93f77fe700 1 -- 172.21.15.22:0/3058752449 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917310768 0 0) 0x7f93f815fe20 con 0x7f93f80cf4d0 2023-07-11T00:30:09.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.286+0000 7f93f77fe700 1 -- 172.21.15.22:0/3058752449 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93e4001110 con 0x7f93f80cf4d0 2023-07-11T00:30:09.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.286+0000 7f93f77fe700 1 -- 172.21.15.22:0/3058752449 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1105103874 0 0) 0x7f93e80035b0 con 0x7f93f80b1f00 2023-07-11T00:30:09.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.286+0000 7f93f77fe700 1 -- 172.21.15.22:0/3058752449 >> v2:172.21.15.184:3300/0 conn(0x7f93f80b82c0 msgr2=0x7f93f8160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:09.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.286+0000 7f93f77fe700 1 --2- 172.21.15.22:0/3058752449 >> v2:172.21.15.184:3300/0 conn(0x7f93f80b82c0 0x7f93f8160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:09.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.286+0000 7f93f77fe700 1 -- 172.21.15.22:0/3058752449 >> v1:172.21.15.184:6789/0 conn(0x7f93f80cf4d0 legacy=0x7f93f80cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:09.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.286+0000 7f93f77fe700 1 -- 172.21.15.22:0/3058752449 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f81603e0 con 0x7f93f80b1f00 2023-07-11T00:30:09.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.286+0000 7f93f77fe700 1 -- 172.21.15.22:0/3058752449 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7f93e4001800 con 0x7f93f80b1f00 2023-07-11T00:30:09.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.286+0000 7f93f77fe700 1 -- 172.21.15.22:0/3058752449 >> v1:172.21.15.22:6789/0 conn(0x7f93f80b1f00 legacy=0x7f93f80ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:09.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.286+0000 7f93f77fe700 1 --2- 172.21.15.22:0/3058752449 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93e8003b90 0x7f93e8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:09.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.286+0000 7f93f77fe700 1 --2- 172.21.15.22:0/3058752449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e8004850 0x7f93e8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:09.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.286+0000 7f93f77fe700 1 --2- 172.21.15.22:0/3058752449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93e8005200 0x7f93e800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:09.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.286+0000 7f93f77fe700 1 -- 172.21.15.22:0/3058752449 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f80b8690 con 0x7f93e8005200 2023-07-11T00:30:09.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.286+0000 7f93f77fe700 1 -- 172.21.15.22:0/3058752449 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e800c110 con 0x7f93e8004850 2023-07-11T00:30:09.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.286+0000 7f93f77fe700 1 -- 172.21.15.22:0/3058752449 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e800c2d0 con 0x7f93e8003b90 2023-07-11T00:30:09.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.287+0000 7f93f7fff700 1 --2- 172.21.15.22:0/3058752449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e8004850 0x7f93e8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:09.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.287+0000 7f93fd79c700 1 --2- 172.21.15.22:0/3058752449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93e8005200 0x7f93e800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:09.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.287+0000 7f93fcf9b700 1 --2- 172.21.15.22:0/3058752449 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93e8003b90 0x7f93e8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:09.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.287+0000 7f93fd79c700 1 -- 172.21.15.22:0/3058752449 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93e8003b90 msgr2=0x7f93e8003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:09.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.287+0000 7f93fd79c700 1 --2- 172.21.15.22:0/3058752449 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93e8003b90 0x7f93e8003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:09.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.287+0000 7f93fd79c700 1 -- 172.21.15.22:0/3058752449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e8004850 msgr2=0x7f93e8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:09.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.287+0000 7f93fd79c700 1 --2- 172.21.15.22:0/3058752449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e8004850 0x7f93e8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:09.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.287+0000 7f93fd79c700 1 -- 172.21.15.22:0/3058752449 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e80035b0 con 0x7f93e8005200 2023-07-11T00:30:09.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.287+0000 7f93fd79c700 1 -- 172.21.15.22:0/3058752449 reap_dead start 2023-07-11T00:30:09.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.287+0000 7f93fd79c700 1 --2- 172.21.15.22:0/3058752449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93e8005200 0x7f93e800ba10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f93f000c490 tx=0x7f93e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a452232707bdd404 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:09.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.287+0000 7f93f77fe700 1 -- 172.21.15.22:0/3058752449 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f0003a00 con 0x7f93e8005200 2023-07-11T00:30:09.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.287+0000 7f93f77fe700 1 -- 172.21.15.22:0/3058752449 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f0003b60 con 0x7f93e8005200 2023-07-11T00:30:09.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.287+0000 7f93f77fe700 1 -- 172.21.15.22:0/3058752449 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f00050d0 con 0x7f93e8005200 2023-07-11T00:30:09.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.288+0000 7f93ff1ff700 1 -- 172.21.15.22:0/3058752449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93e8005200 msgr2=0x7f93e800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:09.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.288+0000 7f93ff1ff700 1 --2- 172.21.15.22:0/3058752449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93e8005200 0x7f93e800ba10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f93f000c490 tx=0x7f93e8005880 comp rx=0 tx=0).stop 2023-07-11T00:30:09.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.288+0000 7f93ff1ff700 1 -- 172.21.15.22:0/3058752449 shutdown_connections 2023-07-11T00:30:09.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.288+0000 7f93ff1ff700 1 --2- 172.21.15.22:0/3058752449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93e8005200 0x7f93e800ba10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:09.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.288+0000 7f93ff1ff700 1 -- 172.21.15.22:0/3058752449 >> 172.21.15.22:0/3058752449 conn(0x7f93f8071660 msgr2=0x7f93f8071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:09.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.288+0000 7f93ff1ff700 1 -- 172.21.15.22:0/3058752449 shutdown_connections 2023-07-11T00:30:09.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.288+0000 7f93ff1ff700 1 -- 172.21.15.22:0/3058752449 wait complete. 2023-07-11T00:30:09.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.291+0000 7f93ff1ff700 1 Processor -- start 2023-07-11T00:30:09.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.291+0000 7f93ff1ff700 1 -- start start 2023-07-11T00:30:09.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.292+0000 7f93ff1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e8005200 0x7f93f815e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:09.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.292+0000 7f93ff1ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93f815c1b0 0x7f93f81f1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:09.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.292+0000 7f93ff1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93f81f4f10 0x7f93f81f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:09.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.292+0000 7f93ff1ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f81f58d0 con 0x7f93f815c1b0 2023-07-11T00:30:09.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.292+0000 7f93ff1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f815f5c0 con 0x7f93e8005200 2023-07-11T00:30:09.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.292+0000 7f93ff1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f815ed20 con 0x7f93f81f4f10 2023-07-11T00:30:09.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.292+0000 7f93f7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93f815c1b0 0x7f93f81f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:09.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.292+0000 7f93f7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93f815c1b0 0x7f93f81f1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41598/0 (socket says 172.21.15.22:41598) 2023-07-11T00:30:09.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.292+0000 7f93f7fff700 1 -- 172.21.15.22:0/3691676122 learned_addr learned my addr 172.21.15.22:0/3691676122 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:09.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.292+0000 7f93fcf9b700 1 --2- 172.21.15.22:0/3691676122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e8005200 0x7f93f815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:09.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.292+0000 7f93fd79c700 1 --2- 172.21.15.22:0/3691676122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93f81f4f10 0x7f93f81f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:09.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.293+0000 7f93f7fff700 1 -- 172.21.15.22:0/3691676122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93f81f4f10 msgr2=0x7f93f81f5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:09.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.293+0000 7f93f7fff700 1 --2- 172.21.15.22:0/3691676122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93f81f4f10 0x7f93f81f5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:09.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.293+0000 7f93f7fff700 1 -- 172.21.15.22:0/3691676122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e8005200 msgr2=0x7f93f815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:09.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.293+0000 7f93f7fff700 1 --2- 172.21.15.22:0/3691676122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e8005200 0x7f93f815e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:09.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.293+0000 7f93f7fff700 1 -- 172.21.15.22:0/3691676122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f815f000 con 0x7f93f815c1b0 2023-07-11T00:30:09.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.293+0000 7f93fd79c700 1 --2- 172.21.15.22:0/3691676122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93f81f4f10 0x7f93f81f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:09.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.293+0000 7f93f7fff700 1 --2- 172.21.15.22:0/3691676122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93f815c1b0 0x7f93f81f1130 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f93e4007320 tx=0x7f93e40076e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:09.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.293+0000 7f93f57fa700 1 -- 172.21.15.22:0/3691676122 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e4007ea0 con 0x7f93f815c1b0 2023-07-11T00:30:09.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.293+0000 7f93f57fa700 1 -- 172.21.15.22:0/3691676122 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e4007800 con 0x7f93f815c1b0 2023-07-11T00:30:09.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.293+0000 7f93ff1ff700 1 -- 172.21.15.22:0/3691676122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f815f2e0 con 0x7f93f815c1b0 2023-07-11T00:30:09.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.293+0000 7f93f57fa700 1 -- 172.21.15.22:0/3691676122 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e400fa90 con 0x7f93f815c1b0 2023-07-11T00:30:09.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.293+0000 7f93ff1ff700 1 -- 172.21.15.22:0/3691676122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f81f1670 con 0x7f93f815c1b0 2023-07-11T00:30:09.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.294+0000 7f93ff1ff700 1 -- 172.21.15.22:0/3691676122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f81e7020 con 0x7f93f815c1b0 2023-07-11T00:30:09.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.295+0000 7f93f57fa700 1 -- 172.21.15.22:0/3691676122 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f93e400fbf0 con 0x7f93f815c1b0 2023-07-11T00:30:09.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.296+0000 7f93f57fa700 1 --2- 172.21.15.22:0/3691676122 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f93dc06ace0 0x7f93dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:09.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.297+0000 7f93f57fa700 1 -- 172.21.15.22:0/3691676122 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f93e4089540 con 0x7f93f815c1b0 2023-07-11T00:30:09.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.297+0000 7f93fcf9b700 1 --2- 172.21.15.22:0/3691676122 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f93dc06ace0 0x7f93dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:09.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.298+0000 7f93fcf9b700 1 --2- 172.21.15.22:0/3691676122 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f93dc06ace0 0x7f93dc06d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f93f81f4e70 tx=0x7f93ec009210 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:09.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.301+0000 7f93f57fa700 1 -- 172.21.15.22:0/3691676122 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f93f81e7020 con 0x7f93f815c1b0 2023-07-11T00:30:09.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:09.506+0000 7f93ff1ff700 1 -- 172.21.15.22:0/3691676122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f93f8160db0 con 0x7f93f815c1b0 2023-07-11T00:30:10.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.040+0000 7f93f57fa700 1 -- 172.21.15.22:0/3691676122 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f93f8160db0 con 0x7f93f815c1b0 2023-07-11T00:30:10.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.045+0000 7f93ff1ff700 1 -- 172.21.15.22:0/3691676122 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f93dc06ace0 msgr2=0x7f93dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:10.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.045+0000 7f93ff1ff700 1 --2- 172.21.15.22:0/3691676122 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f93dc06ace0 0x7f93dc06d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f93f81f4e70 tx=0x7f93ec009210 comp rx=0 tx=0).stop 2023-07-11T00:30:10.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.045+0000 7f93ff1ff700 1 -- 172.21.15.22:0/3691676122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93f815c1b0 msgr2=0x7f93f81f1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:10.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.045+0000 7f93ff1ff700 1 --2- 172.21.15.22:0/3691676122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93f815c1b0 0x7f93f81f1130 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f93e4007320 tx=0x7f93e40076e0 comp rx=0 tx=0).stop 2023-07-11T00:30:10.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.046+0000 7f93ff1ff700 1 -- 172.21.15.22:0/3691676122 shutdown_connections 2023-07-11T00:30:10.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.046+0000 7f93ff1ff700 1 --2- 172.21.15.22:0/3691676122 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f93dc06ace0 0x7f93dc06d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:10.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.046+0000 7f93ff1ff700 1 --2- 172.21.15.22:0/3691676122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93f81f4f10 0x7f93f81f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:10.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.046+0000 7f93ff1ff700 1 --2- 172.21.15.22:0/3691676122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e8005200 0x7f93f815e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:10.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.046+0000 7f93ff1ff700 1 --2- 172.21.15.22:0/3691676122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93f815c1b0 0x7f93f81f1130 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:10.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.046+0000 7f93ff1ff700 1 -- 172.21.15.22:0/3691676122 >> 172.21.15.22:0/3691676122 conn(0x7f93f8071660 msgr2=0x7f93f80b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:10.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.051+0000 7f93ff1ff700 1 -- 172.21.15.22:0/3691676122 shutdown_connections 2023-07-11T00:30:10.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.051+0000 7f93ff1ff700 1 -- 172.21.15.22:0/3691676122 wait complete. 2023-07-11T00:30:10.069 INFO:teuthology.orchestra.run.smithi022.stderr:set pool 5 allow_ec_overwrites to true 2023-07-11T00:30:10.098 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-07-11T00:30:10.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.299+0000 7fef875ff700 1 Processor -- start 2023-07-11T00:30:10.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.300+0000 7fef875ff700 1 -- start start 2023-07-11T00:30:10.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.301+0000 7fef875ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fef800b8260 0x7fef800cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:10.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.301+0000 7fef875ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef800d25c0 0x7fef800b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:10.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.301+0000 7fef875ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef80160a00 con 0x7fef800b4b50 2023-07-11T00:30:10.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.301+0000 7fef875ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef800b4fd0 con 0x7fef800b8260 2023-07-11T00:30:10.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.301+0000 7fef875ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef80160ce0 con 0x7fef800d25c0 2023-07-11T00:30:10.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.301+0000 7fef84b9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef800d25c0 0x7fef800b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:10.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.301+0000 7fef85b9c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fef800b4b50 0x7fef8006b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:57294/0 (socket says 172.21.15.22:57294) 2023-07-11T00:30:10.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.301+0000 7fef85b9c700 1 -- 172.21.15.22:0/4144579621 learned_addr learned my addr 172.21.15.22:0/4144579621 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:10.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.301+0000 7fef8539b700 1 --2- 172.21.15.22:0/4144579621 >> v2:172.21.15.184:3300/0 conn(0x7fef800b8260 0x7fef800cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:10.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.302+0000 7fef77fff700 1 -- 172.21.15.22:0/4144579621 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178917659 0 0) 0x7fef80160a00 con 0x7fef800b4b50 2023-07-11T00:30:10.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.302+0000 7fef77fff700 1 -- 172.21.15.22:0/4144579621 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef6c0035b0 con 0x7fef800b4b50 2023-07-11T00:30:10.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.302+0000 7fef8539b700 1 -- 172.21.15.22:0/4144579621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef800d25c0 msgr2=0x7fef800b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:10.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.302+0000 7fef8539b700 1 --2- 172.21.15.22:0/4144579621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef800d25c0 0x7fef800b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:10.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.302+0000 7fef8539b700 1 -- 172.21.15.22:0/4144579621 >> v1:172.21.15.184:6789/0 conn(0x7fef800b4b50 legacy=0x7fef8006b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:10.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.302+0000 7fef8539b700 1 -- 172.21.15.22:0/4144579621 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef800cd280 con 0x7fef800b8260 2023-07-11T00:30:10.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.302+0000 7fef84b9a700 1 --2- 172.21.15.22:0/4144579621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef800d25c0 0x7fef800b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:30:10.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.302+0000 7fef8539b700 1 --2- 172.21.15.22:0/4144579621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef800b8260 0x7fef800cede0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009840 tx=0x7fef7c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52ec7d86fcd6c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:10.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.302+0000 7fef77fff700 1 -- 172.21.15.22:0/4144579621 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c011830 con 0x7fef800b8260 2023-07-11T00:30:10.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.303+0000 7fef77fff700 1 -- 172.21.15.22:0/4144579621 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c011990 con 0x7fef800b8260 2023-07-11T00:30:10.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.303+0000 7fef77fff700 1 -- 172.21.15.22:0/4144579621 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c011d20 con 0x7fef800b8260 2023-07-11T00:30:10.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.303+0000 7fef875ff700 1 -- 172.21.15.22:0/4144579621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef800b8260 msgr2=0x7fef800cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.303+0000 7fef875ff700 1 --2- 172.21.15.22:0/4144579621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef800b8260 0x7fef800cede0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009840 tx=0x7fef7c009b50 comp rx=0 tx=0).stop 2023-07-11T00:30:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.303+0000 7fef875ff700 1 -- 172.21.15.22:0/4144579621 shutdown_connections 2023-07-11T00:30:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.303+0000 7fef875ff700 1 --2- 172.21.15.22:0/4144579621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef800b8260 0x7fef800cede0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.303+0000 7fef875ff700 1 --2- 172.21.15.22:0/4144579621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef800d25c0 0x7fef800b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.303+0000 7fef875ff700 1 -- 172.21.15.22:0/4144579621 >> 172.21.15.22:0/4144579621 conn(0x7fef800722b0 msgr2=0x7fef800cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.303+0000 7fef875ff700 1 -- 172.21.15.22:0/4144579621 shutdown_connections 2023-07-11T00:30:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.303+0000 7fef875ff700 1 -- 172.21.15.22:0/4144579621 wait complete. 2023-07-11T00:30:10.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.305+0000 7fef875ff700 1 Processor -- start 2023-07-11T00:30:10.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.305+0000 7fef875ff700 1 -- start start 2023-07-11T00:30:10.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.306+0000 7fef875ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef800b8260 0x7fef8015ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:10.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.306+0000 7fef875ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef800d25c0 0x7fef8014ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:10.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.306+0000 7fef875ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef800c9cd0 0x7fef8014cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:10.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.306+0000 7fef875ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8014d4b0 con 0x7fef800b8260 2023-07-11T00:30:10.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.306+0000 7fef875ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef801f2540 con 0x7fef800c9cd0 2023-07-11T00:30:10.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.306+0000 7fef875ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef801f2820 con 0x7fef800d25c0 2023-07-11T00:30:10.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.306+0000 7fef8539b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef800b8260 0x7fef8015ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:10.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.306+0000 7fef8539b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef800b8260 0x7fef8015ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33152/0 (socket says 172.21.15.22:33152) 2023-07-11T00:30:10.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.306+0000 7fef8539b700 1 -- 172.21.15.22:0/1239130624 learned_addr learned my addr 172.21.15.22:0/1239130624 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:10.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.307+0000 7fef85b9c700 1 --2- 172.21.15.22:0/1239130624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef800c9cd0 0x7fef8014cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:10.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.307+0000 7fef84b9a700 1 --2- 172.21.15.22:0/1239130624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef800d25c0 0x7fef8014ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:10.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.307+0000 7fef8539b700 1 -- 172.21.15.22:0/1239130624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef800d25c0 msgr2=0x7fef8014ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:10.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.307+0000 7fef8539b700 1 --2- 172.21.15.22:0/1239130624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef800d25c0 0x7fef8014ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:10.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.307+0000 7fef8539b700 1 -- 172.21.15.22:0/1239130624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef800c9cd0 msgr2=0x7fef8014cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:10.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.307+0000 7fef8539b700 1 --2- 172.21.15.22:0/1239130624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef800c9cd0 0x7fef8014cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:10.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.307+0000 7fef8539b700 1 -- 172.21.15.22:0/1239130624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef700094a0 con 0x7fef800b8260 2023-07-11T00:30:10.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.307+0000 7fef84b9a700 1 --2- 172.21.15.22:0/1239130624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef800d25c0 0x7fef8014ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:10.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.307+0000 7fef8539b700 1 --2- 172.21.15.22:0/1239130624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef800b8260 0x7fef8015ac30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0090b0 tx=0x7fef7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:10.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.307+0000 7fef75ffb700 1 -- 172.21.15.22:0/1239130624 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0036a0 con 0x7fef800b8260 2023-07-11T00:30:10.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.307+0000 7fef75ffb700 1 -- 172.21.15.22:0/1239130624 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c01f070 con 0x7fef800b8260 2023-07-11T00:30:10.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.307+0000 7fef75ffb700 1 -- 172.21.15.22:0/1239130624 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c003a60 con 0x7fef800b8260 2023-07-11T00:30:10.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.307+0000 7fef875ff700 1 -- 172.21.15.22:0/1239130624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7c0094a0 con 0x7fef800b8260 2023-07-11T00:30:10.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.308+0000 7fef875ff700 1 -- 172.21.15.22:0/1239130624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef801f2de0 con 0x7fef800b8260 2023-07-11T00:30:10.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.308+0000 7fef875ff700 1 -- 172.21.15.22:0/1239130624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8004ea60 con 0x7fef800b8260 2023-07-11T00:30:10.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.309+0000 7fef75ffb700 1 -- 172.21.15.22:0/1239130624 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fef7c003bc0 con 0x7fef800b8260 2023-07-11T00:30:10.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.310+0000 7fef75ffb700 1 --2- 172.21.15.22:0/1239130624 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fef6406ace0 0x7fef6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:10.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.311+0000 7fef75ffb700 1 -- 172.21.15.22:0/1239130624 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fef7c021070 con 0x7fef800b8260 2023-07-11T00:30:10.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.311+0000 7fef84b9a700 1 --2- 172.21.15.22:0/1239130624 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fef6406ace0 0x7fef6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:10.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.312+0000 7fef84b9a700 1 --2- 172.21.15.22:0/1239130624 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fef6406ace0 0x7fef6406d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef801e70a0 tx=0x7fef70008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:10.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.315+0000 7fef75ffb700 1 -- 172.21.15.22:0/1239130624 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fef7c055d90 con 0x7fef800b8260 2023-07-11T00:30:10.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:10.570+0000 7fef875ff700 1 -- 172.21.15.22:0/1239130624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fef8015fbb0 con 0x7fef800b8260 2023-07-11T00:30:10.815 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-07-11T00:30:10.813+0000 7f8dcbdf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-11T00:30:11.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.061+0000 7fef75ffb700 1 -- 172.21.15.22:0/1239130624 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fef7c0150b0 con 0x7fef800b8260 2023-07-11T00:30:11.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.064+0000 7fef875ff700 1 -- 172.21.15.22:0/1239130624 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fef6406ace0 msgr2=0x7fef6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:11.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.064+0000 7fef875ff700 1 --2- 172.21.15.22:0/1239130624 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fef6406ace0 0x7fef6406d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef801e70a0 tx=0x7fef70008040 comp rx=0 tx=0).stop 2023-07-11T00:30:11.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.064+0000 7fef875ff700 1 -- 172.21.15.22:0/1239130624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef800b8260 msgr2=0x7fef8015ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:11.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.064+0000 7fef875ff700 1 --2- 172.21.15.22:0/1239130624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef800b8260 0x7fef8015ac30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0090b0 tx=0x7fef7c004750 comp rx=0 tx=0).stop 2023-07-11T00:30:11.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.064+0000 7fef875ff700 1 -- 172.21.15.22:0/1239130624 shutdown_connections 2023-07-11T00:30:11.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.064+0000 7fef875ff700 1 --2- 172.21.15.22:0/1239130624 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fef6406ace0 0x7fef6406d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.064+0000 7fef875ff700 1 --2- 172.21.15.22:0/1239130624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef800c9cd0 0x7fef8014cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.064+0000 7fef875ff700 1 --2- 172.21.15.22:0/1239130624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef800b8260 0x7fef8015ac30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.064+0000 7fef875ff700 1 --2- 172.21.15.22:0/1239130624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef800d25c0 0x7fef8014ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.064+0000 7fef875ff700 1 -- 172.21.15.22:0/1239130624 >> 172.21.15.22:0/1239130624 conn(0x7fef800b4b50 msgr2=0x7fef8006be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:11.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.064+0000 7fef875ff700 1 -- 172.21.15.22:0/1239130624 shutdown_connections 2023-07-11T00:30:11.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.064+0000 7fef875ff700 1 -- 172.21.15.22:0/1239130624 wait complete. 2023-07-11T00:30:11.072 INFO:teuthology.orchestra.run.smithi022.stderr:added data pool 5 to fsmap 2023-07-11T00:30:11.087 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:30:11.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.293+0000 7f96147ff700 1 Processor -- start 2023-07-11T00:30:11.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.293+0000 7f96147ff700 1 -- start start 2023-07-11T00:30:11.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.294+0000 7f96147ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f960c15c460 0x7f960c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:11.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.294+0000 7f96147ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f960c0d2640 0x7f960c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:11.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.294+0000 7f96147ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960c0d1790 con 0x7f960c0cf720 2023-07-11T00:30:11.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.294+0000 7f96147ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960c0cedd0 con 0x7f960c15c460 2023-07-11T00:30:11.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.294+0000 7f96147ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0cd950 con 0x7f960c0d2640 2023-07-11T00:30:11.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.294+0000 7f961259b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f960c15c460 0x7f960c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:11.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.294+0000 7f9612d9c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f960c0cf720 0x7f960c0d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51890/0 (socket says 172.21.15.22:51890) 2023-07-11T00:30:11.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.294+0000 7f9612d9c700 1 -- 172.21.15.22:0/974963797 learned_addr learned my addr 172.21.15.22:0/974963797 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:11.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.295+0000 7f9611d9a700 1 --2- 172.21.15.22:0/974963797 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f960c0d2640 0x7f960c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:11.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.295+0000 7f961259b700 1 -- 172.21.15.22:0/974963797 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f960c0d2640 msgr2=0x7f960c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:11.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.295+0000 7f9611599700 1 -- 172.21.15.22:0/974963797 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171144812 0 0) 0x7f960c0d1790 con 0x7f960c0cf720 2023-07-11T00:30:11.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.295+0000 7f961259b700 1 --2- 172.21.15.22:0/974963797 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f960c0d2640 0x7f960c0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.295+0000 7f961259b700 1 -- 172.21.15.22:0/974963797 >> v1:172.21.15.22:6789/0 conn(0x7f960c0cf720 legacy=0x7f960c0d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:11.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.295+0000 7f961259b700 1 -- 172.21.15.22:0/974963797 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c0d14b0 con 0x7f960c15c460 2023-07-11T00:30:11.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.295+0000 7f9611d9a700 1 --2- 172.21.15.22:0/974963797 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f960c0d2640 0x7f960c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:11.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.295+0000 7f961259b700 1 --2- 172.21.15.22:0/974963797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f960c15c460 0x7f960c0b59d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9608009840 tx=0x7f9608009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1454790b9a5c3654 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:11.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.295+0000 7f9611599700 1 -- 172.21.15.22:0/974963797 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608011830 con 0x7f960c15c460 2023-07-11T00:30:11.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.295+0000 7f9611599700 1 -- 172.21.15.22:0/974963797 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9608011990 con 0x7f960c15c460 2023-07-11T00:30:11.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.295+0000 7f9611599700 1 -- 172.21.15.22:0/974963797 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608011d20 con 0x7f960c15c460 2023-07-11T00:30:11.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.296+0000 7f96147ff700 1 -- 172.21.15.22:0/974963797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f960c15c460 msgr2=0x7f960c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:11.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.296+0000 7f96147ff700 1 --2- 172.21.15.22:0/974963797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f960c15c460 0x7f960c0b59d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9608009840 tx=0x7f9608009b50 comp rx=0 tx=0).stop 2023-07-11T00:30:11.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.296+0000 7f96147ff700 1 -- 172.21.15.22:0/974963797 shutdown_connections 2023-07-11T00:30:11.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.296+0000 7f96147ff700 1 --2- 172.21.15.22:0/974963797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f960c15c460 0x7f960c0b59d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.296+0000 7f96147ff700 1 --2- 172.21.15.22:0/974963797 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f960c0d2640 0x7f960c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.296+0000 7f96147ff700 1 -- 172.21.15.22:0/974963797 >> 172.21.15.22:0/974963797 conn(0x7f960c071660 msgr2=0x7f960c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:11.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.296+0000 7f96147ff700 1 -- 172.21.15.22:0/974963797 shutdown_connections 2023-07-11T00:30:11.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.296+0000 7f96147ff700 1 -- 172.21.15.22:0/974963797 wait complete. 2023-07-11T00:30:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.298+0000 7f96147ff700 1 Processor -- start 2023-07-11T00:30:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.298+0000 7f96147ff700 1 -- start start 2023-07-11T00:30:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.299+0000 7f96147ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f960c0cf720 0x7f960c14de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.299+0000 7f96147ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f960c0d2640 0x7f960c14ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.299+0000 7f96147ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f960c15c460 0x7f960c0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.299+0000 7f96147ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c14f0f0 con 0x7f960c0cf720 2023-07-11T00:30:11.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.299+0000 7f96147ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c1510c0 con 0x7f960c15c460 2023-07-11T00:30:11.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.299+0000 7f96147ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0c96f0 con 0x7f960c0d2640 2023-07-11T00:30:11.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.299+0000 7f961259b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f960c0cf720 0x7f960c14de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:11.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.299+0000 7f961259b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f960c0cf720 0x7f960c14de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33174/0 (socket says 172.21.15.22:33174) 2023-07-11T00:30:11.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.299+0000 7f961259b700 1 -- 172.21.15.22:0/2675394476 learned_addr learned my addr 172.21.15.22:0/2675394476 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:11.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.299+0000 7f961259b700 1 -- 172.21.15.22:0/2675394476 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f960c0d2640 msgr2=0x7f960c14ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:11.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.299+0000 7f961259b700 1 --2- 172.21.15.22:0/2675394476 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f960c0d2640 0x7f960c14ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.299+0000 7f961259b700 1 -- 172.21.15.22:0/2675394476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f960c15c460 msgr2=0x7f960c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:11.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.299+0000 7f961259b700 1 --2- 172.21.15.22:0/2675394476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f960c15c460 0x7f960c0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.299+0000 7f961259b700 1 -- 172.21.15.22:0/2675394476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96080094a0 con 0x7f960c0cf720 2023-07-11T00:30:11.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.300+0000 7f961259b700 1 --2- 172.21.15.22:0/2675394476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f960c0cf720 0x7f960c14de10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f96080090b0 tx=0x7f9608004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:11.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.300+0000 7f9602ffd700 1 -- 172.21.15.22:0/2675394476 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96080038a0 con 0x7f960c0cf720 2023-07-11T00:30:11.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.300+0000 7f9602ffd700 1 -- 172.21.15.22:0/2675394476 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960801f070 con 0x7f960c0cf720 2023-07-11T00:30:11.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.300+0000 7f9602ffd700 1 -- 172.21.15.22:0/2675394476 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608003c20 con 0x7f960c0cf720 2023-07-11T00:30:11.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.300+0000 7f96147ff700 1 -- 172.21.15.22:0/2675394476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c151360 con 0x7f960c0cf720 2023-07-11T00:30:11.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.300+0000 7f96147ff700 1 -- 172.21.15.22:0/2675394476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c151920 con 0x7f960c0cf720 2023-07-11T00:30:11.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.301+0000 7f96147ff700 1 -- 172.21.15.22:0/2675394476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c04ea60 con 0x7f960c0cf720 2023-07-11T00:30:11.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.302+0000 7f9602ffd700 1 -- 172.21.15.22:0/2675394476 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f960801a430 con 0x7f960c0cf720 2023-07-11T00:30:11.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.303+0000 7f9602ffd700 1 --2- 172.21.15.22:0/2675394476 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f95f006ace0 0x7f95f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:11.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.303+0000 7f9602ffd700 1 -- 172.21.15.22:0/2675394476 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9608021070 con 0x7f960c0cf720 2023-07-11T00:30:11.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.303+0000 7f9611d9a700 1 --2- 172.21.15.22:0/2675394476 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f95f006ace0 0x7f95f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:11.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.304+0000 7f9611d9a700 1 --2- 172.21.15.22:0/2675394476 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f95f006ace0 0x7f95f006d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95fc006fd0 tx=0x7f95fc008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:11.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.307+0000 7f9602ffd700 1 -- 172.21.15.22:0/2675394476 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f96080bd380 con 0x7f960c0cf720 2023-07-11T00:30:11.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.557+0000 7f96147ff700 1 -- 172.21.15.22:0/2675394476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f960c0b4fa0 con 0x7f960c0cf720 2023-07-11T00:30:11.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.558+0000 7f9602ffd700 1 -- 172.21.15.22:0/2675394476 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f9608056080 con 0x7f960c0cf720 2023-07-11T00:30:11.560 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:11.561 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3244868368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3244868368},{"type":"v1","addr":"172.21.15.22:6833","nonce":3244868368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/907204261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":907204261},{"type":"v1","addr":"172.21.15.184:6836","nonce":907204261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/1214375050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1214375050},{"type":"v1","addr":"172.21.15.22:6835","nonce":1214375050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:30:05.408970+0000","modified":"2023-07-11T00:30:10.572160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3376322541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3376322541},{"type":"v1","addr":"172.21.15.184:6837","nonce":3376322541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-11T00:30:11.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.560+0000 7f96147ff700 1 -- 172.21.15.22:0/2675394476 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f95f006ace0 msgr2=0x7f95f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:11.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.560+0000 7f96147ff700 1 --2- 172.21.15.22:0/2675394476 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f95f006ace0 0x7f95f006d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95fc006fd0 tx=0x7f95fc008040 comp rx=0 tx=0).stop 2023-07-11T00:30:11.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.560+0000 7f96147ff700 1 -- 172.21.15.22:0/2675394476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f960c0cf720 msgr2=0x7f960c14de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:11.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.560+0000 7f96147ff700 1 --2- 172.21.15.22:0/2675394476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f960c0cf720 0x7f960c14de10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f96080090b0 tx=0x7f9608004750 comp rx=0 tx=0).stop 2023-07-11T00:30:11.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.560+0000 7f96147ff700 1 -- 172.21.15.22:0/2675394476 shutdown_connections 2023-07-11T00:30:11.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.560+0000 7f96147ff700 1 --2- 172.21.15.22:0/2675394476 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f95f006ace0 0x7f95f006d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.560+0000 7f96147ff700 1 --2- 172.21.15.22:0/2675394476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f960c15c460 0x7f960c0c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.560+0000 7f96147ff700 1 --2- 172.21.15.22:0/2675394476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f960c0cf720 0x7f960c14de10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.560+0000 7f96147ff700 1 --2- 172.21.15.22:0/2675394476 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f960c0d2640 0x7f960c14ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.560+0000 7f96147ff700 1 -- 172.21.15.22:0/2675394476 >> 172.21.15.22:0/2675394476 conn(0x7f960c071660 msgr2=0x7f960c0b7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:11.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.560+0000 7f96147ff700 1 -- 172.21.15.22:0/2675394476 shutdown_connections 2023-07-11T00:30:11.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.560+0000 7f96147ff700 1 -- 172.21.15.22:0/2675394476 wait complete. 2023-07-11T00:30:11.567 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 7 2023-07-11T00:30:11.581 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:30:11.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.779+0000 7fb61e1ff700 1 Processor -- start 2023-07-11T00:30:11.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.779+0000 7fb61e1ff700 1 -- start start 2023-07-11T00:30:11.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.780+0000 7fb61e1ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6180d2640 0x7fb6180b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:11.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.780+0000 7fb61e1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb6180cf8f0 0x7fb61815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:11.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.781+0000 7fb61e1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6180d1790 con 0x7fb61815c460 2023-07-11T00:30:11.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.781+0000 7fb61e1ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6180cedd0 con 0x7fb6180d2640 2023-07-11T00:30:11.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.781+0000 7fb61e1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6180cd950 con 0x7fb6180cf8f0 2023-07-11T00:30:11.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.781+0000 7fb616ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6180d2640 0x7fb6180b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:11.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.781+0000 7fb616ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6180d2640 0x7fb6180b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33182/0 (socket says 172.21.15.22:33182) 2023-07-11T00:30:11.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.781+0000 7fb616ffd700 1 -- 172.21.15.22:0/2017085169 learned_addr learned my addr 172.21.15.22:0/2017085169 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:11.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.781+0000 7fb617fff700 1 --2- 172.21.15.22:0/2017085169 >> v2:172.21.15.184:3300/0 conn(0x7fb6180cf8f0 0x7fb61815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:11.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.781+0000 7fb616ffd700 1 -- 172.21.15.22:0/2017085169 >> v2:172.21.15.184:3300/0 conn(0x7fb6180cf8f0 msgr2=0x7fb61815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:11.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.781+0000 7fb616ffd700 1 --2- 172.21.15.22:0/2017085169 >> v2:172.21.15.184:3300/0 conn(0x7fb6180cf8f0 0x7fb61815fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.781+0000 7fb616ffd700 1 -- 172.21.15.22:0/2017085169 >> v1:172.21.15.184:6789/0 conn(0x7fb61815c460 legacy=0x7fb6180cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:11.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.781+0000 7fb616ffd700 1 -- 172.21.15.22:0/2017085169 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6180d14b0 con 0x7fb6180d2640 2023-07-11T00:30:11.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.781+0000 7fb617fff700 1 --2- 172.21.15.22:0/2017085169 >> v2:172.21.15.184:3300/0 conn(0x7fb6180cf8f0 0x7fb61815fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:30:11.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.781+0000 7fb616ffd700 1 --2- 172.21.15.22:0/2017085169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6180d2640 0x7fb6180b59d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb618072140 tx=0x7fb60c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ba6d3935cb1ce3 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:11.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.782+0000 7fb6167fc700 1 -- 172.21.15.22:0/2017085169 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c004230 con 0x7fb6180d2640 2023-07-11T00:30:11.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.782+0000 7fb6167fc700 1 -- 172.21.15.22:0/2017085169 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c004390 con 0x7fb6180d2640 2023-07-11T00:30:11.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.782+0000 7fb6167fc700 1 -- 172.21.15.22:0/2017085169 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c0036a0 con 0x7fb6180d2640 2023-07-11T00:30:11.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.782+0000 7fb61e1ff700 1 -- 172.21.15.22:0/2017085169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6180d2640 msgr2=0x7fb6180b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:11.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.782+0000 7fb61e1ff700 1 --2- 172.21.15.22:0/2017085169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6180d2640 0x7fb6180b59d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb618072140 tx=0x7fb60c009bd0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.782+0000 7fb61e1ff700 1 -- 172.21.15.22:0/2017085169 shutdown_connections 2023-07-11T00:30:11.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.782+0000 7fb61e1ff700 1 --2- 172.21.15.22:0/2017085169 >> v2:172.21.15.184:3300/0 conn(0x7fb6180cf8f0 0x7fb61815fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.782+0000 7fb61e1ff700 1 --2- 172.21.15.22:0/2017085169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6180d2640 0x7fb6180b59d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.782+0000 7fb61e1ff700 1 -- 172.21.15.22:0/2017085169 >> 172.21.15.22:0/2017085169 conn(0x7fb618071660 msgr2=0x7fb618071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:11.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.782+0000 7fb61e1ff700 1 -- 172.21.15.22:0/2017085169 shutdown_connections 2023-07-11T00:30:11.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.783+0000 7fb61e1ff700 1 -- 172.21.15.22:0/2017085169 wait complete. 2023-07-11T00:30:11.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.784+0000 7fb61e1ff700 1 Processor -- start 2023-07-11T00:30:11.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.784+0000 7fb61e1ff700 1 -- start start 2023-07-11T00:30:11.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.785+0000 7fb61e1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6180cf8f0 0x7fb61814de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:11.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.785+0000 7fb61e1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6180d2640 0x7fb6180c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:11.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.785+0000 7fb61e1ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb61815c460 0x7fb6180c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:11.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.785+0000 7fb61e1ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6180c9cf0 con 0x7fb61815c460 2023-07-11T00:30:11.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.785+0000 7fb61e1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6180c9f60 con 0x7fb6180d2640 2023-07-11T00:30:11.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.785+0000 7fb61e1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6180ca240 con 0x7fb6180cf8f0 2023-07-11T00:30:11.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.785+0000 7fb617fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb61815c460 0x7fb6180c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:11.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.785+0000 7fb617fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb61815c460 0x7fb6180c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33186/0 (socket says 172.21.15.22:33186) 2023-07-11T00:30:11.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.785+0000 7fb617fff700 1 -- 172.21.15.22:0/1466706026 learned_addr learned my addr 172.21.15.22:0/1466706026 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:11.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.785+0000 7fb616ffd700 1 --2- 172.21.15.22:0/1466706026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6180d2640 0x7fb6180c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:11.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.786+0000 7fb6177fe700 1 --2- 172.21.15.22:0/1466706026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6180cf8f0 0x7fb61814de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:11.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.786+0000 7fb617fff700 1 -- 172.21.15.22:0/1466706026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6180cf8f0 msgr2=0x7fb61814de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.786+0000 7fb617fff700 1 --2- 172.21.15.22:0/1466706026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6180cf8f0 0x7fb61814de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.786+0000 7fb617fff700 1 -- 172.21.15.22:0/1466706026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6180d2640 msgr2=0x7fb6180c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.786+0000 7fb617fff700 1 --2- 172.21.15.22:0/1466706026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6180d2640 0x7fb6180c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.786+0000 7fb617fff700 1 -- 172.21.15.22:0/1466706026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c009550 con 0x7fb61815c460 2023-07-11T00:30:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.786+0000 7fb617fff700 1 --2- 172.21.15.22:0/1466706026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb61815c460 0x7fb6180c8dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb61000cd50 tx=0x7fb61000a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:11.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.786+0000 7fb5fffff700 1 -- 172.21.15.22:0/1466706026 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61000cea0 con 0x7fb61815c460 2023-07-11T00:30:11.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.786+0000 7fb5fffff700 1 -- 172.21.15.22:0/1466706026 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61000f480 con 0x7fb61815c460 2023-07-11T00:30:11.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.786+0000 7fb5fffff700 1 -- 172.21.15.22:0/1466706026 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61000f830 con 0x7fb61815c460 2023-07-11T00:30:11.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.786+0000 7fb61e1ff700 1 -- 172.21.15.22:0/1466706026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6180ca520 con 0x7fb61815c460 2023-07-11T00:30:11.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.787+0000 7fb61e1ff700 1 -- 172.21.15.22:0/1466706026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61814e350 con 0x7fb61815c460 2023-07-11T00:30:11.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.788+0000 7fb61e1ff700 1 -- 172.21.15.22:0/1466706026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6180ca710 con 0x7fb61815c460 2023-07-11T00:30:11.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.789+0000 7fb5fffff700 1 -- 172.21.15.22:0/1466706026 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb61000b040 con 0x7fb61815c460 2023-07-11T00:30:11.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.789+0000 7fb5fffff700 1 --2- 172.21.15.22:0/1466706026 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb60406ace0 0x7fb60406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:11.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.790+0000 7fb5fffff700 1 -- 172.21.15.22:0/1466706026 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb610089f00 con 0x7fb61815c460 2023-07-11T00:30:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.790+0000 7fb6177fe700 1 --2- 172.21.15.22:0/1466706026 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb60406ace0 0x7fb60406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.791+0000 7fb6177fe700 1 --2- 172.21.15.22:0/1466706026 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb60406ace0 0x7fb60406d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb608007fd0 tx=0x7fb608007ec0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:11.794+0000 7fb5fffff700 1 -- 172.21.15.22:0/1466706026 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb610054c20 con 0x7fb61815c460 2023-07-11T00:30:12.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.000+0000 7fb61e1ff700 1 -- 172.21.15.22:0/1466706026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb61804ea60 con 0x7fb61815c460 2023-07-11T00:30:12.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.002+0000 7fb5fffff700 1 -- 172.21.15.22:0/1466706026 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20062 (secure 0 0 0) 0x7fb61001d090 con 0x7fb61815c460 2023-07-11T00:30:12.004 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:12.005 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:10.571866+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:30:12.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.004+0000 7fb61e1ff700 1 -- 172.21.15.22:0/1466706026 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb60406ace0 msgr2=0x7fb60406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:12.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.004+0000 7fb61e1ff700 1 --2- 172.21.15.22:0/1466706026 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb60406ace0 0x7fb60406d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb608007fd0 tx=0x7fb608007ec0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.004+0000 7fb61e1ff700 1 -- 172.21.15.22:0/1466706026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb61815c460 msgr2=0x7fb6180c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:12.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.004+0000 7fb61e1ff700 1 --2- 172.21.15.22:0/1466706026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb61815c460 0x7fb6180c8dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb61000cd50 tx=0x7fb61000a560 comp rx=0 tx=0).stop 2023-07-11T00:30:12.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.004+0000 7fb61e1ff700 1 -- 172.21.15.22:0/1466706026 shutdown_connections 2023-07-11T00:30:12.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.004+0000 7fb61e1ff700 1 --2- 172.21.15.22:0/1466706026 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb60406ace0 0x7fb60406d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.004+0000 7fb61e1ff700 1 --2- 172.21.15.22:0/1466706026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6180cf8f0 0x7fb61814de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.004+0000 7fb61e1ff700 1 --2- 172.21.15.22:0/1466706026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb61815c460 0x7fb6180c8dc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.004+0000 7fb61e1ff700 1 --2- 172.21.15.22:0/1466706026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6180d2640 0x7fb6180c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.004+0000 7fb61e1ff700 1 -- 172.21.15.22:0/1466706026 >> 172.21.15.22:0/1466706026 conn(0x7fb618071660 msgr2=0x7fb61815fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:12.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.004+0000 7fb61e1ff700 1 -- 172.21.15.22:0/1466706026 shutdown_connections 2023-07-11T00:30:12.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.004+0000 7fb61e1ff700 1 -- 172.21.15.22:0/1466706026 wait complete. 2023-07-11T00:30:12.025 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:30:12.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.225+0000 7f23293ff700 1 Processor -- start 2023-07-11T00:30:12.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.225+0000 7f23293ff700 1 -- start start 2023-07-11T00:30:12.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.226+0000 7f23293ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f23240d2640 0x7f23240b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:12.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.226+0000 7f23293ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f23240cf8f0 0x7f232415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:12.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.226+0000 7f23293ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23240d1790 con 0x7f232415c460 2023-07-11T00:30:12.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.226+0000 7f23293ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23240cedd0 con 0x7f23240cf8f0 2023-07-11T00:30:12.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.226+0000 7f23293ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23240cd950 con 0x7f23240d2640 2023-07-11T00:30:12.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.226+0000 7f23237fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f23240cf8f0 0x7f232415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:12.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.226+0000 7f2322ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f232415c460 0x7f23240cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51906/0 (socket says 172.21.15.22:51906) 2023-07-11T00:30:12.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.226+0000 7f2322ffd700 1 -- 172.21.15.22:0/4080982915 learned_addr learned my addr 172.21.15.22:0/4080982915 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:12.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.226+0000 7f231bfff700 1 --2- 172.21.15.22:0/4080982915 >> v2:172.21.15.184:3300/0 conn(0x7f23240d2640 0x7f23240b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:12.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.227+0000 7f23237fe700 1 -- 172.21.15.22:0/4080982915 >> v2:172.21.15.184:3300/0 conn(0x7f23240d2640 msgr2=0x7f23240b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:12.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.227+0000 7f23237fe700 1 --2- 172.21.15.22:0/4080982915 >> v2:172.21.15.184:3300/0 conn(0x7f23240d2640 0x7f23240b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.227+0000 7f23237fe700 1 -- 172.21.15.22:0/4080982915 >> v1:172.21.15.22:6789/0 conn(0x7f232415c460 legacy=0x7f23240cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:12.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.227+0000 7f23227fc700 1 -- 172.21.15.22:0/4080982915 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986141002 0 0) 0x7f23240d1790 con 0x7f232415c460 2023-07-11T00:30:12.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.227+0000 7f23237fe700 1 -- 172.21.15.22:0/4080982915 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23240d14b0 con 0x7f23240cf8f0 2023-07-11T00:30:12.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.227+0000 7f23237fe700 1 --2- 172.21.15.22:0/4080982915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240cf8f0 0x7f232415fe20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f232415fd80 tx=0x7f231c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6b52bc625f2e73 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:12.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.227+0000 7f23227fc700 1 -- 172.21.15.22:0/4080982915 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c00e070 con 0x7f23240cf8f0 2023-07-11T00:30:12.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.227+0000 7f23227fc700 1 -- 172.21.15.22:0/4080982915 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c00bb20 con 0x7f23240cf8f0 2023-07-11T00:30:12.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.227+0000 7f23227fc700 1 -- 172.21.15.22:0/4080982915 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c012430 con 0x7f23240cf8f0 2023-07-11T00:30:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.228+0000 7f23293ff700 1 -- 172.21.15.22:0/4080982915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240cf8f0 msgr2=0x7f232415fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.228+0000 7f23293ff700 1 --2- 172.21.15.22:0/4080982915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240cf8f0 0x7f232415fe20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f232415fd80 tx=0x7f231c00b330 comp rx=0 tx=0).stop 2023-07-11T00:30:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.228+0000 7f23293ff700 1 -- 172.21.15.22:0/4080982915 shutdown_connections 2023-07-11T00:30:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.228+0000 7f23293ff700 1 --2- 172.21.15.22:0/4080982915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240cf8f0 0x7f232415fe20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.228+0000 7f23293ff700 1 --2- 172.21.15.22:0/4080982915 >> v2:172.21.15.184:3300/0 conn(0x7f23240d2640 0x7f23240b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.228+0000 7f23293ff700 1 -- 172.21.15.22:0/4080982915 >> 172.21.15.22:0/4080982915 conn(0x7f2324071660 msgr2=0x7f2324071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.228+0000 7f23293ff700 1 -- 172.21.15.22:0/4080982915 shutdown_connections 2023-07-11T00:30:12.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.228+0000 7f23293ff700 1 -- 172.21.15.22:0/4080982915 wait complete. 2023-07-11T00:30:12.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.230+0000 7f23293ff700 1 Processor -- start 2023-07-11T00:30:12.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.230+0000 7f23293ff700 1 -- start start 2023-07-11T00:30:12.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f23293ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240cf8f0 0x7f232415d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:12.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f23293ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23240d2640 0x7f23240cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:12.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f23293ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f232415c460 0x7f23240cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:12.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f23293ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2324150940 con 0x7f23240cf8f0 2023-07-11T00:30:12.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f23293ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23240c6a20 con 0x7f23240d2640 2023-07-11T00:30:12.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f23293ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232415f7d0 con 0x7f232415c460 2023-07-11T00:30:12.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f2322ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240cf8f0 0x7f232415d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:12.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f2322ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240cf8f0 0x7f232415d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33214/0 (socket says 172.21.15.22:33214) 2023-07-11T00:30:12.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f2322ffd700 1 -- 172.21.15.22:0/2826428482 learned_addr learned my addr 172.21.15.22:0/2826428482 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:12.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f231bfff700 1 --2- 172.21.15.22:0/2826428482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23240d2640 0x7f23240cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:12.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f23237fe700 1 --2- 172.21.15.22:0/2826428482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f232415c460 0x7f23240cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:12.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f2322ffd700 1 -- 172.21.15.22:0/2826428482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f232415c460 msgr2=0x7f23240cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:12.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f2322ffd700 1 --2- 172.21.15.22:0/2826428482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f232415c460 0x7f23240cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f2322ffd700 1 -- 172.21.15.22:0/2826428482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23240d2640 msgr2=0x7f23240cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:12.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f2322ffd700 1 --2- 172.21.15.22:0/2826428482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23240d2640 0x7f23240cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f2322ffd700 1 -- 172.21.15.22:0/2826428482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c009a70 con 0x7f23240cf8f0 2023-07-11T00:30:12.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f23237fe700 1 --2- 172.21.15.22:0/2826428482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f232415c460 0x7f23240cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:30:12.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.231+0000 7f231bfff700 1 --2- 172.21.15.22:0/2826428482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23240d2640 0x7f23240cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:12.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.232+0000 7f2322ffd700 1 --2- 172.21.15.22:0/2826428482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240cf8f0 0x7f232415d240 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f23140011e0 tx=0x7f231400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:12.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.232+0000 7f231b7fe700 1 -- 172.21.15.22:0/2826428482 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314004c80 con 0x7f23240cf8f0 2023-07-11T00:30:12.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.232+0000 7f231b7fe700 1 -- 172.21.15.22:0/2826428482 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2314004e00 con 0x7f23240cf8f0 2023-07-11T00:30:12.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.232+0000 7f23293ff700 1 -- 172.21.15.22:0/2826428482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232415c8d0 con 0x7f23240cf8f0 2023-07-11T00:30:12.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.232+0000 7f231b7fe700 1 -- 172.21.15.22:0/2826428482 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314007310 con 0x7f23240cf8f0 2023-07-11T00:30:12.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.232+0000 7f23293ff700 1 -- 172.21.15.22:0/2826428482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232415cb40 con 0x7f23240cf8f0 2023-07-11T00:30:12.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.233+0000 7f23293ff700 1 -- 172.21.15.22:0/2826428482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232404ea60 con 0x7f23240cf8f0 2023-07-11T00:30:12.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.234+0000 7f231b7fe700 1 -- 172.21.15.22:0/2826428482 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2314007470 con 0x7f23240cf8f0 2023-07-11T00:30:12.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.235+0000 7f231b7fe700 1 --2- 172.21.15.22:0/2826428482 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f230406ace0 0x7f230406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:12.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.235+0000 7f231b7fe700 1 -- 172.21.15.22:0/2826428482 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2314089570 con 0x7f23240cf8f0 2023-07-11T00:30:12.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.235+0000 7f231bfff700 1 --2- 172.21.15.22:0/2826428482 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f230406ace0 0x7f230406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:12.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.236+0000 7f231bfff700 1 --2- 172.21.15.22:0/2826428482 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f230406ace0 0x7f230406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f232415bc00 tx=0x7f230c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:12.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.239+0000 7f231b7fe700 1 -- 172.21.15.22:0/2826428482 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2314054320 con 0x7f23240cf8f0 2023-07-11T00:30:12.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.444+0000 7f23293ff700 1 -- 172.21.15.22:0/2826428482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23240b4fa0 con 0x7f23240cf8f0 2023-07-11T00:30:12.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.445+0000 7f231b7fe700 1 -- 172.21.15.22:0/2826428482 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f2314057940 con 0x7f23240cf8f0 2023-07-11T00:30:12.448 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:12.448 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:10.571866+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:30:12.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.448+0000 7f23293ff700 1 -- 172.21.15.22:0/2826428482 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f230406ace0 msgr2=0x7f230406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:12.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.448+0000 7f23293ff700 1 --2- 172.21.15.22:0/2826428482 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f230406ace0 0x7f230406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f232415bc00 tx=0x7f230c008040 comp rx=0 tx=0).stop 2023-07-11T00:30:12.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.448+0000 7f23293ff700 1 -- 172.21.15.22:0/2826428482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240cf8f0 msgr2=0x7f232415d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:12.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.448+0000 7f23293ff700 1 --2- 172.21.15.22:0/2826428482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240cf8f0 0x7f232415d240 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f23140011e0 tx=0x7f231400cae0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.448+0000 7f23293ff700 1 -- 172.21.15.22:0/2826428482 shutdown_connections 2023-07-11T00:30:12.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.448+0000 7f23293ff700 1 --2- 172.21.15.22:0/2826428482 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f230406ace0 0x7f230406d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.448+0000 7f23293ff700 1 --2- 172.21.15.22:0/2826428482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f232415c460 0x7f23240cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.448+0000 7f23293ff700 1 --2- 172.21.15.22:0/2826428482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240cf8f0 0x7f232415d240 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.448+0000 7f23293ff700 1 --2- 172.21.15.22:0/2826428482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23240d2640 0x7f23240cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.448+0000 7f23293ff700 1 -- 172.21.15.22:0/2826428482 >> 172.21.15.22:0/2826428482 conn(0x7f2324071660 msgr2=0x7f23240b8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:12.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.448+0000 7f23293ff700 1 -- 172.21.15.22:0/2826428482 shutdown_connections 2023-07-11T00:30:12.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.448+0000 7f23293ff700 1 -- 172.21.15.22:0/2826428482 wait complete. 2023-07-11T00:30:12.497 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:30:12.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.698+0000 7fd7b85ff700 1 Processor -- start 2023-07-11T00:30:12.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.698+0000 7fd7b85ff700 1 -- start start 2023-07-11T00:30:12.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.699+0000 7fd7b85ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7b00d2640 0x7fd7b00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:12.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.699+0000 7fd7b85ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7b00cf8f0 0x7fd7b015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:12.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.699+0000 7fd7b85ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b00d1790 con 0x7fd7b015c460 2023-07-11T00:30:12.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.699+0000 7fd7b85ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b00cedd0 con 0x7fd7b00d2640 2023-07-11T00:30:12.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.699+0000 7fd7b85ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b00cd950 con 0x7fd7b00cf8f0 2023-07-11T00:30:12.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.699+0000 7fd7b5b9a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7b00d2640 0x7fd7b00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:12.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.699+0000 7fd7b639b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd7b015c460 0x7fd7b00cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51918/0 (socket says 172.21.15.22:51918) 2023-07-11T00:30:12.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.699+0000 7fd7b639b700 1 -- 172.21.15.22:0/3685454261 learned_addr learned my addr 172.21.15.22:0/3685454261 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:12.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.699+0000 7fd7b6b9c700 1 --2- 172.21.15.22:0/3685454261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7b00cf8f0 0x7fd7b015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:12.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.700+0000 7fd7b5399700 1 -- 172.21.15.22:0/3685454261 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638794343 0 0) 0x7fd7b00d1790 con 0x7fd7b015c460 2023-07-11T00:30:12.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.700+0000 7fd7b5b9a700 1 -- 172.21.15.22:0/3685454261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7b00cf8f0 msgr2=0x7fd7b015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:12.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.700+0000 7fd7b5b9a700 1 --2- 172.21.15.22:0/3685454261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7b00cf8f0 0x7fd7b015fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.700+0000 7fd7b5b9a700 1 -- 172.21.15.22:0/3685454261 >> v1:172.21.15.22:6789/0 conn(0x7fd7b015c460 legacy=0x7fd7b00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:12.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.700+0000 7fd7b5b9a700 1 -- 172.21.15.22:0/3685454261 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b00d14b0 con 0x7fd7b00d2640 2023-07-11T00:30:12.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.700+0000 7fd7b5b9a700 1 --2- 172.21.15.22:0/3685454261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00d2640 0x7fd7b00b59d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009840 tx=0x7fd7a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31722c83b7c8de87 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:12.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.700+0000 7fd7b5399700 1 -- 172.21.15.22:0/3685454261 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0011830 con 0x7fd7b00d2640 2023-07-11T00:30:12.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.700+0000 7fd7b5399700 1 -- 172.21.15.22:0/3685454261 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a0011990 con 0x7fd7b00d2640 2023-07-11T00:30:12.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.700+0000 7fd7b5399700 1 -- 172.21.15.22:0/3685454261 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0011d20 con 0x7fd7b00d2640 2023-07-11T00:30:12.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.701+0000 7fd7b85ff700 1 -- 172.21.15.22:0/3685454261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00d2640 msgr2=0x7fd7b00b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:12.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.701+0000 7fd7b85ff700 1 --2- 172.21.15.22:0/3685454261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00d2640 0x7fd7b00b59d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009840 tx=0x7fd7a0009b50 comp rx=0 tx=0).stop 2023-07-11T00:30:12.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.701+0000 7fd7b85ff700 1 -- 172.21.15.22:0/3685454261 shutdown_connections 2023-07-11T00:30:12.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.701+0000 7fd7b85ff700 1 --2- 172.21.15.22:0/3685454261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7b00cf8f0 0x7fd7b015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.701+0000 7fd7b85ff700 1 --2- 172.21.15.22:0/3685454261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00d2640 0x7fd7b00b59d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.701+0000 7fd7b85ff700 1 -- 172.21.15.22:0/3685454261 >> 172.21.15.22:0/3685454261 conn(0x7fd7b0071660 msgr2=0x7fd7b0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:12.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.701+0000 7fd7b85ff700 1 -- 172.21.15.22:0/3685454261 shutdown_connections 2023-07-11T00:30:12.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.701+0000 7fd7b85ff700 1 -- 172.21.15.22:0/3685454261 wait complete. 2023-07-11T00:30:12.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.703+0000 7fd7b85ff700 1 Processor -- start 2023-07-11T00:30:12.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.703+0000 7fd7b85ff700 1 -- start start 2023-07-11T00:30:12.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.704+0000 7fd7b85ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7b00cf8f0 0x7fd7b015b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:12.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.704+0000 7fd7b85ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00d2640 0x7fd7b0158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:12.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.704+0000 7fd7b85ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7b015c460 0x7fd7b014a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:12.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.704+0000 7fd7b85ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b01592c0 con 0x7fd7b00d2640 2023-07-11T00:30:12.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.704+0000 7fd7b85ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b01595a0 con 0x7fd7b00cf8f0 2023-07-11T00:30:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.704+0000 7fd7b85ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b0159880 con 0x7fd7b015c460 2023-07-11T00:30:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.704+0000 7fd7b5b9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00d2640 0x7fd7b0158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.704+0000 7fd7b5b9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00d2640 0x7fd7b0158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33238/0 (socket says 172.21.15.22:33238) 2023-07-11T00:30:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.704+0000 7fd7b5b9a700 1 -- 172.21.15.22:0/13538894 learned_addr learned my addr 172.21.15.22:0/13538894 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.704+0000 7fd7b6b9c700 1 --2- 172.21.15.22:0/13538894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7b015c460 0x7fd7b014a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:12.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.704+0000 7fd7b639b700 1 --2- 172.21.15.22:0/13538894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7b00cf8f0 0x7fd7b015b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:12.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.705+0000 7fd7b5b9a700 1 -- 172.21.15.22:0/13538894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7b015c460 msgr2=0x7fd7b014a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:12.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.705+0000 7fd7b5b9a700 1 --2- 172.21.15.22:0/13538894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7b015c460 0x7fd7b014a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.705+0000 7fd7b5b9a700 1 -- 172.21.15.22:0/13538894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7b00cf8f0 msgr2=0x7fd7b015b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:12.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.705+0000 7fd7b5b9a700 1 --2- 172.21.15.22:0/13538894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7b00cf8f0 0x7fd7b015b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.705+0000 7fd7b5b9a700 1 -- 172.21.15.22:0/13538894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a00094a0 con 0x7fd7b00d2640 2023-07-11T00:30:12.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.705+0000 7fd7b5b9a700 1 --2- 172.21.15.22:0/13538894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00d2640 0x7fd7b0158800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009b90 tx=0x7fd7a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:12.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.705+0000 7fd7a6ffd700 1 -- 172.21.15.22:0/13538894 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a00038a0 con 0x7fd7b00d2640 2023-07-11T00:30:12.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.705+0000 7fd7a6ffd700 1 -- 172.21.15.22:0/13538894 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a001e070 con 0x7fd7b00d2640 2023-07-11T00:30:12.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.705+0000 7fd7b85ff700 1 -- 172.21.15.22:0/13538894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b0159b60 con 0x7fd7b00d2640 2023-07-11T00:30:12.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.705+0000 7fd7a6ffd700 1 -- 172.21.15.22:0/13538894 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0003c40 con 0x7fd7b00d2640 2023-07-11T00:30:12.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.705+0000 7fd7b85ff700 1 -- 172.21.15.22:0/13538894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b015a360 con 0x7fd7b00d2640 2023-07-11T00:30:12.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.706+0000 7fd7b85ff700 1 -- 172.21.15.22:0/13538894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b015a080 con 0x7fd7b00d2640 2023-07-11T00:30:12.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.707+0000 7fd7a6ffd700 1 -- 172.21.15.22:0/13538894 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd7a002d450 con 0x7fd7b00d2640 2023-07-11T00:30:12.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.708+0000 7fd7a6ffd700 1 --2- 172.21.15.22:0/13538894 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd79406ace0 0x7fd79406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:12.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.708+0000 7fd7a6ffd700 1 -- 172.21.15.22:0/13538894 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd7a008a740 con 0x7fd7b00d2640 2023-07-11T00:30:12.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.709+0000 7fd7b639b700 1 --2- 172.21.15.22:0/13538894 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd79406ace0 0x7fd79406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:12.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.709+0000 7fd7b639b700 1 --2- 172.21.15.22:0/13538894 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd79406ace0 0x7fd79406d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0012e0 tx=0x7fd7ac0018c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:12.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.713+0000 7fd7a6ffd700 1 -- 172.21.15.22:0/13538894 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd7b015a080 con 0x7fd7b00d2640 2023-07-11T00:30:12.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.976+0000 7fd7b85ff700 1 -- 172.21.15.22:0/13538894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7b015a080 con 0x7fd7b00d2640 2023-07-11T00:30:12.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.976+0000 7fd7a6ffd700 1 -- 172.21.15.22:0/13538894 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fd7b015a080 con 0x7fd7b00d2640 2023-07-11T00:30:12.979 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:12.979 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3244868368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3244868368},{"type":"v1","addr":"172.21.15.22:6833","nonce":3244868368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/907204261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":907204261},{"type":"v1","addr":"172.21.15.184:6836","nonce":907204261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/1214375050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1214375050},{"type":"v1","addr":"172.21.15.22:6835","nonce":1214375050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:30:05.408970+0000","modified":"2023-07-11T00:30:10.572160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3376322541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3376322541},{"type":"v1","addr":"172.21.15.184:6837","nonce":3376322541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-11T00:30:12.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.978+0000 7fd7b85ff700 1 -- 172.21.15.22:0/13538894 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd79406ace0 msgr2=0x7fd79406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:12.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.978+0000 7fd7b85ff700 1 --2- 172.21.15.22:0/13538894 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd79406ace0 0x7fd79406d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0012e0 tx=0x7fd7ac0018c0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.978+0000 7fd7b85ff700 1 -- 172.21.15.22:0/13538894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00d2640 msgr2=0x7fd7b0158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:12.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.978+0000 7fd7b85ff700 1 --2- 172.21.15.22:0/13538894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00d2640 0x7fd7b0158800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009b90 tx=0x7fd7a0004750 comp rx=0 tx=0).stop 2023-07-11T00:30:12.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.978+0000 7fd7b85ff700 1 -- 172.21.15.22:0/13538894 shutdown_connections 2023-07-11T00:30:12.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.978+0000 7fd7b85ff700 1 --2- 172.21.15.22:0/13538894 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd79406ace0 0x7fd79406d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.978+0000 7fd7b85ff700 1 --2- 172.21.15.22:0/13538894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7b015c460 0x7fd7b014a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.978+0000 7fd7b85ff700 1 --2- 172.21.15.22:0/13538894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7b00cf8f0 0x7fd7b015b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.978+0000 7fd7b85ff700 1 --2- 172.21.15.22:0/13538894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00d2640 0x7fd7b0158800 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:12.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.978+0000 7fd7b85ff700 1 -- 172.21.15.22:0/13538894 >> 172.21.15.22:0/13538894 conn(0x7fd7b0071660 msgr2=0x7fd7b00d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:12.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.979+0000 7fd7b85ff700 1 -- 172.21.15.22:0/13538894 shutdown_connections 2023-07-11T00:30:12.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:12.979+0000 7fd7b85ff700 1 -- 172.21.15.22:0/13538894 wait complete. 2023-07-11T00:30:12.983 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 7 2023-07-11T00:30:12.999 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:30:13.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.201+0000 7f8c4b9ff700 1 Processor -- start 2023-07-11T00:30:13.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.201+0000 7f8c4b9ff700 1 -- start start 2023-07-11T00:30:13.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.203+0000 7f8c4b9ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8c440d2640 0x7f8c440b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:13.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.203+0000 7f8c4b9ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8c440cf8f0 0x7f8c4415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:13.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.203+0000 7f8c4b9ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c440d1790 con 0x7f8c4415c460 2023-07-11T00:30:13.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.203+0000 7f8c4b9ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c440cedd0 con 0x7f8c440cf8f0 2023-07-11T00:30:13.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.203+0000 7f8c4b9ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c440cd950 con 0x7f8c440d2640 2023-07-11T00:30:13.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.203+0000 7f8c4979b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8c4415c460 0x7f8c440cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51934/0 (socket says 172.21.15.22:51934) 2023-07-11T00:30:13.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.203+0000 7f8c4979b700 1 -- 172.21.15.22:0/2721467197 learned_addr learned my addr 172.21.15.22:0/2721467197 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:13.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.203+0000 7f8c49f9c700 1 --2- 172.21.15.22:0/2721467197 >> v2:172.21.15.22:3300/0 conn(0x7f8c440cf8f0 0x7f8c4415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:13.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.203+0000 7f8c48f9a700 1 --2- 172.21.15.22:0/2721467197 >> v2:172.21.15.184:3300/0 conn(0x7f8c440d2640 0x7f8c440b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:13.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.203+0000 7f8c3bfff700 1 -- 172.21.15.22:0/2721467197 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048365763 0 0) 0x7f8c440d1790 con 0x7f8c4415c460 2023-07-11T00:30:13.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.203+0000 7f8c3bfff700 1 -- 172.21.15.22:0/2721467197 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c300035b0 con 0x7f8c4415c460 2023-07-11T00:30:13.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.203+0000 7f8c49f9c700 1 -- 172.21.15.22:0/2721467197 >> v2:172.21.15.184:3300/0 conn(0x7f8c440d2640 msgr2=0x7f8c440b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:13.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.203+0000 7f8c49f9c700 1 --2- 172.21.15.22:0/2721467197 >> v2:172.21.15.184:3300/0 conn(0x7f8c440d2640 0x7f8c440b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:13.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.203+0000 7f8c49f9c700 1 -- 172.21.15.22:0/2721467197 >> v1:172.21.15.22:6789/0 conn(0x7f8c4415c460 legacy=0x7f8c440cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:13.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.203+0000 7f8c49f9c700 1 -- 172.21.15.22:0/2721467197 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c440d14b0 con 0x7f8c440cf8f0 2023-07-11T00:30:13.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.203+0000 7f8c48f9a700 1 --2- 172.21.15.22:0/2721467197 >> v2:172.21.15.184:3300/0 conn(0x7f8c440d2640 0x7f8c440b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:13.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.204+0000 7f8c49f9c700 1 --2- 172.21.15.22:0/2721467197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c440cf8f0 0x7f8c4415fe20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8c4415fd80 tx=0x7f8c3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5726b0dffdde35b server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:13.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.204+0000 7f8c3bfff700 1 -- 172.21.15.22:0/2721467197 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c00e070 con 0x7f8c440cf8f0 2023-07-11T00:30:13.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.204+0000 7f8c3bfff700 1 -- 172.21.15.22:0/2721467197 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3c00bb20 con 0x7f8c440cf8f0 2023-07-11T00:30:13.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.204+0000 7f8c3bfff700 1 -- 172.21.15.22:0/2721467197 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c012430 con 0x7f8c440cf8f0 2023-07-11T00:30:13.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.204+0000 7f8c4b9ff700 1 -- 172.21.15.22:0/2721467197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c440cf8f0 msgr2=0x7f8c4415fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:13.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.204+0000 7f8c4b9ff700 1 --2- 172.21.15.22:0/2721467197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c440cf8f0 0x7f8c4415fe20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8c4415fd80 tx=0x7f8c3c00b330 comp rx=0 tx=0).stop 2023-07-11T00:30:13.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.205+0000 7f8c4b9ff700 1 -- 172.21.15.22:0/2721467197 shutdown_connections 2023-07-11T00:30:13.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.205+0000 7f8c4b9ff700 1 --2- 172.21.15.22:0/2721467197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c440cf8f0 0x7f8c4415fe20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:13.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.205+0000 7f8c4b9ff700 1 --2- 172.21.15.22:0/2721467197 >> v2:172.21.15.184:3300/0 conn(0x7f8c440d2640 0x7f8c440b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:13.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.205+0000 7f8c4b9ff700 1 -- 172.21.15.22:0/2721467197 >> 172.21.15.22:0/2721467197 conn(0x7f8c44071660 msgr2=0x7f8c44071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:13.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.205+0000 7f8c4b9ff700 1 -- 172.21.15.22:0/2721467197 shutdown_connections 2023-07-11T00:30:13.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.205+0000 7f8c4b9ff700 1 -- 172.21.15.22:0/2721467197 wait complete. 2023-07-11T00:30:13.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.206+0000 7f8c4b9ff700 1 Processor -- start 2023-07-11T00:30:13.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.207+0000 7f8c4b9ff700 1 -- start start 2023-07-11T00:30:13.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.207+0000 7f8c4b9ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c440cf8f0 0x7f8c44150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.207+0000 7f8c4b9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c440d2640 0x7f8c441e7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.208+0000 7f8c4b9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c4415c460 0x7f8c441e8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.208+0000 7f8c4b9ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c441508c0 con 0x7f8c440cf8f0 2023-07-11T00:30:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.208+0000 7f8c4b9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c440ca3d0 con 0x7f8c4415c460 2023-07-11T00:30:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.208+0000 7f8c4b9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c440ca6b0 con 0x7f8c440d2640 2023-07-11T00:30:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.208+0000 7f8c4979b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c440cf8f0 0x7f8c44150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.208+0000 7f8c4979b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c440cf8f0 0x7f8c44150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33244/0 (socket says 172.21.15.22:33244) 2023-07-11T00:30:13.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.208+0000 7f8c4979b700 1 -- 172.21.15.22:0/402774287 learned_addr learned my addr 172.21.15.22:0/402774287 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.208+0000 7f8c48f9a700 1 --2- 172.21.15.22:0/402774287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c440d2640 0x7f8c441e7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.208+0000 7f8c49f9c700 1 --2- 172.21.15.22:0/402774287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c4415c460 0x7f8c441e8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:13.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.208+0000 7f8c4979b700 1 -- 172.21.15.22:0/402774287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c440d2640 msgr2=0x7f8c441e7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:13.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.208+0000 7f8c4979b700 1 --2- 172.21.15.22:0/402774287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c440d2640 0x7f8c441e7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:13.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.208+0000 7f8c4979b700 1 -- 172.21.15.22:0/402774287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c4415c460 msgr2=0x7f8c441e8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:13.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.208+0000 7f8c4979b700 1 --2- 172.21.15.22:0/402774287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c4415c460 0x7f8c441e8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:13.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.208+0000 7f8c4979b700 1 -- 172.21.15.22:0/402774287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c009a70 con 0x7f8c440cf8f0 2023-07-11T00:30:13.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.208+0000 7f8c4979b700 1 --2- 172.21.15.22:0/402774287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c440cf8f0 0x7f8c44150380 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000c700 tx=0x7f8c4000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:13.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.209+0000 7f8c39ffb700 1 -- 172.21.15.22:0/402774287 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c40005d70 con 0x7f8c440cf8f0 2023-07-11T00:30:13.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.209+0000 7f8c39ffb700 1 -- 172.21.15.22:0/402774287 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c400070d0 con 0x7f8c440cf8f0 2023-07-11T00:30:13.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.209+0000 7f8c4b9ff700 1 -- 172.21.15.22:0/402774287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c440ca990 con 0x7f8c440cf8f0 2023-07-11T00:30:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.209+0000 7f8c39ffb700 1 -- 172.21.15.22:0/402774287 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c40007460 con 0x7f8c440cf8f0 2023-07-11T00:30:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.209+0000 7f8c4b9ff700 1 -- 172.21.15.22:0/402774287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c440caf50 con 0x7f8c440cf8f0 2023-07-11T00:30:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.210+0000 7f8c4b9ff700 1 -- 172.21.15.22:0/402774287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c4404ea60 con 0x7f8c440cf8f0 2023-07-11T00:30:13.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.211+0000 7f8c39ffb700 1 -- 172.21.15.22:0/402774287 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c400075c0 con 0x7f8c440cf8f0 2023-07-11T00:30:13.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.212+0000 7f8c39ffb700 1 --2- 172.21.15.22:0/402774287 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f8c2806ace0 0x7f8c2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:13.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.212+0000 7f8c39ffb700 1 -- 172.21.15.22:0/402774287 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8c40088e60 con 0x7f8c440cf8f0 2023-07-11T00:30:13.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.212+0000 7f8c48f9a700 1 --2- 172.21.15.22:0/402774287 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f8c2806ace0 0x7f8c2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:13.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.213+0000 7f8c48f9a700 1 --2- 172.21.15.22:0/402774287 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f8c2806ace0 0x7f8c2806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c441f5240 tx=0x7f8c34008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:13.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.216+0000 7f8c39ffb700 1 -- 172.21.15.22:0/402774287 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8c40053b90 con 0x7f8c440cf8f0 2023-07-11T00:30:13.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.423+0000 7f8c4b9ff700 1 -- 172.21.15.22:0/402774287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c440b4fa0 con 0x7f8c440cf8f0 2023-07-11T00:30:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.424+0000 7f8c39ffb700 1 -- 172.21.15.22:0/402774287 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f8c400571b0 con 0x7f8c440cf8f0 2023-07-11T00:30:13.429 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:13.430 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:10.571866+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:30:13.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.426+0000 7f8c4b9ff700 1 -- 172.21.15.22:0/402774287 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f8c2806ace0 msgr2=0x7f8c2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.426+0000 7f8c4b9ff700 1 --2- 172.21.15.22:0/402774287 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f8c2806ace0 0x7f8c2806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c441f5240 tx=0x7f8c34008040 comp rx=0 tx=0).stop 2023-07-11T00:30:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.426+0000 7f8c4b9ff700 1 -- 172.21.15.22:0/402774287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c440cf8f0 msgr2=0x7f8c44150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:13.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.426+0000 7f8c4b9ff700 1 --2- 172.21.15.22:0/402774287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c440cf8f0 0x7f8c44150380 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000c700 tx=0x7f8c4000cac0 comp rx=0 tx=0).stop 2023-07-11T00:30:13.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.426+0000 7f8c4b9ff700 1 -- 172.21.15.22:0/402774287 shutdown_connections 2023-07-11T00:30:13.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.426+0000 7f8c4b9ff700 1 --2- 172.21.15.22:0/402774287 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f8c2806ace0 0x7f8c2806d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:13.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.426+0000 7f8c4b9ff700 1 --2- 172.21.15.22:0/402774287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c4415c460 0x7f8c441e8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:13.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.426+0000 7f8c4b9ff700 1 --2- 172.21.15.22:0/402774287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c440cf8f0 0x7f8c44150380 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:13.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.426+0000 7f8c4b9ff700 1 --2- 172.21.15.22:0/402774287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c440d2640 0x7f8c441e7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:13.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.426+0000 7f8c4b9ff700 1 -- 172.21.15.22:0/402774287 >> 172.21.15.22:0/402774287 conn(0x7f8c44071660 msgr2=0x7f8c440b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:13.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.426+0000 7f8c4b9ff700 1 -- 172.21.15.22:0/402774287 shutdown_connections 2023-07-11T00:30:13.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:13.426+0000 7f8c4b9ff700 1 -- 172.21.15.22:0/402774287 wait complete. 2023-07-11T00:30:13.853 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-11T00:30:05.408970+0000', 'modified': '2023-07-11T00:30:10.572160+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6837/3376322541', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6835', 'nonce': 3376322541}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 3376322541}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-07-11T00:30:13.853 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-11T00:30:13.854 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-11T00:30:14.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.067+0000 7f50067ff700 1 Processor -- start 2023-07-11T00:30:14.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.067+0000 7f50067ff700 1 -- start start 2023-07-11T00:30:14.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.068+0000 7f50067ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f500015c460 0x7f50000b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.068+0000 7f50067ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f50000d2640 0x7f50000cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.068+0000 7f50067ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f50000cf720 0x7f50000cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.068+0000 7f50067ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50000cedd0 con 0x7f50000d2640 2023-07-11T00:30:14.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.069+0000 7f50067ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50000d1790 con 0x7f50000cf720 2023-07-11T00:30:14.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.069+0000 7f50067ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50000cd950 con 0x7f500015c460 2023-07-11T00:30:14.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.069+0000 7f4fff7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f50000d2640 0x7f50000cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.069+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f500015c460 0x7f50000b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.069+0000 7f4fff7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f50000d2640 0x7f50000cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33250/0 (socket says 172.21.15.22:33250) 2023-07-11T00:30:14.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.069+0000 7f4fff7fe700 1 -- 172.21.15.22:0/1066493261 learned_addr learned my addr 172.21.15.22:0/1066493261 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:14.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.069+0000 7f4ffffff700 1 --2- 172.21.15.22:0/1066493261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f500015c460 0x7f50000b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:53634/0 (socket says 172.21.15.22:53634) 2023-07-11T00:30:14.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.069+0000 7f5004d9c700 1 --2- 172.21.15.22:0/1066493261 >> v2:172.21.15.184:3300/0 conn(0x7f50000cf720 0x7f50000cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.069+0000 7f4fff7fe700 1 -- 172.21.15.22:0/1066493261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f500015c460 msgr2=0x7f50000b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:14.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.069+0000 7f4fff7fe700 1 --2- 172.21.15.22:0/1066493261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f500015c460 0x7f50000b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.069+0000 7f4fff7fe700 1 -- 172.21.15.22:0/1066493261 >> v2:172.21.15.184:3300/0 conn(0x7f50000cf720 msgr2=0x7f50000cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:14.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.069+0000 7f4fff7fe700 1 --2- 172.21.15.22:0/1066493261 >> v2:172.21.15.184:3300/0 conn(0x7f50000cf720 0x7f50000cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.069+0000 7f4fff7fe700 1 -- 172.21.15.22:0/1066493261 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50000d14b0 con 0x7f50000d2640 2023-07-11T00:30:14.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.070+0000 7f4fff7fe700 1 --2- 172.21.15.22:0/1066493261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50000d2640 0x7f50000cf1e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f500008bf90 tx=0x7f4ff4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969f78ed24fca18d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:14.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.070+0000 7f4ffeffd700 1 -- 172.21.15.22:0/1066493261 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4011830 con 0x7f50000d2640 2023-07-11T00:30:14.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.070+0000 7f4ffeffd700 1 -- 172.21.15.22:0/1066493261 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff4011990 con 0x7f50000d2640 2023-07-11T00:30:14.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.070+0000 7f4ffeffd700 1 -- 172.21.15.22:0/1066493261 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4011d20 con 0x7f50000d2640 2023-07-11T00:30:14.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.070+0000 7f50067ff700 1 -- 172.21.15.22:0/1066493261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50000d2640 msgr2=0x7f50000cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:14.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.070+0000 7f50067ff700 1 --2- 172.21.15.22:0/1066493261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50000d2640 0x7f50000cf1e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f500008bf90 tx=0x7f4ff4009bd0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.070+0000 7f50067ff700 1 -- 172.21.15.22:0/1066493261 shutdown_connections 2023-07-11T00:30:14.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.070+0000 7f50067ff700 1 --2- 172.21.15.22:0/1066493261 >> v2:172.21.15.184:3300/0 conn(0x7f50000cf720 0x7f50000cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.070+0000 7f50067ff700 1 --2- 172.21.15.22:0/1066493261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f500015c460 0x7f50000b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.070+0000 7f50067ff700 1 --2- 172.21.15.22:0/1066493261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50000d2640 0x7f50000cf1e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.071+0000 7f50067ff700 1 -- 172.21.15.22:0/1066493261 >> 172.21.15.22:0/1066493261 conn(0x7f5000071660 msgr2=0x7f5000071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:14.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.071+0000 7f50067ff700 1 -- 172.21.15.22:0/1066493261 shutdown_connections 2023-07-11T00:30:14.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.071+0000 7f50067ff700 1 -- 172.21.15.22:0/1066493261 wait complete. 2023-07-11T00:30:14.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.072+0000 7f50067ff700 1 Processor -- start 2023-07-11T00:30:14.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.073+0000 7f50067ff700 1 -- start start 2023-07-11T00:30:14.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.074+0000 7f50067ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50000cf720 0x7f50000cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.074+0000 7f50067ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50000d2640 0x7f50001e6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.074+0000 7f50067ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f500015c460 0x7f50001523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.074+0000 7f50067ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50001e6d50 con 0x7f50000d2640 2023-07-11T00:30:14.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.074+0000 7f50067ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50001528e0 con 0x7f500015c460 2023-07-11T00:30:14.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.074+0000 7f50067ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50000ccc80 con 0x7f50000cf720 2023-07-11T00:30:14.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.074+0000 7f4fff7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50000d2640 0x7f50001e6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.074+0000 7f4fff7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50000d2640 0x7f50001e6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33266/0 (socket says 172.21.15.22:33266) 2023-07-11T00:30:14.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.074+0000 7f4fff7fe700 1 -- 172.21.15.22:0/588125927 learned_addr learned my addr 172.21.15.22:0/588125927 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:14.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.074+0000 7f4ffffff700 1 --2- 172.21.15.22:0/588125927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50000cf720 0x7f50000cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.074+0000 7f5004d9c700 1 --2- 172.21.15.22:0/588125927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f500015c460 0x7f50001523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.074+0000 7f4fff7fe700 1 -- 172.21.15.22:0/588125927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50000cf720 msgr2=0x7f50000cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:14.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.074+0000 7f4fff7fe700 1 --2- 172.21.15.22:0/588125927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50000cf720 0x7f50000cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.074+0000 7f4fff7fe700 1 -- 172.21.15.22:0/588125927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f500015c460 msgr2=0x7f50001523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:14.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.074+0000 7f4fff7fe700 1 --2- 172.21.15.22:0/588125927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f500015c460 0x7f50001523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.074+0000 7f4fff7fe700 1 -- 172.21.15.22:0/588125927 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff4009550 con 0x7f50000d2640 2023-07-11T00:30:14.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.074+0000 7f4fff7fe700 1 --2- 172.21.15.22:0/588125927 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50000d2640 0x7f50001e6810 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009c10 tx=0x7f4ff4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:14.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.075+0000 7f4ffcff9700 1 -- 172.21.15.22:0/588125927 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4004510 con 0x7f50000d2640 2023-07-11T00:30:14.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.075+0000 7f4ffcff9700 1 -- 172.21.15.22:0/588125927 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff401e070 con 0x7f50000d2640 2023-07-11T00:30:14.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.075+0000 7f4ffcff9700 1 -- 172.21.15.22:0/588125927 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff40038e0 con 0x7f50000d2640 2023-07-11T00:30:14.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.075+0000 7f50067ff700 1 -- 172.21.15.22:0/588125927 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50000c9c50 con 0x7f50000d2640 2023-07-11T00:30:14.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.075+0000 7f50067ff700 1 -- 172.21.15.22:0/588125927 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50000ca210 con 0x7f50000d2640 2023-07-11T00:30:14.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.077+0000 7f4ffcff9700 1 -- 172.21.15.22:0/588125927 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ff4003a40 con 0x7f50000d2640 2023-07-11T00:30:14.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.078+0000 7f4ffcff9700 1 --2- 172.21.15.22:0/588125927 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4fec06ace0 0x7f4fec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.078+0000 7f4ffcff9700 1 -- 172.21.15.22:0/588125927 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4ff4020070 con 0x7f50000d2640 2023-07-11T00:30:14.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.079+0000 7f4ffffff700 1 --2- 172.21.15.22:0/588125927 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4fec06ace0 0x7f4fec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.079+0000 7f4ffffff700 1 --2- 172.21.15.22:0/588125927 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4fec06ace0 0x7f4fec06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009ad0 tx=0x7f4ff0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:14.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.080+0000 7f501a0d9b80 1 Processor -- start 2023-07-11T00:30:14.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.080+0000 7f501a0d9b80 1 -- start start 2023-07-11T00:30:14.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.081+0000 7f501a0d9b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564225700d60 0x564225701130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.081+0000 7f501a0d9b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642257061a0 0x564225724a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.081+0000 7f501a0d9b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5642256dbb60 0x5642256de120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.081+0000 7f501a0d9b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x564225652ea0 con 0x564225700d60 2023-07-11T00:30:14.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.081+0000 7f501a0d9b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642255c6600 con 0x5642256dbb60 2023-07-11T00:30:14.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.081+0000 7f501a0d9b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x564225635910 con 0x5642257061a0 2023-07-11T00:30:14.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.081+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564225700d60 0x564225701130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.081+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564225700d60 0x564225701130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33270/0 (socket says 172.21.15.22:33270) 2023-07-11T00:30:14.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.081+0000 7f4ffffff700 1 -- 172.21.15.22:0/340033054 learned_addr learned my addr 172.21.15.22:0/340033054 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:14.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.081+0000 7f5004d9c700 1 --2- 172.21.15.22:0/340033054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5642256dbb60 0x5642256de120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.081+0000 7f4fff7fe700 1 --2- 172.21.15.22:0/340033054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642257061a0 0x564225724a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.082+0000 7f4ffffff700 1 -- 172.21.15.22:0/340033054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642257061a0 msgr2=0x564225724a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:14.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.082+0000 7f4ffffff700 1 --2- 172.21.15.22:0/340033054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642257061a0 0x564225724a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.082+0000 7f4ffffff700 1 -- 172.21.15.22:0/340033054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5642256dbb60 msgr2=0x5642256de120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:14.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.082+0000 7f4ffffff700 1 --2- 172.21.15.22:0/340033054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5642256dbb60 0x5642256de120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.082+0000 7f4ffffff700 1 -- 172.21.15.22:0/340033054 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564225422790 con 0x564225700d60 2023-07-11T00:30:14.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.082+0000 7f4ffffff700 1 --2- 172.21.15.22:0/340033054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564225700d60 0x564225701130 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0011c10 tx=0x7f4ff0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b611e24b47fad446 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:14.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.082+0000 7f4fe5ffb700 1 -- 172.21.15.22:0/340033054 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff00158d0 con 0x564225700d60 2023-07-11T00:30:14.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.082+0000 7f4fe5ffb700 1 -- 172.21.15.22:0/340033054 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff0015a30 con 0x564225700d60 2023-07-11T00:30:14.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.082+0000 7f4fe5ffb700 1 -- 172.21.15.22:0/340033054 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0015da0 con 0x564225700d60 2023-07-11T00:30:14.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.083+0000 7f501a0d9b80 1 -- 172.21.15.22:0/340033054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564225700d60 msgr2=0x564225701130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:14.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.083+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/340033054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564225700d60 0x564225701130 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0011c10 tx=0x7f4ff0014000 comp rx=0 tx=0).stop 2023-07-11T00:30:14.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.083+0000 7f501a0d9b80 1 -- 172.21.15.22:0/340033054 shutdown_connections 2023-07-11T00:30:14.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.083+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/340033054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5642256dbb60 0x5642256de120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.083+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/340033054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564225700d60 0x564225701130 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.083+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/340033054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642257061a0 0x564225724a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.083+0000 7f501a0d9b80 1 -- 172.21.15.22:0/340033054 >> 172.21.15.22:0/340033054 conn(0x5642256d3320 msgr2=0x5642257235c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:14.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.083+0000 7f501a0d9b80 1 -- 172.21.15.22:0/340033054 shutdown_connections 2023-07-11T00:30:14.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.083+0000 7f501a0d9b80 1 -- 172.21.15.22:0/340033054 wait complete. 2023-07-11T00:30:14.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.084+0000 7f501a0d9b80 1 -- start start 2023-07-11T00:30:14.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.084+0000 7f501a0d9b80 1 Processor -- start 2023-07-11T00:30:14.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.085+0000 7f501a0d9b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5642256dbb60 0x56422570c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.085+0000 7f501a0d9b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564225700d60 0x564225725b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.085+0000 7f501a0d9b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642257061a0 0x5642257260c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.085+0000 7f501a0d9b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x56422562ebe0 con 0x5642256dbb60 2023-07-11T00:30:14.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.085+0000 7f501a0d9b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642255ec5b0 con 0x564225700d60 2023-07-11T00:30:14.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.085+0000 7f501a0d9b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5642255d2910 con 0x5642257061a0 2023-07-11T00:30:14.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.085+0000 7f501a0d9b80 10 client.0 _ll_register_callbacks cb 0x5642255eab70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-11T00:30:14.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.085+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5642256dbb60 0x56422570c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.085+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5642256dbb60 0x56422570c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33280/0 (socket says 172.21.15.22:33280) 2023-07-11T00:30:14.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.085+0000 7f4ffffff700 1 -- 172.21.15.22:0/3369457272 learned_addr learned my addr 172.21.15.22:0/3369457272 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:14.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.085+0000 7f5004d9c700 1 --2- 172.21.15.22:0/3369457272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642257061a0 0x5642257260c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.085+0000 7f4fff7fe700 1 --2- 172.21.15.22:0/3369457272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564225700d60 0x564225725b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.086+0000 7f4ffffff700 1 -- 172.21.15.22:0/3369457272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642257061a0 msgr2=0x5642257260c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:14.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.086+0000 7f4ffffff700 1 --2- 172.21.15.22:0/3369457272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642257061a0 0x5642257260c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.086+0000 7f4ffffff700 1 -- 172.21.15.22:0/3369457272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564225700d60 msgr2=0x564225725b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:14.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.086+0000 7f4ffffff700 1 --2- 172.21.15.22:0/3369457272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564225700d60 0x564225725b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.086+0000 7f4ffffff700 1 -- 172.21.15.22:0/3369457272 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff0011890 con 0x5642256dbb60 2023-07-11T00:30:14.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.086+0000 7f4fff7fe700 1 --2- 172.21.15.22:0/3369457272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564225700d60 0x564225725b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:14.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.086+0000 7f4ffffff700 1 --2- 172.21.15.22:0/3369457272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5642256dbb60 0x56422570c200 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0008010 tx=0x7f4ff0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606b2aa435cdea8d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:14.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.086+0000 7f4fdeffd700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-07-11T00:30:14.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.086+0000 7f4fdeffd700 1 -- 172.21.15.22:0/3369457272 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff00158d0 con 0x5642256dbb60 2023-07-11T00:30:14.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.086+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3369457272 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642256d0930 con 0x5642256dbb60 2023-07-11T00:30:14.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.086+0000 7f4fdeffd700 1 -- 172.21.15.22:0/3369457272 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4ff0031070 con 0x5642256dbb60 2023-07-11T00:30:14.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.086+0000 7f4fdeffd700 1 -- 172.21.15.22:0/3369457272 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ff0021650 con 0x5642256dbb60 2023-07-11T00:30:14.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.086+0000 7f501a0d9b80 10 client.4446 fetch_fsmap learned FSMap version 7 2023-07-11T00:30:14.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.086+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3369457272 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56422550f0a0 con 0x5642256dbb60 2023-07-11T00:30:14.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.087+0000 7f4fdeffd700 1 -- 172.21.15.22:0/3369457272 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5642256d0930 con 0x5642256dbb60 2023-07-11T00:30:14.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.087+0000 7f4fdeffd700 1 -- 172.21.15.22:0/3369457272 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f4ff00217b0 con 0x5642256dbb60 2023-07-11T00:30:14.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.087+0000 7f501a0d9b80 10 client.4446 fetch_fsmap finished waiting for FSMap version 7 2023-07-11T00:30:14.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.087+0000 7f501a0d9b80 10 client.4446 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-11T00:30:14.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.087+0000 7f501a0d9b80 20 client.4446 populate_metadata read hostname 'smithi022' 2023-07-11T00:30:14.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.087+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/3369457272 >> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] conn(0x5642256fe350 0x5642257250b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.087+0000 7f501a0d9b80 4 client.4446 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-11T00:30:14.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.087+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3369457272 --> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5642256ad0e0 con 0x5642256fe350 2023-07-11T00:30:14.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.087+0000 7f4fff7fe700 1 --2- 172.21.15.22:0/3369457272 >> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] conn(0x5642256fe350 0x5642257250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.088+0000 7f4fff7fe700 1 --2- 172.21.15.22:0/3369457272 >> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] conn(0x5642256fe350 0x5642257250b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f08b9e097a3e541f server_cookie=f3d159f61b90af57 in_seq=0 out_seq=0 2023-07-11T00:30:14.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.088+0000 7f4fdeffd700 10 client.4446 ms_handle_connect on v2:172.21.15.184:6835/3376322541 2023-07-11T00:30:14.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.089+0000 7f4fdeffd700 1 -- 172.21.15.22:0/3369457272 <== mds.0 v2:172.21.15.184:6835/3376322541 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5642256ad0e0 con 0x5642256fe350 2023-07-11T00:30:14.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.089+0000 7f4fdeffd700 10 client.4446 handle_command_reply: tid=0 2023-07-11T00:30:14.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.089+0000 7f501a0d9b80 1 client.4446 shutdown 2023-07-11T00:30:14.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.089+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3369457272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5642256dbb60 msgr2=0x56422570c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:14.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.089+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/3369457272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5642256dbb60 0x56422570c200 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0008010 tx=0x7f4ff0004750 comp rx=0 tx=0).stop 2023-07-11T00:30:14.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.089+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3369457272 shutdown_connections 2023-07-11T00:30:14.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.089+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/3369457272 >> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] conn(0x5642256fe350 0x5642257250b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.089+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/3369457272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642257061a0 0x5642257260c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.089+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/3369457272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5642256dbb60 0x56422570c200 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.089+0000 7f4fdeffd700 0 client.4446 ms_handle_reset on v2:172.21.15.184:6835/3376322541 2023-07-11T00:30:14.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.089+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/3369457272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564225700d60 0x564225725b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.089+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3369457272 >> 172.21.15.22:0/3369457272 conn(0x5642256d3320 msgr2=0x5642256d7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:14.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.089+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3369457272 shutdown_connections 2023-07-11T00:30:14.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.089+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3369457272 wait complete. 2023-07-11T00:30:14.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.089+0000 7f501a0d9b80 20 client.4446 trim_cache size 0 max 16384 2023-07-11T00:30:14.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.108+0000 7f501a0d9b80 1 Processor -- start 2023-07-11T00:30:14.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.108+0000 7f501a0d9b80 1 -- start start 2023-07-11T00:30:14.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.109+0000 7f501a0d9b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5642256d3320 0x5642256fa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.109+0000 7f501a0d9b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642256dbb60 0x564225725af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.109+0000 7f501a0d9b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564225700d60 0x564225726030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.109+0000 7f501a0d9b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x564225423390 con 0x564225700d60 2023-07-11T00:30:14.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.109+0000 7f501a0d9b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642256bac00 con 0x5642256d3320 2023-07-11T00:30:14.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.109+0000 7f501a0d9b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x56422571b6e0 con 0x5642256dbb60 2023-07-11T00:30:14.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.109+0000 7f5004d9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564225700d60 0x564225726030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.109+0000 7f5004d9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564225700d60 0x564225726030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33294/0 (socket says 172.21.15.22:33294) 2023-07-11T00:30:14.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.109+0000 7f5004d9c700 1 -- 172.21.15.22:0/3456453151 learned_addr learned my addr 172.21.15.22:0/3456453151 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:14.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.109+0000 7f5004d9c700 1 -- 172.21.15.22:0/3456453151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642256dbb60 msgr2=0x564225725af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:14.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.109+0000 7f5004d9c700 1 --2- 172.21.15.22:0/3456453151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642256dbb60 0x564225725af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.109+0000 7f5004d9c700 1 -- 172.21.15.22:0/3456453151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5642256d3320 msgr2=0x5642256fa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:14.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.109+0000 7f5004d9c700 1 --2- 172.21.15.22:0/3456453151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5642256d3320 0x5642256fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.109+0000 7f5004d9c700 1 -- 172.21.15.22:0/3456453151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642255f4b10 con 0x564225700d60 2023-07-11T00:30:14.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.109+0000 7f5004d9c700 1 --2- 172.21.15.22:0/3456453151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564225700d60 0x564225726030 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8007680 tx=0x7f4ff800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3d8f5248236984 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:14.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.110+0000 7f4fe67fc700 1 -- 172.21.15.22:0/3456453151 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8019650 con 0x564225700d60 2023-07-11T00:30:14.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.110+0000 7f4fe67fc700 1 -- 172.21.15.22:0/3456453151 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff8011040 con 0x564225700d60 2023-07-11T00:30:14.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.110+0000 7f4fe67fc700 1 -- 172.21.15.22:0/3456453151 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80197b0 con 0x564225700d60 2023-07-11T00:30:14.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.110+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3456453151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564225700d60 msgr2=0x564225726030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:14.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.110+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/3456453151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564225700d60 0x564225726030 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8007680 tx=0x7f4ff800b040 comp rx=0 tx=0).stop 2023-07-11T00:30:14.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.110+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3456453151 shutdown_connections 2023-07-11T00:30:14.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.110+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/3456453151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564225700d60 0x564225726030 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.110+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/3456453151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5642256d3320 0x5642256fa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.110+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/3456453151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642256dbb60 0x564225725af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.110+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3456453151 >> 172.21.15.22:0/3456453151 conn(0x5642256d99a0 msgr2=0x564225745130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:14.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.110+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3456453151 shutdown_connections 2023-07-11T00:30:14.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.110+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3456453151 wait complete. 2023-07-11T00:30:14.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.111+0000 7f501a0d9b80 1 -- start start 2023-07-11T00:30:14.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.111+0000 7f501a0d9b80 1 Processor -- start 2023-07-11T00:30:14.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.112+0000 7f501a0d9b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642256d3320 0x56422570b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.112+0000 7f501a0d9b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5642256dbb60 0x56422578da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.112+0000 7f501a0d9b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564225700d60 0x56422571bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.112+0000 7f501a0d9b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642256de200 con 0x5642256dbb60 2023-07-11T00:30:14.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.112+0000 7f501a0d9b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56422578e470 con 0x564225700d60 2023-07-11T00:30:14.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.112+0000 7f501a0d9b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5642257254d0 con 0x5642256d3320 2023-07-11T00:30:14.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.112+0000 7f501a0d9b80 10 client.0 _ll_register_callbacks cb 0x7f4ff8009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-11T00:30:14.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.112+0000 7f4fff7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5642256dbb60 0x56422578da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.113+0000 7f4fff7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5642256dbb60 0x56422578da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33308/0 (socket says 172.21.15.22:33308) 2023-07-11T00:30:14.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.113+0000 7f4fff7fe700 1 -- 172.21.15.22:0/3383981834 learned_addr learned my addr 172.21.15.22:0/3383981834 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:14.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.113+0000 7f4ffffff700 1 --2- 172.21.15.22:0/3383981834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642256d3320 0x56422570b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.113+0000 7f5004d9c700 1 --2- 172.21.15.22:0/3383981834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564225700d60 0x56422571bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.113+0000 7f4fff7fe700 1 -- 172.21.15.22:0/3383981834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642256d3320 msgr2=0x56422570b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:14.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.113+0000 7f4fff7fe700 1 --2- 172.21.15.22:0/3383981834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642256d3320 0x56422570b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.113+0000 7f4fff7fe700 1 -- 172.21.15.22:0/3383981834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564225700d60 msgr2=0x56422571bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:14.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.113+0000 7f4fff7fe700 1 --2- 172.21.15.22:0/3383981834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564225700d60 0x56422571bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.113+0000 7f4fff7fe700 1 -- 172.21.15.22:0/3383981834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff8007330 con 0x5642256dbb60 2023-07-11T00:30:14.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.113+0000 7f4ffffff700 1 --2- 172.21.15.22:0/3383981834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642256d3320 0x56422570b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:14.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.113+0000 7f4fff7fe700 1 --2- 172.21.15.22:0/3383981834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5642256dbb60 0x56422578da80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4059360 tx=0x7f4ff4006ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb1adf5cb64a007 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:14.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.113+0000 7f4fdeffd700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-07-11T00:30:14.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.113+0000 7f4fdeffd700 1 -- 172.21.15.22:0/3383981834 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4061720 con 0x5642256dbb60 2023-07-11T00:30:14.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.113+0000 7f4fdeffd700 1 -- 172.21.15.22:0/3383981834 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4ff4086030 con 0x5642256dbb60 2023-07-11T00:30:14.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.113+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3383981834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ff0015a30 con 0x5642256dbb60 2023-07-11T00:30:14.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.113+0000 7f4fdeffd700 1 -- 172.21.15.22:0/3383981834 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ff4057510 con 0x5642256dbb60 2023-07-11T00:30:14.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.114+0000 7f501a0d9b80 10 client.4452 fetch_fsmap learned FSMap version 7 2023-07-11T00:30:14.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.114+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3383981834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5642254831d0 con 0x5642256dbb60 2023-07-11T00:30:14.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.114+0000 7f4fdeffd700 1 -- 172.21.15.22:0/3383981834 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff0015a30 con 0x5642256dbb60 2023-07-11T00:30:14.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.114+0000 7f4fdeffd700 1 -- 172.21.15.22:0/3383981834 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f4ff4055ae0 con 0x5642256dbb60 2023-07-11T00:30:14.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.114+0000 7f501a0d9b80 10 client.4452 fetch_fsmap finished waiting for FSMap version 7 2023-07-11T00:30:14.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.114+0000 7f501a0d9b80 10 client.4452 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-11T00:30:14.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.114+0000 7f501a0d9b80 20 client.4452 populate_metadata read hostname 'smithi022' 2023-07-11T00:30:14.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.114+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/3383981834 >> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] conn(0x5642257061a0 0x56422571c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.114+0000 7f501a0d9b80 4 client.4452 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-07-11T00:30:14.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.114+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3383981834 --> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564225627d20 con 0x5642257061a0 2023-07-11T00:30:14.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.114+0000 7f4ffffff700 1 --2- 172.21.15.22:0/3383981834 >> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] conn(0x5642257061a0 0x56422571c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.115+0000 7f4ffffff700 1 --2- 172.21.15.22:0/3383981834 >> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] conn(0x5642257061a0 0x56422571c170 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f15f4083038f7897 server_cookie=2feda23974b50595 in_seq=0 out_seq=0 2023-07-11T00:30:14.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.115+0000 7f4fdeffd700 10 client.4452 ms_handle_connect on v2:172.21.15.184:6835/3376322541 2023-07-11T00:30:14.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.115+0000 7f4fdeffd700 1 -- 172.21.15.22:0/3383981834 <== mds.0 v2:172.21.15.184:6835/3376322541 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x564225627d20 con 0x5642257061a0 2023-07-11T00:30:14.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.115+0000 7f4fdeffd700 10 client.4452 handle_command_reply: tid=0 2023-07-11T00:30:14.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.115+0000 7f501a0d9b80 1 client.4452 shutdown 2023-07-11T00:30:14.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.115+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3383981834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5642256dbb60 msgr2=0x56422578da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:14.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.115+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/3383981834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5642256dbb60 0x56422578da80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4059360 tx=0x7f4ff4006ad0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.115+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3383981834 shutdown_connections 2023-07-11T00:30:14.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.115+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/3383981834 >> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] conn(0x5642257061a0 0x56422571c170 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.115+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/3383981834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642256d3320 0x56422570b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.115+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/3383981834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564225700d60 0x56422571bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.115+0000 7f501a0d9b80 1 --2- 172.21.15.22:0/3383981834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5642256dbb60 0x56422578da80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.115+0000 7f4fdeffd700 0 client.4452 ms_handle_reset on v2:172.21.15.184:6835/3376322541 2023-07-11T00:30:14.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.115+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3383981834 >> 172.21.15.22:0/3383981834 conn(0x5642256d99a0 msgr2=0x5642256ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:14.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.115+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3383981834 shutdown_connections 2023-07-11T00:30:14.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.115+0000 7f501a0d9b80 1 -- 172.21.15.22:0/3383981834 wait complete. 2023-07-11T00:30:14.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.116+0000 7f501a0d9b80 20 client.4452 trim_cache size 0 max 16384 2023-07-11T00:30:14.140 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-07-11T00:30:14.140 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "c306ab0a-3faf-4f52-9dba-c4f0807b892e", 2023-07-11T00:30:14.140 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-07-11T00:30:14.141 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4291, 2023-07-11T00:30:14.141 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-07-11T00:30:14.141 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-07-11T00:30:14.141 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-07-11T00:30:14.141 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 8.0936639499999998, 2023-07-11T00:30:14.141 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 7, 2023-07-11T00:30:14.141 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 24, 2023-07-11T00:30:14.141 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 24, 2023-07-11T00:30:14.142 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 14.316054349 2023-07-11T00:30:14.142 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-07-11T00:30:14.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.116+0000 7f50067ff700 1 -- 172.21.15.22:0/588125927 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4fec06ace0 msgr2=0x7f4fec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:14.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.116+0000 7f50067ff700 1 --2- 172.21.15.22:0/588125927 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4fec06ace0 0x7f4fec06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009ad0 tx=0x7f4ff0008040 comp rx=0 tx=0).stop 2023-07-11T00:30:14.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.116+0000 7f50067ff700 1 -- 172.21.15.22:0/588125927 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50000d2640 msgr2=0x7f50001e6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:14.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.116+0000 7f50067ff700 1 --2- 172.21.15.22:0/588125927 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50000d2640 0x7f50001e6810 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009c10 tx=0x7f4ff4004750 comp rx=0 tx=0).stop 2023-07-11T00:30:14.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.116+0000 7f50067ff700 1 -- 172.21.15.22:0/588125927 shutdown_connections 2023-07-11T00:30:14.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.116+0000 7f50067ff700 1 --2- 172.21.15.22:0/588125927 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4fec06ace0 0x7f4fec06d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.116+0000 7f50067ff700 1 --2- 172.21.15.22:0/588125927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50000cf720 0x7f50000cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.116+0000 7f50067ff700 1 --2- 172.21.15.22:0/588125927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f500015c460 0x7f50001523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.116+0000 7f50067ff700 1 --2- 172.21.15.22:0/588125927 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50000d2640 0x7f50001e6810 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.116+0000 7f50067ff700 1 -- 172.21.15.22:0/588125927 >> 172.21.15.22:0/588125927 conn(0x7f5000071660 msgr2=0x7f50000b63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:14.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.116+0000 7f50067ff700 1 -- 172.21.15.22:0/588125927 shutdown_connections 2023-07-11T00:30:14.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.116+0000 7f50067ff700 1 -- 172.21.15.22:0/588125927 wait complete. 2023-07-11T00:30:14.145 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-11T00:30:14.146 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-11T00:30:14.146 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-11T00:30:14.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.344+0000 7f93693ff700 1 Processor -- start 2023-07-11T00:30:14.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.344+0000 7f93693ff700 1 -- start start 2023-07-11T00:30:14.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.345+0000 7f93693ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f93640d2640 0x7f93640b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.346+0000 7f93693ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f93640cf8f0 0x7f936415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.346+0000 7f93693ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93640d1790 con 0x7f936415c460 2023-07-11T00:30:14.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.346+0000 7f93693ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93640cedd0 con 0x7f93640d2640 2023-07-11T00:30:14.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.346+0000 7f93693ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93640cd950 con 0x7f93640cf8f0 2023-07-11T00:30:14.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.346+0000 7f9362ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f936415c460 0x7f93640cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51936/0 (socket says 172.21.15.22:51936) 2023-07-11T00:30:14.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.346+0000 7f9362ffd700 1 -- 172.21.15.22:0/3364667914 learned_addr learned my addr 172.21.15.22:0/3364667914 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:14.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.346+0000 7f93627fc700 1 --2- 172.21.15.22:0/3364667914 >> v2:172.21.15.22:3300/0 conn(0x7f93640d2640 0x7f93640b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.346+0000 7f93637fe700 1 --2- 172.21.15.22:0/3364667914 >> v2:172.21.15.184:3300/0 conn(0x7f93640cf8f0 0x7f936415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.346+0000 7f93627fc700 1 -- 172.21.15.22:0/3364667914 >> v2:172.21.15.184:3300/0 conn(0x7f93640cf8f0 msgr2=0x7f936415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:14.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.346+0000 7f93627fc700 1 --2- 172.21.15.22:0/3364667914 >> v2:172.21.15.184:3300/0 conn(0x7f93640cf8f0 0x7f936415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.346+0000 7f9361ffb700 1 -- 172.21.15.22:0/3364667914 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362692920 0 0) 0x7f93640d1790 con 0x7f936415c460 2023-07-11T00:30:14.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.346+0000 7f93627fc700 1 -- 172.21.15.22:0/3364667914 >> v1:172.21.15.22:6789/0 conn(0x7f936415c460 legacy=0x7f93640cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:14.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.346+0000 7f93627fc700 1 -- 172.21.15.22:0/3364667914 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93640d14b0 con 0x7f93640d2640 2023-07-11T00:30:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.347+0000 7f93627fc700 1 --2- 172.21.15.22:0/3364667914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93640d2640 0x7f93640b59d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9364072140 tx=0x7f9358009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd84146bfed026c server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.347+0000 7f9361ffb700 1 -- 172.21.15.22:0/3364667914 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9358011830 con 0x7f93640d2640 2023-07-11T00:30:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.347+0000 7f9361ffb700 1 -- 172.21.15.22:0/3364667914 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9358011990 con 0x7f93640d2640 2023-07-11T00:30:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.347+0000 7f9361ffb700 1 -- 172.21.15.22:0/3364667914 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9358011d20 con 0x7f93640d2640 2023-07-11T00:30:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.347+0000 7f93693ff700 1 -- 172.21.15.22:0/3364667914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93640d2640 msgr2=0x7f93640b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.347+0000 7f93693ff700 1 --2- 172.21.15.22:0/3364667914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93640d2640 0x7f93640b59d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9364072140 tx=0x7f9358009b20 comp rx=0 tx=0).stop 2023-07-11T00:30:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.347+0000 7f93693ff700 1 -- 172.21.15.22:0/3364667914 shutdown_connections 2023-07-11T00:30:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.347+0000 7f93693ff700 1 --2- 172.21.15.22:0/3364667914 >> v2:172.21.15.184:3300/0 conn(0x7f93640cf8f0 0x7f936415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.347+0000 7f93693ff700 1 --2- 172.21.15.22:0/3364667914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93640d2640 0x7f93640b59d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.347+0000 7f93693ff700 1 -- 172.21.15.22:0/3364667914 >> 172.21.15.22:0/3364667914 conn(0x7f9364071660 msgr2=0x7f9364071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.348+0000 7f93693ff700 1 -- 172.21.15.22:0/3364667914 shutdown_connections 2023-07-11T00:30:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.348+0000 7f93693ff700 1 -- 172.21.15.22:0/3364667914 wait complete. 2023-07-11T00:30:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.349+0000 7f93693ff700 1 Processor -- start 2023-07-11T00:30:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.349+0000 7f93693ff700 1 -- start start 2023-07-11T00:30:14.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.350+0000 7f93693ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93640cf8f0 0x7f93641e8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.350+0000 7f93693ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93640d2640 0x7f93640c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.350+0000 7f93693ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f936415c460 0x7f93641f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.350+0000 7f93693ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93640cc360 con 0x7f936415c460 2023-07-11T00:30:14.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.350+0000 7f93693ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93640cc600 con 0x7f93640cf8f0 2023-07-11T00:30:14.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.350+0000 7f93693ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93640cc8e0 con 0x7f93640d2640 2023-07-11T00:30:14.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.351+0000 7f93637fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f936415c460 0x7f93641f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.351+0000 7f93637fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f936415c460 0x7f93641f5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33320/0 (socket says 172.21.15.22:33320) 2023-07-11T00:30:14.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.351+0000 7f93637fe700 1 -- 172.21.15.22:0/4087049048 learned_addr learned my addr 172.21.15.22:0/4087049048 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:14.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.351+0000 7f9362ffd700 1 --2- 172.21.15.22:0/4087049048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93640cf8f0 0x7f93641e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.351+0000 7f93627fc700 1 --2- 172.21.15.22:0/4087049048 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93640d2640 0x7f93640c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.351+0000 7f93637fe700 1 -- 172.21.15.22:0/4087049048 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93640d2640 msgr2=0x7f93640c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:14.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.351+0000 7f93637fe700 1 --2- 172.21.15.22:0/4087049048 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93640d2640 0x7f93640c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.351+0000 7f93637fe700 1 -- 172.21.15.22:0/4087049048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93640cf8f0 msgr2=0x7f93641e8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:14.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.351+0000 7f93637fe700 1 --2- 172.21.15.22:0/4087049048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93640cf8f0 0x7f93641e8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.351+0000 7f93637fe700 1 -- 172.21.15.22:0/4087049048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93580094a0 con 0x7f936415c460 2023-07-11T00:30:14.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.351+0000 7f93637fe700 1 --2- 172.21.15.22:0/4087049048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f936415c460 0x7f93641f5760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f935c007e60 tx=0x7f935c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:14.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.352+0000 7f934b7fe700 1 -- 172.21.15.22:0/4087049048 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c00ed30 con 0x7f936415c460 2023-07-11T00:30:14.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.352+0000 7f934b7fe700 1 -- 172.21.15.22:0/4087049048 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c014420 con 0x7f936415c460 2023-07-11T00:30:14.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.352+0000 7f934b7fe700 1 -- 172.21.15.22:0/4087049048 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c0147d0 con 0x7f936415c460 2023-07-11T00:30:14.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.352+0000 7f93693ff700 1 -- 172.21.15.22:0/4087049048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93640ccbc0 con 0x7f936415c460 2023-07-11T00:30:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.352+0000 7f93693ff700 1 -- 172.21.15.22:0/4087049048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93640ca190 con 0x7f936415c460 2023-07-11T00:30:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.353+0000 7f93693ff700 1 -- 172.21.15.22:0/4087049048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93640ca380 con 0x7f936415c460 2023-07-11T00:30:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.354+0000 7f934b7fe700 1 -- 172.21.15.22:0/4087049048 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f935c014930 con 0x7f936415c460 2023-07-11T00:30:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.355+0000 7f934b7fe700 1 --2- 172.21.15.22:0/4087049048 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f935006ace0 0x7f935006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:14.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.355+0000 7f934b7fe700 1 -- 172.21.15.22:0/4087049048 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f935c089e90 con 0x7f936415c460 2023-07-11T00:30:14.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.355+0000 7f9362ffd700 1 --2- 172.21.15.22:0/4087049048 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f935006ace0 0x7f935006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:14.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.356+0000 7f9362ffd700 1 --2- 172.21.15.22:0/4087049048 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f935006ace0 0x7f935006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9354007fd0 tx=0x7f9354007de0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:14.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.359+0000 7f934b7fe700 1 -- 172.21.15.22:0/4087049048 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f935c054c60 con 0x7f936415c460 2023-07-11T00:30:14.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.609+0000 7f93693ff700 1 -- 172.21.15.22:0/4087049048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f936404ea60 con 0x7f936415c460 2023-07-11T00:30:14.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.610+0000 7f934b7fe700 1 -- 172.21.15.22:0/4087049048 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f935c058280 con 0x7f936415c460 2023-07-11T00:30:14.613 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-11T00:30:14.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.612+0000 7f93693ff700 1 -- 172.21.15.22:0/4087049048 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f935006ace0 msgr2=0x7f935006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:14.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.612+0000 7f93693ff700 1 --2- 172.21.15.22:0/4087049048 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f935006ace0 0x7f935006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9354007fd0 tx=0x7f9354007de0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.612+0000 7f93693ff700 1 -- 172.21.15.22:0/4087049048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f936415c460 msgr2=0x7f93641f5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:14.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.612+0000 7f93693ff700 1 --2- 172.21.15.22:0/4087049048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f936415c460 0x7f93641f5760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f935c007e60 tx=0x7f935c00e3c0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.612+0000 7f93693ff700 1 -- 172.21.15.22:0/4087049048 shutdown_connections 2023-07-11T00:30:14.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.612+0000 7f93693ff700 1 --2- 172.21.15.22:0/4087049048 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f935006ace0 0x7f935006d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.612+0000 7f93693ff700 1 --2- 172.21.15.22:0/4087049048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f936415c460 0x7f93641f5760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.612+0000 7f93693ff700 1 --2- 172.21.15.22:0/4087049048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93640cf8f0 0x7f93641e8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.612+0000 7f93693ff700 1 --2- 172.21.15.22:0/4087049048 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93640d2640 0x7f93640c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:14.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.612+0000 7f93693ff700 1 -- 172.21.15.22:0/4087049048 >> 172.21.15.22:0/4087049048 conn(0x7f9364071660 msgr2=0x7f93640b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:14.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.612+0000 7f93693ff700 1 -- 172.21.15.22:0/4087049048 shutdown_connections 2023-07-11T00:30:14.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:14.612+0000 7f93693ff700 1 -- 172.21.15.22:0/4087049048 wait complete. 2023-07-11T00:30:14.632 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-11T00:30:14.632 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-11T00:30:14.632 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-07-11T00:30:14.633 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-07-11T00:30:14.633 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-11T00:30:14.633 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-11T00:30:14.633 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-11T00:30:14.634 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-11T00:30:14.634 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-07-11T00:30:14.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:14.635 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-07-11T00:30:14.681 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-11T00:30:14.682 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-11T00:30:14.682 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-07-11T00:30:14.682 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:14.682 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-07-11T00:30:14.682 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:14.682 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:30:14.682 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-07-11T00:30:14.683 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-07-11T00:30:14.683 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:30:14.683 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-07-11T00:30:14.683 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-07-11T00:30:14.683 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-11T00:30:14.683 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:30:14.683 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-07-11T00:30:14.683 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-11T00:30:14.684 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42325sec preferred_lft 42325sec 2023-07-11T00:30:14.684 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-07-11T00:30:14.684 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:14.684 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:30:14.684 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:30:14.684 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-07-11T00:30:14.685 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-11T00:30:14.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:14.686 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-07-11T00:30:14.686 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-07-11T00:30:14.687 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add name ceph-brx type bridge 2023-07-11T00:30:14.687 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr flush dev ceph-brx 2023-07-11T00:30:14.687 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set ceph-brx up 2023-07-11T00:30:14.687 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-11T00:30:14.688 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-07-11T00:30:15.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:15.127 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-11T00:30:15.199 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-07-11T00:30:15.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:15.203 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-07-11T00:30:15.273 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-07-11T00:30:15.273 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-11T00:30:15.273 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-11T00:30:15.273 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-11T00:30:15.274 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-11T00:30:15.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:15.275 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-07-11T00:30:15.275 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-07-11T00:30:15.276 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-11T00:30:15.276 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-11T00:30:15.276 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-11T00:30:15.277 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-07-11T00:30:15.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:15.969 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-07-11T00:30:16.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:16.018 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list-id 2023-07-11T00:30:16.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:16.065 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-07-11T00:30:16.065 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-07-11T00:30:16.066 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-11T00:30:16.066 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-07-11T00:30:16.066 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-07-11T00:30:16.211 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-07-11T00:30:16.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:16.213 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-07-11T00:30:16.214 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-07-11T00:30:16.214 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-07-11T00:30:16.215 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-11T00:30:16.216 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-07-11T00:30:16.217 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-07-11T00:30:16.217 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-07-11T00:30:16.218 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-07-11T00:30:16.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:16.492 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-07-11T00:30:16.492 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-07-11T00:30:16.493 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-07-11T00:30:16.493 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set dev brx.0 master ceph-brx 2023-07-11T00:30:16.493 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-07-11T00:30:16.674 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-07-11T00:30:16.675 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-11T00:30:16.675 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-07-11T00:30:16.722 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-07-11T00:30:16.722 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-11T00:30:16.723 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-07-11T00:30:16.808 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2023-07-11T00:30:16.919 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-11T00:30:16.919 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-11T00:30:16.995 INFO:teuthology.orchestra.run.smithi022.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-11T00:30:16.997 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-11T00:30:16.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:16.999 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2023-07-11T00:30:17.046 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-11T00:30:17.048 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-07-11T00:30:17.091 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2023-07-11T00:30:17.186 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-11T00:30:17.187 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-11T00:30:17.260 INFO:teuthology.orchestra.run.smithi022.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-11T00:30:17.262 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-11T00:30:17.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:17.264 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2023-07-11T00:30:17.284 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi022.stderr:2023-07-11T00:30:17.282+0000 7f19eca4c5c0 -1 init, newargv = 0x5593073af1e0 newargc=15 2023-07-11T00:30:17.285 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi022.stderr:ceph-fuse[118767]: starting ceph client 2023-07-11T00:30:17.297 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi022.stderr:ceph-fuse[118767]: starting fuse 2023-07-11T00:30:17.315 INFO:teuthology.orchestra.run.smithi022.stdout:43 2023-07-11T00:30:17.316 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-07-11T00:30:17.316 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-11T00:30:17.317 DEBUG:teuthology.orchestra.run.smithi022:> import glob 2023-07-11T00:30:17.317 DEBUG:teuthology.orchestra.run.smithi022:> import re 2023-07-11T00:30:17.317 DEBUG:teuthology.orchestra.run.smithi022:> import os 2023-07-11T00:30:17.317 DEBUG:teuthology.orchestra.run.smithi022:> import subprocess 2023-07-11T00:30:17.318 DEBUG:teuthology.orchestra.run.smithi022:> 2023-07-11T00:30:17.318 DEBUG:teuthology.orchestra.run.smithi022:> def _find_admin_socket(client_name): 2023-07-11T00:30:17.318 DEBUG:teuthology.orchestra.run.smithi022:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-07-11T00:30:17.318 DEBUG:teuthology.orchestra.run.smithi022:> files = glob.glob(asok_path) 2023-07-11T00:30:17.319 DEBUG:teuthology.orchestra.run.smithi022:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-07-11T00:30:17.319 DEBUG:teuthology.orchestra.run.smithi022:> 2023-07-11T00:30:17.319 DEBUG:teuthology.orchestra.run.smithi022:> # Given a non-glob path, it better be there 2023-07-11T00:30:17.320 DEBUG:teuthology.orchestra.run.smithi022:> if "*" not in asok_path: 2023-07-11T00:30:17.320 DEBUG:teuthology.orchestra.run.smithi022:> assert(len(files) == 1) 2023-07-11T00:30:17.320 DEBUG:teuthology.orchestra.run.smithi022:> return files[0] 2023-07-11T00:30:17.321 DEBUG:teuthology.orchestra.run.smithi022:> 2023-07-11T00:30:17.321 DEBUG:teuthology.orchestra.run.smithi022:> for f in files: 2023-07-11T00:30:17.321 DEBUG:teuthology.orchestra.run.smithi022:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-11T00:30:17.322 DEBUG:teuthology.orchestra.run.smithi022:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-11T00:30:17.322 DEBUG:teuthology.orchestra.run.smithi022:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-11T00:30:17.322 DEBUG:teuthology.orchestra.run.smithi022:> contents = proc_f.read() 2023-07-11T00:30:17.322 DEBUG:teuthology.orchestra.run.smithi022:> if mountpoint in contents: 2023-07-11T00:30:17.323 DEBUG:teuthology.orchestra.run.smithi022:> return f 2023-07-11T00:30:17.323 DEBUG:teuthology.orchestra.run.smithi022:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-11T00:30:17.323 DEBUG:teuthology.orchestra.run.smithi022:> 2023-07-11T00:30:17.323 DEBUG:teuthology.orchestra.run.smithi022:> print(_find_admin_socket("client.admin")) 2023-07-11T00:30:17.324 DEBUG:teuthology.orchestra.run.smithi022:> ' 2023-07-11T00:30:17.503 INFO:teuthology.orchestra.run.smithi022.stdout:/var/run/ceph/ceph-client.admin.118767.asok 2023-07-11T00:30:17.680 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.118767.asok 2023-07-11T00:30:17.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:17.681 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.118767.asok status 2023-07-11T00:30:17.909 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-07-11T00:30:17.909 INFO:teuthology.orchestra.run.smithi022.stdout: "metadata": { 2023-07-11T00:30:17.910 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_sha1": "b5891ed62e7aba6227aed8ab09a4dd0853a1caf2", 2023-07-11T00:30:17.910 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev)", 2023-07-11T00:30:17.910 INFO:teuthology.orchestra.run.smithi022.stdout: "entity_id": "admin", 2023-07-11T00:30:17.910 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": "smithi022", 2023-07-11T00:30:17.910 INFO:teuthology.orchestra.run.smithi022.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-07-11T00:30:17.910 INFO:teuthology.orchestra.run.smithi022.stdout: "pid": "118767", 2023-07-11T00:30:17.910 INFO:teuthology.orchestra.run.smithi022.stdout: "root": "/" 2023-07-11T00:30:17.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:30:17.911 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_count": 0, 2023-07-11T00:30:17.911 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_pinned_count": 0, 2023-07-11T00:30:17.911 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4467, 2023-07-11T00:30:17.911 INFO:teuthology.orchestra.run.smithi022.stdout: "inst": { 2023-07-11T00:30:17.911 INFO:teuthology.orchestra.run.smithi022.stdout: "name": { 2023-07-11T00:30:17.911 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "client", 2023-07-11T00:30:17.911 INFO:teuthology.orchestra.run.smithi022.stdout: "num": 4467 2023-07-11T00:30:17.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:30:17.912 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2023-07-11T00:30:17.912 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2023-07-11T00:30:17.912 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2023-07-11T00:30:17.912 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 983423986 2023-07-11T00:30:17.913 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:30:17.913 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:30:17.913 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2023-07-11T00:30:17.914 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2023-07-11T00:30:17.914 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2023-07-11T00:30:17.914 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 983423986 2023-07-11T00:30:17.914 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:30:17.914 INFO:teuthology.orchestra.run.smithi022.stdout: "inst_str": "client.4467 192.168.0.1:0/983423986", 2023-07-11T00:30:17.914 INFO:teuthology.orchestra.run.smithi022.stdout: "addr_str": "192.168.0.1:0/983423986", 2023-07-11T00:30:17.914 INFO:teuthology.orchestra.run.smithi022.stdout: "inode_count": 1, 2023-07-11T00:30:17.914 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_epoch": 7, 2023-07-11T00:30:17.915 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch": 24, 2023-07-11T00:30:17.915 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch_barrier": 0, 2023-07-11T00:30:17.915 INFO:teuthology.orchestra.run.smithi022.stdout: "blocklisted": false, 2023-07-11T00:30:17.915 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs" 2023-07-11T00:30:17.915 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-07-11T00:30:17.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:17.924 DEBUG:teuthology.orchestra.run.smithi022:> stat --file-system '--printf=%T 2023-07-11T00:30:17.924 DEBUG:teuthology.orchestra.run.smithi022:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-07-11T00:30:17.971 INFO:teuthology.orchestra.run.smithi022.stdout:fuseblk 2023-07-11T00:30:17.972 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-07-11T00:30:17.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:17.972 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-07-11T00:30:18.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:18.045 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-07-11T00:30:18.184 INFO:teuthology.orchestra.run.smithi022.stdout:# file: . 2023-07-11T00:30:18.184 INFO:teuthology.orchestra.run.smithi022.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-07-11T00:30:18.184 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:18.185 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:30:18.186 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:30:18.232 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:30:18.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.470+0000 7f22617ff700 1 Processor -- start 2023-07-11T00:30:18.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.470+0000 7f22617ff700 1 -- start start 2023-07-11T00:30:18.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.471+0000 7f22617ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f225c15c460 0x7f225c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:18.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.471+0000 7f22617ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f225c0d2640 0x7f225c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:18.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.471+0000 7f22617ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225c0d1790 con 0x7f225c0cf720 2023-07-11T00:30:18.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.471+0000 7f22617ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225c0cedd0 con 0x7f225c15c460 2023-07-11T00:30:18.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.471+0000 7f22617ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225c0cd950 con 0x7f225c0d2640 2023-07-11T00:30:18.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.472+0000 7f225affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f225c15c460 0x7f225c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:18.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.472+0000 7f225affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f225c15c460 0x7f225c0b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33334/0 (socket says 172.21.15.22:33334) 2023-07-11T00:30:18.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.472+0000 7f225affd700 1 -- 172.21.15.22:0/2262149397 learned_addr learned my addr 172.21.15.22:0/2262149397 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:18.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.472+0000 7f225a7fc700 1 --2- 172.21.15.22:0/2262149397 >> v2:172.21.15.184:3300/0 conn(0x7f225c0d2640 0x7f225c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:18.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.472+0000 7f225affd700 1 -- 172.21.15.22:0/2262149397 >> v2:172.21.15.184:3300/0 conn(0x7f225c0d2640 msgr2=0x7f225c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:18.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.472+0000 7f225affd700 1 --2- 172.21.15.22:0/2262149397 >> v2:172.21.15.184:3300/0 conn(0x7f225c0d2640 0x7f225c0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:18.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.472+0000 7f225affd700 1 -- 172.21.15.22:0/2262149397 >> v1:172.21.15.184:6789/0 conn(0x7f225c0cf720 legacy=0x7f225c0d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:18.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.472+0000 7f225affd700 1 -- 172.21.15.22:0/2262149397 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c0d14b0 con 0x7f225c15c460 2023-07-11T00:30:18.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.472+0000 7f225a7fc700 1 --2- 172.21.15.22:0/2262149397 >> v2:172.21.15.184:3300/0 conn(0x7f225c0d2640 0x7f225c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:30:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.472+0000 7f225affd700 1 --2- 172.21.15.22:0/2262149397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f225c15c460 0x7f225c0b59d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f225c15fd80 tx=0x7f224c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07120b7a474c1d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.473+0000 7f2259ffb700 1 -- 172.21.15.22:0/2262149397 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c004230 con 0x7f225c15c460 2023-07-11T00:30:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.473+0000 7f2259ffb700 1 -- 172.21.15.22:0/2262149397 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224c004390 con 0x7f225c15c460 2023-07-11T00:30:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.473+0000 7f2259ffb700 1 -- 172.21.15.22:0/2262149397 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c0036a0 con 0x7f225c15c460 2023-07-11T00:30:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.473+0000 7f22617ff700 1 -- 172.21.15.22:0/2262149397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f225c15c460 msgr2=0x7f225c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.473+0000 7f22617ff700 1 --2- 172.21.15.22:0/2262149397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f225c15c460 0x7f225c0b59d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f225c15fd80 tx=0x7f224c009bd0 comp rx=0 tx=0).stop 2023-07-11T00:30:18.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.473+0000 7f22617ff700 1 -- 172.21.15.22:0/2262149397 shutdown_connections 2023-07-11T00:30:18.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.473+0000 7f22617ff700 1 --2- 172.21.15.22:0/2262149397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f225c15c460 0x7f225c0b59d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:18.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.473+0000 7f22617ff700 1 --2- 172.21.15.22:0/2262149397 >> v2:172.21.15.184:3300/0 conn(0x7f225c0d2640 0x7f225c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:18.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.473+0000 7f22617ff700 1 -- 172.21.15.22:0/2262149397 >> 172.21.15.22:0/2262149397 conn(0x7f225c071660 msgr2=0x7f225c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:18.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.473+0000 7f22617ff700 1 -- 172.21.15.22:0/2262149397 shutdown_connections 2023-07-11T00:30:18.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.473+0000 7f22617ff700 1 -- 172.21.15.22:0/2262149397 wait complete. 2023-07-11T00:30:18.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.475+0000 7f22617ff700 1 Processor -- start 2023-07-11T00:30:18.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.475+0000 7f22617ff700 1 -- start start 2023-07-11T00:30:18.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.476+0000 7f22617ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f225c0cf720 0x7f225c153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:18.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.476+0000 7f22617ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f225c0d2640 0x7f225c0c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:18.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.476+0000 7f22617ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f225c15c460 0x7f225c0b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:18.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.476+0000 7f22617ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c1543d0 con 0x7f225c0d2640 2023-07-11T00:30:18.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.476+0000 7f22617ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c1f2340 con 0x7f225c15c460 2023-07-11T00:30:18.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.476+0000 7f22617ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c1f2620 con 0x7f225c0cf720 2023-07-11T00:30:18.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.477+0000 7f225a7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f225c0d2640 0x7f225c0c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:18.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.477+0000 7f225a7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f225c0d2640 0x7f225c0c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33346/0 (socket says 172.21.15.22:33346) 2023-07-11T00:30:18.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.477+0000 7f225a7fc700 1 -- 172.21.15.22:0/3092061212 learned_addr learned my addr 172.21.15.22:0/3092061212 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:18.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.477+0000 7f225affd700 1 --2- 172.21.15.22:0/3092061212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f225c0cf720 0x7f225c153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:18.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.477+0000 7f225b7fe700 1 --2- 172.21.15.22:0/3092061212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f225c15c460 0x7f225c0b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:18.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.477+0000 7f225a7fc700 1 -- 172.21.15.22:0/3092061212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f225c0cf720 msgr2=0x7f225c153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:18.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.477+0000 7f225a7fc700 1 --2- 172.21.15.22:0/3092061212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f225c0cf720 0x7f225c153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:18.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.477+0000 7f225a7fc700 1 -- 172.21.15.22:0/3092061212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f225c15c460 msgr2=0x7f225c0b7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:18.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.477+0000 7f225a7fc700 1 --2- 172.21.15.22:0/3092061212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f225c15c460 0x7f225c0b7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:18.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.477+0000 7f225a7fc700 1 -- 172.21.15.22:0/3092061212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c009550 con 0x7f225c0d2640 2023-07-11T00:30:18.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.477+0000 7f225a7fc700 1 --2- 172.21.15.22:0/3092061212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f225c0d2640 0x7f225c0c8fc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f225000c7f0 tx=0x7f225000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:18.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.478+0000 7f22437fe700 1 -- 172.21.15.22:0/3092061212 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250011800 con 0x7f225c0d2640 2023-07-11T00:30:18.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.478+0000 7f22437fe700 1 -- 172.21.15.22:0/3092061212 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2250011960 con 0x7f225c0d2640 2023-07-11T00:30:18.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.478+0000 7f22437fe700 1 -- 172.21.15.22:0/3092061212 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250011cf0 con 0x7f225c0d2640 2023-07-11T00:30:18.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.478+0000 7f22617ff700 1 -- 172.21.15.22:0/3092061212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225c1f2900 con 0x7f225c0d2640 2023-07-11T00:30:18.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.478+0000 7f22617ff700 1 -- 172.21.15.22:0/3092061212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225c1f2f40 con 0x7f225c0d2640 2023-07-11T00:30:18.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.479+0000 7f22617ff700 1 -- 172.21.15.22:0/3092061212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225c1f3160 con 0x7f225c0d2640 2023-07-11T00:30:18.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.480+0000 7f22437fe700 1 -- 172.21.15.22:0/3092061212 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2250018360 con 0x7f225c0d2640 2023-07-11T00:30:18.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.481+0000 7f22437fe700 1 --2- 172.21.15.22:0/3092061212 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f224806ace0 0x7f224806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:18.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.481+0000 7f22437fe700 1 -- 172.21.15.22:0/3092061212 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2250089610 con 0x7f225c0d2640 2023-07-11T00:30:18.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.481+0000 7f225affd700 1 --2- 172.21.15.22:0/3092061212 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f224806ace0 0x7f224806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:18.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.482+0000 7f225affd700 1 --2- 172.21.15.22:0/3092061212 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f224806ace0 0x7f224806d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f224c009130 tx=0x7f224c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:18.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.485+0000 7f22437fe700 1 -- 172.21.15.22:0/3092061212 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f22500543d0 con 0x7f225c0d2640 2023-07-11T00:30:18.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.695+0000 7f22617ff700 1 -- 172.21.15.22:0/3092061212 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f225c04ea60 con 0x7f225c0d2640 2023-07-11T00:30:18.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.697+0000 7f22437fe700 1 -- 172.21.15.22:0/3092061212 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f22500579f0 con 0x7f225c0d2640 2023-07-11T00:30:18.700 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:18.701 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:10.571866+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:30:18.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.699+0000 7f22617ff700 1 -- 172.21.15.22:0/3092061212 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f224806ace0 msgr2=0x7f224806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:18.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.699+0000 7f22617ff700 1 --2- 172.21.15.22:0/3092061212 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f224806ace0 0x7f224806d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f224c009130 tx=0x7f224c008030 comp rx=0 tx=0).stop 2023-07-11T00:30:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.699+0000 7f22617ff700 1 -- 172.21.15.22:0/3092061212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f225c0d2640 msgr2=0x7f225c0c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.699+0000 7f22617ff700 1 --2- 172.21.15.22:0/3092061212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f225c0d2640 0x7f225c0c8fc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f225000c7f0 tx=0x7f225000cb00 comp rx=0 tx=0).stop 2023-07-11T00:30:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.700+0000 7f22617ff700 1 -- 172.21.15.22:0/3092061212 shutdown_connections 2023-07-11T00:30:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.700+0000 7f22617ff700 1 --2- 172.21.15.22:0/3092061212 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f224806ace0 0x7f224806d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.700+0000 7f22617ff700 1 --2- 172.21.15.22:0/3092061212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f225c0cf720 0x7f225c153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.700+0000 7f22617ff700 1 --2- 172.21.15.22:0/3092061212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f225c15c460 0x7f225c0b7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.700+0000 7f22617ff700 1 --2- 172.21.15.22:0/3092061212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f225c0d2640 0x7f225c0c8fc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:18.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.700+0000 7f22617ff700 1 -- 172.21.15.22:0/3092061212 >> 172.21.15.22:0/3092061212 conn(0x7f225c071660 msgr2=0x7f225c06b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:18.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.700+0000 7f22617ff700 1 -- 172.21.15.22:0/3092061212 shutdown_connections 2023-07-11T00:30:18.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.700+0000 7f22617ff700 1 -- 172.21.15.22:0/3092061212 wait complete. 2023-07-11T00:30:18.720 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:29:57.631007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:29:58.547599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:30:03.826184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:30:04.383448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-11T00:30:08.075875+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-11T00:30:18.721 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:30:18.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.925+0000 7f9ff13ff700 1 Processor -- start 2023-07-11T00:30:18.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.925+0000 7f9ff13ff700 1 -- start start 2023-07-11T00:30:18.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.926+0000 7f9ff13ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fec0d3730 0x7f9fec0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:18.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.927+0000 7f9ff13ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9fec0cfa90 0x7f9fec0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:18.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.927+0000 7f9ff13ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fec0d0b20 con 0x7f9fec0b8430 2023-07-11T00:30:18.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.927+0000 7f9ff13ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec0cda30 con 0x7f9fec0cfa90 2023-07-11T00:30:18.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.927+0000 7f9ff13ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0b8800 con 0x7f9fec0d3730 2023-07-11T00:30:18.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.927+0000 7f9feb7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9fec0cfa90 0x7f9fec0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:18.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.927+0000 7f9feb7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9fec0cfa90 0x7f9fec0d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33360/0 (socket says 172.21.15.22:33360) 2023-07-11T00:30:18.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.927+0000 7f9feb7fe700 1 -- 172.21.15.22:0/858345597 learned_addr learned my addr 172.21.15.22:0/858345597 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:18.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.927+0000 7f9fe3fff700 1 --2- 172.21.15.22:0/858345597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fec0d3730 0x7f9fec0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:18.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.927+0000 7f9feb7fe700 1 -- 172.21.15.22:0/858345597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fec0d3730 msgr2=0x7f9fec0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:18.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.927+0000 7f9feb7fe700 1 --2- 172.21.15.22:0/858345597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fec0d3730 0x7f9fec0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:18.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.927+0000 7f9feb7fe700 1 -- 172.21.15.22:0/858345597 >> v1:172.21.15.184:6789/0 conn(0x7f9fec0b8430 legacy=0x7f9fec0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:18.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.927+0000 7f9feb7fe700 1 -- 172.21.15.22:0/858345597 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec0cfeb0 con 0x7f9fec0cfa90 2023-07-11T00:30:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.928+0000 7f9feb7fe700 1 --2- 172.21.15.22:0/858345597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fec0cfa90 0x7f9fec0d0fb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009e50 tx=0x7f9fe400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e6f7cfdb9379a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.928+0000 7f9fea7fc700 1 -- 172.21.15.22:0/858345597 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe400e070 con 0x7f9fec0cfa90 2023-07-11T00:30:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.928+0000 7f9fea7fc700 1 -- 172.21.15.22:0/858345597 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe400b9c0 con 0x7f9fec0cfa90 2023-07-11T00:30:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.928+0000 7f9fea7fc700 1 -- 172.21.15.22:0/858345597 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe400bd70 con 0x7f9fec0cfa90 2023-07-11T00:30:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.928+0000 7f9ff13ff700 1 -- 172.21.15.22:0/858345597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fec0cfa90 msgr2=0x7f9fec0d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.928+0000 7f9ff13ff700 1 --2- 172.21.15.22:0/858345597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fec0cfa90 0x7f9fec0d0fb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009e50 tx=0x7f9fe400b330 comp rx=0 tx=0).stop 2023-07-11T00:30:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.928+0000 7f9ff13ff700 1 -- 172.21.15.22:0/858345597 shutdown_connections 2023-07-11T00:30:18.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.928+0000 7f9ff13ff700 1 --2- 172.21.15.22:0/858345597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fec0cfa90 0x7f9fec0d0fb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:18.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.928+0000 7f9ff13ff700 1 --2- 172.21.15.22:0/858345597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fec0d3730 0x7f9fec0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:18.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.928+0000 7f9ff13ff700 1 -- 172.21.15.22:0/858345597 >> 172.21.15.22:0/858345597 conn(0x7f9fec06b3f0 msgr2=0x7f9fec06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:18.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.929+0000 7f9ff13ff700 1 -- 172.21.15.22:0/858345597 shutdown_connections 2023-07-11T00:30:18.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.929+0000 7f9ff13ff700 1 -- 172.21.15.22:0/858345597 wait complete. 2023-07-11T00:30:18.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.930+0000 7f9ff13ff700 1 Processor -- start 2023-07-11T00:30:18.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.930+0000 7f9ff13ff700 1 -- start start 2023-07-11T00:30:18.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.931+0000 7f9ff13ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fec0b8430 0x7f9fec1f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:18.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.931+0000 7f9ff13ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fec0cfa90 0x7f9fec0b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:18.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.931+0000 7f9ff13ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fec0d3730 0x7f9fec0b6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:18.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.931+0000 7f9ff13ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec1f6480 con 0x7f9fec0cfa90 2023-07-11T00:30:18.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.931+0000 7f9ff13ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0c68a0 con 0x7f9fec0d3730 2023-07-11T00:30:18.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.931+0000 7f9ff13ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec1f5be0 con 0x7f9fec0b8430 2023-07-11T00:30:18.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.932+0000 7f9fe3fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fec0cfa90 0x7f9fec0b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:18.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.932+0000 7f9fe3fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fec0cfa90 0x7f9fec0b5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33366/0 (socket says 172.21.15.22:33366) 2023-07-11T00:30:18.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.932+0000 7f9fe3fff700 1 -- 172.21.15.22:0/1187566958 learned_addr learned my addr 172.21.15.22:0/1187566958 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:18.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.932+0000 7f9feaffd700 1 --2- 172.21.15.22:0/1187566958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fec0b8430 0x7f9fec1f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:18.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.932+0000 7f9feb7fe700 1 --2- 172.21.15.22:0/1187566958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fec0d3730 0x7f9fec0b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:18.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.932+0000 7f9fe3fff700 1 -- 172.21.15.22:0/1187566958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fec0b8430 msgr2=0x7f9fec1f5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:18.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.932+0000 7f9fe3fff700 1 --2- 172.21.15.22:0/1187566958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fec0b8430 0x7f9fec1f5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:18.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.932+0000 7f9fe3fff700 1 -- 172.21.15.22:0/1187566958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fec0d3730 msgr2=0x7f9fec0b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:18.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.932+0000 7f9fe3fff700 1 --2- 172.21.15.22:0/1187566958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fec0d3730 0x7f9fec0b6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:18.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.932+0000 7f9fe3fff700 1 -- 172.21.15.22:0/1187566958 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe4009b30 con 0x7f9fec0cfa90 2023-07-11T00:30:18.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.932+0000 7f9fe3fff700 1 --2- 172.21.15.22:0/1187566958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fec0cfa90 0x7f9fec0b5ef0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400d800 tx=0x7f9fd400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:18.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.932+0000 7f9fe37fe700 1 -- 172.21.15.22:0/1187566958 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd40125f0 con 0x7f9fec0cfa90 2023-07-11T00:30:18.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.933+0000 7f9fe37fe700 1 -- 172.21.15.22:0/1187566958 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd4012750 con 0x7f9fec0cfa90 2023-07-11T00:30:18.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.933+0000 7f9fe37fe700 1 -- 172.21.15.22:0/1187566958 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4012b00 con 0x7f9fec0cfa90 2023-07-11T00:30:18.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.933+0000 7f9ff13ff700 1 -- 172.21.15.22:0/1187566958 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fec1f5ec0 con 0x7f9fec0cfa90 2023-07-11T00:30:18.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.933+0000 7f9ff13ff700 1 -- 172.21.15.22:0/1187566958 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fec1f21a0 con 0x7f9fec0cfa90 2023-07-11T00:30:18.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.934+0000 7f9ff13ff700 1 -- 172.21.15.22:0/1187566958 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fec0c6670 con 0x7f9fec0cfa90 2023-07-11T00:30:18.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.935+0000 7f9fe37fe700 1 -- 172.21.15.22:0/1187566958 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9fd4012c60 con 0x7f9fec0cfa90 2023-07-11T00:30:18.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.936+0000 7f9fe37fe700 1 --2- 172.21.15.22:0/1187566958 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9fcc06ace0 0x7f9fcc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:18.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.936+0000 7f9fe37fe700 1 -- 172.21.15.22:0/1187566958 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9fd4089800 con 0x7f9fec0cfa90 2023-07-11T00:30:18.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.936+0000 7f9feaffd700 1 --2- 172.21.15.22:0/1187566958 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9fcc06ace0 0x7f9fcc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:18.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.937+0000 7f9feaffd700 1 --2- 172.21.15.22:0/1187566958 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9fcc06ace0 0x7f9fcc06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0b6b70 tx=0x7f9fdc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:18.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:18.940+0000 7f9fe37fe700 1 -- 172.21.15.22:0/1187566958 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9fec0c6670 con 0x7f9fec0cfa90 2023-07-11T00:30:19.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.151+0000 7f9ff13ff700 1 -- 172.21.15.22:0/1187566958 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9fec0c6670 con 0x7f9fec0cfa90 2023-07-11T00:30:19.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.151+0000 7f9fe37fe700 1 -- 172.21.15.22:0/1187566958 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9fec0c6670 con 0x7f9fec0cfa90 2023-07-11T00:30:19.154 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2023-07-11T00:30:19.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.153+0000 7f9ff13ff700 1 -- 172.21.15.22:0/1187566958 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9fcc06ace0 msgr2=0x7f9fcc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:19.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.153+0000 7f9ff13ff700 1 --2- 172.21.15.22:0/1187566958 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9fcc06ace0 0x7f9fcc06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0b6b70 tx=0x7f9fdc009040 comp rx=0 tx=0).stop 2023-07-11T00:30:19.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.153+0000 7f9ff13ff700 1 -- 172.21.15.22:0/1187566958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fec0cfa90 msgr2=0x7f9fec0b5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:19.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.153+0000 7f9ff13ff700 1 --2- 172.21.15.22:0/1187566958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fec0cfa90 0x7f9fec0b5ef0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400d800 tx=0x7f9fd400db10 comp rx=0 tx=0).stop 2023-07-11T00:30:19.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.154+0000 7f9ff13ff700 1 -- 172.21.15.22:0/1187566958 shutdown_connections 2023-07-11T00:30:19.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.154+0000 7f9ff13ff700 1 --2- 172.21.15.22:0/1187566958 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9fcc06ace0 0x7f9fcc06d190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:19.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.154+0000 7f9ff13ff700 1 --2- 172.21.15.22:0/1187566958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fec0b8430 0x7f9fec1f5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:19.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.154+0000 7f9ff13ff700 1 --2- 172.21.15.22:0/1187566958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fec0d3730 0x7f9fec0b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:19.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.154+0000 7f9ff13ff700 1 --2- 172.21.15.22:0/1187566958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fec0cfa90 0x7f9fec0b5ef0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:19.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.154+0000 7f9ff13ff700 1 -- 172.21.15.22:0/1187566958 >> 172.21.15.22:0/1187566958 conn(0x7f9fec06b3f0 msgr2=0x7f9fec1e6360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:19.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.154+0000 7f9ff13ff700 1 -- 172.21.15.22:0/1187566958 shutdown_connections 2023-07-11T00:30:19.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.154+0000 7f9ff13ff700 1 -- 172.21.15.22:0/1187566958 wait complete. 2023-07-11T00:30:19.175 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:30:19.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.377+0000 7f0d9edff700 1 Processor -- start 2023-07-11T00:30:19.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.377+0000 7f0d9edff700 1 -- start start 2023-07-11T00:30:19.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.379+0000 7f0d9edff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0d980cfc60 0x7f0d98167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:19.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.379+0000 7f0d9edff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d980d0b20 con 0x7f0d980b8430 2023-07-11T00:30:19.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.379+0000 7f0d9edff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d980b4ee0 con 0x7f0d980d3730 2023-07-11T00:30:19.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.379+0000 7f0d9edff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d980cda30 con 0x7f0d980cfc60 2023-07-11T00:30:19.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.379+0000 7f0d9d39c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0d980cfc60 0x7f0d98167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:19.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.379+0000 7f0d9cb9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0d980b8430 0x7f0d980cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51946/0 (socket says 172.21.15.22:51946) 2023-07-11T00:30:19.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.379+0000 7f0d9cb9b700 1 -- 172.21.15.22:0/867952534 learned_addr learned my addr 172.21.15.22:0/867952534 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:19.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.379+0000 7f0d9d39c700 1 -- 172.21.15.22:0/867952534 >> v1:172.21.15.184:6789/0 conn(0x7f0d980d3730 legacy=0x7f0d980cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:19.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.379+0000 7f0d9d39c700 1 -- 172.21.15.22:0/867952534 >> v1:172.21.15.22:6789/0 conn(0x7f0d980b8430 legacy=0x7f0d980cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:19.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.379+0000 7f0d9d39c700 1 -- 172.21.15.22:0/867952534 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d980b51c0 con 0x7f0d980cfc60 2023-07-11T00:30:19.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.380+0000 7f0d9d39c700 1 --2- 172.21.15.22:0/867952534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d980cfc60 0x7f0d98167010 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009d90 tx=0x7f0d9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6490230953996aff server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:19.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.380+0000 7f0d977fe700 1 -- 172.21.15.22:0/867952534 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9000e070 con 0x7f0d980cfc60 2023-07-11T00:30:19.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.380+0000 7f0d977fe700 1 -- 172.21.15.22:0/867952534 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9000bbd0 con 0x7f0d980cfc60 2023-07-11T00:30:19.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.380+0000 7f0d977fe700 1 -- 172.21.15.22:0/867952534 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90012430 con 0x7f0d980cfc60 2023-07-11T00:30:19.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.380+0000 7f0d9edff700 1 -- 172.21.15.22:0/867952534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d980cfc60 msgr2=0x7f0d98167010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:19.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.380+0000 7f0d9edff700 1 --2- 172.21.15.22:0/867952534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d980cfc60 0x7f0d98167010 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009d90 tx=0x7f0d9000b330 comp rx=0 tx=0).stop 2023-07-11T00:30:19.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.381+0000 7f0d9edff700 1 -- 172.21.15.22:0/867952534 shutdown_connections 2023-07-11T00:30:19.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.381+0000 7f0d9edff700 1 --2- 172.21.15.22:0/867952534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d980cfc60 0x7f0d98167010 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:19.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.381+0000 7f0d9edff700 1 -- 172.21.15.22:0/867952534 >> 172.21.15.22:0/867952534 conn(0x7f0d9806b3f0 msgr2=0x7f0d9806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:19.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.381+0000 7f0d9edff700 1 -- 172.21.15.22:0/867952534 shutdown_connections 2023-07-11T00:30:19.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.381+0000 7f0d9edff700 1 -- 172.21.15.22:0/867952534 wait complete. 2023-07-11T00:30:19.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.383+0000 7f0d9edff700 1 Processor -- start 2023-07-11T00:30:19.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.383+0000 7f0d9edff700 1 -- start start 2023-07-11T00:30:19.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.384+0000 7f0d9edff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d980b8430 0x7f0d981f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:19.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.384+0000 7f0d9edff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d980cfc60 0x7f0d980cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:19.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.384+0000 7f0d9edff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d980d3730 0x7f0d9815a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:19.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.385+0000 7f0d9edff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d981f2450 con 0x7f0d980d3730 2023-07-11T00:30:19.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.385+0000 7f0d9edff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d980cb350 con 0x7f0d980cfc60 2023-07-11T00:30:19.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.385+0000 7f0d9edff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d981f1e00 con 0x7f0d980b8430 2023-07-11T00:30:19.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.385+0000 7f0d9d39c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d980d3730 0x7f0d9815a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:19.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.385+0000 7f0d9d39c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d980d3730 0x7f0d9815a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33384/0 (socket says 172.21.15.22:33384) 2023-07-11T00:30:19.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.385+0000 7f0d9d39c700 1 -- 172.21.15.22:0/2797350074 learned_addr learned my addr 172.21.15.22:0/2797350074 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:19.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.385+0000 7f0d9cb9b700 1 --2- 172.21.15.22:0/2797350074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d980b8430 0x7f0d981f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:19.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.385+0000 7f0d97fff700 1 --2- 172.21.15.22:0/2797350074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d980cfc60 0x7f0d980cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:19.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.385+0000 7f0d9d39c700 1 -- 172.21.15.22:0/2797350074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d980b8430 msgr2=0x7f0d981f28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:19.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.385+0000 7f0d9d39c700 1 --2- 172.21.15.22:0/2797350074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d980b8430 0x7f0d981f28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:19.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.385+0000 7f0d9d39c700 1 -- 172.21.15.22:0/2797350074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d980cfc60 msgr2=0x7f0d980cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:19.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.385+0000 7f0d9d39c700 1 --2- 172.21.15.22:0/2797350074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d980cfc60 0x7f0d980cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:19.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.385+0000 7f0d9d39c700 1 -- 172.21.15.22:0/2797350074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d90009a70 con 0x7f0d980d3730 2023-07-11T00:30:19.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.386+0000 7f0d9d39c700 1 --2- 172.21.15.22:0/2797350074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d980d3730 0x7f0d9815a9e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d90014040 tx=0x7f0d90004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:19.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.386+0000 7f0d957fa700 1 -- 172.21.15.22:0/2797350074 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d900098f0 con 0x7f0d980d3730 2023-07-11T00:30:19.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.386+0000 7f0d957fa700 1 -- 172.21.15.22:0/2797350074 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d90020070 con 0x7f0d980d3730 2023-07-11T00:30:19.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.386+0000 7f0d957fa700 1 -- 172.21.15.22:0/2797350074 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90004280 con 0x7f0d980d3730 2023-07-11T00:30:19.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.386+0000 7f0d9edff700 1 -- 172.21.15.22:0/2797350074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d981f20e0 con 0x7f0d980d3730 2023-07-11T00:30:19.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.386+0000 7f0d9edff700 1 -- 172.21.15.22:0/2797350074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d980cb040 con 0x7f0d980d3730 2023-07-11T00:30:19.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.387+0000 7f0d82ffd700 1 -- 172.21.15.22:0/2797350074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d700052f0 con 0x7f0d980d3730 2023-07-11T00:30:19.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.388+0000 7f0d957fa700 1 -- 172.21.15.22:0/2797350074 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d900043e0 con 0x7f0d980d3730 2023-07-11T00:30:19.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.389+0000 7f0d957fa700 1 --2- 172.21.15.22:0/2797350074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0d7c06ace0 0x7f0d7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:19.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.389+0000 7f0d957fa700 1 -- 172.21.15.22:0/2797350074 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0d90022070 con 0x7f0d980d3730 2023-07-11T00:30:19.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.390+0000 7f0d9cb9b700 1 --2- 172.21.15.22:0/2797350074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0d7c06ace0 0x7f0d7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:19.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.391+0000 7f0d9cb9b700 1 --2- 172.21.15.22:0/2797350074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0d7c06ace0 0x7f0d7c06d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c005910 tx=0x7f0d8c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:19.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.394+0000 7f0d957fa700 1 -- 172.21.15.22:0/2797350074 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0d900564a0 con 0x7f0d980d3730 2023-07-11T00:30:19.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.600+0000 7f0d82ffd700 1 -- 172.21.15.22:0/2797350074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d70005b20 con 0x7f0d980d3730 2023-07-11T00:30:19.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.600+0000 7f0d957fa700 1 -- 172.21.15.22:0/2797350074 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d9002c020 con 0x7f0d980d3730 2023-07-11T00:30:19.603 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-07-11T00:30:19.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.602+0000 7f0d82ffd700 1 -- 172.21.15.22:0/2797350074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0d7c06ace0 msgr2=0x7f0d7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:19.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.602+0000 7f0d82ffd700 1 --2- 172.21.15.22:0/2797350074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0d7c06ace0 0x7f0d7c06d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c005910 tx=0x7f0d8c009040 comp rx=0 tx=0).stop 2023-07-11T00:30:19.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.603+0000 7f0d82ffd700 1 -- 172.21.15.22:0/2797350074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d980d3730 msgr2=0x7f0d9815a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:19.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.603+0000 7f0d82ffd700 1 --2- 172.21.15.22:0/2797350074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d980d3730 0x7f0d9815a9e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d90014040 tx=0x7f0d90004ad0 comp rx=0 tx=0).stop 2023-07-11T00:30:19.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.603+0000 7f0d82ffd700 1 -- 172.21.15.22:0/2797350074 shutdown_connections 2023-07-11T00:30:19.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.603+0000 7f0d82ffd700 1 --2- 172.21.15.22:0/2797350074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0d7c06ace0 0x7f0d7c06d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:19.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.603+0000 7f0d82ffd700 1 --2- 172.21.15.22:0/2797350074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d980b8430 0x7f0d981f28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:19.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.603+0000 7f0d82ffd700 1 --2- 172.21.15.22:0/2797350074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d980d3730 0x7f0d9815a9e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:19.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.603+0000 7f0d82ffd700 1 --2- 172.21.15.22:0/2797350074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d980cfc60 0x7f0d980cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:19.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.603+0000 7f0d82ffd700 1 -- 172.21.15.22:0/2797350074 >> 172.21.15.22:0/2797350074 conn(0x7f0d9806b3f0 msgr2=0x7f0d980cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:19.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.603+0000 7f0d82ffd700 1 -- 172.21.15.22:0/2797350074 shutdown_connections 2023-07-11T00:30:19.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.603+0000 7f0d82ffd700 1 -- 172.21.15.22:0/2797350074 wait complete. 2023-07-11T00:30:19.623 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:30:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.825+0000 7fa6883ff700 1 Processor -- start 2023-07-11T00:30:19.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.825+0000 7fa6883ff700 1 -- start start 2023-07-11T00:30:19.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.826+0000 7fa6883ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6800b8430 0x7fa6800cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:19.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.826+0000 7fa6883ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa6800cfc60 0x7fa6800d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:19.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.826+0000 7fa6883ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6800d0b20 con 0x7fa6800d3730 2023-07-11T00:30:19.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.826+0000 7fa6883ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6800b8800 con 0x7fa6800cfc60 2023-07-11T00:30:19.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.826+0000 7fa6883ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800b4ee0 con 0x7fa6800b8430 2023-07-11T00:30:19.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.826+0000 7fa68599a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa6800d3730 0x7fa6800cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51960/0 (socket says 172.21.15.22:51960) 2023-07-11T00:30:19.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.826+0000 7fa68599a700 1 -- 172.21.15.22:0/2787903161 learned_addr learned my addr 172.21.15.22:0/2787903161 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:19.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.827+0000 7fa68619b700 1 --2- 172.21.15.22:0/2787903161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6800b8430 0x7fa6800cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:19.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.827+0000 7fa68699c700 1 --2- 172.21.15.22:0/2787903161 >> v2:172.21.15.184:3300/0 conn(0x7fa6800cfc60 0x7fa6800d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:19.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.827+0000 7fa685199700 1 -- 172.21.15.22:0/2787903161 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453565209 0 0) 0x7fa6800d0b20 con 0x7fa6800d3730 2023-07-11T00:30:19.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.827+0000 7fa685199700 1 -- 172.21.15.22:0/2787903161 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa66c0035b0 con 0x7fa6800d3730 2023-07-11T00:30:19.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.827+0000 7fa68619b700 1 -- 172.21.15.22:0/2787903161 >> v2:172.21.15.184:3300/0 conn(0x7fa6800cfc60 msgr2=0x7fa6800d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.827+0000 7fa68619b700 1 --2- 172.21.15.22:0/2787903161 >> v2:172.21.15.184:3300/0 conn(0x7fa6800cfc60 0x7fa6800d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.827+0000 7fa68619b700 1 -- 172.21.15.22:0/2787903161 >> v1:172.21.15.22:6789/0 conn(0x7fa6800d3730 legacy=0x7fa6800cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.827+0000 7fa68619b700 1 -- 172.21.15.22:0/2787903161 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6800b51c0 con 0x7fa6800b8430 2023-07-11T00:30:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.827+0000 7fa68699c700 1 --2- 172.21.15.22:0/2787903161 >> v2:172.21.15.184:3300/0 conn(0x7fa6800cfc60 0x7fa6800d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:30:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.827+0000 7fa68619b700 1 --2- 172.21.15.22:0/2787903161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6800b8430 0x7fa6800cd320 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009840 tx=0x7fa67c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ed8a47026c73671 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.828+0000 7fa685199700 1 -- 172.21.15.22:0/2787903161 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c011830 con 0x7fa6800b8430 2023-07-11T00:30:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.828+0000 7fa685199700 1 -- 172.21.15.22:0/2787903161 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c011990 con 0x7fa6800b8430 2023-07-11T00:30:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.828+0000 7fa685199700 1 -- 172.21.15.22:0/2787903161 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c011d20 con 0x7fa6800b8430 2023-07-11T00:30:19.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.828+0000 7fa6883ff700 1 -- 172.21.15.22:0/2787903161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6800b8430 msgr2=0x7fa6800cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:19.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.828+0000 7fa6883ff700 1 --2- 172.21.15.22:0/2787903161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6800b8430 0x7fa6800cd320 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009840 tx=0x7fa67c009b50 comp rx=0 tx=0).stop 2023-07-11T00:30:19.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.828+0000 7fa6883ff700 1 -- 172.21.15.22:0/2787903161 shutdown_connections 2023-07-11T00:30:19.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.828+0000 7fa6883ff700 1 --2- 172.21.15.22:0/2787903161 >> v2:172.21.15.184:3300/0 conn(0x7fa6800cfc60 0x7fa6800d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:19.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.828+0000 7fa6883ff700 1 --2- 172.21.15.22:0/2787903161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6800b8430 0x7fa6800cd320 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:19.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.828+0000 7fa6883ff700 1 -- 172.21.15.22:0/2787903161 >> 172.21.15.22:0/2787903161 conn(0x7fa68006b3f0 msgr2=0x7fa68006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:19.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.828+0000 7fa6883ff700 1 -- 172.21.15.22:0/2787903161 shutdown_connections 2023-07-11T00:30:19.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.828+0000 7fa6883ff700 1 -- 172.21.15.22:0/2787903161 wait complete. 2023-07-11T00:30:19.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.831+0000 7fa6883ff700 1 Processor -- start 2023-07-11T00:30:19.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.831+0000 7fa6883ff700 1 -- start start 2023-07-11T00:30:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.832+0000 7fa6883ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6800b8430 0x7fa6801f1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.832+0000 7fa6883ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6800cfc60 0x7fa6800b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.832+0000 7fa6883ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6800d3730 0x7fa68015e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.832+0000 7fa6883ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68015dc70 con 0x7fa6800cfc60 2023-07-11T00:30:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.832+0000 7fa6883ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800cae00 con 0x7fa6800b8430 2023-07-11T00:30:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.832+0000 7fa6883ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68015d3d0 con 0x7fa6800d3730 2023-07-11T00:30:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.833+0000 7fa68599a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6800cfc60 0x7fa6800b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.833+0000 7fa68599a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6800cfc60 0x7fa6800b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33398/0 (socket says 172.21.15.22:33398) 2023-07-11T00:30:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.833+0000 7fa68599a700 1 -- 172.21.15.22:0/1990114624 learned_addr learned my addr 172.21.15.22:0/1990114624 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.833+0000 7fa68619b700 1 --2- 172.21.15.22:0/1990114624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6800b8430 0x7fa6801f1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.833+0000 7fa68699c700 1 --2- 172.21.15.22:0/1990114624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6800d3730 0x7fa68015e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.833+0000 7fa68599a700 1 -- 172.21.15.22:0/1990114624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6800d3730 msgr2=0x7fa68015e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.833+0000 7fa68599a700 1 --2- 172.21.15.22:0/1990114624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6800d3730 0x7fa68015e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.833+0000 7fa68599a700 1 -- 172.21.15.22:0/1990114624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6800b8430 msgr2=0x7fa6801f1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.833+0000 7fa68599a700 1 --2- 172.21.15.22:0/1990114624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6800b8430 0x7fa6801f1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.833+0000 7fa68599a700 1 -- 172.21.15.22:0/1990114624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa678009a70 con 0x7fa6800cfc60 2023-07-11T00:30:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.833+0000 7fa68599a700 1 --2- 172.21.15.22:0/1990114624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6800cfc60 0x7fa6800b3600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa670001eb0 tx=0x7fa67000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.834+0000 7fa676ffd700 1 -- 172.21.15.22:0/1990114624 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67000cea0 con 0x7fa6800cfc60 2023-07-11T00:30:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.834+0000 7fa676ffd700 1 -- 172.21.15.22:0/1990114624 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa670005d70 con 0x7fa6800cfc60 2023-07-11T00:30:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.834+0000 7fa6883ff700 1 -- 172.21.15.22:0/1990114624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67c0094a0 con 0x7fa6800cfc60 2023-07-11T00:30:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.834+0000 7fa676ffd700 1 -- 172.21.15.22:0/1990114624 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6700072f0 con 0x7fa6800cfc60 2023-07-11T00:30:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.834+0000 7fa6883ff700 1 -- 172.21.15.22:0/1990114624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68015d990 con 0x7fa6800cfc60 2023-07-11T00:30:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.835+0000 7fa6883ff700 1 -- 172.21.15.22:0/1990114624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6800cac60 con 0x7fa6800cfc60 2023-07-11T00:30:19.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.836+0000 7fa676ffd700 1 -- 172.21.15.22:0/1990114624 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa670007450 con 0x7fa6800cfc60 2023-07-11T00:30:19.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.837+0000 7fa676ffd700 1 --2- 172.21.15.22:0/1990114624 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa66406ace0 0x7fa66406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:19.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.837+0000 7fa676ffd700 1 -- 172.21.15.22:0/1990114624 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa670088ba0 con 0x7fa6800cfc60 2023-07-11T00:30:19.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.837+0000 7fa68619b700 1 --2- 172.21.15.22:0/1990114624 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa66406ace0 0x7fa66406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:19.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.838+0000 7fa68619b700 1 --2- 172.21.15.22:0/1990114624 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa66406ace0 0x7fa66406d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa67c000c00 tx=0x7fa67c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:19.841+0000 7fa676ffd700 1 -- 172.21.15.22:0/1990114624 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa6800cac60 con 0x7fa6800cfc60 2023-07-11T00:30:20.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.045+0000 7fa6883ff700 1 -- 172.21.15.22:0/1990114624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6800cac60 con 0x7fa6800cfc60 2023-07-11T00:30:20.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.045+0000 7fa676ffd700 1 -- 172.21.15.22:0/1990114624 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa6800cac60 con 0x7fa6800cfc60 2023-07-11T00:30:20.048 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:30:20.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.048+0000 7fa6883ff700 1 -- 172.21.15.22:0/1990114624 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa66406ace0 msgr2=0x7fa66406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:20.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.048+0000 7fa6883ff700 1 --2- 172.21.15.22:0/1990114624 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa66406ace0 0x7fa66406d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa67c000c00 tx=0x7fa67c008030 comp rx=0 tx=0).stop 2023-07-11T00:30:20.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.048+0000 7fa6883ff700 1 -- 172.21.15.22:0/1990114624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6800cfc60 msgr2=0x7fa6800b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:20.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.048+0000 7fa6883ff700 1 --2- 172.21.15.22:0/1990114624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6800cfc60 0x7fa6800b3600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa670001eb0 tx=0x7fa67000c7b0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.048+0000 7fa6883ff700 1 -- 172.21.15.22:0/1990114624 shutdown_connections 2023-07-11T00:30:20.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.048+0000 7fa6883ff700 1 --2- 172.21.15.22:0/1990114624 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa66406ace0 0x7fa66406d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.048+0000 7fa6883ff700 1 --2- 172.21.15.22:0/1990114624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6800d3730 0x7fa68015e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.048+0000 7fa6883ff700 1 --2- 172.21.15.22:0/1990114624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6800b8430 0x7fa6801f1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.048+0000 7fa6883ff700 1 --2- 172.21.15.22:0/1990114624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6800cfc60 0x7fa6800b3600 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.048+0000 7fa6883ff700 1 -- 172.21.15.22:0/1990114624 >> 172.21.15.22:0/1990114624 conn(0x7fa68006b3f0 msgr2=0x7fa680160500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:20.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.048+0000 7fa6883ff700 1 -- 172.21.15.22:0/1990114624 shutdown_connections 2023-07-11T00:30:20.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.048+0000 7fa6883ff700 1 -- 172.21.15.22:0/1990114624 wait complete. 2023-07-11T00:30:20.068 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:30:20.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.270+0000 7f1eecbff700 1 Processor -- start 2023-07-11T00:30:20.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.270+0000 7f1eecbff700 1 -- start start 2023-07-11T00:30:20.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.272+0000 7f1eecbff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1ee80b8430 0x7f1ee80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:20.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.272+0000 7f1eecbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ee80cfc60 0x7f1ee80d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:20.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.272+0000 7f1eecbff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee80d0b20 con 0x7f1ee80d3730 2023-07-11T00:30:20.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.272+0000 7f1eecbff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee80b8800 con 0x7f1ee80b8430 2023-07-11T00:30:20.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.272+0000 7f1eecbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee80b4ee0 con 0x7f1ee80cfc60 2023-07-11T00:30:20.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.272+0000 7f1ee659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1ee80b8430 0x7f1ee80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.272+0000 7f1edffff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1ee80d3730 0x7f1ee80cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57442/0 (socket says 172.21.15.22:57442) 2023-07-11T00:30:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.272+0000 7f1edffff700 1 -- 172.21.15.22:0/1913286308 learned_addr learned my addr 172.21.15.22:0/1913286308 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.272+0000 7f1ee6d9d700 1 --2- 172.21.15.22:0/1913286308 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ee80cfc60 0x7f1ee80d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.272+0000 7f1ee659c700 1 -- 172.21.15.22:0/1913286308 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ee80cfc60 msgr2=0x7f1ee80d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.272+0000 7f1ee659c700 1 --2- 172.21.15.22:0/1913286308 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ee80cfc60 0x7f1ee80d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.272+0000 7f1ee659c700 1 -- 172.21.15.22:0/1913286308 >> v1:172.21.15.22:6789/0 conn(0x7f1ee80d3730 legacy=0x7f1ee80cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:20.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.272+0000 7f1ee659c700 1 -- 172.21.15.22:0/1913286308 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee80b51c0 con 0x7f1ee80b8430 2023-07-11T00:30:20.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.272+0000 7f1ee6d9d700 1 --2- 172.21.15.22:0/1913286308 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ee80cfc60 0x7f1ee80d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:30:20.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.273+0000 7f1ee659c700 1 --2- 172.21.15.22:0/1913286308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ee80b8430 0x7f1ee80cd320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8009840 tx=0x7f1ed8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c6ceeb935d07c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:20.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.273+0000 7f1ee5d9b700 1 -- 172.21.15.22:0/1913286308 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8011830 con 0x7f1ee80b8430 2023-07-11T00:30:20.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.273+0000 7f1ee5d9b700 1 -- 172.21.15.22:0/1913286308 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed8011990 con 0x7f1ee80b8430 2023-07-11T00:30:20.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.273+0000 7f1ee5d9b700 1 -- 172.21.15.22:0/1913286308 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8011d20 con 0x7f1ee80b8430 2023-07-11T00:30:20.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.273+0000 7f1eecbff700 1 -- 172.21.15.22:0/1913286308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ee80b8430 msgr2=0x7f1ee80cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:20.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.273+0000 7f1eecbff700 1 --2- 172.21.15.22:0/1913286308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ee80b8430 0x7f1ee80cd320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8009840 tx=0x7f1ed8009b50 comp rx=0 tx=0).stop 2023-07-11T00:30:20.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.273+0000 7f1eecbff700 1 -- 172.21.15.22:0/1913286308 shutdown_connections 2023-07-11T00:30:20.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.273+0000 7f1eecbff700 1 --2- 172.21.15.22:0/1913286308 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ee80cfc60 0x7f1ee80d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.273+0000 7f1eecbff700 1 --2- 172.21.15.22:0/1913286308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ee80b8430 0x7f1ee80cd320 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.273+0000 7f1eecbff700 1 -- 172.21.15.22:0/1913286308 >> 172.21.15.22:0/1913286308 conn(0x7f1ee806b3f0 msgr2=0x7f1ee806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:20.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.274+0000 7f1eecbff700 1 -- 172.21.15.22:0/1913286308 shutdown_connections 2023-07-11T00:30:20.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.274+0000 7f1eecbff700 1 -- 172.21.15.22:0/1913286308 wait complete. 2023-07-11T00:30:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.275+0000 7f1eecbff700 1 Processor -- start 2023-07-11T00:30:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.275+0000 7f1eecbff700 1 -- start start 2023-07-11T00:30:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.276+0000 7f1eecbff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ee80b8430 0x7f1ee81580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.276+0000 7f1eecbff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ee80cfc60 0x7f1ee80c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.276+0000 7f1eecbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ee80d3730 0x7f1ee815fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.276+0000 7f1eecbff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee80cca30 con 0x7f1ee80cfc60 2023-07-11T00:30:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.276+0000 7f1eecbff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee80c9cb0 con 0x7f1ee80b8430 2023-07-11T00:30:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.276+0000 7f1eecbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee80c9f90 con 0x7f1ee80d3730 2023-07-11T00:30:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.276+0000 7f1edffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ee80cfc60 0x7f1ee80c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.277+0000 7f1edffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ee80cfc60 0x7f1ee80c8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55648/0 (socket says 172.21.15.22:55648) 2023-07-11T00:30:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.277+0000 7f1edffff700 1 -- 172.21.15.22:0/1876054056 learned_addr learned my addr 172.21.15.22:0/1876054056 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.277+0000 7f1ee6d9d700 1 --2- 172.21.15.22:0/1876054056 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ee80d3730 0x7f1ee815fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.277+0000 7f1ee659c700 1 --2- 172.21.15.22:0/1876054056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ee80b8430 0x7f1ee81580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.277+0000 7f1edffff700 1 -- 172.21.15.22:0/1876054056 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ee80d3730 msgr2=0x7f1ee815fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.277+0000 7f1edffff700 1 --2- 172.21.15.22:0/1876054056 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ee80d3730 0x7f1ee815fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.277+0000 7f1edffff700 1 -- 172.21.15.22:0/1876054056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ee80b8430 msgr2=0x7f1ee81580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.277+0000 7f1edffff700 1 --2- 172.21.15.22:0/1876054056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ee80b8430 0x7f1ee81580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.277+0000 7f1edffff700 1 -- 172.21.15.22:0/1876054056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed80094a0 con 0x7f1ee80cfc60 2023-07-11T00:30:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.277+0000 7f1edffff700 1 --2- 172.21.15.22:0/1876054056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ee80cfc60 0x7f1ee80c8070 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000c520 tx=0x7f1ed000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.278+0000 7f1edeffd700 1 -- 172.21.15.22:0/1876054056 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0005d70 con 0x7f1ee80cfc60 2023-07-11T00:30:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.278+0000 7f1edeffd700 1 -- 172.21.15.22:0/1876054056 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed00070d0 con 0x7f1ee80cfc60 2023-07-11T00:30:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.278+0000 7f1edeffd700 1 -- 172.21.15.22:0/1876054056 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0007440 con 0x7f1ee80cfc60 2023-07-11T00:30:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.278+0000 7f1eecbff700 1 -- 172.21.15.22:0/1876054056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee80ca270 con 0x7f1ee80cfc60 2023-07-11T00:30:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.278+0000 7f1eecbff700 1 -- 172.21.15.22:0/1876054056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee80ca830 con 0x7f1ee80cfc60 2023-07-11T00:30:20.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.279+0000 7f1eecbff700 1 -- 172.21.15.22:0/1876054056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee80cd840 con 0x7f1ee80cfc60 2023-07-11T00:30:20.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.280+0000 7f1edeffd700 1 -- 172.21.15.22:0/1876054056 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ed00075a0 con 0x7f1ee80cfc60 2023-07-11T00:30:20.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.281+0000 7f1edeffd700 1 --2- 172.21.15.22:0/1876054056 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1ec806ace0 0x7f1ec806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.281+0000 7f1edeffd700 1 -- 172.21.15.22:0/1876054056 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1ed0088ac0 con 0x7f1ee80cfc60 2023-07-11T00:30:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.281+0000 7f1ee659c700 1 --2- 172.21.15.22:0/1876054056 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1ec806ace0 0x7f1ec806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.282+0000 7f1ee659c700 1 --2- 172.21.15.22:0/1876054056 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1ec806ace0 0x7f1ec806d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80090b0 tx=0x7f1ed801c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.285+0000 7f1edeffd700 1 -- 172.21.15.22:0/1876054056 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1ee80cd840 con 0x7f1ee80cfc60 2023-07-11T00:30:20.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.487+0000 7f1eecbff700 1 -- 172.21.15.22:0/1876054056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ee80cd840 con 0x7f1ee80cfc60 2023-07-11T00:30:20.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.487+0000 7f1edeffd700 1 -- 172.21.15.22:0/1876054056 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1ee80cd840 con 0x7f1ee80cfc60 2023-07-11T00:30:20.490 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-07-11T00:30:20.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.489+0000 7f1eecbff700 1 -- 172.21.15.22:0/1876054056 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1ec806ace0 msgr2=0x7f1ec806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:20.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.489+0000 7f1eecbff700 1 --2- 172.21.15.22:0/1876054056 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1ec806ace0 0x7f1ec806d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80090b0 tx=0x7f1ed801c040 comp rx=0 tx=0).stop 2023-07-11T00:30:20.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.489+0000 7f1eecbff700 1 -- 172.21.15.22:0/1876054056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ee80cfc60 msgr2=0x7f1ee80c8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:20.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.489+0000 7f1eecbff700 1 --2- 172.21.15.22:0/1876054056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ee80cfc60 0x7f1ee80c8070 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000c520 tx=0x7f1ed000c830 comp rx=0 tx=0).stop 2023-07-11T00:30:20.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.490+0000 7f1eecbff700 1 -- 172.21.15.22:0/1876054056 shutdown_connections 2023-07-11T00:30:20.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.490+0000 7f1eecbff700 1 --2- 172.21.15.22:0/1876054056 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1ec806ace0 0x7f1ec806d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.490+0000 7f1eecbff700 1 --2- 172.21.15.22:0/1876054056 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ee80d3730 0x7f1ee815fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.490+0000 7f1eecbff700 1 --2- 172.21.15.22:0/1876054056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ee80b8430 0x7f1ee81580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.490+0000 7f1eecbff700 1 --2- 172.21.15.22:0/1876054056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ee80cfc60 0x7f1ee80c8070 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.490+0000 7f1eecbff700 1 -- 172.21.15.22:0/1876054056 >> 172.21.15.22:0/1876054056 conn(0x7f1ee806b3f0 msgr2=0x7f1ee80cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:20.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.490+0000 7f1eecbff700 1 -- 172.21.15.22:0/1876054056 shutdown_connections 2023-07-11T00:30:20.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.490+0000 7f1eecbff700 1 -- 172.21.15.22:0/1876054056 wait complete. 2023-07-11T00:30:20.510 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-11T00:30:20.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.711+0000 7f6c079ff700 1 Processor -- start 2023-07-11T00:30:20.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.711+0000 7f6c079ff700 1 -- start start 2023-07-11T00:30:20.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.712+0000 7f6c079ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6c000d3730 0x7f6c000cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:20.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.712+0000 7f6c079ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c000cfa90 0x7f6c000d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:20.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.712+0000 7f6c079ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c000d0b20 con 0x7f6c000b8430 2023-07-11T00:30:20.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.712+0000 7f6c079ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c000cda30 con 0x7f6c000d3730 2023-07-11T00:30:20.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.712+0000 7f6c079ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000b8800 con 0x7f6c000cfa90 2023-07-11T00:30:20.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.713+0000 7f6c04f9a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6c000d3730 0x7f6c000cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:20.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.713+0000 7f6c04f9a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6c000d3730 0x7f6c000cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55662/0 (socket says 172.21.15.22:55662) 2023-07-11T00:30:20.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.713+0000 7f6c04f9a700 1 -- 172.21.15.22:0/4239054143 learned_addr learned my addr 172.21.15.22:0/4239054143 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:20.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.713+0000 7f6c05f9c700 1 --2- 172.21.15.22:0/4239054143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c000cfa90 0x7f6c000d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:20.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.713+0000 7f6c04f9a700 1 -- 172.21.15.22:0/4239054143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c000cfa90 msgr2=0x7f6c000d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:20.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.713+0000 7f6c04f9a700 1 --2- 172.21.15.22:0/4239054143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c000cfa90 0x7f6c000d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.713+0000 7f6c04f9a700 1 -- 172.21.15.22:0/4239054143 >> v1:172.21.15.184:6789/0 conn(0x7f6c000b8430 legacy=0x7f6c000cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:20.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.713+0000 7f6c04f9a700 1 -- 172.21.15.22:0/4239054143 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c000cfeb0 con 0x7f6c000d3730 2023-07-11T00:30:20.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.713+0000 7f6c05f9c700 1 --2- 172.21.15.22:0/4239054143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c000cfa90 0x7f6c000d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:20.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.713+0000 7f6c04f9a700 1 --2- 172.21.15.22:0/4239054143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c000d3730 0x7f6c000cf550 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00098f0 tx=0x7f6bf0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398ddb1c3a21aa13 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:20.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.713+0000 7f6bf7fff700 1 -- 172.21.15.22:0/4239054143 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf000b8a0 con 0x7f6c000d3730 2023-07-11T00:30:20.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.713+0000 7f6bf7fff700 1 -- 172.21.15.22:0/4239054143 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf000ba00 con 0x7f6c000d3730 2023-07-11T00:30:20.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.713+0000 7f6bf7fff700 1 -- 172.21.15.22:0/4239054143 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf000bd90 con 0x7f6c000d3730 2023-07-11T00:30:20.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.714+0000 7f6c079ff700 1 -- 172.21.15.22:0/4239054143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c000d3730 msgr2=0x7f6c000cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:20.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.714+0000 7f6c079ff700 1 --2- 172.21.15.22:0/4239054143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c000d3730 0x7f6c000cf550 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00098f0 tx=0x7f6bf0009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:20.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.714+0000 7f6c079ff700 1 -- 172.21.15.22:0/4239054143 shutdown_connections 2023-07-11T00:30:20.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.714+0000 7f6c079ff700 1 --2- 172.21.15.22:0/4239054143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c000cfa90 0x7f6c000d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.714+0000 7f6c079ff700 1 --2- 172.21.15.22:0/4239054143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c000d3730 0x7f6c000cf550 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.714+0000 7f6c079ff700 1 -- 172.21.15.22:0/4239054143 >> 172.21.15.22:0/4239054143 conn(0x7f6c0006b3f0 msgr2=0x7f6c0006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:20.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.714+0000 7f6c079ff700 1 -- 172.21.15.22:0/4239054143 shutdown_connections 2023-07-11T00:30:20.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.714+0000 7f6c079ff700 1 -- 172.21.15.22:0/4239054143 wait complete. 2023-07-11T00:30:20.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.716+0000 7f6c079ff700 1 Processor -- start 2023-07-11T00:30:20.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.716+0000 7f6c079ff700 1 -- start start 2023-07-11T00:30:20.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.717+0000 7f6c079ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c000b8430 0x7f6c000c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:20.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.717+0000 7f6c079ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c000cfa90 0x7f6c001f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:20.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.717+0000 7f6c079ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c000d3730 0x7f6c000b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:20.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.717+0000 7f6c079ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000c6f70 con 0x7f6c000cfa90 2023-07-11T00:30:20.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.717+0000 7f6c079ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000c7250 con 0x7f6c000b8430 2023-07-11T00:30:20.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.717+0000 7f6c079ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000c7530 con 0x7f6c000d3730 2023-07-11T00:30:20.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.717+0000 7f6c04f9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c000cfa90 0x7f6c001f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:20.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.717+0000 7f6c04f9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c000cfa90 0x7f6c001f1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55674/0 (socket says 172.21.15.22:55674) 2023-07-11T00:30:20.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.717+0000 7f6c0579b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c000b8430 0x7f6c000c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:20.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.717+0000 7f6c04f9a700 1 -- 172.21.15.22:0/3223983206 learned_addr learned my addr 172.21.15.22:0/3223983206 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.718+0000 7f6c05f9c700 1 --2- 172.21.15.22:0/3223983206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c000d3730 0x7f6c000b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.718+0000 7f6c04f9a700 1 -- 172.21.15.22:0/3223983206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c000d3730 msgr2=0x7f6c000b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.718+0000 7f6c04f9a700 1 --2- 172.21.15.22:0/3223983206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c000d3730 0x7f6c000b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.718+0000 7f6c04f9a700 1 -- 172.21.15.22:0/3223983206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c000b8430 msgr2=0x7f6c000c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.718+0000 7f6c04f9a700 1 --2- 172.21.15.22:0/3223983206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c000b8430 0x7f6c000c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.718+0000 7f6c04f9a700 1 -- 172.21.15.22:0/3223983206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf0009550 con 0x7f6c000cfa90 2023-07-11T00:30:20.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.718+0000 7f6c04f9a700 1 --2- 172.21.15.22:0/3223983206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c000cfa90 0x7f6c001f1550 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009c40 tx=0x7f6bf0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:20.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.718+0000 7f6bf5ffb700 1 -- 172.21.15.22:0/3223983206 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0004510 con 0x7f6c000cfa90 2023-07-11T00:30:20.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.718+0000 7f6bf5ffb700 1 -- 172.21.15.22:0/3223983206 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf001e070 con 0x7f6c000cfa90 2023-07-11T00:30:20.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.718+0000 7f6bf5ffb700 1 -- 172.21.15.22:0/3223983206 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf00038e0 con 0x7f6c000cfa90 2023-07-11T00:30:20.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.718+0000 7f6c079ff700 1 -- 172.21.15.22:0/3223983206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c000c7810 con 0x7f6c000cfa90 2023-07-11T00:30:20.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.719+0000 7f6c079ff700 1 -- 172.21.15.22:0/3223983206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c000c6bb0 con 0x7f6c000cfa90 2023-07-11T00:30:20.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.720+0000 7f6c079ff700 1 -- 172.21.15.22:0/3223983206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0004ea60 con 0x7f6c000cfa90 2023-07-11T00:30:20.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.721+0000 7f6bf5ffb700 1 -- 172.21.15.22:0/3223983206 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6bf0003a40 con 0x7f6c000cfa90 2023-07-11T00:30:20.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.721+0000 7f6bf5ffb700 1 --2- 172.21.15.22:0/3223983206 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6be406ace0 0x7f6be406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:20.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.722+0000 7f6bf5ffb700 1 -- 172.21.15.22:0/3223983206 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6bf0020070 con 0x7f6c000cfa90 2023-07-11T00:30:20.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.722+0000 7f6c0579b700 1 --2- 172.21.15.22:0/3223983206 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6be406ace0 0x7f6be406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:20.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.723+0000 7f6c0579b700 1 --2- 172.21.15.22:0/3223983206 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6be406ace0 0x7f6be406d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc007fd0 tx=0x7f6bfc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:20.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.726+0000 7f6bf5ffb700 1 -- 172.21.15.22:0/3223983206 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6bf0055970 con 0x7f6c000cfa90 2023-07-11T00:30:20.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.934+0000 7f6c079ff700 1 -- 172.21.15.22:0/3223983206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6c000c6d40 con 0x7f6c000cfa90 2023-07-11T00:30:20.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.935+0000 7f6bf5ffb700 1 -- 172.21.15.22:0/3223983206 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6bf0058f90 con 0x7f6c000cfa90 2023-07-11T00:30:20.938 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:30:20.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.937+0000 7f6c079ff700 1 -- 172.21.15.22:0/3223983206 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6be406ace0 msgr2=0x7f6be406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:20.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.937+0000 7f6c079ff700 1 --2- 172.21.15.22:0/3223983206 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6be406ace0 0x7f6be406d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc007fd0 tx=0x7f6bfc009040 comp rx=0 tx=0).stop 2023-07-11T00:30:20.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.937+0000 7f6c079ff700 1 -- 172.21.15.22:0/3223983206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c000cfa90 msgr2=0x7f6c001f1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:20.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.937+0000 7f6c079ff700 1 --2- 172.21.15.22:0/3223983206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c000cfa90 0x7f6c001f1550 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009c40 tx=0x7f6bf0004750 comp rx=0 tx=0).stop 2023-07-11T00:30:20.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.937+0000 7f6c079ff700 1 -- 172.21.15.22:0/3223983206 shutdown_connections 2023-07-11T00:30:20.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.937+0000 7f6c079ff700 1 --2- 172.21.15.22:0/3223983206 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6be406ace0 0x7f6be406d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.937+0000 7f6c079ff700 1 --2- 172.21.15.22:0/3223983206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c000d3730 0x7f6c000b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.937+0000 7f6c079ff700 1 --2- 172.21.15.22:0/3223983206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c000b8430 0x7f6c000c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.937+0000 7f6c079ff700 1 --2- 172.21.15.22:0/3223983206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c000cfa90 0x7f6c001f1550 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:20.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.937+0000 7f6c079ff700 1 -- 172.21.15.22:0/3223983206 >> 172.21.15.22:0/3223983206 conn(0x7f6c0006b3f0 msgr2=0x7f6c000d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:20.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.937+0000 7f6c079ff700 1 -- 172.21.15.22:0/3223983206 shutdown_connections 2023-07-11T00:30:20.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:20.938+0000 7f6c079ff700 1 -- 172.21.15.22:0/3223983206 wait complete. 2023-07-11T00:30:20.958 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-11T00:30:21.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.160+0000 7fd801fff700 1 Processor -- start 2023-07-11T00:30:21.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.161+0000 7fd801fff700 1 -- start start 2023-07-11T00:30:21.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.162+0000 7fd801fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd7fc15c460 0x7fd7fc0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:21.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.162+0000 7fd801fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7fc0cf8f0 0x7fd7fc15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:21.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.162+0000 7fd801fff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7fc0d1790 con 0x7fd7fc0d2640 2023-07-11T00:30:21.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.162+0000 7fd801fff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7fc0cedd0 con 0x7fd7fc0cf8f0 2023-07-11T00:30:21.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.162+0000 7fd801fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7fc0cd950 con 0x7fd7fc15c460 2023-07-11T00:30:21.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.162+0000 7fd7fbfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7fc0cf8f0 0x7fd7fc15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:21.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.162+0000 7fd7f3fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd7fc0d2640 0x7fd7fc0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57458/0 (socket says 172.21.15.22:57458) 2023-07-11T00:30:21.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.162+0000 7fd7fbfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7fc0cf8f0 0x7fd7fc15fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55678/0 (socket says 172.21.15.22:55678) 2023-07-11T00:30:21.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.162+0000 7fd7fbfff700 1 -- 172.21.15.22:0/735085112 learned_addr learned my addr 172.21.15.22:0/735085112 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:21.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.162+0000 7fd7fb7fe700 1 --2- 172.21.15.22:0/735085112 >> v2:172.21.15.184:3300/0 conn(0x7fd7fc15c460 0x7fd7fc0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:21.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.162+0000 7fd7fbfff700 1 -- 172.21.15.22:0/735085112 >> v2:172.21.15.184:3300/0 conn(0x7fd7fc15c460 msgr2=0x7fd7fc0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:21.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.163+0000 7fd7fbfff700 1 --2- 172.21.15.22:0/735085112 >> v2:172.21.15.184:3300/0 conn(0x7fd7fc15c460 0x7fd7fc0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.163+0000 7fd7fbfff700 1 -- 172.21.15.22:0/735085112 >> v1:172.21.15.22:6789/0 conn(0x7fd7fc0d2640 legacy=0x7fd7fc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:21.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.163+0000 7fd7fbfff700 1 -- 172.21.15.22:0/735085112 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc0d14b0 con 0x7fd7fc0cf8f0 2023-07-11T00:30:21.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.163+0000 7fd7fb7fe700 1 --2- 172.21.15.22:0/735085112 >> v2:172.21.15.184:3300/0 conn(0x7fd7fc15c460 0x7fd7fc0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:21.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.163+0000 7fd7fbfff700 1 --2- 172.21.15.22:0/735085112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc0cf8f0 0x7fd7fc15fe20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0b4f00 tx=0x7fd7f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771481afea4c4f44 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:21.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.163+0000 7fd7faffd700 1 -- 172.21.15.22:0/735085112 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f400e070 con 0x7fd7fc0cf8f0 2023-07-11T00:30:21.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.163+0000 7fd7faffd700 1 -- 172.21.15.22:0/735085112 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f400b9c0 con 0x7fd7fc0cf8f0 2023-07-11T00:30:21.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.163+0000 7fd7faffd700 1 -- 172.21.15.22:0/735085112 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f400bd70 con 0x7fd7fc0cf8f0 2023-07-11T00:30:21.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.163+0000 7fd801fff700 1 -- 172.21.15.22:0/735085112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc0cf8f0 msgr2=0x7fd7fc15fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:21.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.163+0000 7fd801fff700 1 --2- 172.21.15.22:0/735085112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc0cf8f0 0x7fd7fc15fe20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0b4f00 tx=0x7fd7f400b330 comp rx=0 tx=0).stop 2023-07-11T00:30:21.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.164+0000 7fd801fff700 1 -- 172.21.15.22:0/735085112 shutdown_connections 2023-07-11T00:30:21.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.164+0000 7fd801fff700 1 --2- 172.21.15.22:0/735085112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc0cf8f0 0x7fd7fc15fe20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.164+0000 7fd801fff700 1 --2- 172.21.15.22:0/735085112 >> v2:172.21.15.184:3300/0 conn(0x7fd7fc15c460 0x7fd7fc0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.164+0000 7fd801fff700 1 -- 172.21.15.22:0/735085112 >> 172.21.15.22:0/735085112 conn(0x7fd7fc071660 msgr2=0x7fd7fc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:21.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.164+0000 7fd801fff700 1 -- 172.21.15.22:0/735085112 shutdown_connections 2023-07-11T00:30:21.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.164+0000 7fd801fff700 1 -- 172.21.15.22:0/735085112 wait complete. 2023-07-11T00:30:21.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.166+0000 7fd801fff700 1 Processor -- start 2023-07-11T00:30:21.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.166+0000 7fd801fff700 1 -- start start 2023-07-11T00:30:21.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.168+0000 7fd801fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7fc0cf8f0 0x7fd7fc153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:21.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.168+0000 7fd801fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7fc0d2640 0x7fd7fc0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:21.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.168+0000 7fd801fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc15c460 0x7fd7fc0c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:21.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.168+0000 7fd801fff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc0c78a0 con 0x7fd7fc15c460 2023-07-11T00:30:21.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.168+0000 7fd801fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc0c7b80 con 0x7fd7fc0d2640 2023-07-11T00:30:21.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.168+0000 7fd801fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc0c7e60 con 0x7fd7fc0cf8f0 2023-07-11T00:30:21.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.168+0000 7fd7fbfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc15c460 0x7fd7fc0c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:21.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.168+0000 7fd7fbfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc15c460 0x7fd7fc0c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55690/0 (socket says 172.21.15.22:55690) 2023-07-11T00:30:21.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.168+0000 7fd7fbfff700 1 -- 172.21.15.22:0/2395529767 learned_addr learned my addr 172.21.15.22:0/2395529767 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:21.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.168+0000 7fd7fb7fe700 1 --2- 172.21.15.22:0/2395529767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7fc0cf8f0 0x7fd7fc153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:21.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.168+0000 7fd7f3fff700 1 --2- 172.21.15.22:0/2395529767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7fc0d2640 0x7fd7fc0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:21.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.168+0000 7fd7fbfff700 1 -- 172.21.15.22:0/2395529767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7fc0cf8f0 msgr2=0x7fd7fc153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:21.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.168+0000 7fd7fbfff700 1 --2- 172.21.15.22:0/2395529767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7fc0cf8f0 0x7fd7fc153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.168+0000 7fd7fbfff700 1 -- 172.21.15.22:0/2395529767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7fc0d2640 msgr2=0x7fd7fc0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:21.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.168+0000 7fd7fbfff700 1 --2- 172.21.15.22:0/2395529767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7fc0d2640 0x7fd7fc0cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.168+0000 7fd7fbfff700 1 -- 172.21.15.22:0/2395529767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f4009b30 con 0x7fd7fc15c460 2023-07-11T00:30:21.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.169+0000 7fd7fbfff700 1 --2- 172.21.15.22:0/2395529767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc15c460 0x7fd7fc0c8940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0d3c80 tx=0x7fd7f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:21.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.169+0000 7fd7f8ff9700 1 -- 172.21.15.22:0/2395529767 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4004930 con 0x7fd7fc15c460 2023-07-11T00:30:21.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.169+0000 7fd7f8ff9700 1 -- 172.21.15.22:0/2395529767 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f40099b0 con 0x7fd7fc15c460 2023-07-11T00:30:21.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.169+0000 7fd7f8ff9700 1 -- 172.21.15.22:0/2395529767 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f401b670 con 0x7fd7fc15c460 2023-07-11T00:30:21.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.169+0000 7fd801fff700 1 -- 172.21.15.22:0/2395529767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7fc0c8140 con 0x7fd7fc15c460 2023-07-11T00:30:21.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.169+0000 7fd801fff700 1 -- 172.21.15.22:0/2395529767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7fc1f2980 con 0x7fd7fc15c460 2023-07-11T00:30:21.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.170+0000 7fd801fff700 1 -- 172.21.15.22:0/2395529767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7fc1f2b10 con 0x7fd7fc15c460 2023-07-11T00:30:21.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.171+0000 7fd7f8ff9700 1 -- 172.21.15.22:0/2395529767 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd7f401b7d0 con 0x7fd7fc15c460 2023-07-11T00:30:21.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.172+0000 7fd7f8ff9700 1 --2- 172.21.15.22:0/2395529767 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd7dc06ace0 0x7fd7dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:21.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.172+0000 7fd7f8ff9700 1 -- 172.21.15.22:0/2395529767 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd7f408ace0 con 0x7fd7fc15c460 2023-07-11T00:30:21.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.172+0000 7fd7fb7fe700 1 --2- 172.21.15.22:0/2395529767 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd7dc06ace0 0x7fd7dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:21.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.173+0000 7fd7fb7fe700 1 --2- 172.21.15.22:0/2395529767 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd7dc06ace0 0x7fd7dc06d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc1581d0 tx=0x7fd7ec008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:21.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.176+0000 7fd7f8ff9700 1 -- 172.21.15.22:0/2395529767 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd7f4055a90 con 0x7fd7fc15c460 2023-07-11T00:30:21.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.395+0000 7fd801fff700 1 -- 172.21.15.22:0/2395529767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd7fc0c8600 con 0x7fd7fc15c460 2023-07-11T00:30:21.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.396+0000 7fd7f8ff9700 1 -- 172.21.15.22:0/2395529767 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd7f40590b0 con 0x7fd7fc15c460 2023-07-11T00:30:21.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.398+0000 7fd801fff700 1 -- 172.21.15.22:0/2395529767 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd7dc06ace0 msgr2=0x7fd7dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:21.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.398+0000 7fd801fff700 1 --2- 172.21.15.22:0/2395529767 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd7dc06ace0 0x7fd7dc06d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc1581d0 tx=0x7fd7ec008040 comp rx=0 tx=0).stop 2023-07-11T00:30:21.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.398+0000 7fd801fff700 1 -- 172.21.15.22:0/2395529767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc15c460 msgr2=0x7fd7fc0c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:21.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.398+0000 7fd801fff700 1 --2- 172.21.15.22:0/2395529767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc15c460 0x7fd7fc0c8940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0d3c80 tx=0x7fd7f4004ad0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.398+0000 7fd801fff700 1 -- 172.21.15.22:0/2395529767 shutdown_connections 2023-07-11T00:30:21.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.398+0000 7fd801fff700 1 --2- 172.21.15.22:0/2395529767 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd7dc06ace0 0x7fd7dc06d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.398+0000 7fd801fff700 1 --2- 172.21.15.22:0/2395529767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7fc0cf8f0 0x7fd7fc153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.398+0000 7fd801fff700 1 --2- 172.21.15.22:0/2395529767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc15c460 0x7fd7fc0c8940 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.398+0000 7fd801fff700 1 --2- 172.21.15.22:0/2395529767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7fc0d2640 0x7fd7fc0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.398+0000 7fd801fff700 1 -- 172.21.15.22:0/2395529767 >> 172.21.15.22:0/2395529767 conn(0x7fd7fc071660 msgr2=0x7fd7fc0cf070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:21.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.398+0000 7fd801fff700 1 -- 172.21.15.22:0/2395529767 shutdown_connections 2023-07-11T00:30:21.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.398+0000 7fd801fff700 1 -- 172.21.15.22:0/2395529767 wait complete. 2023-07-11T00:30:21.402 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-07-11T00:30:21.419 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:30:21.419 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:30:21.466 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:30:21.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.703+0000 7fc7735ff700 1 Processor -- start 2023-07-11T00:30:21.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.703+0000 7fc7735ff700 1 -- start start 2023-07-11T00:30:21.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.705+0000 7fc7735ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76c0d2640 0x7fc76c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:21.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.705+0000 7fc7735ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc76c0cf8f0 0x7fc76c15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:21.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.705+0000 7fc7735ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76c0d1790 con 0x7fc76c15c460 2023-07-11T00:30:21.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.705+0000 7fc7735ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76c0cedd0 con 0x7fc76c0cf8f0 2023-07-11T00:30:21.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.705+0000 7fc7735ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c0cd950 con 0x7fc76c0d2640 2023-07-11T00:30:21.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.705+0000 7fc770b9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76c0d2640 0x7fc76c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:21.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.705+0000 7fc770b9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76c0d2640 0x7fc76c0b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:35688/0 (socket says 172.21.15.22:35688) 2023-07-11T00:30:21.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.705+0000 7fc770b9a700 1 -- 172.21.15.22:0/302084127 learned_addr learned my addr 172.21.15.22:0/302084127 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:21.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.705+0000 7fc771b9c700 1 --2- 172.21.15.22:0/302084127 >> v2:172.21.15.184:3300/0 conn(0x7fc76c0cf8f0 0x7fc76c15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:21.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.706+0000 7fc770b9a700 1 -- 172.21.15.22:0/302084127 >> v2:172.21.15.184:3300/0 conn(0x7fc76c0cf8f0 msgr2=0x7fc76c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:21.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.706+0000 7fc770b9a700 1 --2- 172.21.15.22:0/302084127 >> v2:172.21.15.184:3300/0 conn(0x7fc76c0cf8f0 0x7fc76c15fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.706+0000 7fc770b9a700 1 -- 172.21.15.22:0/302084127 >> v1:172.21.15.184:6789/0 conn(0x7fc76c15c460 legacy=0x7fc76c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:21.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.706+0000 7fc770b9a700 1 -- 172.21.15.22:0/302084127 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c0d14b0 con 0x7fc76c0d2640 2023-07-11T00:30:21.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.706+0000 7fc770b9a700 1 --2- 172.21.15.22:0/302084127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76c0d2640 0x7fc76c0b59d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0098f0 tx=0x7fc75c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4105f08455cc5b73 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:21.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.706+0000 7fc763fff700 1 -- 172.21.15.22:0/302084127 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c011830 con 0x7fc76c0d2640 2023-07-11T00:30:21.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.706+0000 7fc763fff700 1 -- 172.21.15.22:0/302084127 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c011990 con 0x7fc76c0d2640 2023-07-11T00:30:21.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.706+0000 7fc763fff700 1 -- 172.21.15.22:0/302084127 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c011d20 con 0x7fc76c0d2640 2023-07-11T00:30:21.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.707+0000 7fc7735ff700 1 -- 172.21.15.22:0/302084127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76c0d2640 msgr2=0x7fc76c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:21.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.707+0000 7fc7735ff700 1 --2- 172.21.15.22:0/302084127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76c0d2640 0x7fc76c0b59d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0098f0 tx=0x7fc75c009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:21.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.707+0000 7fc7735ff700 1 -- 172.21.15.22:0/302084127 shutdown_connections 2023-07-11T00:30:21.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.707+0000 7fc7735ff700 1 --2- 172.21.15.22:0/302084127 >> v2:172.21.15.184:3300/0 conn(0x7fc76c0cf8f0 0x7fc76c15fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.707+0000 7fc7735ff700 1 --2- 172.21.15.22:0/302084127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76c0d2640 0x7fc76c0b59d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.707+0000 7fc7735ff700 1 -- 172.21.15.22:0/302084127 >> 172.21.15.22:0/302084127 conn(0x7fc76c071660 msgr2=0x7fc76c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:21.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.707+0000 7fc7735ff700 1 -- 172.21.15.22:0/302084127 shutdown_connections 2023-07-11T00:30:21.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.707+0000 7fc7735ff700 1 -- 172.21.15.22:0/302084127 wait complete. 2023-07-11T00:30:21.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.709+0000 7fc7735ff700 1 Processor -- start 2023-07-11T00:30:21.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.709+0000 7fc7735ff700 1 -- start start 2023-07-11T00:30:21.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.710+0000 7fc7735ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc76c0cf8f0 0x7fc76c15c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:21.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.710+0000 7fc7735ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76c0d2640 0x7fc76c14c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:21.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.710+0000 7fc7735ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc76c15c460 0x7fc76c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:21.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.710+0000 7fc7735ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c0c9df0 con 0x7fc76c0cf8f0 2023-07-11T00:30:21.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.710+0000 7fc7735ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c15d620 con 0x7fc76c15c460 2023-07-11T00:30:21.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.710+0000 7fc7735ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c15d060 con 0x7fc76c0d2640 2023-07-11T00:30:21.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.710+0000 7fc77139b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc76c0cf8f0 0x7fc76c15c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:21.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.710+0000 7fc77139b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc76c0cf8f0 0x7fc76c15c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55704/0 (socket says 172.21.15.22:55704) 2023-07-11T00:30:21.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.710+0000 7fc77139b700 1 -- 172.21.15.22:0/3914010318 learned_addr learned my addr 172.21.15.22:0/3914010318 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:21.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.710+0000 7fc771b9c700 1 --2- 172.21.15.22:0/3914010318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc76c15c460 0x7fc76c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:21.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.710+0000 7fc770b9a700 1 --2- 172.21.15.22:0/3914010318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76c0d2640 0x7fc76c14c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:21.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.710+0000 7fc77139b700 1 -- 172.21.15.22:0/3914010318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76c0d2640 msgr2=0x7fc76c14c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:21.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.710+0000 7fc77139b700 1 --2- 172.21.15.22:0/3914010318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76c0d2640 0x7fc76c14c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.710+0000 7fc77139b700 1 -- 172.21.15.22:0/3914010318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc76c15c460 msgr2=0x7fc76c15eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:21.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.710+0000 7fc77139b700 1 --2- 172.21.15.22:0/3914010318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc76c15c460 0x7fc76c15eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.710+0000 7fc77139b700 1 -- 172.21.15.22:0/3914010318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c009550 con 0x7fc76c0cf8f0 2023-07-11T00:30:21.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.710+0000 7fc770b9a700 1 --2- 172.21.15.22:0/3914010318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76c0d2640 0x7fc76c14c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:21.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.711+0000 7fc77139b700 1 --2- 172.21.15.22:0/3914010318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc76c0cf8f0 0x7fc76c15c830 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc76800c4e0 tx=0x7fc76800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:21.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.711+0000 7fc761ffb700 1 -- 172.21.15.22:0/3914010318 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7680052d0 con 0x7fc76c0cf8f0 2023-07-11T00:30:21.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.711+0000 7fc761ffb700 1 -- 172.21.15.22:0/3914010318 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc768005430 con 0x7fc76c0cf8f0 2023-07-11T00:30:21.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.711+0000 7fc7735ff700 1 -- 172.21.15.22:0/3914010318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76c15d340 con 0x7fc76c0cf8f0 2023-07-11T00:30:21.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.711+0000 7fc761ffb700 1 -- 172.21.15.22:0/3914010318 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7680038c0 con 0x7fc76c0cf8f0 2023-07-11T00:30:21.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.711+0000 7fc7735ff700 1 -- 172.21.15.22:0/3914010318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76c15cd70 con 0x7fc76c0cf8f0 2023-07-11T00:30:21.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.712+0000 7fc7735ff700 1 -- 172.21.15.22:0/3914010318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76c0ca2d0 con 0x7fc76c0cf8f0 2023-07-11T00:30:21.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.713+0000 7fc761ffb700 1 -- 172.21.15.22:0/3914010318 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc768003a20 con 0x7fc76c0cf8f0 2023-07-11T00:30:21.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.715+0000 7fc761ffb700 1 --2- 172.21.15.22:0/3914010318 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc75006ace0 0x7fc75006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:21.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.715+0000 7fc761ffb700 1 -- 172.21.15.22:0/3914010318 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc768088c20 con 0x7fc76c0cf8f0 2023-07-11T00:30:21.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.715+0000 7fc770b9a700 1 --2- 172.21.15.22:0/3914010318 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc75006ace0 0x7fc75006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:21.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.716+0000 7fc770b9a700 1 --2- 172.21.15.22:0/3914010318 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc75006ace0 0x7fc75006d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc75c000c00 tx=0x7fc75c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:21.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.719+0000 7fc761ffb700 1 -- 172.21.15.22:0/3914010318 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc76c0ca2d0 con 0x7fc76c0cf8f0 2023-07-11T00:30:21.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.930+0000 7fc7735ff700 1 -- 172.21.15.22:0/3914010318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc76c0c9c30 con 0x7fc76c0cf8f0 2023-07-11T00:30:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.931+0000 7fc761ffb700 1 -- 172.21.15.22:0/3914010318 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20062 (secure 0 0 0) 0x7fc7680539d0 con 0x7fc76c0cf8f0 2023-07-11T00:30:21.934 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:21.934 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:10.571866+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:30:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.933+0000 7fc7735ff700 1 -- 172.21.15.22:0/3914010318 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc75006ace0 msgr2=0x7fc75006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:21.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.933+0000 7fc7735ff700 1 --2- 172.21.15.22:0/3914010318 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc75006ace0 0x7fc75006d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc75c000c00 tx=0x7fc75c008030 comp rx=0 tx=0).stop 2023-07-11T00:30:21.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.933+0000 7fc7735ff700 1 -- 172.21.15.22:0/3914010318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc76c0cf8f0 msgr2=0x7fc76c15c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:21.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.933+0000 7fc7735ff700 1 --2- 172.21.15.22:0/3914010318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc76c0cf8f0 0x7fc76c15c830 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc76800c4e0 tx=0x7fc76800c7f0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.934+0000 7fc7735ff700 1 -- 172.21.15.22:0/3914010318 shutdown_connections 2023-07-11T00:30:21.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.934+0000 7fc7735ff700 1 --2- 172.21.15.22:0/3914010318 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc75006ace0 0x7fc75006d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.934+0000 7fc7735ff700 1 --2- 172.21.15.22:0/3914010318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc76c15c460 0x7fc76c15eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.934+0000 7fc7735ff700 1 --2- 172.21.15.22:0/3914010318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc76c0cf8f0 0x7fc76c15c830 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.934+0000 7fc7735ff700 1 --2- 172.21.15.22:0/3914010318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76c0d2640 0x7fc76c14c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:21.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.934+0000 7fc7735ff700 1 -- 172.21.15.22:0/3914010318 >> 172.21.15.22:0/3914010318 conn(0x7fc76c071660 msgr2=0x7fc76c0b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:21.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.934+0000 7fc7735ff700 1 -- 172.21.15.22:0/3914010318 shutdown_connections 2023-07-11T00:30:21.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:21.934+0000 7fc7735ff700 1 -- 172.21.15.22:0/3914010318 wait complete. 2023-07-11T00:30:21.954 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:29:57.631007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:29:58.547599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:30:03.826184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:30:04.383448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-11T00:30:08.075875+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-11T00:30:21.955 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:30:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.158+0000 7f25237ff700 1 Processor -- start 2023-07-11T00:30:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.158+0000 7f25237ff700 1 -- start start 2023-07-11T00:30:22.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.159+0000 7f25237ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f251c0d3730 0x7f251c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:22.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.159+0000 7f25237ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f251c0cfa90 0x7f251c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:22.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.159+0000 7f25237ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251c0d0b20 con 0x7f251c0b8430 2023-07-11T00:30:22.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.159+0000 7f25237ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251c0cda30 con 0x7f251c0d3730 2023-07-11T00:30:22.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.159+0000 7f25237ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0b8800 con 0x7f251c0cfa90 2023-07-11T00:30:22.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.160+0000 7f2520d9a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f251c0d3730 0x7f251c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:22.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.160+0000 7f2520d9a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f251c0d3730 0x7f251c0cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55708/0 (socket says 172.21.15.22:55708) 2023-07-11T00:30:22.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.160+0000 7f2520d9a700 1 -- 172.21.15.22:0/3327401957 learned_addr learned my addr 172.21.15.22:0/3327401957 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:22.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.160+0000 7f2521d9c700 1 --2- 172.21.15.22:0/3327401957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f251c0cfa90 0x7f251c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:22.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.160+0000 7f2520d9a700 1 -- 172.21.15.22:0/3327401957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f251c0cfa90 msgr2=0x7f251c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:22.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.160+0000 7f2520d9a700 1 --2- 172.21.15.22:0/3327401957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f251c0cfa90 0x7f251c0d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:22.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.160+0000 7f2520d9a700 1 -- 172.21.15.22:0/3327401957 >> v1:172.21.15.184:6789/0 conn(0x7f251c0b8430 legacy=0x7f251c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:22.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.160+0000 7f2520d9a700 1 -- 172.21.15.22:0/3327401957 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c0cfeb0 con 0x7f251c0d3730 2023-07-11T00:30:22.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.161+0000 7f2520d9a700 1 --2- 172.21.15.22:0/3327401957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f251c0d3730 0x7f251c0cf550 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f250c0098f0 tx=0x7f250c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97a1a6698d0e092 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:22.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.161+0000 7f2513fff700 1 -- 172.21.15.22:0/3327401957 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c00b8a0 con 0x7f251c0d3730 2023-07-11T00:30:22.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.161+0000 7f2513fff700 1 -- 172.21.15.22:0/3327401957 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250c00ba00 con 0x7f251c0d3730 2023-07-11T00:30:22.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.161+0000 7f2513fff700 1 -- 172.21.15.22:0/3327401957 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c00bd90 con 0x7f251c0d3730 2023-07-11T00:30:22.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.161+0000 7f25237ff700 1 -- 172.21.15.22:0/3327401957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f251c0d3730 msgr2=0x7f251c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:22.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.161+0000 7f25237ff700 1 --2- 172.21.15.22:0/3327401957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f251c0d3730 0x7f251c0cf550 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f250c0098f0 tx=0x7f250c009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:22.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.161+0000 7f25237ff700 1 -- 172.21.15.22:0/3327401957 shutdown_connections 2023-07-11T00:30:22.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.161+0000 7f25237ff700 1 --2- 172.21.15.22:0/3327401957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f251c0cfa90 0x7f251c0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:22.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.162+0000 7f25237ff700 1 --2- 172.21.15.22:0/3327401957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f251c0d3730 0x7f251c0cf550 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:22.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.162+0000 7f25237ff700 1 -- 172.21.15.22:0/3327401957 >> 172.21.15.22:0/3327401957 conn(0x7f251c06b3f0 msgr2=0x7f251c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:22.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.162+0000 7f25237ff700 1 -- 172.21.15.22:0/3327401957 shutdown_connections 2023-07-11T00:30:22.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.162+0000 7f25237ff700 1 -- 172.21.15.22:0/3327401957 wait complete. 2023-07-11T00:30:22.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.163+0000 7f25237ff700 1 Processor -- start 2023-07-11T00:30:22.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.163+0000 7f25237ff700 1 -- start start 2023-07-11T00:30:22.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.164+0000 7f25237ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f251c0b8430 0x7f251c1f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:22.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.164+0000 7f25237ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f251c0cfa90 0x7f251c0b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:22.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.164+0000 7f25237ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f251c0d3730 0x7f251c0cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:22.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.164+0000 7f25237ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c1f2c10 con 0x7f251c0b8430 2023-07-11T00:30:22.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.164+0000 7f25237ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c1f2090 con 0x7f251c0cfa90 2023-07-11T00:30:22.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.164+0000 7f25237ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c1f2370 con 0x7f251c0d3730 2023-07-11T00:30:22.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.165+0000 7f252159b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f251c0b8430 0x7f251c1f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:22.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.165+0000 7f252159b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f251c0b8430 0x7f251c1f2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55722/0 (socket says 172.21.15.22:55722) 2023-07-11T00:30:22.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.165+0000 7f252159b700 1 -- 172.21.15.22:0/3177654227 learned_addr learned my addr 172.21.15.22:0/3177654227 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:22.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.165+0000 7f2520d9a700 1 --2- 172.21.15.22:0/3177654227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f251c0cfa90 0x7f251c0b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:22.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.165+0000 7f2521d9c700 1 --2- 172.21.15.22:0/3177654227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f251c0d3730 0x7f251c0cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:22.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.165+0000 7f252159b700 1 -- 172.21.15.22:0/3177654227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f251c0d3730 msgr2=0x7f251c0cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:22.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.165+0000 7f252159b700 1 --2- 172.21.15.22:0/3177654227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f251c0d3730 0x7f251c0cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:22.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.165+0000 7f252159b700 1 -- 172.21.15.22:0/3177654227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f251c0cfa90 msgr2=0x7f251c0b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:22.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.165+0000 7f252159b700 1 --2- 172.21.15.22:0/3177654227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f251c0cfa90 0x7f251c0b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:22.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.165+0000 7f252159b700 1 -- 172.21.15.22:0/3177654227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c009550 con 0x7f251c0b8430 2023-07-11T00:30:22.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.165+0000 7f252159b700 1 --2- 172.21.15.22:0/3177654227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f251c0b8430 0x7f251c1f2d70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f251800c4e0 tx=0x7f251800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:22.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.166+0000 7f2511ffb700 1 -- 172.21.15.22:0/3177654227 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25180052d0 con 0x7f251c0b8430 2023-07-11T00:30:22.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.166+0000 7f2511ffb700 1 -- 172.21.15.22:0/3177654227 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2518005430 con 0x7f251c0b8430 2023-07-11T00:30:22.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.166+0000 7f2511ffb700 1 -- 172.21.15.22:0/3177654227 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25180038c0 con 0x7f251c0b8430 2023-07-11T00:30:22.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.166+0000 7f25237ff700 1 -- 172.21.15.22:0/3177654227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251c1f2650 con 0x7f251c0b8430 2023-07-11T00:30:22.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.166+0000 7f25237ff700 1 -- 172.21.15.22:0/3177654227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251c1f32b0 con 0x7f251c0b8430 2023-07-11T00:30:22.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.167+0000 7f25237ff700 1 -- 172.21.15.22:0/3177654227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251c04ea60 con 0x7f251c0b8430 2023-07-11T00:30:22.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.168+0000 7f2511ffb700 1 -- 172.21.15.22:0/3177654227 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2518003a20 con 0x7f251c0b8430 2023-07-11T00:30:22.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.169+0000 7f2511ffb700 1 --2- 172.21.15.22:0/3177654227 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f250006ace0 0x7f250006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:22.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.169+0000 7f2511ffb700 1 -- 172.21.15.22:0/3177654227 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2518088bb0 con 0x7f251c0b8430 2023-07-11T00:30:22.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.169+0000 7f2520d9a700 1 --2- 172.21.15.22:0/3177654227 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f250006ace0 0x7f250006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:22.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.170+0000 7f2520d9a700 1 --2- 172.21.15.22:0/3177654227 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f250006ace0 0x7f250006d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f250c014040 tx=0x7f250c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:22.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.174+0000 7f2511ffb700 1 -- 172.21.15.22:0/3177654227 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f25180538d0 con 0x7f251c0b8430 2023-07-11T00:30:22.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.380+0000 7f25237ff700 1 -- 172.21.15.22:0/3177654227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f251c0d1530 con 0x7f251c0b8430 2023-07-11T00:30:22.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.380+0000 7f2511ffb700 1 -- 172.21.15.22:0/3177654227 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2518017020 con 0x7f251c0b8430 2023-07-11T00:30:22.383 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2023-07-11T00:30:22.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.383+0000 7f25237ff700 1 -- 172.21.15.22:0/3177654227 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f250006ace0 msgr2=0x7f250006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:22.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.383+0000 7f25237ff700 1 --2- 172.21.15.22:0/3177654227 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f250006ace0 0x7f250006d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f250c014040 tx=0x7f250c008030 comp rx=0 tx=0).stop 2023-07-11T00:30:22.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.383+0000 7f25237ff700 1 -- 172.21.15.22:0/3177654227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f251c0b8430 msgr2=0x7f251c1f2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:22.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.383+0000 7f25237ff700 1 --2- 172.21.15.22:0/3177654227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f251c0b8430 0x7f251c1f2d70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f251800c4e0 tx=0x7f251800c7f0 comp rx=0 tx=0).stop 2023-07-11T00:30:22.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.383+0000 7f25237ff700 1 -- 172.21.15.22:0/3177654227 shutdown_connections 2023-07-11T00:30:22.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.383+0000 7f25237ff700 1 --2- 172.21.15.22:0/3177654227 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f250006ace0 0x7f250006d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:22.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.383+0000 7f25237ff700 1 --2- 172.21.15.22:0/3177654227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f251c0d3730 0x7f251c0cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:22.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.383+0000 7f25237ff700 1 --2- 172.21.15.22:0/3177654227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f251c0b8430 0x7f251c1f2d70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:22.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.383+0000 7f25237ff700 1 --2- 172.21.15.22:0/3177654227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f251c0cfa90 0x7f251c0b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:22.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.383+0000 7f25237ff700 1 -- 172.21.15.22:0/3177654227 >> 172.21.15.22:0/3177654227 conn(0x7f251c06b3f0 msgr2=0x7f251c0d1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:22.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.383+0000 7f25237ff700 1 -- 172.21.15.22:0/3177654227 shutdown_connections 2023-07-11T00:30:22.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.383+0000 7f25237ff700 1 -- 172.21.15.22:0/3177654227 wait complete. 2023-07-11T00:30:22.404 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:30:22.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.606+0000 7f0f983ff700 1 Processor -- start 2023-07-11T00:30:22.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.606+0000 7f0f983ff700 1 -- start start 2023-07-11T00:30:22.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.607+0000 7f0f983ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f900b4590 0x7f0f900b4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:22.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.607+0000 7f0f983ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f900b4ea0 con 0x7f0f9006bda0 2023-07-11T00:30:22.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.607+0000 7f0f983ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9015d3d0 con 0x7f0f9006c210 2023-07-11T00:30:22.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.607+0000 7f0f983ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9006b390 con 0x7f0f900b4590 2023-07-11T00:30:22.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.607+0000 7f0f9599a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0f9006bda0 0x7f0f900d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57460/0 (socket says 172.21.15.22:57460) 2023-07-11T00:30:22.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.607+0000 7f0f9599a700 1 -- 172.21.15.22:0/1538764676 learned_addr learned my addr 172.21.15.22:0/1538764676 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:22.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.607+0000 7f0f9619b700 1 --2- 172.21.15.22:0/1538764676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f900b4590 0x7f0f900b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:22.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.608+0000 7f0f95199700 1 -- 172.21.15.22:0/1538764676 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885686962 0 0) 0x7f0f9015d3d0 con 0x7f0f9006c210 2023-07-11T00:30:22.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.608+0000 7f0f95199700 1 -- 172.21.15.22:0/1538764676 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f7c0035b0 con 0x7f0f9006c210 2023-07-11T00:30:22.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.608+0000 7f0f95199700 1 -- 172.21.15.22:0/1538764676 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803759980 0 0) 0x7f0f900b4ea0 con 0x7f0f9006bda0 2023-07-11T00:30:22.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.608+0000 7f0f95199700 1 -- 172.21.15.22:0/1538764676 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f9015d3d0 con 0x7f0f9006bda0 2023-07-11T00:30:22.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.608+0000 7f0f9619b700 1 -- 172.21.15.22:0/1538764676 >> v1:172.21.15.184:6789/0 conn(0x7f0f9006c210 legacy=0x7f0f9015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:22.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.608+0000 7f0f9619b700 1 -- 172.21.15.22:0/1538764676 >> v1:172.21.15.22:6789/0 conn(0x7f0f9006bda0 legacy=0x7f0f900d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:22.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.608+0000 7f0f9619b700 1 -- 172.21.15.22:0/1538764676 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9015d6b0 con 0x7f0f900b4590 2023-07-11T00:30:22.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.608+0000 7f0f9619b700 1 --2- 172.21.15.22:0/1538764676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f900b4590 0x7f0f900b4960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009870 tx=0x7f0f8c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efb5a6d63ee583e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:22.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.609+0000 7f0f95199700 1 -- 172.21.15.22:0/1538764676 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c011830 con 0x7f0f900b4590 2023-07-11T00:30:22.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.609+0000 7f0f95199700 1 -- 172.21.15.22:0/1538764676 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c011990 con 0x7f0f900b4590 2023-07-11T00:30:22.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.609+0000 7f0f95199700 1 -- 172.21.15.22:0/1538764676 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c011d20 con 0x7f0f900b4590 2023-07-11T00:30:22.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.609+0000 7f0f983ff700 1 -- 172.21.15.22:0/1538764676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f900b4590 msgr2=0x7f0f900b4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:22.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.609+0000 7f0f983ff700 1 --2- 172.21.15.22:0/1538764676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f900b4590 0x7f0f900b4960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009870 tx=0x7f0f8c009b80 comp rx=0 tx=0).stop 2023-07-11T00:30:22.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.609+0000 7f0f983ff700 1 -- 172.21.15.22:0/1538764676 shutdown_connections 2023-07-11T00:30:22.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.609+0000 7f0f983ff700 1 --2- 172.21.15.22:0/1538764676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f900b4590 0x7f0f900b4960 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:22.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.609+0000 7f0f983ff700 1 -- 172.21.15.22:0/1538764676 >> 172.21.15.22:0/1538764676 conn(0x7f0f900cf590 msgr2=0x7f0f900cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:22.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.609+0000 7f0f983ff700 1 -- 172.21.15.22:0/1538764676 shutdown_connections 2023-07-11T00:30:22.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.609+0000 7f0f983ff700 1 -- 172.21.15.22:0/1538764676 wait complete. 2023-07-11T00:30:22.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.611+0000 7f0f983ff700 1 Processor -- start 2023-07-11T00:30:22.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.611+0000 7f0f983ff700 1 -- start start 2023-07-11T00:30:22.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.612+0000 7f0f983ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f9006bda0 0x7f0f901546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:22.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.612+0000 7f0f983ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f9006c210 0x7f0f90156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:22.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.612+0000 7f0f983ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f900b4590 0x7f0f901e5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:22.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.612+0000 7f0f983ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f901579f0 con 0x7f0f900b4590 2023-07-11T00:30:22.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.612+0000 7f0f983ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900c9be0 con 0x7f0f9006bda0 2023-07-11T00:30:22.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.612+0000 7f0f983ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900c9ec0 con 0x7f0f9006c210 2023-07-11T00:30:22.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.612+0000 7f0f9699c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f900b4590 0x7f0f901e5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:22.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.612+0000 7f0f9619b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f9006bda0 0x7f0f901546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:22.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.612+0000 7f0f9599a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f9006c210 0x7f0f90156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:22.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.612+0000 7f0f9699c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f900b4590 0x7f0f901e5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55736/0 (socket says 172.21.15.22:55736) 2023-07-11T00:30:22.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.612+0000 7f0f9699c700 1 -- 172.21.15.22:0/2652706439 learned_addr learned my addr 172.21.15.22:0/2652706439 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:22.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.613+0000 7f0f9699c700 1 -- 172.21.15.22:0/2652706439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f9006c210 msgr2=0x7f0f90156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:22.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.613+0000 7f0f9699c700 1 --2- 172.21.15.22:0/2652706439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f9006c210 0x7f0f90156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:22.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.613+0000 7f0f9699c700 1 -- 172.21.15.22:0/2652706439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f9006bda0 msgr2=0x7f0f901546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:22.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.613+0000 7f0f9699c700 1 --2- 172.21.15.22:0/2652706439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f9006bda0 0x7f0f901546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:22.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.613+0000 7f0f9699c700 1 -- 172.21.15.22:0/2652706439 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8c0094a0 con 0x7f0f900b4590 2023-07-11T00:30:22.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.613+0000 7f0f9699c700 1 --2- 172.21.15.22:0/2652706439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f900b4590 0x7f0f901e5b80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800cc40 tx=0x7f0f8800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:22.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.613+0000 7f0f86ffd700 1 -- 172.21.15.22:0/2652706439 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88003c00 con 0x7f0f900b4590 2023-07-11T00:30:22.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.613+0000 7f0f86ffd700 1 -- 172.21.15.22:0/2652706439 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f88003d60 con 0x7f0f900b4590 2023-07-11T00:30:22.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.613+0000 7f0f983ff700 1 -- 172.21.15.22:0/2652706439 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f900ca1a0 con 0x7f0f900b4590 2023-07-11T00:30:22.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.613+0000 7f0f86ffd700 1 -- 172.21.15.22:0/2652706439 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8800ab00 con 0x7f0f900b4590 2023-07-11T00:30:22.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.613+0000 7f0f983ff700 1 -- 172.21.15.22:0/2652706439 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f90154be0 con 0x7f0f900b4590 2023-07-11T00:30:22.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.614+0000 7f0f983ff700 1 -- 172.21.15.22:0/2652706439 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f900ca6c0 con 0x7f0f900b4590 2023-07-11T00:30:22.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.615+0000 7f0f86ffd700 1 -- 172.21.15.22:0/2652706439 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f8800ac60 con 0x7f0f900b4590 2023-07-11T00:30:22.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.616+0000 7f0f86ffd700 1 --2- 172.21.15.22:0/2652706439 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0f7406ace0 0x7f0f7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:22.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.616+0000 7f0f86ffd700 1 -- 172.21.15.22:0/2652706439 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0f880898b0 con 0x7f0f900b4590 2023-07-11T00:30:22.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.617+0000 7f0f9619b700 1 --2- 172.21.15.22:0/2652706439 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0f7406ace0 0x7f0f7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:22.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.618+0000 7f0f9619b700 1 --2- 172.21.15.22:0/2652706439 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0f7406ace0 0x7f0f7406d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0097c0 tx=0x7f0f8c01c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:22.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.620+0000 7f0f86ffd700 1 -- 172.21.15.22:0/2652706439 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0f900ca6c0 con 0x7f0f900b4590 2023-07-11T00:30:22.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.825+0000 7f0f983ff700 1 -- 172.21.15.22:0/2652706439 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f900ca6c0 con 0x7f0f900b4590 2023-07-11T00:30:22.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.826+0000 7f0f86ffd700 1 -- 172.21.15.22:0/2652706439 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f900ca6c0 con 0x7f0f900b4590 2023-07-11T00:30:22.828 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-07-11T00:30:22.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.828+0000 7f0f983ff700 1 -- 172.21.15.22:0/2652706439 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0f7406ace0 msgr2=0x7f0f7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:22.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.828+0000 7f0f983ff700 1 --2- 172.21.15.22:0/2652706439 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0f7406ace0 0x7f0f7406d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0097c0 tx=0x7f0f8c01c040 comp rx=0 tx=0).stop 2023-07-11T00:30:22.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.828+0000 7f0f983ff700 1 -- 172.21.15.22:0/2652706439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f900b4590 msgr2=0x7f0f901e5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:22.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.828+0000 7f0f983ff700 1 --2- 172.21.15.22:0/2652706439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f900b4590 0x7f0f901e5b80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800cc40 tx=0x7f0f8800cf50 comp rx=0 tx=0).stop 2023-07-11T00:30:22.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.828+0000 7f0f983ff700 1 -- 172.21.15.22:0/2652706439 shutdown_connections 2023-07-11T00:30:22.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.828+0000 7f0f983ff700 1 --2- 172.21.15.22:0/2652706439 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0f7406ace0 0x7f0f7406d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:22.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.828+0000 7f0f983ff700 1 --2- 172.21.15.22:0/2652706439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f900b4590 0x7f0f901e5b80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:22.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.828+0000 7f0f983ff700 1 --2- 172.21.15.22:0/2652706439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f9006bda0 0x7f0f901546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:22.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.828+0000 7f0f983ff700 1 --2- 172.21.15.22:0/2652706439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f9006c210 0x7f0f90156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:22.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.828+0000 7f0f983ff700 1 -- 172.21.15.22:0/2652706439 >> 172.21.15.22:0/2652706439 conn(0x7f0f900cf590 msgr2=0x7f0f9015f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:22.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.829+0000 7f0f983ff700 1 -- 172.21.15.22:0/2652706439 shutdown_connections 2023-07-11T00:30:22.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:22.829+0000 7f0f983ff700 1 -- 172.21.15.22:0/2652706439 wait complete. 2023-07-11T00:30:22.849 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:30:23.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.053+0000 7f12e59ff700 1 Processor -- start 2023-07-11T00:30:23.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.054+0000 7f12e59ff700 1 -- start start 2023-07-11T00:30:23.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.055+0000 7f12e59ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12e00b8430 0x7f12e00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:23.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.055+0000 7f12e59ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e00d0b20 con 0x7f12e00d3730 2023-07-11T00:30:23.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.055+0000 7f12e59ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e00b4ee0 con 0x7f12e00cfc60 2023-07-11T00:30:23.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.055+0000 7f12e59ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00b8800 con 0x7f12e00b8430 2023-07-11T00:30:23.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.055+0000 7f12de7fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f12e00d3730 0x7f12e00cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57472/0 (socket says 172.21.15.22:57472) 2023-07-11T00:30:23.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.055+0000 7f12de7fc700 1 -- 172.21.15.22:0/1028644610 learned_addr learned my addr 172.21.15.22:0/1028644610 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:23.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.055+0000 7f12deffd700 1 --2- 172.21.15.22:0/1028644610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12e00b8430 0x7f12e00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:23.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.056+0000 7f12ddffb700 1 -- 172.21.15.22:0/1028644610 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836295501 0 0) 0x7f12e00d0b20 con 0x7f12e00d3730 2023-07-11T00:30:23.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.056+0000 7f12ddffb700 1 -- 172.21.15.22:0/1028644610 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12c80035b0 con 0x7f12e00d3730 2023-07-11T00:30:23.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.056+0000 7f12ddffb700 1 -- 172.21.15.22:0/1028644610 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162417009 0 0) 0x7f12e00b4ee0 con 0x7f12e00cfc60 2023-07-11T00:30:23.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.056+0000 7f12ddffb700 1 -- 172.21.15.22:0/1028644610 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12e00d0b20 con 0x7f12e00cfc60 2023-07-11T00:30:23.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.056+0000 7f12deffd700 1 -- 172.21.15.22:0/1028644610 >> v1:172.21.15.184:6789/0 conn(0x7f12e00cfc60 legacy=0x7f12e00d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.056+0000 7f12deffd700 1 -- 172.21.15.22:0/1028644610 >> v1:172.21.15.22:6789/0 conn(0x7f12e00d3730 legacy=0x7f12e00cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.056+0000 7f12deffd700 1 -- 172.21.15.22:0/1028644610 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e00b51c0 con 0x7f12e00b8430 2023-07-11T00:30:23.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.056+0000 7f12deffd700 1 --2- 172.21.15.22:0/1028644610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12e00b8430 0x7f12e00cd320 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009870 tx=0x7f12d0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25673d49a434fd69 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:23.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.056+0000 7f12ddffb700 1 -- 172.21.15.22:0/1028644610 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d0011830 con 0x7f12e00b8430 2023-07-11T00:30:23.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.056+0000 7f12ddffb700 1 -- 172.21.15.22:0/1028644610 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d0011990 con 0x7f12e00b8430 2023-07-11T00:30:23.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.056+0000 7f12ddffb700 1 -- 172.21.15.22:0/1028644610 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d0011d20 con 0x7f12e00b8430 2023-07-11T00:30:23.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.057+0000 7f12e59ff700 1 -- 172.21.15.22:0/1028644610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12e00b8430 msgr2=0x7f12e00cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.057+0000 7f12e59ff700 1 --2- 172.21.15.22:0/1028644610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12e00b8430 0x7f12e00cd320 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009870 tx=0x7f12d0009b80 comp rx=0 tx=0).stop 2023-07-11T00:30:23.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.057+0000 7f12e59ff700 1 -- 172.21.15.22:0/1028644610 shutdown_connections 2023-07-11T00:30:23.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.057+0000 7f12e59ff700 1 --2- 172.21.15.22:0/1028644610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12e00b8430 0x7f12e00cd320 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.057+0000 7f12e59ff700 1 -- 172.21.15.22:0/1028644610 >> 172.21.15.22:0/1028644610 conn(0x7f12e006b3f0 msgr2=0x7f12e006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:23.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.057+0000 7f12e59ff700 1 -- 172.21.15.22:0/1028644610 shutdown_connections 2023-07-11T00:30:23.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.057+0000 7f12e59ff700 1 -- 172.21.15.22:0/1028644610 wait complete. 2023-07-11T00:30:23.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.059+0000 7f12e59ff700 1 Processor -- start 2023-07-11T00:30:23.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.059+0000 7f12e59ff700 1 -- start start 2023-07-11T00:30:23.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.060+0000 7f12e59ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12e00b8430 0x7f12e00cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:23.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.060+0000 7f12e59ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12e00cfc60 0x7f12e00c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:23.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.060+0000 7f12e59ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12e00d3730 0x7f12e01f1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:23.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.060+0000 7f12e59ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e0156830 con 0x7f12e00b8430 2023-07-11T00:30:23.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.060+0000 7f12e59ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00c6bb0 con 0x7f12e00cfc60 2023-07-11T00:30:23.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.060+0000 7f12e59ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e01f19b0 con 0x7f12e00d3730 2023-07-11T00:30:23.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.060+0000 7f12deffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12e00b8430 0x7f12e00cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:23.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.060+0000 7f12deffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12e00b8430 0x7f12e00cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55752/0 (socket says 172.21.15.22:55752) 2023-07-11T00:30:23.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.060+0000 7f12deffd700 1 -- 172.21.15.22:0/900327270 learned_addr learned my addr 172.21.15.22:0/900327270 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:23.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.061+0000 7f12df7fe700 1 --2- 172.21.15.22:0/900327270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12e00d3730 0x7f12e01f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:23.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.061+0000 7f12de7fc700 1 --2- 172.21.15.22:0/900327270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12e00cfc60 0x7f12e00c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:23.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.061+0000 7f12deffd700 1 -- 172.21.15.22:0/900327270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12e00d3730 msgr2=0x7f12e01f1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.061+0000 7f12deffd700 1 --2- 172.21.15.22:0/900327270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12e00d3730 0x7f12e01f1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.061+0000 7f12deffd700 1 -- 172.21.15.22:0/900327270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12e00cfc60 msgr2=0x7f12e00c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.061+0000 7f12deffd700 1 --2- 172.21.15.22:0/900327270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12e00cfc60 0x7f12e00c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.061+0000 7f12deffd700 1 -- 172.21.15.22:0/900327270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d00094a0 con 0x7f12e00b8430 2023-07-11T00:30:23.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.061+0000 7f12df7fe700 1 --2- 172.21.15.22:0/900327270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12e00d3730 0x7f12e01f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:23.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.061+0000 7f12deffd700 1 --2- 172.21.15.22:0/900327270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12e00b8430 0x7f12e00cb790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f12d00090b0 tx=0x7f12d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:23.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.061+0000 7f12c7fff700 1 -- 172.21.15.22:0/900327270 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d001a760 con 0x7f12e00b8430 2023-07-11T00:30:23.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.061+0000 7f12c7fff700 1 -- 172.21.15.22:0/900327270 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d001a8c0 con 0x7f12e00b8430 2023-07-11T00:30:23.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.061+0000 7f12c7fff700 1 -- 172.21.15.22:0/900327270 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d001ac30 con 0x7f12e00b8430 2023-07-11T00:30:23.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.061+0000 7f12e59ff700 1 -- 172.21.15.22:0/900327270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e00c76d0 con 0x7f12e00b8430 2023-07-11T00:30:23.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.062+0000 7f12e59ff700 1 -- 172.21.15.22:0/900327270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e00c7110 con 0x7f12e00b8430 2023-07-11T00:30:23.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.063+0000 7f12e59ff700 1 -- 172.21.15.22:0/900327270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e0156600 con 0x7f12e00b8430 2023-07-11T00:30:23.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.063+0000 7f12c7fff700 1 -- 172.21.15.22:0/900327270 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f12d0022070 con 0x7f12e00b8430 2023-07-11T00:30:23.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.065+0000 7f12c7fff700 1 --2- 172.21.15.22:0/900327270 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f12cc06ace0 0x7f12cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:23.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.065+0000 7f12c7fff700 1 -- 172.21.15.22:0/900327270 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f12d008a410 con 0x7f12e00b8430 2023-07-11T00:30:23.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.065+0000 7f12de7fc700 1 --2- 172.21.15.22:0/900327270 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f12cc06ace0 0x7f12cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:23.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.066+0000 7f12de7fc700 1 --2- 172.21.15.22:0/900327270 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f12cc06ace0 0x7f12cc06d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f12e00c7b40 tx=0x7f12d4007e00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:23.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.069+0000 7f12c7fff700 1 -- 172.21.15.22:0/900327270 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f12e0156600 con 0x7f12e00b8430 2023-07-11T00:30:23.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.280+0000 7f12e59ff700 1 -- 172.21.15.22:0/900327270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12e0156600 con 0x7f12e00b8430 2023-07-11T00:30:23.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.281+0000 7f12c7fff700 1 -- 172.21.15.22:0/900327270 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12d0015020 con 0x7f12e00b8430 2023-07-11T00:30:23.284 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:30:23.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.283+0000 7f12e59ff700 1 -- 172.21.15.22:0/900327270 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f12cc06ace0 msgr2=0x7f12cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.283+0000 7f12e59ff700 1 --2- 172.21.15.22:0/900327270 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f12cc06ace0 0x7f12cc06d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f12e00c7b40 tx=0x7f12d4007e00 comp rx=0 tx=0).stop 2023-07-11T00:30:23.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.283+0000 7f12e59ff700 1 -- 172.21.15.22:0/900327270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12e00b8430 msgr2=0x7f12e00cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.283+0000 7f12e59ff700 1 --2- 172.21.15.22:0/900327270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12e00b8430 0x7f12e00cb790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f12d00090b0 tx=0x7f12d0004750 comp rx=0 tx=0).stop 2023-07-11T00:30:23.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.283+0000 7f12e59ff700 1 -- 172.21.15.22:0/900327270 shutdown_connections 2023-07-11T00:30:23.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.283+0000 7f12e59ff700 1 --2- 172.21.15.22:0/900327270 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f12cc06ace0 0x7f12cc06d190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.283+0000 7f12e59ff700 1 --2- 172.21.15.22:0/900327270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12e00d3730 0x7f12e01f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.283+0000 7f12e59ff700 1 --2- 172.21.15.22:0/900327270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12e00b8430 0x7f12e00cb790 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.283+0000 7f12e59ff700 1 --2- 172.21.15.22:0/900327270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12e00cfc60 0x7f12e00c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.283+0000 7f12e59ff700 1 -- 172.21.15.22:0/900327270 >> 172.21.15.22:0/900327270 conn(0x7f12e006b3f0 msgr2=0x7f12e00cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:23.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.283+0000 7f12e59ff700 1 -- 172.21.15.22:0/900327270 shutdown_connections 2023-07-11T00:30:23.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.284+0000 7f12e59ff700 1 -- 172.21.15.22:0/900327270 wait complete. 2023-07-11T00:30:23.304 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:30:23.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.505+0000 7fb6903ff700 1 Processor -- start 2023-07-11T00:30:23.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.505+0000 7fb6903ff700 1 -- start start 2023-07-11T00:30:23.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.506+0000 7fb6903ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb6880cfc60 0x7fb688167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:23.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.506+0000 7fb6903ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6880d0b20 con 0x7fb6880d3730 2023-07-11T00:30:23.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.506+0000 7fb6903ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6880b4ee0 con 0x7fb6880b8430 2023-07-11T00:30:23.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.506+0000 7fb6903ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6880cda30 con 0x7fb6880cfc60 2023-07-11T00:30:23.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.506+0000 7fb68d99a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb6880d3730 0x7fb6880cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57478/0 (socket says 172.21.15.22:57478) 2023-07-11T00:30:23.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.506+0000 7fb68d99a700 1 -- 172.21.15.22:0/2149755232 learned_addr learned my addr 172.21.15.22:0/2149755232 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:23.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.506+0000 7fb68e99c700 1 --2- 172.21.15.22:0/2149755232 >> v2:172.21.15.184:3300/0 conn(0x7fb6880cfc60 0x7fb688167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:23.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.507+0000 7fb68d199700 1 -- 172.21.15.22:0/2149755232 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901505867 0 0) 0x7fb6880d0b20 con 0x7fb6880d3730 2023-07-11T00:30:23.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.507+0000 7fb68d199700 1 -- 172.21.15.22:0/2149755232 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6740035b0 con 0x7fb6880d3730 2023-07-11T00:30:23.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.507+0000 7fb68e99c700 1 -- 172.21.15.22:0/2149755232 >> v1:172.21.15.184:6789/0 conn(0x7fb6880b8430 legacy=0x7fb6880cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.507+0000 7fb68d199700 1 -- 172.21.15.22:0/2149755232 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550736832 0 0) 0x7fb6880b4ee0 con 0x7fb6880b8430 2023-07-11T00:30:23.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.507+0000 7fb68e99c700 1 -- 172.21.15.22:0/2149755232 >> v1:172.21.15.22:6789/0 conn(0x7fb6880d3730 legacy=0x7fb6880cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.507+0000 7fb68e99c700 1 -- 172.21.15.22:0/2149755232 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6880b51c0 con 0x7fb6880cfc60 2023-07-11T00:30:23.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.507+0000 7fb68e99c700 1 --2- 172.21.15.22:0/2149755232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6880cfc60 0x7fb688167010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb680009d90 tx=0x7fb68000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d6288a58a68e231 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:23.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.508+0000 7fb68d199700 1 -- 172.21.15.22:0/2149755232 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68000e070 con 0x7fb6880cfc60 2023-07-11T00:30:23.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.508+0000 7fb68d199700 1 -- 172.21.15.22:0/2149755232 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68000bb20 con 0x7fb6880cfc60 2023-07-11T00:30:23.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.508+0000 7fb68d199700 1 -- 172.21.15.22:0/2149755232 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68000bed0 con 0x7fb6880cfc60 2023-07-11T00:30:23.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.508+0000 7fb6903ff700 1 -- 172.21.15.22:0/2149755232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6880cfc60 msgr2=0x7fb688167010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.508+0000 7fb6903ff700 1 --2- 172.21.15.22:0/2149755232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6880cfc60 0x7fb688167010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb680009d90 tx=0x7fb68000b330 comp rx=0 tx=0).stop 2023-07-11T00:30:23.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.508+0000 7fb6903ff700 1 -- 172.21.15.22:0/2149755232 shutdown_connections 2023-07-11T00:30:23.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.508+0000 7fb6903ff700 1 --2- 172.21.15.22:0/2149755232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6880cfc60 0x7fb688167010 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.508+0000 7fb6903ff700 1 -- 172.21.15.22:0/2149755232 >> 172.21.15.22:0/2149755232 conn(0x7fb68806b3f0 msgr2=0x7fb68806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:23.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.508+0000 7fb6903ff700 1 -- 172.21.15.22:0/2149755232 shutdown_connections 2023-07-11T00:30:23.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.508+0000 7fb6903ff700 1 -- 172.21.15.22:0/2149755232 wait complete. 2023-07-11T00:30:23.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.510+0000 7fb6903ff700 1 Processor -- start 2023-07-11T00:30:23.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.510+0000 7fb6903ff700 1 -- start start 2023-07-11T00:30:23.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.511+0000 7fb6903ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6880b8430 0x7fb6880c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:23.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.511+0000 7fb6903ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6880cfc60 0x7fb6881581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:23.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.511+0000 7fb6903ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6880d3730 0x7fb68815de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:23.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.511+0000 7fb6903ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6880c93d0 con 0x7fb6880d3730 2023-07-11T00:30:23.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.511+0000 7fb6903ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6880c8a00 con 0x7fb6880b8430 2023-07-11T00:30:23.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.511+0000 7fb6903ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68815e860 con 0x7fb6880cfc60 2023-07-11T00:30:23.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.511+0000 7fb68e99c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6880d3730 0x7fb68815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:23.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.512+0000 7fb68e99c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6880d3730 0x7fb68815de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55760/0 (socket says 172.21.15.22:55760) 2023-07-11T00:30:23.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.512+0000 7fb68e99c700 1 -- 172.21.15.22:0/1611545499 learned_addr learned my addr 172.21.15.22:0/1611545499 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:23.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.512+0000 7fb68e19b700 1 --2- 172.21.15.22:0/1611545499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6880b8430 0x7fb6880c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:23.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.512+0000 7fb68d99a700 1 --2- 172.21.15.22:0/1611545499 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6880cfc60 0x7fb6881581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:23.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.512+0000 7fb68e99c700 1 -- 172.21.15.22:0/1611545499 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6880cfc60 msgr2=0x7fb6881581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.512+0000 7fb68e99c700 1 --2- 172.21.15.22:0/1611545499 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6880cfc60 0x7fb6881581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.512+0000 7fb68e99c700 1 -- 172.21.15.22:0/1611545499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6880b8430 msgr2=0x7fb6880c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.512+0000 7fb68e99c700 1 --2- 172.21.15.22:0/1611545499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6880b8430 0x7fb6880c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.512+0000 7fb68e99c700 1 -- 172.21.15.22:0/1611545499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb680009a70 con 0x7fb6880d3730 2023-07-11T00:30:23.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.512+0000 7fb68e19b700 1 --2- 172.21.15.22:0/1611545499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6880b8430 0x7fb6880c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:23.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.512+0000 7fb68e99c700 1 --2- 172.21.15.22:0/1611545499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6880d3730 0x7fb68815de50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb680014040 tx=0x7fb680004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:23.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.512+0000 7fb67effd700 1 -- 172.21.15.22:0/1611545499 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68001b810 con 0x7fb6880d3730 2023-07-11T00:30:23.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.513+0000 7fb67effd700 1 -- 172.21.15.22:0/1611545499 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb680020070 con 0x7fb6880d3730 2023-07-11T00:30:23.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.513+0000 7fb6903ff700 1 -- 172.21.15.22:0/1611545499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6880c80d0 con 0x7fb6880d3730 2023-07-11T00:30:23.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.513+0000 7fb67effd700 1 -- 172.21.15.22:0/1611545499 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68001bbb0 con 0x7fb6880d3730 2023-07-11T00:30:23.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.513+0000 7fb6903ff700 1 -- 172.21.15.22:0/1611545499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6880c8690 con 0x7fb6880d3730 2023-07-11T00:30:23.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.514+0000 7fb6903ff700 1 -- 172.21.15.22:0/1611545499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68804ea60 con 0x7fb6880d3730 2023-07-11T00:30:23.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.515+0000 7fb67effd700 1 -- 172.21.15.22:0/1611545499 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb68001bd10 con 0x7fb6880d3730 2023-07-11T00:30:23.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.516+0000 7fb67effd700 1 --2- 172.21.15.22:0/1611545499 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb66c06ad10 0x7fb66c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:23.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.516+0000 7fb67effd700 1 -- 172.21.15.22:0/1611545499 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb680022070 con 0x7fb6880d3730 2023-07-11T00:30:23.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.516+0000 7fb68e19b700 1 --2- 172.21.15.22:0/1611545499 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb66c06ad10 0x7fb66c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:23.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.517+0000 7fb68e19b700 1 --2- 172.21.15.22:0/1611545499 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb66c06ad10 0x7fb66c06d1c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb684000f60 tx=0x7fb684009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:23.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.520+0000 7fb67effd700 1 -- 172.21.15.22:0/1611545499 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb680059d70 con 0x7fb6880d3730 2023-07-11T00:30:23.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.728+0000 7fb6903ff700 1 -- 172.21.15.22:0/1611545499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb6880c8b40 con 0x7fb6880d3730 2023-07-11T00:30:23.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.728+0000 7fb67effd700 1 -- 172.21.15.22:0/1611545499 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb680059900 con 0x7fb6880d3730 2023-07-11T00:30:23.731 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-07-11T00:30:23.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.730+0000 7fb6903ff700 1 -- 172.21.15.22:0/1611545499 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb66c06ad10 msgr2=0x7fb66c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.730+0000 7fb6903ff700 1 --2- 172.21.15.22:0/1611545499 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb66c06ad10 0x7fb66c06d1c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb684000f60 tx=0x7fb684009040 comp rx=0 tx=0).stop 2023-07-11T00:30:23.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.730+0000 7fb6903ff700 1 -- 172.21.15.22:0/1611545499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6880d3730 msgr2=0x7fb68815de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.730+0000 7fb6903ff700 1 --2- 172.21.15.22:0/1611545499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6880d3730 0x7fb68815de50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb680014040 tx=0x7fb680004ad0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.731+0000 7fb6903ff700 1 -- 172.21.15.22:0/1611545499 shutdown_connections 2023-07-11T00:30:23.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.731+0000 7fb6903ff700 1 --2- 172.21.15.22:0/1611545499 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb66c06ad10 0x7fb66c06d1c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.731+0000 7fb6903ff700 1 --2- 172.21.15.22:0/1611545499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6880d3730 0x7fb68815de50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.731+0000 7fb6903ff700 1 --2- 172.21.15.22:0/1611545499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6880b8430 0x7fb6880c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.731+0000 7fb6903ff700 1 --2- 172.21.15.22:0/1611545499 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6880cfc60 0x7fb6881581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.731+0000 7fb6903ff700 1 -- 172.21.15.22:0/1611545499 >> 172.21.15.22:0/1611545499 conn(0x7fb68806b3f0 msgr2=0x7fb6880cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:23.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.731+0000 7fb6903ff700 1 -- 172.21.15.22:0/1611545499 shutdown_connections 2023-07-11T00:30:23.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.731+0000 7fb6903ff700 1 -- 172.21.15.22:0/1611545499 wait complete. 2023-07-11T00:30:23.750 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-11T00:30:23.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.953+0000 7f3bc77ff700 1 Processor -- start 2023-07-11T00:30:23.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.953+0000 7f3bc77ff700 1 -- start start 2023-07-11T00:30:23.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.954+0000 7f3bc77ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3bc00b8430 0x7f3bc00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:23.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.954+0000 7f3bc77ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3bc00cfc60 0x7f3bc00d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:23.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.954+0000 7f3bc77ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc00d0b20 con 0x7f3bc00d3730 2023-07-11T00:30:23.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.954+0000 7f3bc77ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc00b8800 con 0x7f3bc00b8430 2023-07-11T00:30:23.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.954+0000 7f3bc77ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc00b4ee0 con 0x7f3bc00cfc60 2023-07-11T00:30:23.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.955+0000 7f3bc559b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3bc00b8430 0x7f3bc00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:23.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.955+0000 7f3bc559b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3bc00b8430 0x7f3bc00cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55766/0 (socket says 172.21.15.22:55766) 2023-07-11T00:30:23.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.955+0000 7f3bc559b700 1 -- 172.21.15.22:0/1426639399 learned_addr learned my addr 172.21.15.22:0/1426639399 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:23.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.955+0000 7f3bc5d9c700 1 --2- 172.21.15.22:0/1426639399 >> v2:172.21.15.184:3300/0 conn(0x7f3bc00cfc60 0x7f3bc00d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:23.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.955+0000 7f3bc559b700 1 -- 172.21.15.22:0/1426639399 >> v2:172.21.15.184:3300/0 conn(0x7f3bc00cfc60 msgr2=0x7f3bc00d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:23.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.955+0000 7f3bc559b700 1 --2- 172.21.15.22:0/1426639399 >> v2:172.21.15.184:3300/0 conn(0x7f3bc00cfc60 0x7f3bc00d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.955+0000 7f3bc559b700 1 -- 172.21.15.22:0/1426639399 >> v1:172.21.15.184:6789/0 conn(0x7f3bc00d3730 legacy=0x7f3bc00cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.955+0000 7f3bc559b700 1 -- 172.21.15.22:0/1426639399 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc00b51c0 con 0x7f3bc00b8430 2023-07-11T00:30:23.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.955+0000 7f3bc559b700 1 --2- 172.21.15.22:0/1426639399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc00b8430 0x7f3bc00cd320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00b2100 tx=0x7f3bbc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07cfb2718a8e435 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:23.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.956+0000 7f3bb7fff700 1 -- 172.21.15.22:0/1426639399 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00b870 con 0x7f3bc00b8430 2023-07-11T00:30:23.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.956+0000 7f3bb7fff700 1 -- 172.21.15.22:0/1426639399 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc00b9d0 con 0x7f3bc00b8430 2023-07-11T00:30:23.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.956+0000 7f3bb7fff700 1 -- 172.21.15.22:0/1426639399 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00bd60 con 0x7f3bc00b8430 2023-07-11T00:30:23.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.956+0000 7f3bc77ff700 1 -- 172.21.15.22:0/1426639399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc00b8430 msgr2=0x7f3bc00cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.956+0000 7f3bc77ff700 1 --2- 172.21.15.22:0/1426639399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc00b8430 0x7f3bc00cd320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00b2100 tx=0x7f3bbc009bd0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.956+0000 7f3bc77ff700 1 -- 172.21.15.22:0/1426639399 shutdown_connections 2023-07-11T00:30:23.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.956+0000 7f3bc77ff700 1 --2- 172.21.15.22:0/1426639399 >> v2:172.21.15.184:3300/0 conn(0x7f3bc00cfc60 0x7f3bc00d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.956+0000 7f3bc77ff700 1 --2- 172.21.15.22:0/1426639399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc00b8430 0x7f3bc00cd320 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.956+0000 7f3bc77ff700 1 -- 172.21.15.22:0/1426639399 >> 172.21.15.22:0/1426639399 conn(0x7f3bc006b3f0 msgr2=0x7f3bc006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:23.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.956+0000 7f3bc77ff700 1 -- 172.21.15.22:0/1426639399 shutdown_connections 2023-07-11T00:30:23.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.956+0000 7f3bc77ff700 1 -- 172.21.15.22:0/1426639399 wait complete. 2023-07-11T00:30:23.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.958+0000 7f3bc77ff700 1 Processor -- start 2023-07-11T00:30:23.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.958+0000 7f3bc77ff700 1 -- start start 2023-07-11T00:30:23.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.959+0000 7f3bc77ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bc00b8430 0x7f3bc0155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:23.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.959+0000 7f3bc77ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bc00cfc60 0x7f3bc015d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:23.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.959+0000 7f3bc77ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc00d3730 0x7f3bc00b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:23.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.959+0000 7f3bc77ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc015e360 con 0x7f3bc00d3730 2023-07-11T00:30:23.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.959+0000 7f3bc77ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc015e640 con 0x7f3bc00cfc60 2023-07-11T00:30:23.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.959+0000 7f3bc77ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc015e920 con 0x7f3bc00b8430 2023-07-11T00:30:23.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.959+0000 7f3bc5d9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc00d3730 0x7f3bc00b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:23.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.959+0000 7f3bc5d9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc00d3730 0x7f3bc00b2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55780/0 (socket says 172.21.15.22:55780) 2023-07-11T00:30:23.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.959+0000 7f3bc5d9c700 1 -- 172.21.15.22:0/2537188253 learned_addr learned my addr 172.21.15.22:0/2537188253 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:23.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.960+0000 7f3bc4d9a700 1 --2- 172.21.15.22:0/2537188253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bc00cfc60 0x7f3bc015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:23.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.960+0000 7f3bc559b700 1 --2- 172.21.15.22:0/2537188253 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bc00b8430 0x7f3bc0155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:23.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.960+0000 7f3bc5d9c700 1 -- 172.21.15.22:0/2537188253 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bc00b8430 msgr2=0x7f3bc0155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.960+0000 7f3bc5d9c700 1 --2- 172.21.15.22:0/2537188253 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bc00b8430 0x7f3bc0155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.960+0000 7f3bc5d9c700 1 -- 172.21.15.22:0/2537188253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bc00cfc60 msgr2=0x7f3bc015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:23.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.960+0000 7f3bc5d9c700 1 --2- 172.21.15.22:0/2537188253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bc00cfc60 0x7f3bc015d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:23.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.960+0000 7f3bc5d9c700 1 -- 172.21.15.22:0/2537188253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc009550 con 0x7f3bc00d3730 2023-07-11T00:30:23.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.960+0000 7f3bc5d9c700 1 --2- 172.21.15.22:0/2537188253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc00d3730 0x7f3bc00b2fc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8007e40 tx=0x7f3bb800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:23.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.960+0000 7f3bb5ffb700 1 -- 172.21.15.22:0/2537188253 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb800ed30 con 0x7f3bc00d3730 2023-07-11T00:30:23.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.960+0000 7f3bb5ffb700 1 -- 172.21.15.22:0/2537188253 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb8014420 con 0x7f3bc00d3730 2023-07-11T00:30:23.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.960+0000 7f3bc77ff700 1 -- 172.21.15.22:0/2537188253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc015ec00 con 0x7f3bc00d3730 2023-07-11T00:30:23.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.960+0000 7f3bb5ffb700 1 -- 172.21.15.22:0/2537188253 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb80147d0 con 0x7f3bc00d3730 2023-07-11T00:30:23.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.961+0000 7f3bc77ff700 1 -- 172.21.15.22:0/2537188253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc00c7a40 con 0x7f3bc00d3730 2023-07-11T00:30:23.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.961+0000 7f3bc77ff700 1 -- 172.21.15.22:0/2537188253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc00c7c00 con 0x7f3bc00d3730 2023-07-11T00:30:23.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.962+0000 7f3bb5ffb700 1 -- 172.21.15.22:0/2537188253 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3bb8014930 con 0x7f3bc00d3730 2023-07-11T00:30:23.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.963+0000 7f3bb5ffb700 1 --2- 172.21.15.22:0/2537188253 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3ba406ace0 0x7f3ba406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:23.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.963+0000 7f3bb5ffb700 1 -- 172.21.15.22:0/2537188253 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3bb8089f00 con 0x7f3bc00d3730 2023-07-11T00:30:23.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.964+0000 7f3bc559b700 1 --2- 172.21.15.22:0/2537188253 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3ba406ace0 0x7f3ba406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:23.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.965+0000 7f3bc559b700 1 --2- 172.21.15.22:0/2537188253 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3ba406ace0 0x7f3ba406d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc000c00 tx=0x7f3bbc008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:23.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:23.967+0000 7f3bb5ffb700 1 -- 172.21.15.22:0/2537188253 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3bc00c7c00 con 0x7f3bc00d3730 2023-07-11T00:30:24.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.172+0000 7f3bc77ff700 1 -- 172.21.15.22:0/2537188253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3bc015f120 con 0x7f3bc00d3730 2023-07-11T00:30:24.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.173+0000 7f3bb5ffb700 1 -- 172.21.15.22:0/2537188253 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3bc015f120 con 0x7f3bc00d3730 2023-07-11T00:30:24.176 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:30:24.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.175+0000 7f3bc77ff700 1 -- 172.21.15.22:0/2537188253 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3ba406ace0 msgr2=0x7f3ba406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:24.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.175+0000 7f3bc77ff700 1 --2- 172.21.15.22:0/2537188253 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3ba406ace0 0x7f3ba406d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc000c00 tx=0x7f3bbc008030 comp rx=0 tx=0).stop 2023-07-11T00:30:24.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.175+0000 7f3bc77ff700 1 -- 172.21.15.22:0/2537188253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc00d3730 msgr2=0x7f3bc00b2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:24.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.175+0000 7f3bc77ff700 1 --2- 172.21.15.22:0/2537188253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc00d3730 0x7f3bc00b2fc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8007e40 tx=0x7f3bb800e3c0 comp rx=0 tx=0).stop 2023-07-11T00:30:24.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.175+0000 7f3bc77ff700 1 -- 172.21.15.22:0/2537188253 shutdown_connections 2023-07-11T00:30:24.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.175+0000 7f3bc77ff700 1 --2- 172.21.15.22:0/2537188253 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3ba406ace0 0x7f3ba406d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:24.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.175+0000 7f3bc77ff700 1 --2- 172.21.15.22:0/2537188253 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bc00b8430 0x7f3bc0155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:24.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.175+0000 7f3bc77ff700 1 --2- 172.21.15.22:0/2537188253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc00d3730 0x7f3bc00b2fc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:24.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.175+0000 7f3bc77ff700 1 --2- 172.21.15.22:0/2537188253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bc00cfc60 0x7f3bc015d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:24.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.175+0000 7f3bc77ff700 1 -- 172.21.15.22:0/2537188253 >> 172.21.15.22:0/2537188253 conn(0x7f3bc006b3f0 msgr2=0x7f3bc00b6380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:24.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.176+0000 7f3bc77ff700 1 -- 172.21.15.22:0/2537188253 shutdown_connections 2023-07-11T00:30:24.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.176+0000 7f3bc77ff700 1 -- 172.21.15.22:0/2537188253 wait complete. 2023-07-11T00:30:24.195 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-11T00:30:24.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.397+0000 7f25fd7ff700 1 Processor -- start 2023-07-11T00:30:24.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.398+0000 7f25fd7ff700 1 -- start start 2023-07-11T00:30:24.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.399+0000 7f25fd7ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f25f80d2640 0x7f25f80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:24.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.399+0000 7f25fd7ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f80d1790 con 0x7f25f815c460 2023-07-11T00:30:24.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.399+0000 7f25fd7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f80cd950 con 0x7f25f80cf8f0 2023-07-11T00:30:24.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.399+0000 7f25fd7ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f80cedd0 con 0x7f25f80d2640 2023-07-11T00:30:24.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.399+0000 7f25f6ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f25f815c460 0x7f25f80cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57488/0 (socket says 172.21.15.22:57488) 2023-07-11T00:30:24.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.399+0000 7f25f6ffd700 1 -- 172.21.15.22:0/3936512226 learned_addr learned my addr 172.21.15.22:0/3936512226 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:24.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.400+0000 7f25f67fc700 1 --2- 172.21.15.22:0/3936512226 >> v2:172.21.15.184:3300/0 conn(0x7f25f80d2640 0x7f25f80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:24.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.400+0000 7f25f5ffb700 1 -- 172.21.15.22:0/3936512226 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432459670 0 0) 0x7f25f80d1790 con 0x7f25f815c460 2023-07-11T00:30:24.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.400+0000 7f25f5ffb700 1 -- 172.21.15.22:0/3936512226 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25e00035b0 con 0x7f25f815c460 2023-07-11T00:30:24.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.400+0000 7f25f5ffb700 1 -- 172.21.15.22:0/3936512226 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1637521659 0 0) 0x7f25e00035b0 con 0x7f25f815c460 2023-07-11T00:30:24.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.400+0000 7f25f5ffb700 1 -- 172.21.15.22:0/3936512226 >> v2:172.21.15.184:3300/0 conn(0x7f25f80d2640 msgr2=0x7f25f80b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:24.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.400+0000 7f25f5ffb700 1 --2- 172.21.15.22:0/3936512226 >> v2:172.21.15.184:3300/0 conn(0x7f25f80d2640 0x7f25f80b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:24.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.400+0000 7f25f5ffb700 1 -- 172.21.15.22:0/3936512226 >> v1:172.21.15.184:6789/0 conn(0x7f25f80cf8f0 legacy=0x7f25f815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:24.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.400+0000 7f25f5ffb700 1 -- 172.21.15.22:0/3936512226 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f80d14b0 con 0x7f25f815c460 2023-07-11T00:30:24.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.400+0000 7f25f5ffb700 1 -- 172.21.15.22:0/3936512226 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7f25e8001670 con 0x7f25f815c460 2023-07-11T00:30:24.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.400+0000 7f25f5ffb700 1 -- 172.21.15.22:0/3936512226 >> v1:172.21.15.22:6789/0 conn(0x7f25f815c460 legacy=0x7f25f80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:24.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.400+0000 7f25f5ffb700 1 --2- 172.21.15.22:0/3936512226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25e0003a00 0x7f25e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:24.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.400+0000 7f25f5ffb700 1 --2- 172.21.15.22:0/3936512226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25e0004850 0x7f25e0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:24.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.400+0000 7f25f5ffb700 1 --2- 172.21.15.22:0/3936512226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25e0005200 0x7f25e000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:24.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.400+0000 7f25f5ffb700 1 -- 172.21.15.22:0/3936512226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f80cedd0 con 0x7f25e0004850 2023-07-11T00:30:24.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.400+0000 7f25f5ffb700 1 -- 172.21.15.22:0/3936512226 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e000c190 con 0x7f25e0003a00 2023-07-11T00:30:24.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.400+0000 7f25f5ffb700 1 -- 172.21.15.22:0/3936512226 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e000c350 con 0x7f25e0005200 2023-07-11T00:30:24.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.400+0000 7f25f67fc700 1 --2- 172.21.15.22:0/3936512226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25e0004850 0x7f25e0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:24.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.401+0000 7f25f77fe700 1 --2- 172.21.15.22:0/3936512226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25e0005200 0x7f25e000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:24.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.401+0000 7f25f6ffd700 1 --2- 172.21.15.22:0/3936512226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25e0003a00 0x7f25e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:24.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.401+0000 7f25f67fc700 1 -- 172.21.15.22:0/3936512226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25e0005200 msgr2=0x7f25e000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:24.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.401+0000 7f25f67fc700 1 --2- 172.21.15.22:0/3936512226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25e0005200 0x7f25e000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:24.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.401+0000 7f25f67fc700 1 -- 172.21.15.22:0/3936512226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25e0003a00 msgr2=0x7f25e0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:24.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.401+0000 7f25f67fc700 1 --2- 172.21.15.22:0/3936512226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25e0003a00 0x7f25e0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:24.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.401+0000 7f25f67fc700 1 -- 172.21.15.22:0/3936512226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e00035b0 con 0x7f25e0004850 2023-07-11T00:30:24.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.401+0000 7f25f6ffd700 1 --2- 172.21.15.22:0/3936512226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25e0003a00 0x7f25e0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:24.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.401+0000 7f25f77fe700 1 -- 172.21.15.22:0/3936512226 reap_dead start 2023-07-11T00:30:24.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.401+0000 7f25f67fc700 1 --2- 172.21.15.22:0/3936512226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25e0004850 0x7f25e0004cc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009b30 tx=0x7f25e0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32444a02f99da4ba server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:24.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.401+0000 7f25f5ffb700 1 -- 172.21.15.22:0/3936512226 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec00e6c0 con 0x7f25e0004850 2023-07-11T00:30:24.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.401+0000 7f25f5ffb700 1 -- 172.21.15.22:0/3936512226 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec00e820 con 0x7f25e0004850 2023-07-11T00:30:24.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.401+0000 7f25f5ffb700 1 -- 172.21.15.22:0/3936512226 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec00eb90 con 0x7f25e0004850 2023-07-11T00:30:24.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.402+0000 7f25fd7ff700 1 -- 172.21.15.22:0/3936512226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25e0004850 msgr2=0x7f25e0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:24.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.402+0000 7f25fd7ff700 1 --2- 172.21.15.22:0/3936512226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25e0004850 0x7f25e0004cc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009b30 tx=0x7f25e0005880 comp rx=0 tx=0).stop 2023-07-11T00:30:24.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.402+0000 7f25fd7ff700 1 -- 172.21.15.22:0/3936512226 shutdown_connections 2023-07-11T00:30:24.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.402+0000 7f25fd7ff700 1 --2- 172.21.15.22:0/3936512226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25e0004850 0x7f25e0004cc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:24.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.402+0000 7f25fd7ff700 1 -- 172.21.15.22:0/3936512226 >> 172.21.15.22:0/3936512226 conn(0x7f25f8071660 msgr2=0x7f25f8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:24.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.402+0000 7f25fd7ff700 1 -- 172.21.15.22:0/3936512226 shutdown_connections 2023-07-11T00:30:24.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.402+0000 7f25fd7ff700 1 -- 172.21.15.22:0/3936512226 wait complete. 2023-07-11T00:30:24.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.404+0000 7f25fd7ff700 1 Processor -- start 2023-07-11T00:30:24.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.404+0000 7f25fd7ff700 1 -- start start 2023-07-11T00:30:24.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.405+0000 7f25fd7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25e0004850 0x7f25f814cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:24.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.405+0000 7f25fd7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25f80caeb0 0x7f25f80cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:24.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.405+0000 7f25fd7ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25f8157f40 0x7f25f81583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:24.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.405+0000 7f25fd7ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f8158900 con 0x7f25f8157f40 2023-07-11T00:30:24.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.405+0000 7f25fd7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f815d000 con 0x7f25f80caeb0 2023-07-11T00:30:24.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.405+0000 7f25fd7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f815d8a0 con 0x7f25e0004850 2023-07-11T00:30:24.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.405+0000 7f25f77fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25f8157f40 0x7f25f81583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:24.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.405+0000 7f25f77fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25f8157f40 0x7f25f81583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55794/0 (socket says 172.21.15.22:55794) 2023-07-11T00:30:24.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.405+0000 7f25f77fe700 1 -- 172.21.15.22:0/711390648 learned_addr learned my addr 172.21.15.22:0/711390648 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:24.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.405+0000 7f25f6ffd700 1 --2- 172.21.15.22:0/711390648 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25e0004850 0x7f25f814cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:24.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.405+0000 7f25f67fc700 1 --2- 172.21.15.22:0/711390648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25f80caeb0 0x7f25f80cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:24.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.406+0000 7f25f77fe700 1 -- 172.21.15.22:0/711390648 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25e0004850 msgr2=0x7f25f814cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:24.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.406+0000 7f25f77fe700 1 --2- 172.21.15.22:0/711390648 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25e0004850 0x7f25f814cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:24.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.406+0000 7f25f77fe700 1 -- 172.21.15.22:0/711390648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25f80caeb0 msgr2=0x7f25f80cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:24.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.406+0000 7f25f77fe700 1 --2- 172.21.15.22:0/711390648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25f80caeb0 0x7f25f80cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:24.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.406+0000 7f25f77fe700 1 -- 172.21.15.22:0/711390648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f80cc5f0 con 0x7f25f8157f40 2023-07-11T00:30:24.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.406+0000 7f25f77fe700 1 --2- 172.21.15.22:0/711390648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25f8157f40 0x7f25f81583c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f25f806aba0 tx=0x7f25f000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:24.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.406+0000 7f25df7fe700 1 -- 172.21.15.22:0/711390648 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0003c10 con 0x7f25f8157f40 2023-07-11T00:30:24.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.406+0000 7f25df7fe700 1 -- 172.21.15.22:0/711390648 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f0003d70 con 0x7f25f8157f40 2023-07-11T00:30:24.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.406+0000 7f25df7fe700 1 -- 172.21.15.22:0/711390648 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0005310 con 0x7f25f8157f40 2023-07-11T00:30:24.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.406+0000 7f25fd7ff700 1 -- 172.21.15.22:0/711390648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f815d250 con 0x7f25f8157f40 2023-07-11T00:30:24.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.406+0000 7f25fd7ff700 1 -- 172.21.15.22:0/711390648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f814d050 con 0x7f25f8157f40 2023-07-11T00:30:24.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.407+0000 7f25fd7ff700 1 -- 172.21.15.22:0/711390648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f815da30 con 0x7f25f8157f40 2023-07-11T00:30:24.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.409+0000 7f25df7fe700 1 -- 172.21.15.22:0/711390648 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f25f0005470 con 0x7f25f8157f40 2023-07-11T00:30:24.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.409+0000 7f25df7fe700 1 --2- 172.21.15.22:0/711390648 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f25e406ace0 0x7f25e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:24.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.410+0000 7f25df7fe700 1 -- 172.21.15.22:0/711390648 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f25f00896c0 con 0x7f25f8157f40 2023-07-11T00:30:24.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.410+0000 7f25f6ffd700 1 --2- 172.21.15.22:0/711390648 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f25e406ace0 0x7f25e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:24.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.411+0000 7f25f6ffd700 1 --2- 172.21.15.22:0/711390648 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f25e406ace0 0x7f25e406d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f25f81543d0 tx=0x7f25e8007040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:24.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.414+0000 7f25df7fe700 1 -- 172.21.15.22:0/711390648 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f25f0054510 con 0x7f25f8157f40 2023-07-11T00:30:24.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.640+0000 7f25fd7ff700 1 -- 172.21.15.22:0/711390648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f25f804ea60 con 0x7f25f8157f40 2023-07-11T00:30:24.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.640+0000 7f25df7fe700 1 -- 172.21.15.22:0/711390648 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f25f0057b30 con 0x7f25f8157f40 2023-07-11T00:30:24.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.643+0000 7f25fd7ff700 1 -- 172.21.15.22:0/711390648 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f25e406ace0 msgr2=0x7f25e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:24.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.643+0000 7f25fd7ff700 1 --2- 172.21.15.22:0/711390648 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f25e406ace0 0x7f25e406d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f25f81543d0 tx=0x7f25e8007040 comp rx=0 tx=0).stop 2023-07-11T00:30:24.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.643+0000 7f25fd7ff700 1 -- 172.21.15.22:0/711390648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25f8157f40 msgr2=0x7f25f81583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:24.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.643+0000 7f25fd7ff700 1 --2- 172.21.15.22:0/711390648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25f8157f40 0x7f25f81583c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f25f806aba0 tx=0x7f25f000ee50 comp rx=0 tx=0).stop 2023-07-11T00:30:24.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.643+0000 7f25fd7ff700 1 -- 172.21.15.22:0/711390648 shutdown_connections 2023-07-11T00:30:24.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.643+0000 7f25fd7ff700 1 --2- 172.21.15.22:0/711390648 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f25e406ace0 0x7f25e406d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:24.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.643+0000 7f25fd7ff700 1 --2- 172.21.15.22:0/711390648 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25e0004850 0x7f25f814cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:24.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.643+0000 7f25fd7ff700 1 --2- 172.21.15.22:0/711390648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25f8157f40 0x7f25f81583c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:24.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.643+0000 7f25fd7ff700 1 --2- 172.21.15.22:0/711390648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25f80caeb0 0x7f25f80cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:24.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.643+0000 7f25fd7ff700 1 -- 172.21.15.22:0/711390648 >> 172.21.15.22:0/711390648 conn(0x7f25f8071660 msgr2=0x7f25f8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:24.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.643+0000 7f25fd7ff700 1 -- 172.21.15.22:0/711390648 shutdown_connections 2023-07-11T00:30:24.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:24.643+0000 7f25fd7ff700 1 -- 172.21.15.22:0/711390648 wait complete. 2023-07-11T00:30:24.650 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-07-11T00:30:24.663 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi022.front.sepia.ceph.com... 2023-07-11T00:30:24.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:24.664 DEBUG:teuthology.orchestra.run.smithi022:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-07-11T00:30:24.731 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi022.stderr:ceph-fuse[118767]: fuse finished with error 0 and tester_r 0 2023-07-11T00:30:24.734 INFO:teuthology.orchestra.run:waiting for 300 2023-07-11T00:30:30.837 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-07-11T00:30:30.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:30.838 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-07-11T00:30:30.896 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:30:31.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.101+0000 7f1064fff700 1 Processor -- start 2023-07-11T00:30:31.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.101+0000 7f1064fff700 1 -- start start 2023-07-11T00:30:31.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.103+0000 7f1064fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1060157f10 0x7f106006a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:31.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.103+0000 7f1064fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1060070a50 0x7f1060070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:31.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.103+0000 7f1064fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106015e210 con 0x7f1060070340 2023-07-11T00:30:31.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.103+0000 7f1064fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106006d900 con 0x7f1060070a50 2023-07-11T00:30:31.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.103+0000 7f1064fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1060071410 con 0x7f1060157f10 2023-07-11T00:30:31.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.103+0000 7f105e59c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1060157f10 0x7f106006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:31.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.103+0000 7f105ed9d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1060070a50 0x7f1060070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:31.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.103+0000 7f105e59c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1060157f10 0x7f106006a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:33598/0 (socket says 172.21.15.22:33598) 2023-07-11T00:30:31.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.103+0000 7f105e59c700 1 -- 172.21.15.22:0/2385994610 learned_addr learned my addr 172.21.15.22:0/2385994610 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:31.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.104+0000 7f105e59c700 1 -- 172.21.15.22:0/2385994610 >> v2:172.21.15.184:3300/0 conn(0x7f1060070a50 msgr2=0x7f1060070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:31.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.104+0000 7f105e59c700 1 --2- 172.21.15.22:0/2385994610 >> v2:172.21.15.184:3300/0 conn(0x7f1060070a50 0x7f1060070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.104+0000 7f105e59c700 1 -- 172.21.15.22:0/2385994610 >> v1:172.21.15.184:6789/0 conn(0x7f1060070340 legacy=0x7f106015e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:31.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.104+0000 7f105e59c700 1 -- 172.21.15.22:0/2385994610 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106015dee0 con 0x7f1060157f10 2023-07-11T00:30:31.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.104+0000 7f105e59c700 1 --2- 172.21.15.22:0/2385994610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1060157f10 0x7f106006a940 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f10500098f0 tx=0x7f1050009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=129ae186a22d591d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:31.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.104+0000 7f105dd9b700 1 -- 172.21.15.22:0/2385994610 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050011830 con 0x7f1060157f10 2023-07-11T00:30:31.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.104+0000 7f105dd9b700 1 -- 172.21.15.22:0/2385994610 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1050011990 con 0x7f1060157f10 2023-07-11T00:30:31.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.104+0000 7f105dd9b700 1 -- 172.21.15.22:0/2385994610 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050011d20 con 0x7f1060157f10 2023-07-11T00:30:31.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.105+0000 7f1064fff700 1 -- 172.21.15.22:0/2385994610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1060157f10 msgr2=0x7f106006a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:31.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.105+0000 7f1064fff700 1 --2- 172.21.15.22:0/2385994610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1060157f10 0x7f106006a940 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f10500098f0 tx=0x7f1050009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:31.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.105+0000 7f1064fff700 1 -- 172.21.15.22:0/2385994610 shutdown_connections 2023-07-11T00:30:31.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.105+0000 7f1064fff700 1 --2- 172.21.15.22:0/2385994610 >> v2:172.21.15.184:3300/0 conn(0x7f1060070a50 0x7f1060070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.105+0000 7f1064fff700 1 --2- 172.21.15.22:0/2385994610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1060157f10 0x7f106006a940 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.105+0000 7f1064fff700 1 -- 172.21.15.22:0/2385994610 >> 172.21.15.22:0/2385994610 conn(0x7f10600b0390 msgr2=0x7f10600b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:31.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.105+0000 7f1064fff700 1 -- 172.21.15.22:0/2385994610 shutdown_connections 2023-07-11T00:30:31.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.105+0000 7f1064fff700 1 -- 172.21.15.22:0/2385994610 wait complete. 2023-07-11T00:30:31.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.107+0000 7f1064fff700 1 Processor -- start 2023-07-11T00:30:31.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.107+0000 7f1064fff700 1 -- start start 2023-07-11T00:30:31.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.108+0000 7f1064fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1060070340 0x7f10600b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:31.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.108+0000 7f1064fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1060070a50 0x7f106014b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:31.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.108+0000 7f1064fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1060157f10 0x7f10600c2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:31.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.108+0000 7f1064fff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600c5300 con 0x7f1060157f10 2023-07-11T00:30:31.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.108+0000 7f1064fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600b4490 con 0x7f1060070340 2023-07-11T00:30:31.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.108+0000 7f1064fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106014c530 con 0x7f1060070a50 2023-07-11T00:30:31.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.108+0000 7f105ed9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1060157f10 0x7f10600c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:31.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.108+0000 7f105ed9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1060157f10 0x7f10600c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45332/0 (socket says 172.21.15.22:45332) 2023-07-11T00:30:31.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.108+0000 7f105ed9d700 1 -- 172.21.15.22:0/1145579470 learned_addr learned my addr 172.21.15.22:0/1145579470 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:31.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.108+0000 7f1057fff700 1 --2- 172.21.15.22:0/1145579470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1060070a50 0x7f106014b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:31.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.108+0000 7f105e59c700 1 --2- 172.21.15.22:0/1145579470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1060070340 0x7f10600b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:31.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.108+0000 7f105ed9d700 1 -- 172.21.15.22:0/1145579470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1060070a50 msgr2=0x7f106014b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:31.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.109+0000 7f105ed9d700 1 --2- 172.21.15.22:0/1145579470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1060070a50 0x7f106014b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.109+0000 7f105ed9d700 1 -- 172.21.15.22:0/1145579470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1060070340 msgr2=0x7f10600b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:31.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.109+0000 7f105ed9d700 1 --2- 172.21.15.22:0/1145579470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1060070340 0x7f10600b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.109+0000 7f105ed9d700 1 -- 172.21.15.22:0/1145579470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1050009550 con 0x7f1060157f10 2023-07-11T00:30:31.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.109+0000 7f105ed9d700 1 --2- 172.21.15.22:0/1145579470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1060157f10 0x7f10600c2440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f105800efc0 tx=0x7f105800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:31.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.109+0000 7f1056ffd700 1 -- 172.21.15.22:0/1145579470 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800cad0 con 0x7f1060157f10 2023-07-11T00:30:31.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.109+0000 7f1056ffd700 1 -- 172.21.15.22:0/1145579470 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105800f040 con 0x7f1060157f10 2023-07-11T00:30:31.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.109+0000 7f1064fff700 1 -- 172.21.15.22:0/1145579470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10600c4470 con 0x7f1060157f10 2023-07-11T00:30:31.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.109+0000 7f1056ffd700 1 -- 172.21.15.22:0/1145579470 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800ce70 con 0x7f1060157f10 2023-07-11T00:30:31.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.109+0000 7f1064fff700 1 -- 172.21.15.22:0/1145579470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10600c49d0 con 0x7f1060157f10 2023-07-11T00:30:31.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.110+0000 7f1064fff700 1 -- 172.21.15.22:0/1145579470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10600b20e0 con 0x7f1060157f10 2023-07-11T00:30:31.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.111+0000 7f1056ffd700 1 -- 172.21.15.22:0/1145579470 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1058014480 con 0x7f1060157f10 2023-07-11T00:30:31.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.112+0000 7f1056ffd700 1 --2- 172.21.15.22:0/1145579470 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f104006ace0 0x7f104006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:31.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.112+0000 7f1056ffd700 1 -- 172.21.15.22:0/1145579470 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1058089ff0 con 0x7f1060157f10 2023-07-11T00:30:31.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.113+0000 7f105e59c700 1 --2- 172.21.15.22:0/1145579470 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f104006ace0 0x7f104006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:31.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.113+0000 7f105e59c700 1 --2- 172.21.15.22:0/1145579470 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f104006ace0 0x7f104006d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1050009c40 tx=0x7f105001d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:31.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.117+0000 7f1056ffd700 1 -- 172.21.15.22:0/1145579470 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f10580bc380 con 0x7f1060157f10 2023-07-11T00:30:31.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.326+0000 7f1064fff700 1 -- 172.21.15.22:0/1145579470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f106004ea60 con 0x7f1060157f10 2023-07-11T00:30:31.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.327+0000 7f1056ffd700 1 -- 172.21.15.22:0/1145579470 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f10600b20e0 con 0x7f1060157f10 2023-07-11T00:30:31.330 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:31.331 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:10.571866+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:30:31.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.330+0000 7f1064fff700 1 -- 172.21.15.22:0/1145579470 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f104006ace0 msgr2=0x7f104006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:31.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.330+0000 7f1064fff700 1 --2- 172.21.15.22:0/1145579470 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f104006ace0 0x7f104006d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1050009c40 tx=0x7f105001d040 comp rx=0 tx=0).stop 2023-07-11T00:30:31.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.330+0000 7f1064fff700 1 -- 172.21.15.22:0/1145579470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1060157f10 msgr2=0x7f10600c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:31.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.330+0000 7f1064fff700 1 --2- 172.21.15.22:0/1145579470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1060157f10 0x7f10600c2440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f105800efc0 tx=0x7f105800c0c0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.330+0000 7f1064fff700 1 -- 172.21.15.22:0/1145579470 shutdown_connections 2023-07-11T00:30:31.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.330+0000 7f1064fff700 1 --2- 172.21.15.22:0/1145579470 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f104006ace0 0x7f104006d190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.330+0000 7f1064fff700 1 --2- 172.21.15.22:0/1145579470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1060157f10 0x7f10600c2440 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.330+0000 7f1064fff700 1 --2- 172.21.15.22:0/1145579470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1060070340 0x7f10600b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.330+0000 7f1064fff700 1 --2- 172.21.15.22:0/1145579470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1060070a50 0x7f106014b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.330+0000 7f1064fff700 1 -- 172.21.15.22:0/1145579470 >> 172.21.15.22:0/1145579470 conn(0x7f10600b0390 msgr2=0x7f10600aee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:31.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.330+0000 7f1064fff700 1 -- 172.21.15.22:0/1145579470 shutdown_connections 2023-07-11T00:30:31.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.330+0000 7f1064fff700 1 -- 172.21.15.22:0/1145579470 wait complete. 2023-07-11T00:30:31.351 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:30:31.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.550+0000 7f50aedff700 1 Processor -- start 2023-07-11T00:30:31.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.551+0000 7f50aedff700 1 -- start start 2023-07-11T00:30:31.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.552+0000 7f50aedff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a80b59d0 0x7f50a81671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:31.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.552+0000 7f50aedff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a80d1790 con 0x7f50a80d2640 2023-07-11T00:30:31.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.552+0000 7f50aedff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a80cd950 con 0x7f50a815c460 2023-07-11T00:30:31.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.552+0000 7f50aedff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a80cedd0 con 0x7f50a80b59d0 2023-07-11T00:30:31.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.552+0000 7f50a7fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f50a80d2640 0x7f50a80cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45774/0 (socket says 172.21.15.22:45774) 2023-07-11T00:30:31.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.552+0000 7f50a7fff700 1 -- 172.21.15.22:0/1558890153 learned_addr learned my addr 172.21.15.22:0/1558890153 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:31.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.552+0000 7f50ad39c700 1 --2- 172.21.15.22:0/1558890153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a80b59d0 0x7f50a81671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:31.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.552+0000 7f50a77fe700 1 -- 172.21.15.22:0/1558890153 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390655106 0 0) 0x7f50a80d1790 con 0x7f50a80d2640 2023-07-11T00:30:31.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.552+0000 7f50a77fe700 1 -- 172.21.15.22:0/1558890153 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50980035b0 con 0x7f50a80d2640 2023-07-11T00:30:31.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.553+0000 7f50a77fe700 1 -- 172.21.15.22:0/1558890153 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 243227382 0 0) 0x7f50980035b0 con 0x7f50a80d2640 2023-07-11T00:30:31.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.553+0000 7f50a77fe700 1 -- 172.21.15.22:0/1558890153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a80b59d0 msgr2=0x7f50a81671b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:31.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.553+0000 7f50a77fe700 1 --2- 172.21.15.22:0/1558890153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a80b59d0 0x7f50a81671b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.553+0000 7f50a77fe700 1 -- 172.21.15.22:0/1558890153 >> v1:172.21.15.184:6789/0 conn(0x7f50a815c460 legacy=0x7f50a80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:31.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.553+0000 7f50a77fe700 1 -- 172.21.15.22:0/1558890153 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a80d14b0 con 0x7f50a80d2640 2023-07-11T00:30:31.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.553+0000 7f50a77fe700 1 -- 172.21.15.22:0/1558890153 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7f5094001670 con 0x7f50a80d2640 2023-07-11T00:30:31.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.553+0000 7f50a77fe700 1 -- 172.21.15.22:0/1558890153 >> v1:172.21.15.22:6789/0 conn(0x7f50a80d2640 legacy=0x7f50a80cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:31.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.553+0000 7f50a77fe700 1 --2- 172.21.15.22:0/1558890153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5098003a30 0x7f5098003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:31.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.553+0000 7f50a77fe700 1 --2- 172.21.15.22:0/1558890153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a80b59d0 0x7f5098004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:31.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.553+0000 7f50a77fe700 1 --2- 172.21.15.22:0/1558890153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5098004d90 0x7f5098005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:31.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.553+0000 7f50a77fe700 1 -- 172.21.15.22:0/1558890153 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a80cedd0 con 0x7f5098003a30 2023-07-11T00:30:31.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.553+0000 7f50a77fe700 1 -- 172.21.15.22:0/1558890153 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509800bbd0 con 0x7f5098004d90 2023-07-11T00:30:31.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.553+0000 7f50a77fe700 1 -- 172.21.15.22:0/1558890153 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509800bd90 con 0x7f50a80b59d0 2023-07-11T00:30:31.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.553+0000 7f50acb9b700 1 --2- 172.21.15.22:0/1558890153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5098003a30 0x7f5098003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:31.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.553+0000 7f50a7fff700 1 --2- 172.21.15.22:0/1558890153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a80b59d0 0x7f5098004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:31.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.553+0000 7f50ad39c700 1 --2- 172.21.15.22:0/1558890153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5098004d90 0x7f5098005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:31.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.554+0000 7f50acb9b700 1 -- 172.21.15.22:0/1558890153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a80b59d0 msgr2=0x7f5098004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:31.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.554+0000 7f50acb9b700 1 --2- 172.21.15.22:0/1558890153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a80b59d0 0x7f5098004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.554+0000 7f50acb9b700 1 -- 172.21.15.22:0/1558890153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5098004d90 msgr2=0x7f5098005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:31.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.554+0000 7f50acb9b700 1 --2- 172.21.15.22:0/1558890153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5098004d90 0x7f5098005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.554+0000 7f50acb9b700 1 -- 172.21.15.22:0/1558890153 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50980035b0 con 0x7f5098003a30 2023-07-11T00:30:31.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.554+0000 7f50acb9b700 1 --2- 172.21.15.22:0/1558890153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5098003a30 0x7f5098003e40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f509c007fd0 tx=0x7f5098005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b98c7c42865b78 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:31.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.554+0000 7f50a77fe700 1 -- 172.21.15.22:0/1558890153 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c0052d0 con 0x7f5098003a30 2023-07-11T00:30:31.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.554+0000 7f50a77fe700 1 -- 172.21.15.22:0/1558890153 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c005470 con 0x7f5098003a30 2023-07-11T00:30:31.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.554+0000 7f50a77fe700 1 -- 172.21.15.22:0/1558890153 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c0038c0 con 0x7f5098003a30 2023-07-11T00:30:31.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.555+0000 7f50aedff700 1 -- 172.21.15.22:0/1558890153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5098003a30 msgr2=0x7f5098003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:31.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.555+0000 7f50aedff700 1 --2- 172.21.15.22:0/1558890153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5098003a30 0x7f5098003e40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f509c007fd0 tx=0x7f5098005880 comp rx=0 tx=0).stop 2023-07-11T00:30:31.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.555+0000 7f50ad39c700 1 -- 172.21.15.22:0/1558890153 reap_dead start 2023-07-11T00:30:31.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.555+0000 7f50aedff700 1 -- 172.21.15.22:0/1558890153 shutdown_connections 2023-07-11T00:30:31.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.555+0000 7f50aedff700 1 -- 172.21.15.22:0/1558890153 >> 172.21.15.22:0/1558890153 conn(0x7f50a8071660 msgr2=0x7f50a8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:31.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.555+0000 7f50aedff700 1 -- 172.21.15.22:0/1558890153 shutdown_connections 2023-07-11T00:30:31.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.555+0000 7f50aedff700 1 -- 172.21.15.22:0/1558890153 wait complete. 2023-07-11T00:30:31.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.557+0000 7f50aedff700 1 Processor -- start 2023-07-11T00:30:31.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.557+0000 7f50aedff700 1 -- start start 2023-07-11T00:30:31.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.558+0000 7f50aedff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5098003a30 0x7f50a815b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:31.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.558+0000 7f50aedff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a8159fd0 0x7f50a81e6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:31.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.558+0000 7f50aedff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a81565e0 0x7f50a8156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:31.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.558+0000 7f50aedff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8156f90 con 0x7f5098003a30 2023-07-11T00:30:31.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.558+0000 7f50aedff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a815bb00 con 0x7f50a81565e0 2023-07-11T00:30:31.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.558+0000 7f50aedff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8159210 con 0x7f50a8159fd0 2023-07-11T00:30:31.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.558+0000 7f50acb9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5098003a30 0x7f50a815b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:31.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.558+0000 7f50acb9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5098003a30 0x7f50a815b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45348/0 (socket says 172.21.15.22:45348) 2023-07-11T00:30:31.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.558+0000 7f50acb9b700 1 -- 172.21.15.22:0/3320445739 learned_addr learned my addr 172.21.15.22:0/3320445739 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:31.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.558+0000 7f50a7fff700 1 --2- 172.21.15.22:0/3320445739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a8159fd0 0x7f50a81e6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:31.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.558+0000 7f50ad39c700 1 --2- 172.21.15.22:0/3320445739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a81565e0 0x7f50a8156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:31.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.558+0000 7f50acb9b700 1 -- 172.21.15.22:0/3320445739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a8159fd0 msgr2=0x7f50a81e6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:31.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.558+0000 7f50acb9b700 1 --2- 172.21.15.22:0/3320445739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a8159fd0 0x7f50a81e6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.558+0000 7f50acb9b700 1 -- 172.21.15.22:0/3320445739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a81565e0 msgr2=0x7f50a8156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:31.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.558+0000 7f50acb9b700 1 --2- 172.21.15.22:0/3320445739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a81565e0 0x7f50a8156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.558+0000 7f50acb9b700 1 -- 172.21.15.22:0/3320445739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a81594f0 con 0x7f5098003a30 2023-07-11T00:30:31.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.558+0000 7f50a7fff700 1 --2- 172.21.15.22:0/3320445739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a8159fd0 0x7f50a81e6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:30:31.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.559+0000 7f50acb9b700 1 --2- 172.21.15.22:0/3320445739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5098003a30 0x7f50a815b520 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f509c004000 tx=0x7f509c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:31.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.559+0000 7f50a57fa700 1 -- 172.21.15.22:0/3320445739 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c007240 con 0x7f5098003a30 2023-07-11T00:30:31.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.559+0000 7f50a57fa700 1 -- 172.21.15.22:0/3320445739 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c0073a0 con 0x7f5098003a30 2023-07-11T00:30:31.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.559+0000 7f50a57fa700 1 -- 172.21.15.22:0/3320445739 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c001290 con 0x7f5098003a30 2023-07-11T00:30:31.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.559+0000 7f50aedff700 1 -- 172.21.15.22:0/3320445739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a81597d0 con 0x7f5098003a30 2023-07-11T00:30:31.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.559+0000 7f50aedff700 1 -- 172.21.15.22:0/3320445739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a81e72f0 con 0x7f5098003a30 2023-07-11T00:30:31.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.560+0000 7f50aedff700 1 -- 172.21.15.22:0/3320445739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a81e7480 con 0x7f5098003a30 2023-07-11T00:30:31.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.561+0000 7f50a57fa700 1 -- 172.21.15.22:0/3320445739 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f509c003680 con 0x7f5098003a30 2023-07-11T00:30:31.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.562+0000 7f50a57fa700 1 --2- 172.21.15.22:0/3320445739 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f508c06ace0 0x7f508c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:31.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.562+0000 7f50a57fa700 1 -- 172.21.15.22:0/3320445739 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f509c08a310 con 0x7f5098003a30 2023-07-11T00:30:31.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.563+0000 7f50a7fff700 1 --2- 172.21.15.22:0/3320445739 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f508c06ace0 0x7f508c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:31.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.563+0000 7f50a7fff700 1 --2- 172.21.15.22:0/3320445739 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f508c06ace0 0x7f508c06d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f50a81e68e0 tx=0x7f5094009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:31.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.566+0000 7f50a57fa700 1 -- 172.21.15.22:0/3320445739 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f509c0550c0 con 0x7f5098003a30 2023-07-11T00:30:31.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.774+0000 7f50aedff700 1 -- 172.21.15.22:0/3320445739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50a804ea60 con 0x7f5098003a30 2023-07-11T00:30:31.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.775+0000 7f50a57fa700 1 -- 172.21.15.22:0/3320445739 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f509c0586e0 con 0x7f5098003a30 2023-07-11T00:30:31.778 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:31.779 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:10.571866+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:30:31.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.778+0000 7f50aedff700 1 -- 172.21.15.22:0/3320445739 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f508c06ace0 msgr2=0x7f508c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:31.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.778+0000 7f50aedff700 1 --2- 172.21.15.22:0/3320445739 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f508c06ace0 0x7f508c06d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f50a81e68e0 tx=0x7f5094009040 comp rx=0 tx=0).stop 2023-07-11T00:30:31.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.778+0000 7f50aedff700 1 -- 172.21.15.22:0/3320445739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5098003a30 msgr2=0x7f50a815b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:31.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.778+0000 7f50aedff700 1 --2- 172.21.15.22:0/3320445739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5098003a30 0x7f50a815b520 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f509c004000 tx=0x7f509c001120 comp rx=0 tx=0).stop 2023-07-11T00:30:31.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.778+0000 7f50aedff700 1 -- 172.21.15.22:0/3320445739 shutdown_connections 2023-07-11T00:30:31.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.778+0000 7f50aedff700 1 --2- 172.21.15.22:0/3320445739 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f508c06ace0 0x7f508c06d190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.778+0000 7f50aedff700 1 --2- 172.21.15.22:0/3320445739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a81565e0 0x7f50a8156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.778+0000 7f50aedff700 1 --2- 172.21.15.22:0/3320445739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5098003a30 0x7f50a815b520 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.778+0000 7f50aedff700 1 --2- 172.21.15.22:0/3320445739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50a8159fd0 0x7f50a81e6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:31.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.778+0000 7f50aedff700 1 -- 172.21.15.22:0/3320445739 >> 172.21.15.22:0/3320445739 conn(0x7f50a8071660 msgr2=0x7f50a80b5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:31.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.778+0000 7f50aedff700 1 -- 172.21.15.22:0/3320445739 shutdown_connections 2023-07-11T00:30:31.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:31.778+0000 7f50aedff700 1 -- 172.21.15.22:0/3320445739 wait complete. 2023-07-11T00:30:31.799 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-11T00:30:32.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.001+0000 7f611f1ff700 1 Processor -- start 2023-07-11T00:30:32.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.001+0000 7f611f1ff700 1 -- start start 2023-07-11T00:30:32.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.002+0000 7f611f1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f61180b8430 0x7f61180cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:32.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.002+0000 7f611f1ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f61180d3730 0x7f61180cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:32.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.002+0000 7f611f1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61180d0b20 con 0x7f61180cfa90 2023-07-11T00:30:32.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.002+0000 7f611f1ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61180b8800 con 0x7f61180d3730 2023-07-11T00:30:32.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.002+0000 7f611f1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61180cfe90 con 0x7f61180b8430 2023-07-11T00:30:32.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.003+0000 7f6117fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f61180d3730 0x7f61180cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:32.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.003+0000 7f6117fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f61180d3730 0x7f61180cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45364/0 (socket says 172.21.15.22:45364) 2023-07-11T00:30:32.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.003+0000 7f6117fff700 1 -- 172.21.15.22:0/3099961847 learned_addr learned my addr 172.21.15.22:0/3099961847 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:32.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.003+0000 7f611cf9b700 1 --2- 172.21.15.22:0/3099961847 >> v2:172.21.15.184:3300/0 conn(0x7f61180b8430 0x7f61180cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:32.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.003+0000 7f6117fff700 1 -- 172.21.15.22:0/3099961847 >> v2:172.21.15.184:3300/0 conn(0x7f61180b8430 msgr2=0x7f61180cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:32.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.003+0000 7f6117fff700 1 --2- 172.21.15.22:0/3099961847 >> v2:172.21.15.184:3300/0 conn(0x7f61180b8430 0x7f61180cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:32.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.003+0000 7f6117fff700 1 -- 172.21.15.22:0/3099961847 >> v1:172.21.15.184:6789/0 conn(0x7f61180cfa90 legacy=0x7f611815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:32.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.003+0000 7f6117fff700 1 -- 172.21.15.22:0/3099961847 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61180b4ee0 con 0x7f61180d3730 2023-07-11T00:30:32.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.003+0000 7f6117fff700 1 --2- 172.21.15.22:0/3099961847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61180d3730 0x7f61180cf550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f61180cf520 tx=0x7f6104009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2728924914d0c77 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:32.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.004+0000 7f61177fe700 1 -- 172.21.15.22:0/3099961847 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610400b870 con 0x7f61180d3730 2023-07-11T00:30:32.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.004+0000 7f61177fe700 1 -- 172.21.15.22:0/3099961847 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610400b9d0 con 0x7f61180d3730 2023-07-11T00:30:32.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.004+0000 7f61177fe700 1 -- 172.21.15.22:0/3099961847 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610400bd60 con 0x7f61180d3730 2023-07-11T00:30:32.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.004+0000 7f611f1ff700 1 -- 172.21.15.22:0/3099961847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61180d3730 msgr2=0x7f61180cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:32.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.004+0000 7f611f1ff700 1 --2- 172.21.15.22:0/3099961847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61180d3730 0x7f61180cf550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f61180cf520 tx=0x7f6104009bd0 comp rx=0 tx=0).stop 2023-07-11T00:30:32.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.004+0000 7f611f1ff700 1 -- 172.21.15.22:0/3099961847 shutdown_connections 2023-07-11T00:30:32.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.004+0000 7f611f1ff700 1 --2- 172.21.15.22:0/3099961847 >> v2:172.21.15.184:3300/0 conn(0x7f61180b8430 0x7f61180cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:32.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.004+0000 7f611f1ff700 1 --2- 172.21.15.22:0/3099961847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61180d3730 0x7f61180cf550 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:32.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.004+0000 7f611f1ff700 1 -- 172.21.15.22:0/3099961847 >> 172.21.15.22:0/3099961847 conn(0x7f611806b3f0 msgr2=0x7f611806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:32.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.004+0000 7f611f1ff700 1 -- 172.21.15.22:0/3099961847 shutdown_connections 2023-07-11T00:30:32.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.004+0000 7f611f1ff700 1 -- 172.21.15.22:0/3099961847 wait complete. 2023-07-11T00:30:32.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.006+0000 7f611f1ff700 1 Processor -- start 2023-07-11T00:30:32.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.006+0000 7f611f1ff700 1 -- start start 2023-07-11T00:30:32.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.007+0000 7f611f1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61180b8430 0x7f611815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:32.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.007+0000 7f611f1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61180cfa90 0x7f611815ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:32.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.007+0000 7f611f1ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61180d3730 0x7f61180cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:32.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.007+0000 7f611f1ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61181f2650 con 0x7f61180d3730 2023-07-11T00:30:32.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.007+0000 7f611f1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61180cc9c0 con 0x7f61180cfa90 2023-07-11T00:30:32.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.007+0000 7f611f1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61181f1cb0 con 0x7f61180b8430 2023-07-11T00:30:32.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.007+0000 7f611d79c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61180d3730 0x7f61180cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:32.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.007+0000 7f611d79c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61180d3730 0x7f61180cbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45380/0 (socket says 172.21.15.22:45380) 2023-07-11T00:30:32.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.007+0000 7f611cf9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61180b8430 0x7f611815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:32.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.007+0000 7f6117fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61180cfa90 0x7f611815ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:32.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.007+0000 7f611d79c700 1 -- 172.21.15.22:0/3519064442 learned_addr learned my addr 172.21.15.22:0/3519064442 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:32.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.008+0000 7f611d79c700 1 -- 172.21.15.22:0/3519064442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61180b8430 msgr2=0x7f611815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:32.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.008+0000 7f611d79c700 1 --2- 172.21.15.22:0/3519064442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61180b8430 0x7f611815e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:32.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.008+0000 7f611d79c700 1 -- 172.21.15.22:0/3519064442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61180cfa90 msgr2=0x7f611815ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:32.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.008+0000 7f611d79c700 1 --2- 172.21.15.22:0/3519064442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61180cfa90 0x7f611815ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:32.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.008+0000 7f611d79c700 1 -- 172.21.15.22:0/3519064442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6104009550 con 0x7f61180d3730 2023-07-11T00:30:32.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.008+0000 7f611d79c700 1 --2- 172.21.15.22:0/3519064442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61180d3730 0x7f61180cbc00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f611000cc50 tx=0x7f611000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:32.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.008+0000 7f61157fa700 1 -- 172.21.15.22:0/3519064442 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110003c00 con 0x7f61180d3730 2023-07-11T00:30:32.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.008+0000 7f61157fa700 1 -- 172.21.15.22:0/3519064442 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6110003d60 con 0x7f61180d3730 2023-07-11T00:30:32.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.008+0000 7f61157fa700 1 -- 172.21.15.22:0/3519064442 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611000aab0 con 0x7f61180d3730 2023-07-11T00:30:32.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.008+0000 7f611f1ff700 1 -- 172.21.15.22:0/3519064442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61181f1f90 con 0x7f61180d3730 2023-07-11T00:30:32.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.009+0000 7f611f1ff700 1 -- 172.21.15.22:0/3519064442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61181f2a70 con 0x7f61180d3730 2023-07-11T00:30:32.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.009+0000 7f611f1ff700 1 -- 172.21.15.22:0/3519064442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61181f2790 con 0x7f61180d3730 2023-07-11T00:30:32.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.011+0000 7f61157fa700 1 -- 172.21.15.22:0/3519064442 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f611000ac10 con 0x7f61180d3730 2023-07-11T00:30:32.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.012+0000 7f61157fa700 1 --2- 172.21.15.22:0/3519064442 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f60fc06ace0 0x7f60fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:32.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.012+0000 7f61157fa700 1 -- 172.21.15.22:0/3519064442 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f61100897a0 con 0x7f61180d3730 2023-07-11T00:30:32.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.012+0000 7f611cf9b700 1 --2- 172.21.15.22:0/3519064442 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f60fc06ace0 0x7f60fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:32.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.013+0000 7f611cf9b700 1 --2- 172.21.15.22:0/3519064442 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f60fc06ace0 0x7f60fc06d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f610c006b20 tx=0x7f610c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:32.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.016+0000 7f61157fa700 1 -- 172.21.15.22:0/3519064442 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f61181f2790 con 0x7f61180d3730 2023-07-11T00:30:32.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:32.270+0000 7f611f1ff700 1 -- 172.21.15.22:0/3519064442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f61181f2790 con 0x7f61180d3730 2023-07-11T00:30:33.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.128+0000 7f61157fa700 1 -- 172.21.15.22:0/3519064442 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f61181f2790 con 0x7f61180d3730 2023-07-11T00:30:33.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.131+0000 7f611f1ff700 1 -- 172.21.15.22:0/3519064442 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f60fc06ace0 msgr2=0x7f60fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:33.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.131+0000 7f611f1ff700 1 --2- 172.21.15.22:0/3519064442 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f60fc06ace0 0x7f60fc06d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f610c006b20 tx=0x7f610c008040 comp rx=0 tx=0).stop 2023-07-11T00:30:33.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.131+0000 7f611f1ff700 1 -- 172.21.15.22:0/3519064442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61180d3730 msgr2=0x7f61180cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:33.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.131+0000 7f611f1ff700 1 --2- 172.21.15.22:0/3519064442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61180d3730 0x7f61180cbc00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f611000cc50 tx=0x7f611000cf60 comp rx=0 tx=0).stop 2023-07-11T00:30:33.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.131+0000 7f611f1ff700 1 -- 172.21.15.22:0/3519064442 shutdown_connections 2023-07-11T00:30:33.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.131+0000 7f611f1ff700 1 --2- 172.21.15.22:0/3519064442 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f60fc06ace0 0x7f60fc06d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:33.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.131+0000 7f611f1ff700 1 --2- 172.21.15.22:0/3519064442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61180b8430 0x7f611815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:33.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.131+0000 7f611f1ff700 1 --2- 172.21.15.22:0/3519064442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61180d3730 0x7f61180cbc00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:33.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.131+0000 7f611f1ff700 1 --2- 172.21.15.22:0/3519064442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61180cfa90 0x7f611815ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:33.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.131+0000 7f611f1ff700 1 -- 172.21.15.22:0/3519064442 >> 172.21.15.22:0/3519064442 conn(0x7f611806b3f0 msgr2=0x7f61180b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:33.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.131+0000 7f611f1ff700 1 -- 172.21.15.22:0/3519064442 shutdown_connections 2023-07-11T00:30:33.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.131+0000 7f611f1ff700 1 -- 172.21.15.22:0/3519064442 wait complete. 2023-07-11T00:30:33.155 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-07-11T00:30:33.155 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-11T00:30:33.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.361+0000 7f0552bff700 1 Processor -- start 2023-07-11T00:30:33.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.361+0000 7f0552bff700 1 -- start start 2023-07-11T00:30:33.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.362+0000 7f0552bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f054c0b4590 0x7f054c0b4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:33.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.362+0000 7f0552bff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f054c06bda0 0x7f054c0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:33.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.362+0000 7f0552bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054c0b4ea0 con 0x7f054c06c210 2023-07-11T00:30:33.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.362+0000 7f0552bff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054c06b390 con 0x7f054c06bda0 2023-07-11T00:30:33.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.362+0000 7f0552bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054c15d3d0 con 0x7f054c0b4590 2023-07-11T00:30:33.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.362+0000 7f054bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f054c06bda0 0x7f054c0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:33.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.363+0000 7f054bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f054c06bda0 0x7f054c0d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45382/0 (socket says 172.21.15.22:45382) 2023-07-11T00:30:33.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.363+0000 7f054bfff700 1 -- 172.21.15.22:0/1407062046 learned_addr learned my addr 172.21.15.22:0/1407062046 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:33.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.363+0000 7f055099b700 1 --2- 172.21.15.22:0/1407062046 >> v2:172.21.15.184:3300/0 conn(0x7f054c0b4590 0x7f054c0b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:33.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.363+0000 7f054bfff700 1 -- 172.21.15.22:0/1407062046 >> v2:172.21.15.184:3300/0 conn(0x7f054c0b4590 msgr2=0x7f054c0b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:33.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.363+0000 7f054bfff700 1 --2- 172.21.15.22:0/1407062046 >> v2:172.21.15.184:3300/0 conn(0x7f054c0b4590 0x7f054c0b4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:33.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.363+0000 7f054bfff700 1 -- 172.21.15.22:0/1407062046 >> v1:172.21.15.184:6789/0 conn(0x7f054c06c210 legacy=0x7f054c15c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:33.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.363+0000 7f054bfff700 1 -- 172.21.15.22:0/1407062046 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c15d6b0 con 0x7f054c06bda0 2023-07-11T00:30:33.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.363+0000 7f054bfff700 1 --2- 172.21.15.22:0/1407062046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c06bda0 0x7f054c0d0a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f054c08be00 tx=0x7f0538009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2151beac7633c731 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:33.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.363+0000 7f054b7fe700 1 -- 172.21.15.22:0/1407062046 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538011830 con 0x7f054c06bda0 2023-07-11T00:30:33.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.364+0000 7f054b7fe700 1 -- 172.21.15.22:0/1407062046 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0538011990 con 0x7f054c06bda0 2023-07-11T00:30:33.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.364+0000 7f054b7fe700 1 -- 172.21.15.22:0/1407062046 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538011d20 con 0x7f054c06bda0 2023-07-11T00:30:33.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.364+0000 7f0552bff700 1 -- 172.21.15.22:0/1407062046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c06bda0 msgr2=0x7f054c0d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:33.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.364+0000 7f0552bff700 1 --2- 172.21.15.22:0/1407062046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c06bda0 0x7f054c0d0a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f054c08be00 tx=0x7f0538009bd0 comp rx=0 tx=0).stop 2023-07-11T00:30:33.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.364+0000 7f0552bff700 1 -- 172.21.15.22:0/1407062046 shutdown_connections 2023-07-11T00:30:33.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.364+0000 7f0552bff700 1 --2- 172.21.15.22:0/1407062046 >> v2:172.21.15.184:3300/0 conn(0x7f054c0b4590 0x7f054c0b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:33.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.364+0000 7f0552bff700 1 --2- 172.21.15.22:0/1407062046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c06bda0 0x7f054c0d0a10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:33.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.364+0000 7f0552bff700 1 -- 172.21.15.22:0/1407062046 >> 172.21.15.22:0/1407062046 conn(0x7f054c0cf590 msgr2=0x7f054c0cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:33.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.364+0000 7f0552bff700 1 -- 172.21.15.22:0/1407062046 shutdown_connections 2023-07-11T00:30:33.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.364+0000 7f0552bff700 1 -- 172.21.15.22:0/1407062046 wait complete. 2023-07-11T00:30:33.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.366+0000 7f0552bff700 1 Processor -- start 2023-07-11T00:30:33.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.366+0000 7f0552bff700 1 -- start start 2023-07-11T00:30:33.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.367+0000 7f0552bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c06bda0 0x7f054c0c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:33.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.367+0000 7f0552bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054c06c210 0x7f054c1554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:33.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.367+0000 7f0552bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f054c0b4590 0x7f054c0b7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:33.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.367+0000 7f0552bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054c157620 con 0x7f054c06bda0 2023-07-11T00:30:33.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.367+0000 7f0552bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054c0c8ee0 con 0x7f054c06c210 2023-07-11T00:30:33.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.367+0000 7f0552bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054c157340 con 0x7f054c0b4590 2023-07-11T00:30:33.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.367+0000 7f055099b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c06bda0 0x7f054c0c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:33.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.367+0000 7f055099b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c06bda0 0x7f054c0c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45396/0 (socket says 172.21.15.22:45396) 2023-07-11T00:30:33.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.367+0000 7f055099b700 1 -- 172.21.15.22:0/968726413 learned_addr learned my addr 172.21.15.22:0/968726413 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:33.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.368+0000 7f055119c700 1 --2- 172.21.15.22:0/968726413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f054c0b4590 0x7f054c0b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:33.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.368+0000 7f054bfff700 1 --2- 172.21.15.22:0/968726413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054c06c210 0x7f054c1554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:33.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.368+0000 7f055099b700 1 -- 172.21.15.22:0/968726413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f054c0b4590 msgr2=0x7f054c0b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:33.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.368+0000 7f055099b700 1 --2- 172.21.15.22:0/968726413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f054c0b4590 0x7f054c0b7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:33.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.368+0000 7f055099b700 1 -- 172.21.15.22:0/968726413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054c06c210 msgr2=0x7f054c1554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:33.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.368+0000 7f055099b700 1 --2- 172.21.15.22:0/968726413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054c06c210 0x7f054c1554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:33.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.368+0000 7f055099b700 1 -- 172.21.15.22:0/968726413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0538009550 con 0x7f054c06bda0 2023-07-11T00:30:33.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.368+0000 7f055099b700 1 --2- 172.21.15.22:0/968726413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c06bda0 0x7f054c0c89a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f054000e9b0 tx=0x7f054000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:33.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.368+0000 7f05497fa700 1 -- 172.21.15.22:0/968726413 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540009710 con 0x7f054c06bda0 2023-07-11T00:30:33.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.368+0000 7f05497fa700 1 -- 172.21.15.22:0/968726413 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054000c850 con 0x7f054c06bda0 2023-07-11T00:30:33.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.368+0000 7f05497fa700 1 -- 172.21.15.22:0/968726413 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054000cbc0 con 0x7f054c06bda0 2023-07-11T00:30:33.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.368+0000 7f0552bff700 1 -- 172.21.15.22:0/968726413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f054c154a10 con 0x7f054c06bda0 2023-07-11T00:30:33.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.368+0000 7f0552bff700 1 -- 172.21.15.22:0/968726413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054c154fd0 con 0x7f054c06bda0 2023-07-11T00:30:33.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.369+0000 7f0552bff700 1 -- 172.21.15.22:0/968726413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f054c04ea60 con 0x7f054c06bda0 2023-07-11T00:30:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.370+0000 7f05497fa700 1 -- 172.21.15.22:0/968726413 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f054000cd20 con 0x7f054c06bda0 2023-07-11T00:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.371+0000 7f05497fa700 1 --2- 172.21.15.22:0/968726413 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f053006ace0 0x7f053006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.372+0000 7f05497fa700 1 -- 172.21.15.22:0/968726413 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0540089910 con 0x7f054c06bda0 2023-07-11T00:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.372+0000 7f054bfff700 1 --2- 172.21.15.22:0/968726413 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f053006ace0 0x7f053006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.373+0000 7f054bfff700 1 --2- 172.21.15.22:0/968726413 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f053006ace0 0x7f053006d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0538014040 tx=0x7f0538008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.375+0000 7f05497fa700 1 -- 172.21.15.22:0/968726413 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f05400580d0 con 0x7f054c06bda0 2023-07-11T00:30:33.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:33.630+0000 7f0552bff700 1 -- 172.21.15.22:0/968726413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f054c0d00a0 con 0x7f054c06bda0 2023-07-11T00:30:34.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.130+0000 7f05497fa700 1 -- 172.21.15.22:0/968726413 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0540057c60 con 0x7f054c06bda0 2023-07-11T00:30:34.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.132+0000 7f0552bff700 1 -- 172.21.15.22:0/968726413 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f053006ace0 msgr2=0x7f053006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:34.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.132+0000 7f0552bff700 1 --2- 172.21.15.22:0/968726413 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f053006ace0 0x7f053006d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0538014040 tx=0x7f0538008030 comp rx=0 tx=0).stop 2023-07-11T00:30:34.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.132+0000 7f0552bff700 1 -- 172.21.15.22:0/968726413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c06bda0 msgr2=0x7f054c0c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:34.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.133+0000 7f0552bff700 1 --2- 172.21.15.22:0/968726413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c06bda0 0x7f054c0c89a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f054000e9b0 tx=0x7f054000ed70 comp rx=0 tx=0).stop 2023-07-11T00:30:34.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.133+0000 7f0552bff700 1 -- 172.21.15.22:0/968726413 shutdown_connections 2023-07-11T00:30:34.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.133+0000 7f0552bff700 1 --2- 172.21.15.22:0/968726413 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f053006ace0 0x7f053006d190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.133+0000 7f0552bff700 1 --2- 172.21.15.22:0/968726413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f054c0b4590 0x7f054c0b7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.133+0000 7f0552bff700 1 --2- 172.21.15.22:0/968726413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c06bda0 0x7f054c0c89a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.133+0000 7f0552bff700 1 --2- 172.21.15.22:0/968726413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054c06c210 0x7f054c1554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.133+0000 7f0552bff700 1 -- 172.21.15.22:0/968726413 >> 172.21.15.22:0/968726413 conn(0x7f054c0cf590 msgr2=0x7f054c0b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:34.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.133+0000 7f0552bff700 1 -- 172.21.15.22:0/968726413 shutdown_connections 2023-07-11T00:30:34.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.133+0000 7f0552bff700 1 -- 172.21.15.22:0/968726413 wait complete. 2023-07-11T00:30:34.156 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-11T00:30:34.156 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:30:34.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.359+0000 7f541afff700 1 Processor -- start 2023-07-11T00:30:34.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.359+0000 7f541afff700 1 -- start start 2023-07-11T00:30:34.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.360+0000 7f541afff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f541415c460 0x7f54140b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:34.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.360+0000 7f541afff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f54140d2640 0x7f54140cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:34.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.360+0000 7f541afff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54140d1790 con 0x7f54140cf720 2023-07-11T00:30:34.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.360+0000 7f541afff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54140cedd0 con 0x7f541415c460 2023-07-11T00:30:34.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.360+0000 7f541afff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54140cd950 con 0x7f54140d2640 2023-07-11T00:30:34.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.361+0000 7f541959c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f54140cf720 0x7f54140d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45788/0 (socket says 172.21.15.22:45788) 2023-07-11T00:30:34.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.361+0000 7f541959c700 1 -- 172.21.15.22:0/399919373 learned_addr learned my addr 172.21.15.22:0/399919373 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:34.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.361+0000 7f5418d9b700 1 --2- 172.21.15.22:0/399919373 >> v2:172.21.15.22:3300/0 conn(0x7f541415c460 0x7f54140b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:34.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.361+0000 7f5413fff700 1 --2- 172.21.15.22:0/399919373 >> v2:172.21.15.184:3300/0 conn(0x7f54140d2640 0x7f54140cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:34.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.361+0000 7f54137fe700 1 -- 172.21.15.22:0/399919373 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330309618 0 0) 0x7f54140d1790 con 0x7f54140cf720 2023-07-11T00:30:34.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.361+0000 7f54137fe700 1 -- 172.21.15.22:0/399919373 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54040035b0 con 0x7f54140cf720 2023-07-11T00:30:34.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.361+0000 7f5418d9b700 1 -- 172.21.15.22:0/399919373 >> v2:172.21.15.184:3300/0 conn(0x7f54140d2640 msgr2=0x7f54140cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:34.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.361+0000 7f5418d9b700 1 --2- 172.21.15.22:0/399919373 >> v2:172.21.15.184:3300/0 conn(0x7f54140d2640 0x7f54140cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.361+0000 7f5418d9b700 1 -- 172.21.15.22:0/399919373 >> v1:172.21.15.22:6789/0 conn(0x7f54140cf720 legacy=0x7f54140d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:34.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.361+0000 7f5418d9b700 1 -- 172.21.15.22:0/399919373 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54140d14b0 con 0x7f541415c460 2023-07-11T00:30:34.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.362+0000 7f5418d9b700 1 --2- 172.21.15.22:0/399919373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f541415c460 0x7f54140b59d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f541415fd80 tx=0x7f5408009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55593a0ad47fc653 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:34.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.362+0000 7f54137fe700 1 -- 172.21.15.22:0/399919373 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408011830 con 0x7f541415c460 2023-07-11T00:30:34.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.362+0000 7f54137fe700 1 -- 172.21.15.22:0/399919373 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5408011990 con 0x7f541415c460 2023-07-11T00:30:34.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.362+0000 7f54137fe700 1 -- 172.21.15.22:0/399919373 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408011d20 con 0x7f541415c460 2023-07-11T00:30:34.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.362+0000 7f541afff700 1 -- 172.21.15.22:0/399919373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f541415c460 msgr2=0x7f54140b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:34.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.362+0000 7f541afff700 1 --2- 172.21.15.22:0/399919373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f541415c460 0x7f54140b59d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f541415fd80 tx=0x7f5408009b20 comp rx=0 tx=0).stop 2023-07-11T00:30:34.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.362+0000 7f541afff700 1 -- 172.21.15.22:0/399919373 shutdown_connections 2023-07-11T00:30:34.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.362+0000 7f541afff700 1 --2- 172.21.15.22:0/399919373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f541415c460 0x7f54140b59d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.362+0000 7f541afff700 1 --2- 172.21.15.22:0/399919373 >> v2:172.21.15.184:3300/0 conn(0x7f54140d2640 0x7f54140cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.363+0000 7f541afff700 1 -- 172.21.15.22:0/399919373 >> 172.21.15.22:0/399919373 conn(0x7f5414071660 msgr2=0x7f5414071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:34.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.363+0000 7f541afff700 1 -- 172.21.15.22:0/399919373 shutdown_connections 2023-07-11T00:30:34.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.363+0000 7f541afff700 1 -- 172.21.15.22:0/399919373 wait complete. 2023-07-11T00:30:34.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.365+0000 7f541afff700 1 Processor -- start 2023-07-11T00:30:34.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.365+0000 7f541afff700 1 -- start start 2023-07-11T00:30:34.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.366+0000 7f541afff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54140cf720 0x7f54140cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:34.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.366+0000 7f541afff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54140d2640 0x7f541414f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:34.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.366+0000 7f541afff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f541415c460 0x7f54141511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:34.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.366+0000 7f541afff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54141539a0 con 0x7f54140cf720 2023-07-11T00:30:34.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.366+0000 7f541afff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5414153040 con 0x7f54140d2640 2023-07-11T00:30:34.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.367+0000 7f541afff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54140ccda0 con 0x7f541415c460 2023-07-11T00:30:34.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.367+0000 7f5418d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54140cf720 0x7f54140cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:34.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.367+0000 7f5418d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54140cf720 0x7f54140cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45412/0 (socket says 172.21.15.22:45412) 2023-07-11T00:30:34.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.367+0000 7f5418d9b700 1 -- 172.21.15.22:0/1320364803 learned_addr learned my addr 172.21.15.22:0/1320364803 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:34.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.367+0000 7f5413fff700 1 --2- 172.21.15.22:0/1320364803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54140d2640 0x7f541414f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:34.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.367+0000 7f541959c700 1 --2- 172.21.15.22:0/1320364803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f541415c460 0x7f54141511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:34.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.367+0000 7f5418d9b700 1 -- 172.21.15.22:0/1320364803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f541415c460 msgr2=0x7f54141511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:34.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.367+0000 7f5418d9b700 1 --2- 172.21.15.22:0/1320364803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f541415c460 0x7f54141511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.367+0000 7f5418d9b700 1 -- 172.21.15.22:0/1320364803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54140d2640 msgr2=0x7f541414f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:34.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.367+0000 7f5418d9b700 1 --2- 172.21.15.22:0/1320364803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54140d2640 0x7f541414f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.367+0000 7f5418d9b700 1 -- 172.21.15.22:0/1320364803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54080094a0 con 0x7f54140cf720 2023-07-11T00:30:34.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.367+0000 7f5418d9b700 1 --2- 172.21.15.22:0/1320364803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54140cf720 0x7f54140cc570 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5408009b60 tx=0x7f5408004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:34.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.368+0000 7f54117fa700 1 -- 172.21.15.22:0/1320364803 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080036a0 con 0x7f54140cf720 2023-07-11T00:30:34.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.368+0000 7f54117fa700 1 -- 172.21.15.22:0/1320364803 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540801f070 con 0x7f54140cf720 2023-07-11T00:30:34.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.368+0000 7f541afff700 1 -- 172.21.15.22:0/1320364803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54141532e0 con 0x7f54140cf720 2023-07-11T00:30:34.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.368+0000 7f54117fa700 1 -- 172.21.15.22:0/1320364803 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408003a20 con 0x7f54140cf720 2023-07-11T00:30:34.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.368+0000 7f541afff700 1 -- 172.21.15.22:0/1320364803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54140ccab0 con 0x7f54140cf720 2023-07-11T00:30:34.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.369+0000 7f541afff700 1 -- 172.21.15.22:0/1320364803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54140b4690 con 0x7f54140cf720 2023-07-11T00:30:34.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.370+0000 7f54117fa700 1 -- 172.21.15.22:0/1320364803 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5408003b80 con 0x7f54140cf720 2023-07-11T00:30:34.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.371+0000 7f54117fa700 1 --2- 172.21.15.22:0/1320364803 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f53f806ace0 0x7f53f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:34.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.371+0000 7f54117fa700 1 -- 172.21.15.22:0/1320364803 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5408021070 con 0x7f54140cf720 2023-07-11T00:30:34.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.371+0000 7f5413fff700 1 --2- 172.21.15.22:0/1320364803 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f53f806ace0 0x7f53f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:34.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.372+0000 7f5413fff700 1 --2- 172.21.15.22:0/1320364803 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f53f806ace0 0x7f53f806d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f541415d560 tx=0x7f5400009210 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:34.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.375+0000 7f54117fa700 1 -- 172.21.15.22:0/1320364803 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5408055d70 con 0x7f54140cf720 2023-07-11T00:30:34.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.632+0000 7f541afff700 1 -- 172.21.15.22:0/1320364803 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5414066e80 con 0x7f54140cf720 2023-07-11T00:30:34.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.633+0000 7f54117fa700 1 -- 172.21.15.22:0/1320364803 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f5408059390 con 0x7f54140cf720 2023-07-11T00:30:34.635 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:34.635 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3244868368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3244868368},{"type":"v1","addr":"172.21.15.22:6833","nonce":3244868368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/907204261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":907204261},{"type":"v1","addr":"172.21.15.184:6836","nonce":907204261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/1214375050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1214375050},{"type":"v1","addr":"172.21.15.22:6835","nonce":1214375050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:30:05.408970+0000","modified":"2023-07-11T00:30:33.631426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3376322541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3376322541},{"type":"v1","addr":"172.21.15.184:6837","nonce":3376322541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-11T00:30:34.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.635+0000 7f541afff700 1 -- 172.21.15.22:0/1320364803 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f53f806ace0 msgr2=0x7f53f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:34.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.635+0000 7f541afff700 1 --2- 172.21.15.22:0/1320364803 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f53f806ace0 0x7f53f806d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f541415d560 tx=0x7f5400009210 comp rx=0 tx=0).stop 2023-07-11T00:30:34.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.635+0000 7f541afff700 1 -- 172.21.15.22:0/1320364803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54140cf720 msgr2=0x7f54140cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:34.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.635+0000 7f541afff700 1 --2- 172.21.15.22:0/1320364803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54140cf720 0x7f54140cc570 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5408009b60 tx=0x7f5408004750 comp rx=0 tx=0).stop 2023-07-11T00:30:34.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.635+0000 7f541afff700 1 -- 172.21.15.22:0/1320364803 shutdown_connections 2023-07-11T00:30:34.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.635+0000 7f541afff700 1 --2- 172.21.15.22:0/1320364803 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f53f806ace0 0x7f53f806d190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.635+0000 7f541afff700 1 --2- 172.21.15.22:0/1320364803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f541415c460 0x7f54141511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.635+0000 7f541afff700 1 --2- 172.21.15.22:0/1320364803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54140cf720 0x7f54140cc570 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.635+0000 7f541afff700 1 --2- 172.21.15.22:0/1320364803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54140d2640 0x7f541414f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.635+0000 7f541afff700 1 -- 172.21.15.22:0/1320364803 >> 172.21.15.22:0/1320364803 conn(0x7f5414071660 msgr2=0x7f54140b7750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:34.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.635+0000 7f541afff700 1 -- 172.21.15.22:0/1320364803 shutdown_connections 2023-07-11T00:30:34.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.635+0000 7f541afff700 1 -- 172.21.15.22:0/1320364803 wait complete. 2023-07-11T00:30:34.640 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 9 2023-07-11T00:30:34.658 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:30:34.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.857+0000 7f7c9bdff700 1 Processor -- start 2023-07-11T00:30:34.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.857+0000 7f7c9bdff700 1 -- start start 2023-07-11T00:30:34.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.858+0000 7f7c9bdff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c940d2640 0x7f7c940b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:34.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.859+0000 7f7c9bdff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7c940cf8f0 0x7f7c9415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:34.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.859+0000 7f7c9bdff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c940d1790 con 0x7f7c9415c460 2023-07-11T00:30:34.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.859+0000 7f7c9bdff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c940cedd0 con 0x7f7c940cf8f0 2023-07-11T00:30:34.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.859+0000 7f7c9bdff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940cd950 con 0x7f7c940d2640 2023-07-11T00:30:34.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.859+0000 7f7c9939a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c940d2640 0x7f7c940b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:34.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.859+0000 7f7c9939a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c940d2640 0x7f7c940b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:33668/0 (socket says 172.21.15.22:33668) 2023-07-11T00:30:34.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.859+0000 7f7c9939a700 1 -- 172.21.15.22:0/3257374921 learned_addr learned my addr 172.21.15.22:0/3257374921 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:34.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.859+0000 7f7c99b9b700 1 --1- 172.21.15.22:0/3257374921 >> v1:172.21.15.184:6789/0 conn(0x7f7c9415c460 0x7f7c940cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:41052/0 (socket says 172.21.15.22:41052) 2023-07-11T00:30:34.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.859+0000 7f7c9a39c700 1 --2- 172.21.15.22:0/3257374921 >> v2:172.21.15.184:3300/0 conn(0x7f7c940cf8f0 0x7f7c9415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:34.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.860+0000 7f7c9939a700 1 -- 172.21.15.22:0/3257374921 >> v2:172.21.15.184:3300/0 conn(0x7f7c940cf8f0 msgr2=0x7f7c9415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:34.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.860+0000 7f7c9939a700 1 --2- 172.21.15.22:0/3257374921 >> v2:172.21.15.184:3300/0 conn(0x7f7c940cf8f0 0x7f7c9415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.860+0000 7f7c9939a700 1 -- 172.21.15.22:0/3257374921 >> v1:172.21.15.184:6789/0 conn(0x7f7c9415c460 legacy=0x7f7c940cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:34.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.860+0000 7f7c9939a700 1 -- 172.21.15.22:0/3257374921 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c940d14b0 con 0x7f7c940d2640 2023-07-11T00:30:34.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.860+0000 7f7c98b99700 1 -- 172.21.15.22:0/3257374921 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756265635 0 0) 0x7f7c940d1790 con 0x7f7c9415c460 2023-07-11T00:30:34.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.860+0000 7f7c9939a700 1 --2- 172.21.15.22:0/3257374921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c940d2640 0x7f7c940b59d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7c840098f0 tx=0x7f7c84009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f7638e7974d9a2d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:34.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.860+0000 7f7c98b99700 1 -- 172.21.15.22:0/3257374921 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84011830 con 0x7f7c940d2640 2023-07-11T00:30:34.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.860+0000 7f7c98b99700 1 -- 172.21.15.22:0/3257374921 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c84011990 con 0x7f7c940d2640 2023-07-11T00:30:34.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.860+0000 7f7c98b99700 1 -- 172.21.15.22:0/3257374921 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84011d20 con 0x7f7c940d2640 2023-07-11T00:30:34.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.861+0000 7f7c9bdff700 1 -- 172.21.15.22:0/3257374921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c940d2640 msgr2=0x7f7c940b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:34.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.861+0000 7f7c9bdff700 1 --2- 172.21.15.22:0/3257374921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c940d2640 0x7f7c940b59d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7c840098f0 tx=0x7f7c84009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:34.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.861+0000 7f7c9bdff700 1 -- 172.21.15.22:0/3257374921 shutdown_connections 2023-07-11T00:30:34.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.861+0000 7f7c9bdff700 1 --2- 172.21.15.22:0/3257374921 >> v2:172.21.15.184:3300/0 conn(0x7f7c940cf8f0 0x7f7c9415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.861+0000 7f7c9bdff700 1 --2- 172.21.15.22:0/3257374921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c940d2640 0x7f7c940b59d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.861+0000 7f7c9bdff700 1 -- 172.21.15.22:0/3257374921 >> 172.21.15.22:0/3257374921 conn(0x7f7c94071660 msgr2=0x7f7c94071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:34.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.861+0000 7f7c9bdff700 1 -- 172.21.15.22:0/3257374921 shutdown_connections 2023-07-11T00:30:34.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.861+0000 7f7c9bdff700 1 -- 172.21.15.22:0/3257374921 wait complete. 2023-07-11T00:30:34.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.863+0000 7f7c9bdff700 1 Processor -- start 2023-07-11T00:30:34.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.864+0000 7f7c9bdff700 1 -- start start 2023-07-11T00:30:34.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.865+0000 7f7c9bdff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c940cf8f0 0x7f7c9414d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:34.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.865+0000 7f7c9bdff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c940d2640 0x7f7c940cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:34.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.865+0000 7f7c9bdff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c9415c460 0x7f7c940cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:34.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.865+0000 7f7c9bdff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940c82c0 con 0x7f7c940d2640 2023-07-11T00:30:34.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.865+0000 7f7c9bdff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9414dba0 con 0x7f7c940cf8f0 2023-07-11T00:30:34.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.865+0000 7f7c9bdff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9415e190 con 0x7f7c9415c460 2023-07-11T00:30:34.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.865+0000 7f7c9939a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c940d2640 0x7f7c940cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:34.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.865+0000 7f7c9939a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c940d2640 0x7f7c940cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45414/0 (socket says 172.21.15.22:45414) 2023-07-11T00:30:34.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.865+0000 7f7c9939a700 1 -- 172.21.15.22:0/1494272273 learned_addr learned my addr 172.21.15.22:0/1494272273 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:34.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.865+0000 7f7c99b9b700 1 --2- 172.21.15.22:0/1494272273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c940cf8f0 0x7f7c9414d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:34.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.865+0000 7f7c9a39c700 1 --2- 172.21.15.22:0/1494272273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c9415c460 0x7f7c940cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:34.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.866+0000 7f7c9939a700 1 -- 172.21.15.22:0/1494272273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c9415c460 msgr2=0x7f7c940cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:34.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.866+0000 7f7c9939a700 1 --2- 172.21.15.22:0/1494272273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c9415c460 0x7f7c940cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.866+0000 7f7c9939a700 1 -- 172.21.15.22:0/1494272273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c940cf8f0 msgr2=0x7f7c9414d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:34.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.866+0000 7f7c9939a700 1 --2- 172.21.15.22:0/1494272273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c940cf8f0 0x7f7c9414d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:34.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.866+0000 7f7c9939a700 1 -- 172.21.15.22:0/1494272273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c84009550 con 0x7f7c940d2640 2023-07-11T00:30:34.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.866+0000 7f7c9939a700 1 --2- 172.21.15.22:0/1494272273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c940d2640 0x7f7c940cbd20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7c84014040 tx=0x7f7c84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:34.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.866+0000 7f7c8a7fc700 1 -- 172.21.15.22:0/1494272273 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84004450 con 0x7f7c940d2640 2023-07-11T00:30:34.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.866+0000 7f7c8a7fc700 1 -- 172.21.15.22:0/1494272273 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8401e070 con 0x7f7c940d2640 2023-07-11T00:30:34.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.866+0000 7f7c9bdff700 1 -- 172.21.15.22:0/1494272273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9414d8b0 con 0x7f7c940d2640 2023-07-11T00:30:34.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.866+0000 7f7c8a7fc700 1 -- 172.21.15.22:0/1494272273 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c840038c0 con 0x7f7c940d2640 2023-07-11T00:30:34.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.866+0000 7f7c9bdff700 1 -- 172.21.15.22:0/1494272273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9415d860 con 0x7f7c940d2640 2023-07-11T00:30:34.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.867+0000 7f7c9bdff700 1 -- 172.21.15.22:0/1494272273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9415e300 con 0x7f7c940d2640 2023-07-11T00:30:34.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.869+0000 7f7c8a7fc700 1 -- 172.21.15.22:0/1494272273 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7c84003a20 con 0x7f7c940d2640 2023-07-11T00:30:34.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.869+0000 7f7c8a7fc700 1 --2- 172.21.15.22:0/1494272273 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7c7806ace0 0x7f7c7806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:34.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.870+0000 7f7c8a7fc700 1 -- 172.21.15.22:0/1494272273 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7c8408a640 con 0x7f7c940d2640 2023-07-11T00:30:34.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.870+0000 7f7c99b9b700 1 --2- 172.21.15.22:0/1494272273 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7c7806ace0 0x7f7c7806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:34.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.871+0000 7f7c99b9b700 1 --2- 172.21.15.22:0/1494272273 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7c7806ace0 0x7f7c7806d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7c90007fd0 tx=0x7f7c90007de0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:34.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:34.874+0000 7f7c8a7fc700 1 -- 172.21.15.22:0/1494272273 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7c84055370 con 0x7f7c940d2640 2023-07-11T00:30:35.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.083+0000 7f7c9bdff700 1 -- 172.21.15.22:0/1494272273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c9404ea60 con 0x7f7c940d2640 2023-07-11T00:30:35.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.084+0000 7f7c8a7fc700 1 -- 172.21.15.22:0/1494272273 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f7c840045b0 con 0x7f7c940d2640 2023-07-11T00:30:35.087 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:35.087 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:10.571866+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:30:35.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.087+0000 7f7c9bdff700 1 -- 172.21.15.22:0/1494272273 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7c7806ace0 msgr2=0x7f7c7806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:35.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.087+0000 7f7c9bdff700 1 --2- 172.21.15.22:0/1494272273 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7c7806ace0 0x7f7c7806d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7c90007fd0 tx=0x7f7c90007de0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.087+0000 7f7c9bdff700 1 -- 172.21.15.22:0/1494272273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c940d2640 msgr2=0x7f7c940cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:35.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.087+0000 7f7c9bdff700 1 --2- 172.21.15.22:0/1494272273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c940d2640 0x7f7c940cbd20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7c84014040 tx=0x7f7c84004750 comp rx=0 tx=0).stop 2023-07-11T00:30:35.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.087+0000 7f7c9bdff700 1 -- 172.21.15.22:0/1494272273 shutdown_connections 2023-07-11T00:30:35.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.087+0000 7f7c9bdff700 1 --2- 172.21.15.22:0/1494272273 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7c7806ace0 0x7f7c7806d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.087+0000 7f7c9bdff700 1 --2- 172.21.15.22:0/1494272273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c9415c460 0x7f7c940cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.087+0000 7f7c9bdff700 1 --2- 172.21.15.22:0/1494272273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c940cf8f0 0x7f7c9414d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.087+0000 7f7c9bdff700 1 --2- 172.21.15.22:0/1494272273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c940d2640 0x7f7c940cbd20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.087+0000 7f7c9bdff700 1 -- 172.21.15.22:0/1494272273 >> 172.21.15.22:0/1494272273 conn(0x7f7c94071660 msgr2=0x7f7c9406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:35.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.087+0000 7f7c9bdff700 1 -- 172.21.15.22:0/1494272273 shutdown_connections 2023-07-11T00:30:35.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.087+0000 7f7c9bdff700 1 -- 172.21.15.22:0/1494272273 wait complete. 2023-07-11T00:30:35.109 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-11T00:30:35.110 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-11T00:30:35.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.308+0000 7f25a85ff700 1 Processor -- start 2023-07-11T00:30:35.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.308+0000 7f25a85ff700 1 -- start start 2023-07-11T00:30:35.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.309+0000 7f25a85ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25a00b8320 0x7f25a00cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:35.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.309+0000 7f25a85ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a00cf3b0 con 0x7f25a00d1cd0 2023-07-11T00:30:35.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.309+0000 7f25a85ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a00b86f0 con 0x7f25a00b4cc0 2023-07-11T00:30:35.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.309+0000 7f25a85ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a00cf0d0 con 0x7f25a00b8320 2023-07-11T00:30:35.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.309+0000 7f25a5b9a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f25a00d1cd0 0x7f25a00b45b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45790/0 (socket says 172.21.15.22:45790) 2023-07-11T00:30:35.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.309+0000 7f25a5b9a700 1 -- 172.21.15.22:0/2322740627 learned_addr learned my addr 172.21.15.22:0/2322740627 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:35.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a639b700 1 --2- 172.21.15.22:0/2322740627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25a00b8320 0x7f25a00cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:35.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a5399700 1 -- 172.21.15.22:0/2322740627 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820808321 0 0) 0x7f25a00cf3b0 con 0x7f25a00d1cd0 2023-07-11T00:30:35.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a5399700 1 -- 172.21.15.22:0/2322740627 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f258c0035b0 con 0x7f25a00d1cd0 2023-07-11T00:30:35.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a5399700 1 -- 172.21.15.22:0/2322740627 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050755018 0 0) 0x7f25a00b86f0 con 0x7f25a00b4cc0 2023-07-11T00:30:35.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a5399700 1 -- 172.21.15.22:0/2322740627 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25a00cf3b0 con 0x7f25a00b4cc0 2023-07-11T00:30:35.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a5399700 1 -- 172.21.15.22:0/2322740627 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2590925165 0 0) 0x7f258c0035b0 con 0x7f25a00d1cd0 2023-07-11T00:30:35.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a5399700 1 -- 172.21.15.22:0/2322740627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25a00b8320 msgr2=0x7f25a00cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:35.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a5399700 1 --2- 172.21.15.22:0/2322740627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25a00b8320 0x7f25a00cd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a5399700 1 -- 172.21.15.22:0/2322740627 >> v1:172.21.15.184:6789/0 conn(0x7f25a00b4cc0 legacy=0x7f25a00d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:35.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a5399700 1 -- 172.21.15.22:0/2322740627 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a00d22c0 con 0x7f25a00d1cd0 2023-07-11T00:30:35.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a5399700 1 -- 172.21.15.22:0/2322740627 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7f2590001670 con 0x7f25a00d1cd0 2023-07-11T00:30:35.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a5399700 1 -- 172.21.15.22:0/2322740627 >> v1:172.21.15.22:6789/0 conn(0x7f25a00d1cd0 legacy=0x7f25a00b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:35.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a5399700 1 --2- 172.21.15.22:0/2322740627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25a00b8320 0x7f258c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:35.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a5399700 1 --2- 172.21.15.22:0/2322740627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f258c004140 0x7f258c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:35.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a5399700 1 --2- 172.21.15.22:0/2322740627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f258c004d90 0x7f258c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:35.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a5399700 1 -- 172.21.15.22:0/2322740627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a00cf0d0 con 0x7f258c004140 2023-07-11T00:30:35.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a5399700 1 -- 172.21.15.22:0/2322740627 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c00bc20 con 0x7f258c004d90 2023-07-11T00:30:35.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.310+0000 7f25a5399700 1 -- 172.21.15.22:0/2322740627 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258c00bde0 con 0x7f25a00b8320 2023-07-11T00:30:35.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.311+0000 7f25a639b700 1 --2- 172.21.15.22:0/2322740627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25a00b8320 0x7f258c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:35.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.311+0000 7f25a5b9a700 1 --2- 172.21.15.22:0/2322740627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f258c004140 0x7f258c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:35.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.311+0000 7f25a6b9c700 1 --2- 172.21.15.22:0/2322740627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f258c004d90 0x7f258c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:35.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.311+0000 7f25a639b700 1 -- 172.21.15.22:0/2322740627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f258c004d90 msgr2=0x7f258c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:35.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.311+0000 7f25a639b700 1 --2- 172.21.15.22:0/2322740627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f258c004d90 0x7f258c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.311+0000 7f25a639b700 1 -- 172.21.15.22:0/2322740627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f258c004140 msgr2=0x7f258c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:35.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.311+0000 7f25a639b700 1 --2- 172.21.15.22:0/2322740627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f258c004140 0x7f258c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.311+0000 7f25a639b700 1 -- 172.21.15.22:0/2322740627 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c0035b0 con 0x7f25a00b8320 2023-07-11T00:30:35.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.311+0000 7f25a5b9a700 1 --2- 172.21.15.22:0/2322740627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f258c004140 0x7f258c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:30:35.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.311+0000 7f25a639b700 1 --2- 172.21.15.22:0/2322740627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25a00b8320 0x7f258c003bc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f259c009b30 tx=0x7f258c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74b1ca1bb5d2800a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:35.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.312+0000 7f25a5399700 1 -- 172.21.15.22:0/2322740627 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c00e6c0 con 0x7f25a00b8320 2023-07-11T00:30:35.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.312+0000 7f25a5399700 1 -- 172.21.15.22:0/2322740627 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c00e820 con 0x7f25a00b8320 2023-07-11T00:30:35.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.312+0000 7f25a5399700 1 -- 172.21.15.22:0/2322740627 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c00eb90 con 0x7f25a00b8320 2023-07-11T00:30:35.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.312+0000 7f25a85ff700 1 -- 172.21.15.22:0/2322740627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25a00b8320 msgr2=0x7f258c003bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:35.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.312+0000 7f25a85ff700 1 --2- 172.21.15.22:0/2322740627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25a00b8320 0x7f258c003bc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f259c009b30 tx=0x7f258c005880 comp rx=0 tx=0).stop 2023-07-11T00:30:35.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.312+0000 7f25a6b9c700 1 -- 172.21.15.22:0/2322740627 reap_dead start 2023-07-11T00:30:35.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.312+0000 7f25a85ff700 1 -- 172.21.15.22:0/2322740627 shutdown_connections 2023-07-11T00:30:35.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.312+0000 7f25a85ff700 1 -- 172.21.15.22:0/2322740627 >> 172.21.15.22:0/2322740627 conn(0x7f25a00722b0 msgr2=0x7f25a00cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:35.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.312+0000 7f25a85ff700 1 -- 172.21.15.22:0/2322740627 shutdown_connections 2023-07-11T00:30:35.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.312+0000 7f25a85ff700 1 -- 172.21.15.22:0/2322740627 wait complete. 2023-07-11T00:30:35.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.314+0000 7f25a85ff700 1 Processor -- start 2023-07-11T00:30:35.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.314+0000 7f25a85ff700 1 -- start start 2023-07-11T00:30:35.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.315+0000 7f25a85ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a00b1170 0x7f25a015f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:35.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.315+0000 7f25a85ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25a015d320 0x7f25a00b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:35.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.315+0000 7f25a85ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25a00b5f80 0x7f25a00cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:35.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.315+0000 7f25a85ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a00b63f0 con 0x7f25a00b1170 2023-07-11T00:30:35.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.315+0000 7f25a85ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a015e130 con 0x7f25a00b5f80 2023-07-11T00:30:35.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.315+0000 7f25a85ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a015d890 con 0x7f25a015d320 2023-07-11T00:30:35.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.315+0000 7f25a639b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a00b1170 0x7f25a015f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:35.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.315+0000 7f25a639b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a00b1170 0x7f25a015f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45442/0 (socket says 172.21.15.22:45442) 2023-07-11T00:30:35.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.315+0000 7f25a639b700 1 -- 172.21.15.22:0/3233570638 learned_addr learned my addr 172.21.15.22:0/3233570638 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:35.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.316+0000 7f25a6b9c700 1 --2- 172.21.15.22:0/3233570638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25a00b5f80 0x7f25a00cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:35.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.316+0000 7f25a5b9a700 1 --2- 172.21.15.22:0/3233570638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25a015d320 0x7f25a00b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:35.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.316+0000 7f25a639b700 1 -- 172.21.15.22:0/3233570638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25a015d320 msgr2=0x7f25a00b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:35.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.316+0000 7f25a639b700 1 --2- 172.21.15.22:0/3233570638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25a015d320 0x7f25a00b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.316+0000 7f25a639b700 1 -- 172.21.15.22:0/3233570638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25a00b5f80 msgr2=0x7f25a00cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.316+0000 7f25a639b700 1 --2- 172.21.15.22:0/3233570638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25a00b5f80 0x7f25a00cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.316+0000 7f25a639b700 1 -- 172.21.15.22:0/3233570638 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a015db70 con 0x7f25a00b1170 2023-07-11T00:30:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.316+0000 7f25a5b9a700 1 --2- 172.21.15.22:0/3233570638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25a015d320 0x7f25a00b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:30:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.316+0000 7f25a639b700 1 --2- 172.21.15.22:0/3233570638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a00b1170 0x7f25a015f4b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f258c00bf70 tx=0x7f259c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.316+0000 7f2596ffd700 1 -- 172.21.15.22:0/3233570638 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c00e6c0 con 0x7f25a00b1170 2023-07-11T00:30:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.316+0000 7f2596ffd700 1 -- 172.21.15.22:0/3233570638 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c003ad0 con 0x7f25a00b1170 2023-07-11T00:30:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.316+0000 7f25a85ff700 1 -- 172.21.15.22:0/3233570638 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a015de50 con 0x7f25a00b1170 2023-07-11T00:30:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.316+0000 7f2596ffd700 1 -- 172.21.15.22:0/3233570638 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c003e80 con 0x7f25a00b1170 2023-07-11T00:30:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.317+0000 7f25a85ff700 1 -- 172.21.15.22:0/3233570638 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a015f9f0 con 0x7f25a00b1170 2023-07-11T00:30:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.317+0000 7f25a85ff700 1 -- 172.21.15.22:0/3233570638 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a00aad50 con 0x7f25a00b1170 2023-07-11T00:30:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.318+0000 7f2596ffd700 1 -- 172.21.15.22:0/3233570638 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f259c013470 con 0x7f25a00b1170 2023-07-11T00:30:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.319+0000 7f2596ffd700 1 --2- 172.21.15.22:0/3233570638 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f258406ace0 0x7f258406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.319+0000 7f2596ffd700 1 -- 172.21.15.22:0/3233570638 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f259c08af80 con 0x7f25a00b1170 2023-07-11T00:30:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.320+0000 7f25a5b9a700 1 --2- 172.21.15.22:0/3233570638 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f258406ace0 0x7f258406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.320+0000 7f25a5b9a700 1 --2- 172.21.15.22:0/3233570638 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f258406ace0 0x7f258406d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2590007fd0 tx=0x7f2590009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:35.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.324+0000 7f2596ffd700 1 -- 172.21.15.22:0/3233570638 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f259c055e50 con 0x7f25a00b1170 2023-07-11T00:30:35.422 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:30:35.426 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:30:35.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.533+0000 7f25a85ff700 1 -- 172.21.15.22:0/3233570638 --> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25a00ced80 con 0x7f258406ace0 2023-07-11T00:30:35.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.547+0000 7f2596ffd700 1 -- 172.21.15.22:0/3233570638 <== mgr.4114 v2:172.21.15.184:6832/380612710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367599 (secure 0 0 0) 0x7f2590007030 con 0x7f258406ace0 2023-07-11T00:30:35.558 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:35.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.552+0000 7f25a85ff700 1 -- 172.21.15.22:0/3233570638 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f258406ace0 msgr2=0x7f258406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:35.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.552+0000 7f25a85ff700 1 --2- 172.21.15.22:0/3233570638 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f258406ace0 0x7f258406d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2590007fd0 tx=0x7f2590009040 comp rx=0 tx=0).stop 2023-07-11T00:30:35.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.552+0000 7f25a85ff700 1 -- 172.21.15.22:0/3233570638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a00b1170 msgr2=0x7f25a015f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:35.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.552+0000 7f25a85ff700 1 --2- 172.21.15.22:0/3233570638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a00b1170 0x7f25a015f4b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f258c00bf70 tx=0x7f259c0047c0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.552+0000 7f25a85ff700 1 -- 172.21.15.22:0/3233570638 shutdown_connections 2023-07-11T00:30:35.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.552+0000 7f25a85ff700 1 --2- 172.21.15.22:0/3233570638 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f258406ace0 0x7f258406d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.552+0000 7f25a85ff700 1 --2- 172.21.15.22:0/3233570638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25a00b5f80 0x7f25a00cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.552+0000 7f25a85ff700 1 --2- 172.21.15.22:0/3233570638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a00b1170 0x7f25a015f4b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.552+0000 7f25a85ff700 1 --2- 172.21.15.22:0/3233570638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25a015d320 0x7f25a00b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.552+0000 7f25a85ff700 1 -- 172.21.15.22:0/3233570638 >> 172.21.15.22:0/3233570638 conn(0x7f25a00b8320 msgr2=0x7f25a00b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:35.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.552+0000 7f25a85ff700 1 -- 172.21.15.22:0/3233570638 shutdown_connections 2023-07-11T00:30:35.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.552+0000 7f25a85ff700 1 -- 172.21.15.22:0/3233570638 wait complete. 2023-07-11T00:30:35.564 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-07-11T00:30:35.573 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-07-11T00:30:34.497827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219352,"kb_used_data":3192,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755368,"statfs":{"total":773094113280,"available":772869496832,"internally_reserved":0,"allocated":3268608,"data_stored":2022316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003582"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117136+0000","last_change":"2023-07-11T00:30:05.911712+0000","last_active":"2023-07-11T00:30:11.117136+0000","last_peered":"2023-07-11T00:30:11.117136+0000","last_clean":"2023-07-11T00:30:11.117136+0000","last_became_active":"2023-07-11T00:30:05.911450+0000","last_became_peered":"2023-07-11T00:30:05.911450+0000","last_unstale":"2023-07-11T00:30:11.117136+0000","last_undegraded":"2023-07-11T00:30:11.117136+0000","last_fullsized":"2023-07-11T00:30:11.117136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:54:15.307917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116734+0000","last_change":"2023-07-11T00:30:05.920040+0000","last_active":"2023-07-11T00:30:11.116734+0000","last_peered":"2023-07-11T00:30:11.116734+0000","last_clean":"2023-07-11T00:30:11.116734+0000","last_became_active":"2023-07-11T00:30:05.919701+0000","last_became_peered":"2023-07-11T00:30:05.919701+0000","last_unstale":"2023-07-11T00:30:11.116734+0000","last_undegraded":"2023-07-11T00:30:11.116734+0000","last_fullsized":"2023-07-11T00:30:11.116734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:30:34.562898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059575+0000","last_change":"2023-07-11T00:30:05.912536+0000","last_active":"2023-07-11T00:30:11.059575+0000","last_peered":"2023-07-11T00:30:11.059575+0000","last_clean":"2023-07-11T00:30:11.059575+0000","last_became_active":"2023-07-11T00:30:05.912241+0000","last_became_peered":"2023-07-11T00:30:05.912241+0000","last_unstale":"2023-07-11T00:30:11.059575+0000","last_undegraded":"2023-07-11T00:30:11.059575+0000","last_fullsized":"2023-07-11T00:30:11.059575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:12:42.514924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058346+0000","last_change":"2023-07-11T00:30:05.903203+0000","last_active":"2023-07-11T00:30:11.058346+0000","last_peered":"2023-07-11T00:30:11.058346+0000","last_clean":"2023-07-11T00:30:11.058346+0000","last_became_active":"2023-07-11T00:30:05.902858+0000","last_became_peered":"2023-07-11T00:30:05.902858+0000","last_unstale":"2023-07-11T00:30:11.058346+0000","last_undegraded":"2023-07-11T00:30:11.058346+0000","last_fullsized":"2023-07-11T00:30:11.058346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:44:07.446915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058655+0000","last_change":"2023-07-11T00:30:05.905150+0000","last_active":"2023-07-11T00:30:11.058655+0000","last_peered":"2023-07-11T00:30:11.058655+0000","last_clean":"2023-07-11T00:30:11.058655+0000","last_became_active":"2023-07-11T00:30:05.904828+0000","last_became_peered":"2023-07-11T00:30:05.904828+0000","last_unstale":"2023-07-11T00:30:11.058655+0000","last_undegraded":"2023-07-11T00:30:11.058655+0000","last_fullsized":"2023-07-11T00:30:11.058655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:37:25.278906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.060073+0000","last_change":"2023-07-11T00:30:05.918168+0000","last_active":"2023-07-11T00:30:11.060073+0000","last_peered":"2023-07-11T00:30:11.060073+0000","last_clean":"2023-07-11T00:30:11.060073+0000","last_became_active":"2023-07-11T00:30:05.917840+0000","last_became_peered":"2023-07-11T00:30:05.917840+0000","last_unstale":"2023-07-11T00:30:11.060073+0000","last_undegraded":"2023-07-11T00:30:11.060073+0000","last_fullsized":"2023-07-11T00:30:11.060073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:32:32.639916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116327+0000","last_change":"2023-07-11T00:30:05.916111+0000","last_active":"2023-07-11T00:30:11.116327+0000","last_peered":"2023-07-11T00:30:11.116327+0000","last_clean":"2023-07-11T00:30:11.116327+0000","last_became_active":"2023-07-11T00:30:05.915793+0000","last_became_peered":"2023-07-11T00:30:05.915793+0000","last_unstale":"2023-07-11T00:30:11.116327+0000","last_undegraded":"2023-07-11T00:30:11.116327+0000","last_fullsized":"2023-07-11T00:30:11.116327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:01:38.063704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116335+0000","last_change":"2023-07-11T00:30:05.924536+0000","last_active":"2023-07-11T00:30:11.116335+0000","last_peered":"2023-07-11T00:30:11.116335+0000","last_clean":"2023-07-11T00:30:11.116335+0000","last_became_active":"2023-07-11T00:30:05.924214+0000","last_became_peered":"2023-07-11T00:30:05.924214+0000","last_unstale":"2023-07-11T00:30:11.116335+0000","last_undegraded":"2023-07-11T00:30:11.116335+0000","last_fullsized":"2023-07-11T00:30:11.116335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:02:21.282407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058461+0000","last_change":"2023-07-11T00:30:05.912403+0000","last_active":"2023-07-11T00:30:11.058461+0000","last_peered":"2023-07-11T00:30:11.058461+0000","last_clean":"2023-07-11T00:30:11.058461+0000","last_became_active":"2023-07-11T00:30:05.912089+0000","last_became_peered":"2023-07-11T00:30:05.912089+0000","last_unstale":"2023-07-11T00:30:11.058461+0000","last_undegraded":"2023-07-11T00:30:11.058461+0000","last_fullsized":"2023-07-11T00:30:11.058461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:05:31.560559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117009+0000","last_change":"2023-07-11T00:30:05.914190+0000","last_active":"2023-07-11T00:30:11.117009+0000","last_peered":"2023-07-11T00:30:11.117009+0000","last_clean":"2023-07-11T00:30:11.117009+0000","last_became_active":"2023-07-11T00:30:05.913891+0000","last_became_peered":"2023-07-11T00:30:05.913891+0000","last_unstale":"2023-07-11T00:30:11.117009+0000","last_undegraded":"2023-07-11T00:30:11.117009+0000","last_fullsized":"2023-07-11T00:30:11.117009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:36:16.891590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059425+0000","last_change":"2023-07-11T00:30:05.918953+0000","last_active":"2023-07-11T00:30:11.059425+0000","last_peered":"2023-07-11T00:30:11.059425+0000","last_clean":"2023-07-11T00:30:11.059425+0000","last_became_active":"2023-07-11T00:30:05.918621+0000","last_became_peered":"2023-07-11T00:30:05.918621+0000","last_unstale":"2023-07-11T00:30:11.059425+0000","last_undegraded":"2023-07-11T00:30:11.059425+0000","last_fullsized":"2023-07-11T00:30:11.059425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:41:28.164012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118528+0000","last_change":"2023-07-11T00:30:05.914213+0000","last_active":"2023-07-11T00:30:11.118528+0000","last_peered":"2023-07-11T00:30:11.118528+0000","last_clean":"2023-07-11T00:30:11.118528+0000","last_became_active":"2023-07-11T00:30:05.913944+0000","last_became_peered":"2023-07-11T00:30:05.913944+0000","last_unstale":"2023-07-11T00:30:11.118528+0000","last_undegraded":"2023-07-11T00:30:11.118528+0000","last_fullsized":"2023-07-11T00:30:11.118528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:59:16.970501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118774+0000","last_change":"2023-07-11T00:30:05.910052+0000","last_active":"2023-07-11T00:30:11.118774+0000","last_peered":"2023-07-11T00:30:11.118774+0000","last_clean":"2023-07-11T00:30:11.118774+0000","last_became_active":"2023-07-11T00:30:05.909736+0000","last_became_peered":"2023-07-11T00:30:05.909736+0000","last_unstale":"2023-07-11T00:30:11.118774+0000","last_undegraded":"2023-07-11T00:30:11.118774+0000","last_fullsized":"2023-07-11T00:30:11.118774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:21:43.298124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116546+0000","last_change":"2023-07-11T00:30:05.917375+0000","last_active":"2023-07-11T00:30:11.116546+0000","last_peered":"2023-07-11T00:30:11.116546+0000","last_clean":"2023-07-11T00:30:11.116546+0000","last_became_active":"2023-07-11T00:30:05.917073+0000","last_became_peered":"2023-07-11T00:30:05.917073+0000","last_unstale":"2023-07-11T00:30:11.116546+0000","last_undegraded":"2023-07-11T00:30:11.116546+0000","last_fullsized":"2023-07-11T00:30:11.116546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:49:32.598344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115820+0000","last_change":"2023-07-11T00:30:05.915585+0000","last_active":"2023-07-11T00:30:11.115820+0000","last_peered":"2023-07-11T00:30:11.115820+0000","last_clean":"2023-07-11T00:30:11.115820+0000","last_became_active":"2023-07-11T00:30:05.915308+0000","last_became_peered":"2023-07-11T00:30:05.915308+0000","last_unstale":"2023-07-11T00:30:11.115820+0000","last_undegraded":"2023-07-11T00:30:11.115820+0000","last_fullsized":"2023-07-11T00:30:11.115820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:31:07.229483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058415+0000","last_change":"2023-07-11T00:30:05.897489+0000","last_active":"2023-07-11T00:30:11.058415+0000","last_peered":"2023-07-11T00:30:11.058415+0000","last_clean":"2023-07-11T00:30:11.058415+0000","last_became_active":"2023-07-11T00:30:05.897078+0000","last_became_peered":"2023-07-11T00:30:05.897078+0000","last_unstale":"2023-07-11T00:30:11.058415+0000","last_undegraded":"2023-07-11T00:30:11.058415+0000","last_fullsized":"2023-07-11T00:30:11.058415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:47:49.437638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058439+0000","last_change":"2023-07-11T00:30:05.904485+0000","last_active":"2023-07-11T00:30:11.058439+0000","last_peered":"2023-07-11T00:30:11.058439+0000","last_clean":"2023-07-11T00:30:11.058439+0000","last_became_active":"2023-07-11T00:30:05.904198+0000","last_became_peered":"2023-07-11T00:30:05.904198+0000","last_unstale":"2023-07-11T00:30:11.058439+0000","last_undegraded":"2023-07-11T00:30:11.058439+0000","last_fullsized":"2023-07-11T00:30:11.058439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:07:55.311856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059904+0000","last_change":"2023-07-11T00:30:05.916172+0000","last_active":"2023-07-11T00:30:11.059904+0000","last_peered":"2023-07-11T00:30:11.059904+0000","last_clean":"2023-07-11T00:30:11.059904+0000","last_became_active":"2023-07-11T00:30:05.915857+0000","last_became_peered":"2023-07-11T00:30:05.915857+0000","last_unstale":"2023-07-11T00:30:11.059904+0000","last_undegraded":"2023-07-11T00:30:11.059904+0000","last_fullsized":"2023-07-11T00:30:11.059904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:03:00.748490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117907+0000","last_change":"2023-07-11T00:30:05.905623+0000","last_active":"2023-07-11T00:30:11.117907+0000","last_peered":"2023-07-11T00:30:11.117907+0000","last_clean":"2023-07-11T00:30:11.117907+0000","last_became_active":"2023-07-11T00:30:05.905411+0000","last_became_peered":"2023-07-11T00:30:05.905411+0000","last_unstale":"2023-07-11T00:30:11.117907+0000","last_undegraded":"2023-07-11T00:30:11.117907+0000","last_fullsized":"2023-07-11T00:30:11.117907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:59:32.190804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059052+0000","last_change":"2023-07-11T00:30:05.912071+0000","last_active":"2023-07-11T00:30:11.059052+0000","last_peered":"2023-07-11T00:30:11.059052+0000","last_clean":"2023-07-11T00:30:11.059052+0000","last_became_active":"2023-07-11T00:30:05.911697+0000","last_became_peered":"2023-07-11T00:30:05.911697+0000","last_unstale":"2023-07-11T00:30:11.059052+0000","last_undegraded":"2023-07-11T00:30:11.059052+0000","last_fullsized":"2023-07-11T00:30:11.059052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:50:20.512890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116233+0000","last_change":"2023-07-11T00:30:05.910797+0000","last_active":"2023-07-11T00:30:11.116233+0000","last_peered":"2023-07-11T00:30:11.116233+0000","last_clean":"2023-07-11T00:30:11.116233+0000","last_became_active":"2023-07-11T00:30:05.910438+0000","last_became_peered":"2023-07-11T00:30:05.910438+0000","last_unstale":"2023-07-11T00:30:11.116233+0000","last_undegraded":"2023-07-11T00:30:11.116233+0000","last_fullsized":"2023-07-11T00:30:11.116233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:47:49.437638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057978+0000","last_change":"2023-07-11T00:30:05.918878+0000","last_active":"2023-07-11T00:30:11.057978+0000","last_peered":"2023-07-11T00:30:11.057978+0000","last_clean":"2023-07-11T00:30:11.057978+0000","last_became_active":"2023-07-11T00:30:05.918348+0000","last_became_peered":"2023-07-11T00:30:05.918348+0000","last_unstale":"2023-07-11T00:30:11.057978+0000","last_undegraded":"2023-07-11T00:30:11.057978+0000","last_fullsized":"2023-07-11T00:30:11.057978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:31:53.264979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116625+0000","last_change":"2023-07-11T00:30:05.903228+0000","last_active":"2023-07-11T00:30:11.116625+0000","last_peered":"2023-07-11T00:30:11.116625+0000","last_clean":"2023-07-11T00:30:11.116625+0000","last_became_active":"2023-07-11T00:30:05.902909+0000","last_became_peered":"2023-07-11T00:30:05.902909+0000","last_unstale":"2023-07-11T00:30:11.116625+0000","last_undegraded":"2023-07-11T00:30:11.116625+0000","last_fullsized":"2023-07-11T00:30:11.116625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:53.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115854+0000","last_change":"2023-07-11T00:30:05.908961+0000","last_active":"2023-07-11T00:30:11.115854+0000","last_peered":"2023-07-11T00:30:11.115854+0000","last_clean":"2023-07-11T00:30:11.115854+0000","last_became_active":"2023-07-11T00:30:05.908652+0000","last_became_peered":"2023-07-11T00:30:05.908652+0000","last_unstale":"2023-07-11T00:30:11.115854+0000","last_undegraded":"2023-07-11T00:30:11.115854+0000","last_fullsized":"2023-07-11T00:30:11.115854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:30:34.562898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117973+0000","last_change":"2023-07-11T00:30:05.915154+0000","last_active":"2023-07-11T00:30:11.117973+0000","last_peered":"2023-07-11T00:30:11.117973+0000","last_clean":"2023-07-11T00:30:11.117973+0000","last_became_active":"2023-07-11T00:30:05.914601+0000","last_became_peered":"2023-07-11T00:30:05.914601+0000","last_unstale":"2023-07-11T00:30:11.117973+0000","last_undegraded":"2023-07-11T00:30:11.117973+0000","last_fullsized":"2023-07-11T00:30:11.117973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:05:31.560559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117482+0000","last_change":"2023-07-11T00:30:05.917313+0000","last_active":"2023-07-11T00:30:11.117482+0000","last_peered":"2023-07-11T00:30:11.117482+0000","last_clean":"2023-07-11T00:30:11.117482+0000","last_became_active":"2023-07-11T00:30:05.916948+0000","last_became_peered":"2023-07-11T00:30:05.916948+0000","last_unstale":"2023-07-11T00:30:11.117482+0000","last_undegraded":"2023-07-11T00:30:11.117482+0000","last_fullsized":"2023-07-11T00:30:11.117482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:23:06.035280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116853+0000","last_change":"2023-07-11T00:30:05.907303+0000","last_active":"2023-07-11T00:30:11.116853+0000","last_peered":"2023-07-11T00:30:11.116853+0000","last_clean":"2023-07-11T00:30:11.116853+0000","last_became_active":"2023-07-11T00:30:05.906928+0000","last_became_peered":"2023-07-11T00:30:05.906928+0000","last_unstale":"2023-07-11T00:30:11.116853+0000","last_undegraded":"2023-07-11T00:30:11.116853+0000","last_fullsized":"2023-07-11T00:30:11.116853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:43:56.168273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059619+0000","last_change":"2023-07-11T00:30:10.072865+0000","last_active":"2023-07-11T00:30:11.059619+0000","last_peered":"2023-07-11T00:30:11.059619+0000","last_clean":"2023-07-11T00:30:11.059619+0000","last_became_active":"2023-07-11T00:30:10.072474+0000","last_became_peered":"2023-07-11T00:30:10.072474+0000","last_unstale":"2023-07-11T00:30:11.059619+0000","last_undegraded":"2023-07-11T00:30:11.059619+0000","last_fullsized":"2023-07-11T00:30:11.059619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:48:40.316132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059700+0000","last_change":"2023-07-11T00:30:04.908760+0000","last_active":"2023-07-11T00:30:11.059700+0000","last_peered":"2023-07-11T00:30:11.059700+0000","last_clean":"2023-07-11T00:30:11.059700+0000","last_became_active":"2023-07-11T00:30:04.908468+0000","last_became_peered":"2023-07-11T00:30:04.908468+0000","last_unstale":"2023-07-11T00:30:11.059700+0000","last_undegraded":"2023-07-11T00:30:11.059700+0000","last_fullsized":"2023-07-11T00:30:11.059700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:48:47.561149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119219+0000","last_change":"2023-07-11T00:30:05.915093+0000","last_active":"2023-07-11T00:30:11.119219+0000","last_peered":"2023-07-11T00:30:11.119219+0000","last_clean":"2023-07-11T00:30:11.119219+0000","last_became_active":"2023-07-11T00:30:05.914787+0000","last_became_peered":"2023-07-11T00:30:05.914787+0000","last_unstale":"2023-07-11T00:30:11.119219+0000","last_undegraded":"2023-07-11T00:30:11.119219+0000","last_fullsized":"2023-07-11T00:30:11.119219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:03:00.748490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058408+0000","last_change":"2023-07-11T00:30:10.068761+0000","last_active":"2023-07-11T00:30:11.058408+0000","last_peered":"2023-07-11T00:30:11.058408+0000","last_clean":"2023-07-11T00:30:11.058408+0000","last_became_active":"2023-07-11T00:30:10.068319+0000","last_became_peered":"2023-07-11T00:30:10.068319+0000","last_unstale":"2023-07-11T00:30:11.058408+0000","last_undegraded":"2023-07-11T00:30:11.058408+0000","last_fullsized":"2023-07-11T00:30:11.058408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:56:42.728305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116259+0000","last_change":"2023-07-11T00:30:04.901722+0000","last_active":"2023-07-11T00:30:11.116259+0000","last_peered":"2023-07-11T00:30:11.116259+0000","last_clean":"2023-07-11T00:30:11.116259+0000","last_became_active":"2023-07-11T00:30:04.901326+0000","last_became_peered":"2023-07-11T00:30:04.901326+0000","last_unstale":"2023-07-11T00:30:11.116259+0000","last_undegraded":"2023-07-11T00:30:11.116259+0000","last_fullsized":"2023-07-11T00:30:11.116259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:31:52.262271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058531+0000","last_change":"2023-07-11T00:30:05.908583+0000","last_active":"2023-07-11T00:30:11.058531+0000","last_peered":"2023-07-11T00:30:11.058531+0000","last_clean":"2023-07-11T00:30:11.058531+0000","last_became_active":"2023-07-11T00:30:05.908245+0000","last_became_peered":"2023-07-11T00:30:05.908245+0000","last_unstale":"2023-07-11T00:30:11.058531+0000","last_undegraded":"2023-07-11T00:30:11.058531+0000","last_fullsized":"2023-07-11T00:30:11.058531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:49:28.388344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058698+0000","last_change":"2023-07-11T00:30:10.083710+0000","last_active":"2023-07-11T00:30:11.058698+0000","last_peered":"2023-07-11T00:30:11.058698+0000","last_clean":"2023-07-11T00:30:11.058698+0000","last_became_active":"2023-07-11T00:30:10.080933+0000","last_became_peered":"2023-07-11T00:30:10.080933+0000","last_unstale":"2023-07-11T00:30:11.058698+0000","last_undegraded":"2023-07-11T00:30:11.058698+0000","last_fullsized":"2023-07-11T00:30:11.058698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:04.352361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119152+0000","last_change":"2023-07-11T00:30:04.904239+0000","last_active":"2023-07-11T00:30:11.119152+0000","last_peered":"2023-07-11T00:30:11.119152+0000","last_clean":"2023-07-11T00:30:11.119152+0000","last_became_active":"2023-07-11T00:30:04.903915+0000","last_became_peered":"2023-07-11T00:30:04.903915+0000","last_unstale":"2023-07-11T00:30:11.119152+0000","last_undegraded":"2023-07-11T00:30:11.119152+0000","last_fullsized":"2023-07-11T00:30:11.119152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:50:41.550137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.060203+0000","last_change":"2023-07-11T00:30:05.907358+0000","last_active":"2023-07-11T00:30:11.060203+0000","last_peered":"2023-07-11T00:30:11.060203+0000","last_clean":"2023-07-11T00:30:11.060203+0000","last_became_active":"2023-07-11T00:30:05.907064+0000","last_became_peered":"2023-07-11T00:30:05.907064+0000","last_unstale":"2023-07-11T00:30:11.060203+0000","last_undegraded":"2023-07-11T00:30:11.060203+0000","last_fullsized":"2023-07-11T00:30:11.060203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:59:37.703330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057571+0000","last_change":"2023-07-11T00:30:10.067504+0000","last_active":"2023-07-11T00:30:11.057571+0000","last_peered":"2023-07-11T00:30:11.057571+0000","last_clean":"2023-07-11T00:30:11.057571+0000","last_became_active":"2023-07-11T00:30:10.067052+0000","last_became_peered":"2023-07-11T00:30:10.067052+0000","last_unstale":"2023-07-11T00:30:11.057571+0000","last_undegraded":"2023-07-11T00:30:11.057571+0000","last_fullsized":"2023-07-11T00:30:11.057571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:41:42.919668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058647+0000","last_change":"2023-07-11T00:30:04.911263+0000","last_active":"2023-07-11T00:30:11.058647+0000","last_peered":"2023-07-11T00:30:11.058647+0000","last_clean":"2023-07-11T00:30:11.058647+0000","last_became_active":"2023-07-11T00:30:04.910905+0000","last_became_peered":"2023-07-11T00:30:04.910905+0000","last_unstale":"2023-07-11T00:30:11.058647+0000","last_undegraded":"2023-07-11T00:30:11.058647+0000","last_fullsized":"2023-07-11T00:30:11.058647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:02:20.279699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119100+0000","last_change":"2023-07-11T00:30:05.915099+0000","last_active":"2023-07-11T00:30:11.119100+0000","last_peered":"2023-07-11T00:30:11.119100+0000","last_clean":"2023-07-11T00:30:11.119100+0000","last_became_active":"2023-07-11T00:30:05.914735+0000","last_became_peered":"2023-07-11T00:30:05.914735+0000","last_unstale":"2023-07-11T00:30:11.119100+0000","last_undegraded":"2023-07-11T00:30:11.119100+0000","last_fullsized":"2023-07-11T00:30:11.119100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:48:48.563856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115732+0000","last_change":"2023-07-11T00:30:10.074010+0000","last_active":"2023-07-11T00:30:11.115732+0000","last_peered":"2023-07-11T00:30:11.115732+0000","last_clean":"2023-07-11T00:30:11.115732+0000","last_became_active":"2023-07-11T00:30:10.073513+0000","last_became_peered":"2023-07-11T00:30:10.073513+0000","last_unstale":"2023-07-11T00:30:11.115732+0000","last_undegraded":"2023-07-11T00:30:11.115732+0000","last_fullsized":"2023-07-11T00:30:11.115732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:49:36.751025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117132+0000","last_change":"2023-07-11T00:30:04.908900+0000","last_active":"2023-07-11T00:30:11.117132+0000","last_peered":"2023-07-11T00:30:11.117132+0000","last_clean":"2023-07-11T00:30:11.117132+0000","last_became_active":"2023-07-11T00:30:04.908536+0000","last_became_peered":"2023-07-11T00:30:04.908536+0000","last_unstale":"2023-07-11T00:30:11.117132+0000","last_undegraded":"2023-07-11T00:30:11.117132+0000","last_fullsized":"2023-07-11T00:30:11.117132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:02:49.585404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116540+0000","last_change":"2023-07-11T00:30:05.908015+0000","last_active":"2023-07-11T00:30:11.116540+0000","last_peered":"2023-07-11T00:30:11.116540+0000","last_clean":"2023-07-11T00:30:11.116540+0000","last_became_active":"2023-07-11T00:30:05.907689+0000","last_became_peered":"2023-07-11T00:30:05.907689+0000","last_unstale":"2023-07-11T00:30:11.116540+0000","last_undegraded":"2023-07-11T00:30:11.116540+0000","last_fullsized":"2023-07-11T00:30:11.116540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:07:38.432308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118369+0000","last_change":"2023-07-11T00:30:10.073042+0000","last_active":"2023-07-11T00:30:11.118369+0000","last_peered":"2023-07-11T00:30:11.118369+0000","last_clean":"2023-07-11T00:30:11.118369+0000","last_became_active":"2023-07-11T00:30:10.072755+0000","last_became_peered":"2023-07-11T00:30:10.072755+0000","last_unstale":"2023-07-11T00:30:11.118369+0000","last_undegraded":"2023-07-11T00:30:11.118369+0000","last_fullsized":"2023-07-11T00:30:11.118369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:25:51.347028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116329+0000","last_change":"2023-07-11T00:30:04.906158+0000","last_active":"2023-07-11T00:30:11.116329+0000","last_peered":"2023-07-11T00:30:11.116329+0000","last_clean":"2023-07-11T00:30:11.116329+0000","last_became_active":"2023-07-11T00:30:04.905839+0000","last_became_peered":"2023-07-11T00:30:04.905839+0000","last_unstale":"2023-07-11T00:30:11.116329+0000","last_undegraded":"2023-07-11T00:30:11.116329+0000","last_fullsized":"2023-07-11T00:30:11.116329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:07:37.429600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118929+0000","last_change":"2023-07-11T00:30:05.912619+0000","last_active":"2023-07-11T00:30:11.118929+0000","last_peered":"2023-07-11T00:30:11.118929+0000","last_clean":"2023-07-11T00:30:11.118929+0000","last_became_active":"2023-07-11T00:30:05.912180+0000","last_became_peered":"2023-07-11T00:30:05.912180+0000","last_unstale":"2023-07-11T00:30:11.118929+0000","last_undegraded":"2023-07-11T00:30:11.118929+0000","last_fullsized":"2023-07-11T00:30:11.118929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:37:25.278906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119122+0000","last_change":"2023-07-11T00:30:10.078408+0000","last_active":"2023-07-11T00:30:11.119122+0000","last_peered":"2023-07-11T00:30:11.119122+0000","last_clean":"2023-07-11T00:30:11.119122+0000","last_became_active":"2023-07-11T00:30:10.077825+0000","last_became_peered":"2023-07-11T00:30:10.077825+0000","last_unstale":"2023-07-11T00:30:11.119122+0000","last_undegraded":"2023-07-11T00:30:11.119122+0000","last_fullsized":"2023-07-11T00:30:11.119122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:08:09.069684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'10","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:24.732814+0000","last_change":"2023-07-11T00:30:04.907926+0000","last_active":"2023-07-11T00:30:24.732814+0000","last_peered":"2023-07-11T00:30:24.732814+0000","last_clean":"2023-07-11T00:30:24.732814+0000","last_became_active":"2023-07-11T00:30:04.907603+0000","last_became_peered":"2023-07-11T00:30:04.907603+0000","last_unstale":"2023-07-11T00:30:24.732814+0000","last_undegraded":"2023-07-11T00:30:24.732814+0000","last_fullsized":"2023-07-11T00:30:24.732814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:35:34.386824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058562+0000","last_change":"2023-07-11T00:30:05.911101+0000","last_active":"2023-07-11T00:30:11.058562+0000","last_peered":"2023-07-11T00:30:11.058562+0000","last_clean":"2023-07-11T00:30:11.058562+0000","last_became_active":"2023-07-11T00:30:05.909430+0000","last_became_peered":"2023-07-11T00:30:05.909430+0000","last_unstale":"2023-07-11T00:30:11.058562+0000","last_undegraded":"2023-07-11T00:30:11.058562+0000","last_fullsized":"2023-07-11T00:30:11.058562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:07:38.432308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116172+0000","last_change":"2023-07-11T00:30:10.081247+0000","last_active":"2023-07-11T00:30:11.116172+0000","last_peered":"2023-07-11T00:30:11.116172+0000","last_clean":"2023-07-11T00:30:11.116172+0000","last_became_active":"2023-07-11T00:30:10.080796+0000","last_became_peered":"2023-07-11T00:30:10.080796+0000","last_unstale":"2023-07-11T00:30:11.116172+0000","last_undegraded":"2023-07-11T00:30:11.116172+0000","last_fullsized":"2023-07-11T00:30:11.116172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:05:35.713240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116102+0000","last_change":"2023-07-11T00:30:04.914310+0000","last_active":"2023-07-11T00:30:11.116102+0000","last_peered":"2023-07-11T00:30:11.116102+0000","last_clean":"2023-07-11T00:30:11.116102+0000","last_became_active":"2023-07-11T00:30:04.913972+0000","last_became_peered":"2023-07-11T00:30:04.913972+0000","last_unstale":"2023-07-11T00:30:11.116102+0000","last_undegraded":"2023-07-11T00:30:11.116102+0000","last_fullsized":"2023-07-11T00:30:11.116102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:51:41.689821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116886+0000","last_change":"2023-07-11T00:30:05.917159+0000","last_active":"2023-07-11T00:30:11.116886+0000","last_peered":"2023-07-11T00:30:11.116886+0000","last_clean":"2023-07-11T00:30:11.116886+0000","last_became_active":"2023-07-11T00:30:05.916849+0000","last_became_peered":"2023-07-11T00:30:05.916849+0000","last_unstale":"2023-07-11T00:30:11.116886+0000","last_undegraded":"2023-07-11T00:30:11.116886+0000","last_fullsized":"2023-07-11T00:30:11.116886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:09:26.818205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117167+0000","last_change":"2023-07-11T00:30:10.068364+0000","last_active":"2023-07-11T00:30:11.117167+0000","last_peered":"2023-07-11T00:30:11.117167+0000","last_clean":"2023-07-11T00:30:11.117167+0000","last_became_active":"2023-07-11T00:30:10.066791+0000","last_became_peered":"2023-07-11T00:30:10.066791+0000","last_unstale":"2023-07-11T00:30:11.117167+0000","last_undegraded":"2023-07-11T00:30:11.117167+0000","last_fullsized":"2023-07-11T00:30:11.117167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:23:00.417735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058112+0000","last_change":"2023-07-11T00:30:04.912548+0000","last_active":"2023-07-11T00:30:11.058112+0000","last_peered":"2023-07-11T00:30:11.058112+0000","last_clean":"2023-07-11T00:30:11.058112+0000","last_became_active":"2023-07-11T00:30:04.912228+0000","last_became_peered":"2023-07-11T00:30:04.912228+0000","last_unstale":"2023-07-11T00:30:11.058112+0000","last_undegraded":"2023-07-11T00:30:11.058112+0000","last_fullsized":"2023-07-11T00:30:11.058112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:00:49.062375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116712+0000","last_change":"2023-07-11T00:30:05.907171+0000","last_active":"2023-07-11T00:30:11.116712+0000","last_peered":"2023-07-11T00:30:11.116712+0000","last_clean":"2023-07-11T00:30:11.116712+0000","last_became_active":"2023-07-11T00:30:05.906862+0000","last_became_peered":"2023-07-11T00:30:05.906862+0000","last_unstale":"2023-07-11T00:30:11.116712+0000","last_undegraded":"2023-07-11T00:30:11.116712+0000","last_fullsized":"2023-07-11T00:30:11.116712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:31:07.229483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117405+0000","last_change":"2023-07-11T00:30:10.073795+0000","last_active":"2023-07-11T00:30:11.117405+0000","last_peered":"2023-07-11T00:30:11.117405+0000","last_clean":"2023-07-11T00:30:11.117405+0000","last_became_active":"2023-07-11T00:30:10.073437+0000","last_became_peered":"2023-07-11T00:30:10.073437+0000","last_unstale":"2023-07-11T00:30:11.117405+0000","last_undegraded":"2023-07-11T00:30:11.117405+0000","last_fullsized":"2023-07-11T00:30:11.117405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:35:39.542213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116190+0000","last_change":"2023-07-11T00:30:04.913583+0000","last_active":"2023-07-11T00:30:11.116190+0000","last_peered":"2023-07-11T00:30:11.116190+0000","last_clean":"2023-07-11T00:30:11.116190+0000","last_became_active":"2023-07-11T00:30:04.913217+0000","last_became_peered":"2023-07-11T00:30:04.913217+0000","last_unstale":"2023-07-11T00:30:11.116190+0000","last_undegraded":"2023-07-11T00:30:11.116190+0000","last_fullsized":"2023-07-11T00:30:11.116190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:02:49.585404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058792+0000","last_change":"2023-07-11T00:30:05.904820+0000","last_active":"2023-07-11T00:30:11.058792+0000","last_peered":"2023-07-11T00:30:11.058792+0000","last_clean":"2023-07-11T00:30:11.058792+0000","last_became_active":"2023-07-11T00:30:05.904502+0000","last_became_peered":"2023-07-11T00:30:05.904502+0000","last_unstale":"2023-07-11T00:30:11.058792+0000","last_undegraded":"2023-07-11T00:30:11.058792+0000","last_fullsized":"2023-07-11T00:30:11.058792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:49:32.598344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116686+0000","last_change":"2023-07-11T00:30:10.072170+0000","last_active":"2023-07-11T00:30:11.116686+0000","last_peered":"2023-07-11T00:30:11.116686+0000","last_clean":"2023-07-11T00:30:11.116686+0000","last_became_active":"2023-07-11T00:30:10.071764+0000","last_became_peered":"2023-07-11T00:30:10.071764+0000","last_unstale":"2023-07-11T00:30:11.116686+0000","last_undegraded":"2023-07-11T00:30:11.116686+0000","last_fullsized":"2023-07-11T00:30:11.116686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:19:04.827674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057318+0000","last_change":"2023-07-11T00:30:04.910630+0000","last_active":"2023-07-11T00:30:11.057318+0000","last_peered":"2023-07-11T00:30:11.057318+0000","last_clean":"2023-07-11T00:30:11.057318+0000","last_became_active":"2023-07-11T00:30:04.910150+0000","last_became_peered":"2023-07-11T00:30:04.910150+0000","last_unstale":"2023-07-11T00:30:11.057318+0000","last_undegraded":"2023-07-11T00:30:11.057318+0000","last_fullsized":"2023-07-11T00:30:11.057318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:14:23.274160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117798+0000","last_change":"2023-07-11T00:30:05.907668+0000","last_active":"2023-07-11T00:30:11.117798+0000","last_peered":"2023-07-11T00:30:11.117798+0000","last_clean":"2023-07-11T00:30:11.117798+0000","last_became_active":"2023-07-11T00:30:05.907397+0000","last_became_peered":"2023-07-11T00:30:05.907397+0000","last_unstale":"2023-07-11T00:30:11.117798+0000","last_undegraded":"2023-07-11T00:30:11.117798+0000","last_fullsized":"2023-07-11T00:30:11.117798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:50:20.512890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116720+0000","last_change":"2023-07-11T00:30:10.070415+0000","last_active":"2023-07-11T00:30:11.116720+0000","last_peered":"2023-07-11T00:30:11.116720+0000","last_clean":"2023-07-11T00:30:11.116720+0000","last_became_active":"2023-07-11T00:30:10.069906+0000","last_became_peered":"2023-07-11T00:30:10.069906+0000","last_unstale":"2023-07-11T00:30:11.116720+0000","last_undegraded":"2023-07-11T00:30:11.116720+0000","last_fullsized":"2023-07-11T00:30:11.116720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:57.996558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117336+0000","last_change":"2023-07-11T00:30:04.910800+0000","last_active":"2023-07-11T00:30:11.117336+0000","last_peered":"2023-07-11T00:30:11.117336+0000","last_clean":"2023-07-11T00:30:11.117336+0000","last_became_active":"2023-07-11T00:30:04.910453+0000","last_became_peered":"2023-07-11T00:30:04.910453+0000","last_unstale":"2023-07-11T00:30:11.117336+0000","last_undegraded":"2023-07-11T00:30:11.117336+0000","last_fullsized":"2023-07-11T00:30:11.117336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:38.027150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116206+0000","last_change":"2023-07-11T00:30:05.908168+0000","last_active":"2023-07-11T00:30:11.116206+0000","last_peered":"2023-07-11T00:30:11.116206+0000","last_clean":"2023-07-11T00:30:11.116206+0000","last_became_active":"2023-07-11T00:30:05.907884+0000","last_became_peered":"2023-07-11T00:30:05.907884+0000","last_unstale":"2023-07-11T00:30:11.116206+0000","last_undegraded":"2023-07-11T00:30:11.116206+0000","last_fullsized":"2023-07-11T00:30:11.116206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:00.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117337+0000","last_change":"2023-07-11T00:30:10.074726+0000","last_active":"2023-07-11T00:30:11.117337+0000","last_peered":"2023-07-11T00:30:11.117337+0000","last_clean":"2023-07-11T00:30:11.117337+0000","last_became_active":"2023-07-11T00:30:10.074281+0000","last_became_peered":"2023-07-11T00:30:10.074281+0000","last_unstale":"2023-07-11T00:30:11.117337+0000","last_undegraded":"2023-07-11T00:30:11.117337+0000","last_fullsized":"2023-07-11T00:30:11.117337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:50:00.072430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117143+0000","last_change":"2023-07-11T00:30:04.913460+0000","last_active":"2023-07-11T00:30:11.117143+0000","last_peered":"2023-07-11T00:30:11.117143+0000","last_clean":"2023-07-11T00:30:11.117143+0000","last_became_active":"2023-07-11T00:30:04.913131+0000","last_became_peered":"2023-07-11T00:30:04.913131+0000","last_unstale":"2023-07-11T00:30:11.117143+0000","last_undegraded":"2023-07-11T00:30:11.117143+0000","last_fullsized":"2023-07-11T00:30:11.117143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:09:25.815497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059267+0000","last_change":"2023-07-11T00:30:05.919028+0000","last_active":"2023-07-11T00:30:11.059267+0000","last_peered":"2023-07-11T00:30:11.059267+0000","last_clean":"2023-07-11T00:30:11.059267+0000","last_became_active":"2023-07-11T00:30:05.918727+0000","last_became_peered":"2023-07-11T00:30:05.918727+0000","last_unstale":"2023-07-11T00:30:11.059267+0000","last_undegraded":"2023-07-11T00:30:11.059267+0000","last_fullsized":"2023-07-11T00:30:11.059267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:22:04.654770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118792+0000","last_change":"2023-07-11T00:30:10.076696+0000","last_active":"2023-07-11T00:30:11.118792+0000","last_peered":"2023-07-11T00:30:11.118792+0000","last_clean":"2023-07-11T00:30:11.118792+0000","last_became_active":"2023-07-11T00:30:10.074714+0000","last_became_peered":"2023-07-11T00:30:10.074714+0000","last_unstale":"2023-07-11T00:30:11.118792+0000","last_undegraded":"2023-07-11T00:30:11.118792+0000","last_fullsized":"2023-07-11T00:30:11.118792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:53:44.062751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116091+0000","last_change":"2023-07-11T00:30:04.918352+0000","last_active":"2023-07-11T00:30:11.116091+0000","last_peered":"2023-07-11T00:30:11.116091+0000","last_clean":"2023-07-11T00:30:11.116091+0000","last_became_active":"2023-07-11T00:30:04.918037+0000","last_became_peered":"2023-07-11T00:30:04.918037+0000","last_unstale":"2023-07-11T00:30:11.116091+0000","last_undegraded":"2023-07-11T00:30:11.116091+0000","last_fullsized":"2023-07-11T00:30:11.116091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:33:45.867117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057432+0000","last_change":"2023-07-11T00:30:05.919328+0000","last_active":"2023-07-11T00:30:11.057432+0000","last_peered":"2023-07-11T00:30:11.057432+0000","last_clean":"2023-07-11T00:30:11.057432+0000","last_became_active":"2023-07-11T00:30:05.919010+0000","last_became_peered":"2023-07-11T00:30:05.919010+0000","last_unstale":"2023-07-11T00:30:11.057432+0000","last_undegraded":"2023-07-11T00:30:11.057432+0000","last_fullsized":"2023-07-11T00:30:11.057432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:11:39.510221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116515+0000","last_change":"2023-07-11T00:30:10.061029+0000","last_active":"2023-07-11T00:30:11.116515+0000","last_peered":"2023-07-11T00:30:11.116515+0000","last_clean":"2023-07-11T00:30:11.116515+0000","last_became_active":"2023-07-11T00:30:10.060602+0000","last_became_peered":"2023-07-11T00:30:10.060602+0000","last_unstale":"2023-07-11T00:30:11.116515+0000","last_undegraded":"2023-07-11T00:30:11.116515+0000","last_fullsized":"2023-07-11T00:30:11.116515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:09:45.109946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116660+0000","last_change":"2023-07-11T00:30:04.907017+0000","last_active":"2023-07-11T00:30:11.116660+0000","last_peered":"2023-07-11T00:30:11.116660+0000","last_clean":"2023-07-11T00:30:11.116660+0000","last_became_active":"2023-07-11T00:30:04.906643+0000","last_became_peered":"2023-07-11T00:30:04.906643+0000","last_unstale":"2023-07-11T00:30:11.116660+0000","last_undegraded":"2023-07-11T00:30:11.116660+0000","last_fullsized":"2023-07-11T00:30:11.116660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:59:35.767800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058314+0000","last_change":"2023-07-11T00:30:05.917921+0000","last_active":"2023-07-11T00:30:11.058314+0000","last_peered":"2023-07-11T00:30:11.058314+0000","last_clean":"2023-07-11T00:30:11.058314+0000","last_became_active":"2023-07-11T00:30:05.917626+0000","last_became_peered":"2023-07-11T00:30:05.917626+0000","last_unstale":"2023-07-11T00:30:11.058314+0000","last_undegraded":"2023-07-11T00:30:11.058314+0000","last_fullsized":"2023-07-11T00:30:11.058314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:56:13.450429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117705+0000","last_change":"2023-07-11T00:30:10.074654+0000","last_active":"2023-07-11T00:30:11.117705+0000","last_peered":"2023-07-11T00:30:11.117705+0000","last_clean":"2023-07-11T00:30:11.117705+0000","last_became_active":"2023-07-11T00:30:10.071607+0000","last_became_peered":"2023-07-11T00:30:10.071607+0000","last_unstale":"2023-07-11T00:30:11.117705+0000","last_undegraded":"2023-07-11T00:30:11.117705+0000","last_fullsized":"2023-07-11T00:30:11.117705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:03:08.156374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118186+0000","last_change":"2023-07-11T00:30:04.909409+0000","last_active":"2023-07-11T00:30:11.118186+0000","last_peered":"2023-07-11T00:30:11.118186+0000","last_clean":"2023-07-11T00:30:11.118186+0000","last_became_active":"2023-07-11T00:30:04.909108+0000","last_became_peered":"2023-07-11T00:30:04.909108+0000","last_unstale":"2023-07-11T00:30:11.118186+0000","last_undegraded":"2023-07-11T00:30:11.118186+0000","last_fullsized":"2023-07-11T00:30:11.118186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:22:03.652063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058847+0000","last_change":"2023-07-11T00:30:05.915428+0000","last_active":"2023-07-11T00:30:11.058847+0000","last_peered":"2023-07-11T00:30:11.058847+0000","last_clean":"2023-07-11T00:30:11.058847+0000","last_became_active":"2023-07-11T00:30:05.914309+0000","last_became_peered":"2023-07-11T00:30:05.914309+0000","last_unstale":"2023-07-11T00:30:11.058847+0000","last_undegraded":"2023-07-11T00:30:11.058847+0000","last_fullsized":"2023-07-11T00:30:11.058847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:39.029858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117114+0000","last_change":"2023-07-11T00:30:10.070740+0000","last_active":"2023-07-11T00:30:11.117114+0000","last_peered":"2023-07-11T00:30:11.117114+0000","last_clean":"2023-07-11T00:30:11.117114+0000","last_became_active":"2023-07-11T00:30:10.070140+0000","last_became_peered":"2023-07-11T00:30:10.070140+0000","last_unstale":"2023-07-11T00:30:11.117114+0000","last_undegraded":"2023-07-11T00:30:11.117114+0000","last_fullsized":"2023-07-11T00:30:11.117114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:07:59.464538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057584+0000","last_change":"2023-07-11T00:30:04.912890+0000","last_active":"2023-07-11T00:30:11.057584+0000","last_peered":"2023-07-11T00:30:11.057584+0000","last_clean":"2023-07-11T00:30:11.057584+0000","last_became_active":"2023-07-11T00:30:04.912603+0000","last_became_peered":"2023-07-11T00:30:04.912603+0000","last_unstale":"2023-07-11T00:30:11.057584+0000","last_undegraded":"2023-07-11T00:30:11.057584+0000","last_fullsized":"2023-07-11T00:30:11.057584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:33:16.183321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058428+0000","last_change":"2023-07-11T00:30:05.914876+0000","last_active":"2023-07-11T00:30:11.058428+0000","last_peered":"2023-07-11T00:30:11.058428+0000","last_clean":"2023-07-11T00:30:11.058428+0000","last_became_active":"2023-07-11T00:30:05.914556+0000","last_became_peered":"2023-07-11T00:30:05.914556+0000","last_unstale":"2023-07-11T00:30:11.058428+0000","last_undegraded":"2023-07-11T00:30:11.058428+0000","last_fullsized":"2023-07-11T00:30:11.058428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:01:38.063704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117150+0000","last_change":"2023-07-11T00:30:10.070879+0000","last_active":"2023-07-11T00:30:11.117150+0000","last_peered":"2023-07-11T00:30:11.117150+0000","last_clean":"2023-07-11T00:30:11.117150+0000","last_became_active":"2023-07-11T00:30:10.070373+0000","last_became_peered":"2023-07-11T00:30:10.070373+0000","last_unstale":"2023-07-11T00:30:11.117150+0000","last_undegraded":"2023-07-11T00:30:11.117150+0000","last_fullsized":"2023-07-11T00:30:11.117150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:51:46.845210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058991+0000","last_change":"2023-07-11T00:30:04.914965+0000","last_active":"2023-07-11T00:30:11.058991+0000","last_peered":"2023-07-11T00:30:11.058991+0000","last_clean":"2023-07-11T00:30:11.058991+0000","last_became_active":"2023-07-11T00:30:04.914499+0000","last_became_peered":"2023-07-11T00:30:04.914499+0000","last_unstale":"2023-07-11T00:30:11.058991+0000","last_undegraded":"2023-07-11T00:30:11.058991+0000","last_fullsized":"2023-07-11T00:30:11.058991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:29:02.495865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059980+0000","last_change":"2023-07-11T00:30:05.910772+0000","last_active":"2023-07-11T00:30:11.059980+0000","last_peered":"2023-07-11T00:30:11.059980+0000","last_clean":"2023-07-11T00:30:11.059980+0000","last_became_active":"2023-07-11T00:30:05.909373+0000","last_became_peered":"2023-07-11T00:30:05.909373+0000","last_unstale":"2023-07-11T00:30:11.059980+0000","last_undegraded":"2023-07-11T00:30:11.059980+0000","last_fullsized":"2023-07-11T00:30:11.059980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:39:38.348755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059752+0000","last_change":"2023-07-11T00:30:10.080512+0000","last_active":"2023-07-11T00:30:11.059752+0000","last_peered":"2023-07-11T00:30:11.059752+0000","last_clean":"2023-07-11T00:30:11.059752+0000","last_became_active":"2023-07-11T00:30:10.080095+0000","last_became_peered":"2023-07-11T00:30:10.080095+0000","last_unstale":"2023-07-11T00:30:11.059752+0000","last_undegraded":"2023-07-11T00:30:11.059752+0000","last_fullsized":"2023-07-11T00:30:11.059752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:50:46.705526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119006+0000","last_change":"2023-07-11T00:30:04.901845+0000","last_active":"2023-07-11T00:30:11.119006+0000","last_peered":"2023-07-11T00:30:11.119006+0000","last_clean":"2023-07-11T00:30:11.119006+0000","last_became_active":"2023-07-11T00:30:04.901568+0000","last_became_peered":"2023-07-11T00:30:04.901568+0000","last_unstale":"2023-07-11T00:30:11.119006+0000","last_undegraded":"2023-07-11T00:30:11.119006+0000","last_fullsized":"2023-07-11T00:30:11.119006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:48:35.160743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118215+0000","last_change":"2023-07-11T00:30:05.921748+0000","last_active":"2023-07-11T00:30:11.118215+0000","last_peered":"2023-07-11T00:30:11.118215+0000","last_clean":"2023-07-11T00:30:11.118215+0000","last_became_active":"2023-07-11T00:30:05.921455+0000","last_became_peered":"2023-07-11T00:30:05.921455+0000","last_unstale":"2023-07-11T00:30:11.118215+0000","last_undegraded":"2023-07-11T00:30:11.118215+0000","last_fullsized":"2023-07-11T00:30:11.118215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:49:28.388344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059460+0000","last_change":"2023-07-11T00:30:10.067600+0000","last_active":"2023-07-11T00:30:11.059460+0000","last_peered":"2023-07-11T00:30:11.059460+0000","last_clean":"2023-07-11T00:30:11.059460+0000","last_became_active":"2023-07-11T00:30:10.067214+0000","last_became_peered":"2023-07-11T00:30:10.067214+0000","last_unstale":"2023-07-11T00:30:11.059460+0000","last_undegraded":"2023-07-11T00:30:11.059460+0000","last_fullsized":"2023-07-11T00:30:11.059460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:16:23.912787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117616+0000","last_change":"2023-07-11T00:30:04.904613+0000","last_active":"2023-07-11T00:30:11.117616+0000","last_peered":"2023-07-11T00:30:11.117616+0000","last_clean":"2023-07-11T00:30:11.117616+0000","last_became_active":"2023-07-11T00:30:04.904312+0000","last_became_peered":"2023-07-11T00:30:04.904312+0000","last_unstale":"2023-07-11T00:30:11.117616+0000","last_undegraded":"2023-07-11T00:30:11.117616+0000","last_fullsized":"2023-07-11T00:30:11.117616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:29:02.495865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058655+0000","last_change":"2023-07-11T00:29:59.627086+0000","last_active":"2023-07-11T00:30:11.058655+0000","last_peered":"2023-07-11T00:30:11.058655+0000","last_clean":"2023-07-11T00:30:11.058655+0000","last_became_active":"2023-07-11T00:29:59.626687+0000","last_became_peered":"2023-07-11T00:29:59.626687+0000","last_unstale":"2023-07-11T00:30:11.058655+0000","last_undegraded":"2023-07-11T00:30:11.058655+0000","last_fullsized":"2023-07-11T00:30:11.058655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:31:04.583322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118938+0000","last_change":"2023-07-11T00:30:05.906700+0000","last_active":"2023-07-11T00:30:11.118938+0000","last_peered":"2023-07-11T00:30:11.118938+0000","last_clean":"2023-07-11T00:30:11.118938+0000","last_became_active":"2023-07-11T00:30:05.906333+0000","last_became_peered":"2023-07-11T00:30:05.906333+0000","last_unstale":"2023-07-11T00:30:11.118938+0000","last_undegraded":"2023-07-11T00:30:11.118938+0000","last_fullsized":"2023-07-11T00:30:11.118938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:12:42.514924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118845+0000","last_change":"2023-07-11T00:30:10.068326+0000","last_active":"2023-07-11T00:30:11.118845+0000","last_peered":"2023-07-11T00:30:11.118845+0000","last_clean":"2023-07-11T00:30:11.118845+0000","last_became_active":"2023-07-11T00:30:10.067893+0000","last_became_peered":"2023-07-11T00:30:10.067893+0000","last_unstale":"2023-07-11T00:30:11.118845+0000","last_undegraded":"2023-07-11T00:30:11.118845+0000","last_fullsized":"2023-07-11T00:30:11.118845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:16:23.912787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116953+0000","last_change":"2023-07-11T00:29:59.589317+0000","last_active":"2023-07-11T00:30:11.116953+0000","last_peered":"2023-07-11T00:30:11.116953+0000","last_clean":"2023-07-11T00:30:11.116953+0000","last_became_active":"2023-07-11T00:29:59.588926+0000","last_became_peered":"2023-07-11T00:29:59.588926+0000","last_unstale":"2023-07-11T00:30:11.116953+0000","last_undegraded":"2023-07-11T00:30:11.116953+0000","last_fullsized":"2023-07-11T00:30:11.116953+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:32.725207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058442+0000","last_change":"2023-07-11T00:30:04.907209+0000","last_active":"2023-07-11T00:30:11.058442+0000","last_peered":"2023-07-11T00:30:11.058442+0000","last_clean":"2023-07-11T00:30:11.058442+0000","last_became_active":"2023-07-11T00:30:04.906867+0000","last_became_peered":"2023-07-11T00:30:04.906867+0000","last_unstale":"2023-07-11T00:30:11.058442+0000","last_undegraded":"2023-07-11T00:30:11.058442+0000","last_fullsized":"2023-07-11T00:30:11.058442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:23:05.032572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059163+0000","last_change":"2023-07-11T00:30:05.917328+0000","last_active":"2023-07-11T00:30:11.059163+0000","last_peered":"2023-07-11T00:30:11.059163+0000","last_clean":"2023-07-11T00:30:11.059163+0000","last_became_active":"2023-07-11T00:30:05.916946+0000","last_became_peered":"2023-07-11T00:30:05.916946+0000","last_unstale":"2023-07-11T00:30:11.059163+0000","last_undegraded":"2023-07-11T00:30:11.059163+0000","last_fullsized":"2023-07-11T00:30:11.059163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:13:25.822286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117049+0000","last_change":"2023-07-11T00:30:10.082010+0000","last_active":"2023-07-11T00:30:11.117049+0000","last_peered":"2023-07-11T00:30:11.117049+0000","last_clean":"2023-07-11T00:30:11.117049+0000","last_became_active":"2023-07-11T00:30:10.081582+0000","last_became_peered":"2023-07-11T00:30:10.081582+0000","last_unstale":"2023-07-11T00:30:11.117049+0000","last_undegraded":"2023-07-11T00:30:11.117049+0000","last_fullsized":"2023-07-11T00:30:11.117049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:33:51.022506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118518+0000","last_change":"2023-07-11T00:29:59.585672+0000","last_active":"2023-07-11T00:30:11.118518+0000","last_peered":"2023-07-11T00:30:11.118518+0000","last_clean":"2023-07-11T00:30:11.118518+0000","last_became_active":"2023-07-11T00:29:59.585405+0000","last_became_peered":"2023-07-11T00:29:59.585405+0000","last_unstale":"2023-07-11T00:30:11.118518+0000","last_undegraded":"2023-07-11T00:30:11.118518+0000","last_fullsized":"2023-07-11T00:30:11.118518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:16:53.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115934+0000","last_change":"2023-07-11T00:29:59.589132+0000","last_active":"2023-07-11T00:30:11.115934+0000","last_peered":"2023-07-11T00:30:11.115934+0000","last_clean":"2023-07-11T00:30:11.115934+0000","last_became_active":"2023-07-11T00:29:59.588293+0000","last_became_peered":"2023-07-11T00:29:59.588293+0000","last_unstale":"2023-07-11T00:30:11.115934+0000","last_undegraded":"2023-07-11T00:30:11.115934+0000","last_fullsized":"2023-07-11T00:30:11.115934+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:36:10.586940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057956+0000","last_change":"2023-07-11T00:30:04.913946+0000","last_active":"2023-07-11T00:30:11.057956+0000","last_peered":"2023-07-11T00:30:11.057956+0000","last_clean":"2023-07-11T00:30:11.057956+0000","last_became_active":"2023-07-11T00:30:04.913711+0000","last_became_peered":"2023-07-11T00:30:04.913711+0000","last_unstale":"2023-07-11T00:30:11.057956+0000","last_undegraded":"2023-07-11T00:30:11.057956+0000","last_fullsized":"2023-07-11T00:30:11.057956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:59:36.700622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058778+0000","last_change":"2023-07-11T00:30:05.918327+0000","last_active":"2023-07-11T00:30:11.058778+0000","last_peered":"2023-07-11T00:30:11.058778+0000","last_clean":"2023-07-11T00:30:11.058778+0000","last_became_active":"2023-07-11T00:30:05.917953+0000","last_became_peered":"2023-07-11T00:30:05.917953+0000","last_unstale":"2023-07-11T00:30:11.058778+0000","last_undegraded":"2023-07-11T00:30:11.058778+0000","last_fullsized":"2023-07-11T00:30:11.058778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:44:29.464142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116829+0000","last_change":"2023-07-11T00:30:10.073421+0000","last_active":"2023-07-11T00:30:11.116829+0000","last_peered":"2023-07-11T00:30:11.116829+0000","last_clean":"2023-07-11T00:30:11.116829+0000","last_became_active":"2023-07-11T00:30:10.073124+0000","last_became_peered":"2023-07-11T00:30:10.073124+0000","last_unstale":"2023-07-11T00:30:11.116829+0000","last_undegraded":"2023-07-11T00:30:11.116829+0000","last_fullsized":"2023-07-11T00:30:11.116829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:42:54.748014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115890+0000","last_change":"2023-07-11T00:29:59.978997+0000","last_active":"2023-07-11T00:30:11.115890+0000","last_peered":"2023-07-11T00:30:11.115890+0000","last_clean":"2023-07-11T00:30:11.115890+0000","last_became_active":"2023-07-11T00:29:59.978716+0000","last_became_peered":"2023-07-11T00:29:59.978716+0000","last_unstale":"2023-07-11T00:30:11.115890+0000","last_undegraded":"2023-07-11T00:30:11.115890+0000","last_fullsized":"2023-07-11T00:30:11.115890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:43:49.863623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116128+0000","last_change":"2023-07-11T00:30:04.910937+0000","last_active":"2023-07-11T00:30:11.116128+0000","last_peered":"2023-07-11T00:30:11.116128+0000","last_clean":"2023-07-11T00:30:11.116128+0000","last_became_active":"2023-07-11T00:30:04.910458+0000","last_became_peered":"2023-07-11T00:30:04.910458+0000","last_unstale":"2023-07-11T00:30:11.116128+0000","last_undegraded":"2023-07-11T00:30:11.116128+0000","last_fullsized":"2023-07-11T00:30:11.116128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:59:36.700622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118101+0000","last_change":"2023-07-11T00:30:05.914883+0000","last_active":"2023-07-11T00:30:11.118101+0000","last_peered":"2023-07-11T00:30:11.118101+0000","last_clean":"2023-07-11T00:30:11.118101+0000","last_became_active":"2023-07-11T00:30:05.914349+0000","last_became_peered":"2023-07-11T00:30:05.914349+0000","last_unstale":"2023-07-11T00:30:11.118101+0000","last_undegraded":"2023-07-11T00:30:11.118101+0000","last_fullsized":"2023-07-11T00:30:11.118101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:32:58.816922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117060+0000","last_change":"2023-07-11T00:30:10.074427+0000","last_active":"2023-07-11T00:30:11.117060+0000","last_peered":"2023-07-11T00:30:11.117060+0000","last_clean":"2023-07-11T00:30:11.117060+0000","last_became_active":"2023-07-11T00:30:10.073876+0000","last_became_peered":"2023-07-11T00:30:10.073876+0000","last_unstale":"2023-07-11T00:30:11.117060+0000","last_undegraded":"2023-07-11T00:30:11.117060+0000","last_fullsized":"2023-07-11T00:30:11.117060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:31:15.040654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115771+0000","last_change":"2023-07-11T00:29:59.978976+0000","last_active":"2023-07-11T00:30:11.115771+0000","last_peered":"2023-07-11T00:30:11.115771+0000","last_clean":"2023-07-11T00:30:11.115771+0000","last_became_active":"2023-07-11T00:29:59.978678+0000","last_became_peered":"2023-07-11T00:29:59.978678+0000","last_unstale":"2023-07-11T00:30:11.115771+0000","last_undegraded":"2023-07-11T00:30:11.115771+0000","last_fullsized":"2023-07-11T00:30:11.115771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:54.370342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118862+0000","last_change":"2023-07-11T00:30:04.909677+0000","last_active":"2023-07-11T00:30:11.118862+0000","last_peered":"2023-07-11T00:30:11.118862+0000","last_clean":"2023-07-11T00:30:11.118862+0000","last_became_active":"2023-07-11T00:30:04.909389+0000","last_became_peered":"2023-07-11T00:30:04.909389+0000","last_unstale":"2023-07-11T00:30:11.118862+0000","last_undegraded":"2023-07-11T00:30:11.118862+0000","last_fullsized":"2023-07-11T00:30:11.118862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:41:27.161304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058572+0000","last_change":"2023-07-11T00:30:05.921943+0000","last_active":"2023-07-11T00:30:11.058572+0000","last_peered":"2023-07-11T00:30:11.058572+0000","last_clean":"2023-07-11T00:30:11.058572+0000","last_became_active":"2023-07-11T00:30:05.921610+0000","last_became_peered":"2023-07-11T00:30:05.921610+0000","last_unstale":"2023-07-11T00:30:11.058572+0000","last_undegraded":"2023-07-11T00:30:11.058572+0000","last_fullsized":"2023-07-11T00:30:11.058572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:34:52.723278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058455+0000","last_change":"2023-07-11T00:30:10.073091+0000","last_active":"2023-07-11T00:30:11.058455+0000","last_peered":"2023-07-11T00:30:11.058455+0000","last_clean":"2023-07-11T00:30:11.058455+0000","last_became_active":"2023-07-11T00:30:10.072625+0000","last_became_peered":"2023-07-11T00:30:10.072625+0000","last_unstale":"2023-07-11T00:30:11.058455+0000","last_undegraded":"2023-07-11T00:30:11.058455+0000","last_fullsized":"2023-07-11T00:30:11.058455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:56:33.500478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116185+0000","last_change":"2023-07-11T00:29:59.979163+0000","last_active":"2023-07-11T00:30:11.116185+0000","last_peered":"2023-07-11T00:30:11.116185+0000","last_clean":"2023-07-11T00:30:11.116185+0000","last_became_active":"2023-07-11T00:29:59.978751+0000","last_became_peered":"2023-07-11T00:29:59.978751+0000","last_unstale":"2023-07-11T00:30:11.116185+0000","last_undegraded":"2023-07-11T00:30:11.116185+0000","last_fullsized":"2023-07-11T00:30:11.116185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:32:52.512271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058712+0000","last_change":"2023-07-11T00:30:04.909467+0000","last_active":"2023-07-11T00:30:11.058712+0000","last_peered":"2023-07-11T00:30:11.058712+0000","last_clean":"2023-07-11T00:30:11.058712+0000","last_became_active":"2023-07-11T00:30:04.908512+0000","last_became_peered":"2023-07-11T00:30:04.908512+0000","last_unstale":"2023-07-11T00:30:11.058712+0000","last_undegraded":"2023-07-11T00:30:11.058712+0000","last_fullsized":"2023-07-11T00:30:11.058712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:09:25.815497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116448+0000","last_change":"2023-07-11T00:30:05.915403+0000","last_active":"2023-07-11T00:30:11.116448+0000","last_peered":"2023-07-11T00:30:11.116448+0000","last_clean":"2023-07-11T00:30:11.116448+0000","last_became_active":"2023-07-11T00:30:05.915006+0000","last_became_peered":"2023-07-11T00:30:05.915006+0000","last_unstale":"2023-07-11T00:30:11.116448+0000","last_undegraded":"2023-07-11T00:30:11.116448+0000","last_fullsized":"2023-07-11T00:30:11.116448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:00:50.065083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057855+0000","last_change":"2023-07-11T00:30:10.074777+0000","last_active":"2023-07-11T00:30:11.057855+0000","last_peered":"2023-07-11T00:30:11.057855+0000","last_clean":"2023-07-11T00:30:11.057855+0000","last_became_active":"2023-07-11T00:30:10.073612+0000","last_became_peered":"2023-07-11T00:30:10.073612+0000","last_unstale":"2023-07-11T00:30:11.057855+0000","last_undegraded":"2023-07-11T00:30:11.057855+0000","last_fullsized":"2023-07-11T00:30:11.057855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:37:55.556018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058461+0000","last_change":"2023-07-11T00:29:59.978981+0000","last_active":"2023-07-11T00:30:11.058461+0000","last_peered":"2023-07-11T00:30:11.058461+0000","last_clean":"2023-07-11T00:30:11.058461+0000","last_became_active":"2023-07-11T00:29:59.978633+0000","last_became_peered":"2023-07-11T00:29:59.978633+0000","last_unstale":"2023-07-11T00:30:11.058461+0000","last_undegraded":"2023-07-11T00:30:11.058461+0000","last_fullsized":"2023-07-11T00:30:11.058461+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:39:53.945627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116711+0000","last_change":"2023-07-11T00:30:04.915315+0000","last_active":"2023-07-11T00:30:11.116711+0000","last_peered":"2023-07-11T00:30:11.116711+0000","last_clean":"2023-07-11T00:30:11.116711+0000","last_became_active":"2023-07-11T00:30:04.914975+0000","last_became_peered":"2023-07-11T00:30:04.914975+0000","last_unstale":"2023-07-11T00:30:11.116711+0000","last_undegraded":"2023-07-11T00:30:11.116711+0000","last_fullsized":"2023-07-11T00:30:11.116711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:56:28.345089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058475+0000","last_change":"2023-07-11T00:30:05.911135+0000","last_active":"2023-07-11T00:30:11.058475+0000","last_peered":"2023-07-11T00:30:11.058475+0000","last_clean":"2023-07-11T00:30:11.058475+0000","last_became_active":"2023-07-11T00:30:05.910827+0000","last_became_peered":"2023-07-11T00:30:05.910827+0000","last_unstale":"2023-07-11T00:30:11.058475+0000","last_undegraded":"2023-07-11T00:30:11.058475+0000","last_fullsized":"2023-07-11T00:30:11.058475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:32:58.816922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058181+0000","last_change":"2023-07-11T00:30:10.083291+0000","last_active":"2023-07-11T00:30:11.058181+0000","last_peered":"2023-07-11T00:30:11.058181+0000","last_clean":"2023-07-11T00:30:11.058181+0000","last_became_active":"2023-07-11T00:30:10.082895+0000","last_became_peered":"2023-07-11T00:30:10.082895+0000","last_unstale":"2023-07-11T00:30:11.058181+0000","last_undegraded":"2023-07-11T00:30:11.058181+0000","last_fullsized":"2023-07-11T00:30:11.058181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:21:54.408864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.060161+0000","last_change":"2023-07-11T00:29:59.585652+0000","last_active":"2023-07-11T00:30:11.060161+0000","last_peered":"2023-07-11T00:30:11.060161+0000","last_clean":"2023-07-11T00:30:11.060161+0000","last_became_active":"2023-07-11T00:29:59.585316+0000","last_became_peered":"2023-07-11T00:29:59.585316+0000","last_unstale":"2023-07-11T00:30:11.060161+0000","last_undegraded":"2023-07-11T00:30:11.060161+0000","last_fullsized":"2023-07-11T00:30:11.060161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:14:02.980670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116535+0000","last_change":"2023-07-11T00:30:04.908230+0000","last_active":"2023-07-11T00:30:11.116535+0000","last_peered":"2023-07-11T00:30:11.116535+0000","last_clean":"2023-07-11T00:30:11.116535+0000","last_became_active":"2023-07-11T00:30:04.907876+0000","last_became_peered":"2023-07-11T00:30:04.907876+0000","last_unstale":"2023-07-11T00:30:11.116535+0000","last_undegraded":"2023-07-11T00:30:11.116535+0000","last_fullsized":"2023-07-11T00:30:11.116535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:44:28.461434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118728+0000","last_change":"2023-07-11T00:30:05.909462+0000","last_active":"2023-07-11T00:30:11.118728+0000","last_peered":"2023-07-11T00:30:11.118728+0000","last_clean":"2023-07-11T00:30:11.118728+0000","last_became_active":"2023-07-11T00:30:05.909171+0000","last_became_peered":"2023-07-11T00:30:05.909171+0000","last_unstale":"2023-07-11T00:30:11.118728+0000","last_undegraded":"2023-07-11T00:30:11.118728+0000","last_fullsized":"2023-07-11T00:30:11.118728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:02:21.282407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117001+0000","last_change":"2023-07-11T00:30:10.071266+0000","last_active":"2023-07-11T00:30:11.117001+0000","last_peered":"2023-07-11T00:30:11.117001+0000","last_clean":"2023-07-11T00:30:11.117001+0000","last_became_active":"2023-07-11T00:30:10.070503+0000","last_became_peered":"2023-07-11T00:30:10.070503+0000","last_unstale":"2023-07-11T00:30:11.117001+0000","last_undegraded":"2023-07-11T00:30:11.117001+0000","last_fullsized":"2023-07-11T00:30:11.117001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:57:33.279600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058426+0000","last_change":"2023-07-11T00:30:04.913993+0000","last_active":"2023-07-11T00:30:11.058426+0000","last_peered":"2023-07-11T00:30:11.058426+0000","last_clean":"2023-07-11T00:30:11.058426+0000","last_became_active":"2023-07-11T00:30:04.913642+0000","last_became_peered":"2023-07-11T00:30:04.913642+0000","last_unstale":"2023-07-11T00:30:11.058426+0000","last_undegraded":"2023-07-11T00:30:11.058426+0000","last_fullsized":"2023-07-11T00:30:11.058426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:57:28.124211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118217+0000","last_change":"2023-07-11T00:30:05.919099+0000","last_active":"2023-07-11T00:30:11.118217+0000","last_peered":"2023-07-11T00:30:11.118217+0000","last_clean":"2023-07-11T00:30:11.118217+0000","last_became_active":"2023-07-11T00:30:05.918814+0000","last_became_peered":"2023-07-11T00:30:05.918814+0000","last_unstale":"2023-07-11T00:30:11.118217+0000","last_undegraded":"2023-07-11T00:30:11.118217+0000","last_fullsized":"2023-07-11T00:30:11.118217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:30:43.008997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116071+0000","last_change":"2023-07-11T00:30:10.069011+0000","last_active":"2023-07-11T00:30:11.116071+0000","last_peered":"2023-07-11T00:30:11.116071+0000","last_clean":"2023-07-11T00:30:11.116071+0000","last_became_active":"2023-07-11T00:30:10.068592+0000","last_became_peered":"2023-07-11T00:30:10.068592+0000","last_unstale":"2023-07-11T00:30:11.116071+0000","last_undegraded":"2023-07-11T00:30:11.116071+0000","last_fullsized":"2023-07-11T00:30:11.116071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:59:40.923189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116511+0000","last_change":"2023-07-11T00:30:04.915144+0000","last_active":"2023-07-11T00:30:11.116511+0000","last_peered":"2023-07-11T00:30:11.116511+0000","last_clean":"2023-07-11T00:30:11.116511+0000","last_became_active":"2023-07-11T00:30:04.914857+0000","last_became_peered":"2023-07-11T00:30:04.914857+0000","last_unstale":"2023-07-11T00:30:11.116511+0000","last_undegraded":"2023-07-11T00:30:11.116511+0000","last_fullsized":"2023-07-11T00:30:11.116511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:08:03.914295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058885+0000","last_change":"2023-07-11T00:30:05.915668+0000","last_active":"2023-07-11T00:30:11.058885+0000","last_peered":"2023-07-11T00:30:11.058885+0000","last_clean":"2023-07-11T00:30:11.058885+0000","last_became_active":"2023-07-11T00:30:05.915103+0000","last_became_peered":"2023-07-11T00:30:05.915103+0000","last_unstale":"2023-07-11T00:30:11.058885+0000","last_undegraded":"2023-07-11T00:30:11.058885+0000","last_fullsized":"2023-07-11T00:30:11.058885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:22:56.265053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116786+0000","last_change":"2023-07-11T00:30:10.081391+0000","last_active":"2023-07-11T00:30:11.116786+0000","last_peered":"2023-07-11T00:30:11.116786+0000","last_clean":"2023-07-11T00:30:11.116786+0000","last_became_active":"2023-07-11T00:30:10.080979+0000","last_became_peered":"2023-07-11T00:30:10.080979+0000","last_unstale":"2023-07-11T00:30:11.116786+0000","last_undegraded":"2023-07-11T00:30:11.116786+0000","last_fullsized":"2023-07-11T00:30:11.116786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:49:32.541025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116347+0000","last_change":"2023-07-11T00:30:04.913406+0000","last_active":"2023-07-11T00:30:11.116347+0000","last_peered":"2023-07-11T00:30:11.116347+0000","last_clean":"2023-07-11T00:30:11.116347+0000","last_became_active":"2023-07-11T00:30:04.913025+0000","last_became_peered":"2023-07-11T00:30:04.913025+0000","last_unstale":"2023-07-11T00:30:11.116347+0000","last_undegraded":"2023-07-11T00:30:11.116347+0000","last_fullsized":"2023-07-11T00:30:11.116347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:37:24.276199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059362+0000","last_change":"2023-07-11T00:30:05.916740+0000","last_active":"2023-07-11T00:30:11.059362+0000","last_peered":"2023-07-11T00:30:11.059362+0000","last_clean":"2023-07-11T00:30:11.059362+0000","last_became_active":"2023-07-11T00:30:05.913008+0000","last_became_peered":"2023-07-11T00:30:05.913008+0000","last_unstale":"2023-07-11T00:30:11.059362+0000","last_undegraded":"2023-07-11T00:30:11.059362+0000","last_fullsized":"2023-07-11T00:30:11.059362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:25:47.194347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058162+0000","last_change":"2023-07-11T00:30:10.066428+0000","last_active":"2023-07-11T00:30:11.058162+0000","last_peered":"2023-07-11T00:30:11.058162+0000","last_clean":"2023-07-11T00:30:11.058162+0000","last_became_active":"2023-07-11T00:30:10.065932+0000","last_became_peered":"2023-07-11T00:30:10.065932+0000","last_unstale":"2023-07-11T00:30:11.058162+0000","last_undegraded":"2023-07-11T00:30:11.058162+0000","last_fullsized":"2023-07-11T00:30:11.058162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:02:54.740793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116255+0000","last_change":"2023-07-11T00:30:04.911637+0000","last_active":"2023-07-11T00:30:11.116255+0000","last_peered":"2023-07-11T00:30:11.116255+0000","last_clean":"2023-07-11T00:30:11.116255+0000","last_became_active":"2023-07-11T00:30:04.911311+0000","last_became_peered":"2023-07-11T00:30:04.911311+0000","last_unstale":"2023-07-11T00:30:11.116255+0000","last_undegraded":"2023-07-11T00:30:11.116255+0000","last_fullsized":"2023-07-11T00:30:11.116255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:47:48.434930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116470+0000","last_change":"2023-07-11T00:30:05.908686+0000","last_active":"2023-07-11T00:30:11.116470+0000","last_peered":"2023-07-11T00:30:11.116470+0000","last_clean":"2023-07-11T00:30:11.116470+0000","last_became_active":"2023-07-11T00:30:05.908384+0000","last_became_peered":"2023-07-11T00:30:05.908384+0000","last_unstale":"2023-07-11T00:30:11.116470+0000","last_undegraded":"2023-07-11T00:30:11.116470+0000","last_fullsized":"2023-07-11T00:30:11.116470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:01:38.063704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116672+0000","last_change":"2023-07-11T00:30:10.073737+0000","last_active":"2023-07-11T00:30:11.116672+0000","last_peered":"2023-07-11T00:30:11.116672+0000","last_clean":"2023-07-11T00:30:11.116672+0000","last_became_active":"2023-07-11T00:30:10.073270+0000","last_became_peered":"2023-07-11T00:30:10.073270+0000","last_unstale":"2023-07-11T00:30:11.116672+0000","last_undegraded":"2023-07-11T00:30:11.116672+0000","last_fullsized":"2023-07-11T00:30:11.116672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:56:17.603111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058726+0000","last_change":"2023-07-11T00:30:04.911003+0000","last_active":"2023-07-11T00:30:11.058726+0000","last_peered":"2023-07-11T00:30:11.058726+0000","last_clean":"2023-07-11T00:30:11.058726+0000","last_became_active":"2023-07-11T00:30:04.910696+0000","last_became_peered":"2023-07-11T00:30:04.910696+0000","last_unstale":"2023-07-11T00:30:11.058726+0000","last_undegraded":"2023-07-11T00:30:11.058726+0000","last_fullsized":"2023-07-11T00:30:11.058726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:08:03.914295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058582+0000","last_change":"2023-07-11T00:30:05.910836+0000","last_active":"2023-07-11T00:30:11.058582+0000","last_peered":"2023-07-11T00:30:11.058582+0000","last_clean":"2023-07-11T00:30:11.058582+0000","last_became_active":"2023-07-11T00:30:05.907744+0000","last_became_peered":"2023-07-11T00:30:05.907744+0000","last_unstale":"2023-07-11T00:30:11.058582+0000","last_undegraded":"2023-07-11T00:30:11.058582+0000","last_fullsized":"2023-07-11T00:30:11.058582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:53.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057491+0000","last_change":"2023-07-11T00:30:05.912291+0000","last_active":"2023-07-11T00:30:11.057491+0000","last_peered":"2023-07-11T00:30:11.057491+0000","last_clean":"2023-07-11T00:30:11.057491+0000","last_became_active":"2023-07-11T00:30:05.912020+0000","last_became_peered":"2023-07-11T00:30:05.912020+0000","last_unstale":"2023-07-11T00:30:11.057491+0000","last_undegraded":"2023-07-11T00:30:11.057491+0000","last_fullsized":"2023-07-11T00:30:11.057491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:35:14.541189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116735+0000","last_change":"2023-07-11T00:30:05.915128+0000","last_active":"2023-07-11T00:30:11.116735+0000","last_peered":"2023-07-11T00:30:11.116735+0000","last_clean":"2023-07-11T00:30:11.116735+0000","last_became_active":"2023-07-11T00:30:05.914684+0000","last_became_peered":"2023-07-11T00:30:05.914684+0000","last_unstale":"2023-07-11T00:30:11.116735+0000","last_undegraded":"2023-07-11T00:30:11.116735+0000","last_fullsized":"2023-07-11T00:30:11.116735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:31:10.887973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059928+0000","last_change":"2023-07-11T00:30:05.911543+0000","last_active":"2023-07-11T00:30:11.059928+0000","last_peered":"2023-07-11T00:30:11.059928+0000","last_clean":"2023-07-11T00:30:11.059928+0000","last_became_active":"2023-07-11T00:30:05.911204+0000","last_became_peered":"2023-07-11T00:30:05.911204+0000","last_unstale":"2023-07-11T00:30:11.059928+0000","last_undegraded":"2023-07-11T00:30:11.059928+0000","last_fullsized":"2023-07-11T00:30:11.059928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:08:16.283098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118055+0000","last_change":"2023-07-11T00:30:05.906824+0000","last_active":"2023-07-11T00:30:11.118055+0000","last_peered":"2023-07-11T00:30:11.118055+0000","last_clean":"2023-07-11T00:30:11.118055+0000","last_became_active":"2023-07-11T00:30:05.906357+0000","last_became_peered":"2023-07-11T00:30:05.906357+0000","last_unstale":"2023-07-11T00:30:11.118055+0000","last_undegraded":"2023-07-11T00:30:11.118055+0000","last_fullsized":"2023-07-11T00:30:11.118055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:13:25.822286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116584+0000","last_change":"2023-07-11T00:30:05.914873+0000","last_active":"2023-07-11T00:30:11.116584+0000","last_peered":"2023-07-11T00:30:11.116584+0000","last_clean":"2023-07-11T00:30:11.116584+0000","last_became_active":"2023-07-11T00:30:05.914537+0000","last_became_peered":"2023-07-11T00:30:05.914537+0000","last_unstale":"2023-07-11T00:30:11.116584+0000","last_undegraded":"2023-07-11T00:30:11.116584+0000","last_fullsized":"2023-07-11T00:30:11.116584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:21:50.256183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":876544,"data_stored":699108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":103369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":847872,"data_stored":695098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":103951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":104730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":103459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":108580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":104021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-11T00:30:35.587 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-11T00:30:35.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.812+0000 7fc6f5bff700 1 Processor -- start 2023-07-11T00:30:35.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.812+0000 7fc6f5bff700 1 -- start start 2023-07-11T00:30:35.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.814+0000 7fc6f5bff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc6f0157f10 0x7fc6f006a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:35.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.814+0000 7fc6f5bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc6f0070340 0x7fc6f015e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:35.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.814+0000 7fc6f5bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6f0070a50 0x7fc6f0070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:35.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.814+0000 7fc6f5bff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f006d900 con 0x7fc6f0157f10 2023-07-11T00:30:35.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.814+0000 7fc6f5bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f00713f0 con 0x7fc6f0070340 2023-07-11T00:30:35.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.814+0000 7fc6f5bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f015e210 con 0x7fc6f0070a50 2023-07-11T00:30:35.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.814+0000 7fc6ef7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc6f0157f10 0x7fc6f006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:35.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.814+0000 7fc6ef7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc6f0157f10 0x7fc6f006a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45458/0 (socket says 172.21.15.22:45458) 2023-07-11T00:30:35.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.814+0000 7fc6ef7fe700 1 -- 172.21.15.22:0/1352133402 learned_addr learned my addr 172.21.15.22:0/1352133402 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:35.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.814+0000 7fc6effff700 1 --2- 172.21.15.22:0/1352133402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6f0070a50 0x7fc6f0070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:35.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.814+0000 7fc6eeffd700 1 --2- 172.21.15.22:0/1352133402 >> v2:172.21.15.184:3300/0 conn(0x7fc6f0070340 0x7fc6f015e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:35.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.814+0000 7fc6ef7fe700 1 -- 172.21.15.22:0/1352133402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6f0070a50 msgr2=0x7fc6f0070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:35.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.814+0000 7fc6ef7fe700 1 --2- 172.21.15.22:0/1352133402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6f0070a50 0x7fc6f0070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.814+0000 7fc6ef7fe700 1 -- 172.21.15.22:0/1352133402 >> v2:172.21.15.184:3300/0 conn(0x7fc6f0070340 msgr2=0x7fc6f015e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:35.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.814+0000 7fc6ef7fe700 1 --2- 172.21.15.22:0/1352133402 >> v2:172.21.15.184:3300/0 conn(0x7fc6f0070340 0x7fc6f015e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.814+0000 7fc6ef7fe700 1 -- 172.21.15.22:0/1352133402 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f015dee0 con 0x7fc6f0157f10 2023-07-11T00:30:35.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.815+0000 7fc6ef7fe700 1 --2- 172.21.15.22:0/1352133402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6f0157f10 0x7fc6f006a940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00cc000 tx=0x7fc6e0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485ac49c5cd9f9e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:35.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.815+0000 7fc6ee7fc700 1 -- 172.21.15.22:0/1352133402 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0011830 con 0x7fc6f0157f10 2023-07-11T00:30:35.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.815+0000 7fc6ee7fc700 1 -- 172.21.15.22:0/1352133402 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e0011990 con 0x7fc6f0157f10 2023-07-11T00:30:35.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.815+0000 7fc6ee7fc700 1 -- 172.21.15.22:0/1352133402 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0011d20 con 0x7fc6f0157f10 2023-07-11T00:30:35.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.815+0000 7fc6f5bff700 1 -- 172.21.15.22:0/1352133402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6f0157f10 msgr2=0x7fc6f006a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:35.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.815+0000 7fc6f5bff700 1 --2- 172.21.15.22:0/1352133402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6f0157f10 0x7fc6f006a940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00cc000 tx=0x7fc6e0009bd0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.816+0000 7fc6f5bff700 1 -- 172.21.15.22:0/1352133402 shutdown_connections 2023-07-11T00:30:35.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.816+0000 7fc6f5bff700 1 --2- 172.21.15.22:0/1352133402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6f0070a50 0x7fc6f0070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.816+0000 7fc6f5bff700 1 --2- 172.21.15.22:0/1352133402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6f0157f10 0x7fc6f006a940 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.816+0000 7fc6f5bff700 1 --2- 172.21.15.22:0/1352133402 >> v2:172.21.15.184:3300/0 conn(0x7fc6f0070340 0x7fc6f015e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.816+0000 7fc6f5bff700 1 -- 172.21.15.22:0/1352133402 >> 172.21.15.22:0/1352133402 conn(0x7fc6f00b0390 msgr2=0x7fc6f00b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:35.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.816+0000 7fc6f5bff700 1 -- 172.21.15.22:0/1352133402 shutdown_connections 2023-07-11T00:30:35.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.816+0000 7fc6f5bff700 1 -- 172.21.15.22:0/1352133402 wait complete. 2023-07-11T00:30:35.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.817+0000 7fc6f5bff700 1 Processor -- start 2023-07-11T00:30:35.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.818+0000 7fc6f5bff700 1 -- start start 2023-07-11T00:30:35.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.818+0000 7fc6f5bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6f0070340 0x7fc6f00c29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:35.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.818+0000 7fc6f5bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6f0070a50 0x7fc6f01550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:35.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.818+0000 7fc6f5bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6f0157f10 0x7fc6f0155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:35.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.818+0000 7fc6f5bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f00c31c0 con 0x7fc6f0070a50 2023-07-11T00:30:35.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.818+0000 7fc6f5bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f00c34a0 con 0x7fc6f0157f10 2023-07-11T00:30:35.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.818+0000 7fc6f5bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f00c3780 con 0x7fc6f0070340 2023-07-11T00:30:35.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.819+0000 7fc6eeffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6f0070a50 0x7fc6f01550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:35.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.819+0000 7fc6eeffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6f0070a50 0x7fc6f01550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45466/0 (socket says 172.21.15.22:45466) 2023-07-11T00:30:35.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.819+0000 7fc6eeffd700 1 -- 172.21.15.22:0/671782637 learned_addr learned my addr 172.21.15.22:0/671782637 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:35.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.819+0000 7fc6effff700 1 --2- 172.21.15.22:0/671782637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6f0157f10 0x7fc6f0155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:35.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.819+0000 7fc6ef7fe700 1 --2- 172.21.15.22:0/671782637 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6f0070340 0x7fc6f00c29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:35.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.819+0000 7fc6eeffd700 1 -- 172.21.15.22:0/671782637 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6f0070340 msgr2=0x7fc6f00c29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:35.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.819+0000 7fc6eeffd700 1 --2- 172.21.15.22:0/671782637 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6f0070340 0x7fc6f00c29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.819+0000 7fc6eeffd700 1 -- 172.21.15.22:0/671782637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6f0157f10 msgr2=0x7fc6f0155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:35.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.819+0000 7fc6eeffd700 1 --2- 172.21.15.22:0/671782637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6f0157f10 0x7fc6f0155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:35.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.819+0000 7fc6eeffd700 1 -- 172.21.15.22:0/671782637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e0009550 con 0x7fc6f0070a50 2023-07-11T00:30:35.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.820+0000 7fc6eeffd700 1 --2- 172.21.15.22:0/671782637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6f0070a50 0x7fc6f01550c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400e930 tx=0x7fc6e400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:35.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.820+0000 7fc6d7fff700 1 -- 172.21.15.22:0/671782637 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4013680 con 0x7fc6f0070a50 2023-07-11T00:30:35.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.820+0000 7fc6d7fff700 1 -- 172.21.15.22:0/671782637 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e40137e0 con 0x7fc6f0070a50 2023-07-11T00:30:35.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.820+0000 7fc6f5bff700 1 -- 172.21.15.22:0/671782637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f00c3a60 con 0x7fc6f0070a50 2023-07-11T00:30:35.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.820+0000 7fc6d7fff700 1 -- 172.21.15.22:0/671782637 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4013b70 con 0x7fc6f0070a50 2023-07-11T00:30:35.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.820+0000 7fc6f5bff700 1 -- 172.21.15.22:0/671782637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f00b2de0 con 0x7fc6f0070a50 2023-07-11T00:30:35.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.821+0000 7fc6f5bff700 1 -- 172.21.15.22:0/671782637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f004ea60 con 0x7fc6f0070a50 2023-07-11T00:30:35.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.822+0000 7fc6d7fff700 1 -- 172.21.15.22:0/671782637 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc6e4013cd0 con 0x7fc6f0070a50 2023-07-11T00:30:35.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.823+0000 7fc6d7fff700 1 --2- 172.21.15.22:0/671782637 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc6dc06ace0 0x7fc6dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:35.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.823+0000 7fc6d7fff700 1 -- 172.21.15.22:0/671782637 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc6e40896d0 con 0x7fc6f0070a50 2023-07-11T00:30:35.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.823+0000 7fc6ef7fe700 1 --2- 172.21.15.22:0/671782637 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc6dc06ace0 0x7fc6dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:35.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.824+0000 7fc6ef7fe700 1 --2- 172.21.15.22:0/671782637 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc6dc06ace0 0x7fc6dc06d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0014040 tx=0x7fc6e0008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:35.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:35.828+0000 7fc6d7fff700 1 -- 172.21.15.22:0/671782637 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc6e4054480 con 0x7fc6f0070a50 2023-07-11T00:30:36.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.034+0000 7fc6f5bff700 1 -- 172.21.15.22:0/671782637 --> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc6f00c9220 con 0x7fc6dc06ace0 2023-07-11T00:30:36.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.045+0000 7fc6d7fff700 1 -- 172.21.15.22:0/671782637 <== mgr.4114 v2:172.21.15.184:6832/380612710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367599 (secure 0 0 0) 0x7fc6e0004040 con 0x7fc6dc06ace0 2023-07-11T00:30:36.051 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:36.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.049+0000 7fc6f5bff700 1 -- 172.21.15.22:0/671782637 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc6dc06ace0 msgr2=0x7fc6dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:36.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.049+0000 7fc6f5bff700 1 --2- 172.21.15.22:0/671782637 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc6dc06ace0 0x7fc6dc06d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0014040 tx=0x7fc6e0008030 comp rx=0 tx=0).stop 2023-07-11T00:30:36.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.049+0000 7fc6f5bff700 1 -- 172.21.15.22:0/671782637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6f0070a50 msgr2=0x7fc6f01550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:36.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.049+0000 7fc6f5bff700 1 --2- 172.21.15.22:0/671782637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6f0070a50 0x7fc6f01550c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400e930 tx=0x7fc6e400ec40 comp rx=0 tx=0).stop 2023-07-11T00:30:36.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.049+0000 7fc6f5bff700 1 -- 172.21.15.22:0/671782637 shutdown_connections 2023-07-11T00:30:36.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.049+0000 7fc6f5bff700 1 --2- 172.21.15.22:0/671782637 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc6dc06ace0 0x7fc6dc06d190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.049+0000 7fc6f5bff700 1 --2- 172.21.15.22:0/671782637 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6f0070340 0x7fc6f00c29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.049+0000 7fc6f5bff700 1 --2- 172.21.15.22:0/671782637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6f0157f10 0x7fc6f0155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.049+0000 7fc6f5bff700 1 --2- 172.21.15.22:0/671782637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6f0070a50 0x7fc6f01550c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.049+0000 7fc6f5bff700 1 -- 172.21.15.22:0/671782637 >> 172.21.15.22:0/671782637 conn(0x7fc6f00b0390 msgr2=0x7fc6f00ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:36.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.049+0000 7fc6f5bff700 1 -- 172.21.15.22:0/671782637 shutdown_connections 2023-07-11T00:30:36.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.049+0000 7fc6f5bff700 1 -- 172.21.15.22:0/671782637 wait complete. 2023-07-11T00:30:36.056 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-07-11T00:30:36.070 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-07-11T00:30:34.497827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219352,"kb_used_data":3192,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755368,"statfs":{"total":773094113280,"available":772869496832,"internally_reserved":0,"allocated":3268608,"data_stored":2022316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003582"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117136+0000","last_change":"2023-07-11T00:30:05.911712+0000","last_active":"2023-07-11T00:30:11.117136+0000","last_peered":"2023-07-11T00:30:11.117136+0000","last_clean":"2023-07-11T00:30:11.117136+0000","last_became_active":"2023-07-11T00:30:05.911450+0000","last_became_peered":"2023-07-11T00:30:05.911450+0000","last_unstale":"2023-07-11T00:30:11.117136+0000","last_undegraded":"2023-07-11T00:30:11.117136+0000","last_fullsized":"2023-07-11T00:30:11.117136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:54:15.307917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116734+0000","last_change":"2023-07-11T00:30:05.920040+0000","last_active":"2023-07-11T00:30:11.116734+0000","last_peered":"2023-07-11T00:30:11.116734+0000","last_clean":"2023-07-11T00:30:11.116734+0000","last_became_active":"2023-07-11T00:30:05.919701+0000","last_became_peered":"2023-07-11T00:30:05.919701+0000","last_unstale":"2023-07-11T00:30:11.116734+0000","last_undegraded":"2023-07-11T00:30:11.116734+0000","last_fullsized":"2023-07-11T00:30:11.116734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:30:34.562898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059575+0000","last_change":"2023-07-11T00:30:05.912536+0000","last_active":"2023-07-11T00:30:11.059575+0000","last_peered":"2023-07-11T00:30:11.059575+0000","last_clean":"2023-07-11T00:30:11.059575+0000","last_became_active":"2023-07-11T00:30:05.912241+0000","last_became_peered":"2023-07-11T00:30:05.912241+0000","last_unstale":"2023-07-11T00:30:11.059575+0000","last_undegraded":"2023-07-11T00:30:11.059575+0000","last_fullsized":"2023-07-11T00:30:11.059575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:12:42.514924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058346+0000","last_change":"2023-07-11T00:30:05.903203+0000","last_active":"2023-07-11T00:30:11.058346+0000","last_peered":"2023-07-11T00:30:11.058346+0000","last_clean":"2023-07-11T00:30:11.058346+0000","last_became_active":"2023-07-11T00:30:05.902858+0000","last_became_peered":"2023-07-11T00:30:05.902858+0000","last_unstale":"2023-07-11T00:30:11.058346+0000","last_undegraded":"2023-07-11T00:30:11.058346+0000","last_fullsized":"2023-07-11T00:30:11.058346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:44:07.446915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058655+0000","last_change":"2023-07-11T00:30:05.905150+0000","last_active":"2023-07-11T00:30:11.058655+0000","last_peered":"2023-07-11T00:30:11.058655+0000","last_clean":"2023-07-11T00:30:11.058655+0000","last_became_active":"2023-07-11T00:30:05.904828+0000","last_became_peered":"2023-07-11T00:30:05.904828+0000","last_unstale":"2023-07-11T00:30:11.058655+0000","last_undegraded":"2023-07-11T00:30:11.058655+0000","last_fullsized":"2023-07-11T00:30:11.058655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:37:25.278906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.060073+0000","last_change":"2023-07-11T00:30:05.918168+0000","last_active":"2023-07-11T00:30:11.060073+0000","last_peered":"2023-07-11T00:30:11.060073+0000","last_clean":"2023-07-11T00:30:11.060073+0000","last_became_active":"2023-07-11T00:30:05.917840+0000","last_became_peered":"2023-07-11T00:30:05.917840+0000","last_unstale":"2023-07-11T00:30:11.060073+0000","last_undegraded":"2023-07-11T00:30:11.060073+0000","last_fullsized":"2023-07-11T00:30:11.060073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:32:32.639916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116327+0000","last_change":"2023-07-11T00:30:05.916111+0000","last_active":"2023-07-11T00:30:11.116327+0000","last_peered":"2023-07-11T00:30:11.116327+0000","last_clean":"2023-07-11T00:30:11.116327+0000","last_became_active":"2023-07-11T00:30:05.915793+0000","last_became_peered":"2023-07-11T00:30:05.915793+0000","last_unstale":"2023-07-11T00:30:11.116327+0000","last_undegraded":"2023-07-11T00:30:11.116327+0000","last_fullsized":"2023-07-11T00:30:11.116327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:01:38.063704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116335+0000","last_change":"2023-07-11T00:30:05.924536+0000","last_active":"2023-07-11T00:30:11.116335+0000","last_peered":"2023-07-11T00:30:11.116335+0000","last_clean":"2023-07-11T00:30:11.116335+0000","last_became_active":"2023-07-11T00:30:05.924214+0000","last_became_peered":"2023-07-11T00:30:05.924214+0000","last_unstale":"2023-07-11T00:30:11.116335+0000","last_undegraded":"2023-07-11T00:30:11.116335+0000","last_fullsized":"2023-07-11T00:30:11.116335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:02:21.282407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058461+0000","last_change":"2023-07-11T00:30:05.912403+0000","last_active":"2023-07-11T00:30:11.058461+0000","last_peered":"2023-07-11T00:30:11.058461+0000","last_clean":"2023-07-11T00:30:11.058461+0000","last_became_active":"2023-07-11T00:30:05.912089+0000","last_became_peered":"2023-07-11T00:30:05.912089+0000","last_unstale":"2023-07-11T00:30:11.058461+0000","last_undegraded":"2023-07-11T00:30:11.058461+0000","last_fullsized":"2023-07-11T00:30:11.058461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:05:31.560559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117009+0000","last_change":"2023-07-11T00:30:05.914190+0000","last_active":"2023-07-11T00:30:11.117009+0000","last_peered":"2023-07-11T00:30:11.117009+0000","last_clean":"2023-07-11T00:30:11.117009+0000","last_became_active":"2023-07-11T00:30:05.913891+0000","last_became_peered":"2023-07-11T00:30:05.913891+0000","last_unstale":"2023-07-11T00:30:11.117009+0000","last_undegraded":"2023-07-11T00:30:11.117009+0000","last_fullsized":"2023-07-11T00:30:11.117009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:36:16.891590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059425+0000","last_change":"2023-07-11T00:30:05.918953+0000","last_active":"2023-07-11T00:30:11.059425+0000","last_peered":"2023-07-11T00:30:11.059425+0000","last_clean":"2023-07-11T00:30:11.059425+0000","last_became_active":"2023-07-11T00:30:05.918621+0000","last_became_peered":"2023-07-11T00:30:05.918621+0000","last_unstale":"2023-07-11T00:30:11.059425+0000","last_undegraded":"2023-07-11T00:30:11.059425+0000","last_fullsized":"2023-07-11T00:30:11.059425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:41:28.164012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118528+0000","last_change":"2023-07-11T00:30:05.914213+0000","last_active":"2023-07-11T00:30:11.118528+0000","last_peered":"2023-07-11T00:30:11.118528+0000","last_clean":"2023-07-11T00:30:11.118528+0000","last_became_active":"2023-07-11T00:30:05.913944+0000","last_became_peered":"2023-07-11T00:30:05.913944+0000","last_unstale":"2023-07-11T00:30:11.118528+0000","last_undegraded":"2023-07-11T00:30:11.118528+0000","last_fullsized":"2023-07-11T00:30:11.118528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:59:16.970501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118774+0000","last_change":"2023-07-11T00:30:05.910052+0000","last_active":"2023-07-11T00:30:11.118774+0000","last_peered":"2023-07-11T00:30:11.118774+0000","last_clean":"2023-07-11T00:30:11.118774+0000","last_became_active":"2023-07-11T00:30:05.909736+0000","last_became_peered":"2023-07-11T00:30:05.909736+0000","last_unstale":"2023-07-11T00:30:11.118774+0000","last_undegraded":"2023-07-11T00:30:11.118774+0000","last_fullsized":"2023-07-11T00:30:11.118774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:21:43.298124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116546+0000","last_change":"2023-07-11T00:30:05.917375+0000","last_active":"2023-07-11T00:30:11.116546+0000","last_peered":"2023-07-11T00:30:11.116546+0000","last_clean":"2023-07-11T00:30:11.116546+0000","last_became_active":"2023-07-11T00:30:05.917073+0000","last_became_peered":"2023-07-11T00:30:05.917073+0000","last_unstale":"2023-07-11T00:30:11.116546+0000","last_undegraded":"2023-07-11T00:30:11.116546+0000","last_fullsized":"2023-07-11T00:30:11.116546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:49:32.598344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115820+0000","last_change":"2023-07-11T00:30:05.915585+0000","last_active":"2023-07-11T00:30:11.115820+0000","last_peered":"2023-07-11T00:30:11.115820+0000","last_clean":"2023-07-11T00:30:11.115820+0000","last_became_active":"2023-07-11T00:30:05.915308+0000","last_became_peered":"2023-07-11T00:30:05.915308+0000","last_unstale":"2023-07-11T00:30:11.115820+0000","last_undegraded":"2023-07-11T00:30:11.115820+0000","last_fullsized":"2023-07-11T00:30:11.115820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:31:07.229483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058415+0000","last_change":"2023-07-11T00:30:05.897489+0000","last_active":"2023-07-11T00:30:11.058415+0000","last_peered":"2023-07-11T00:30:11.058415+0000","last_clean":"2023-07-11T00:30:11.058415+0000","last_became_active":"2023-07-11T00:30:05.897078+0000","last_became_peered":"2023-07-11T00:30:05.897078+0000","last_unstale":"2023-07-11T00:30:11.058415+0000","last_undegraded":"2023-07-11T00:30:11.058415+0000","last_fullsized":"2023-07-11T00:30:11.058415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:47:49.437638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058439+0000","last_change":"2023-07-11T00:30:05.904485+0000","last_active":"2023-07-11T00:30:11.058439+0000","last_peered":"2023-07-11T00:30:11.058439+0000","last_clean":"2023-07-11T00:30:11.058439+0000","last_became_active":"2023-07-11T00:30:05.904198+0000","last_became_peered":"2023-07-11T00:30:05.904198+0000","last_unstale":"2023-07-11T00:30:11.058439+0000","last_undegraded":"2023-07-11T00:30:11.058439+0000","last_fullsized":"2023-07-11T00:30:11.058439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:07:55.311856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059904+0000","last_change":"2023-07-11T00:30:05.916172+0000","last_active":"2023-07-11T00:30:11.059904+0000","last_peered":"2023-07-11T00:30:11.059904+0000","last_clean":"2023-07-11T00:30:11.059904+0000","last_became_active":"2023-07-11T00:30:05.915857+0000","last_became_peered":"2023-07-11T00:30:05.915857+0000","last_unstale":"2023-07-11T00:30:11.059904+0000","last_undegraded":"2023-07-11T00:30:11.059904+0000","last_fullsized":"2023-07-11T00:30:11.059904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:03:00.748490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117907+0000","last_change":"2023-07-11T00:30:05.905623+0000","last_active":"2023-07-11T00:30:11.117907+0000","last_peered":"2023-07-11T00:30:11.117907+0000","last_clean":"2023-07-11T00:30:11.117907+0000","last_became_active":"2023-07-11T00:30:05.905411+0000","last_became_peered":"2023-07-11T00:30:05.905411+0000","last_unstale":"2023-07-11T00:30:11.117907+0000","last_undegraded":"2023-07-11T00:30:11.117907+0000","last_fullsized":"2023-07-11T00:30:11.117907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:59:32.190804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059052+0000","last_change":"2023-07-11T00:30:05.912071+0000","last_active":"2023-07-11T00:30:11.059052+0000","last_peered":"2023-07-11T00:30:11.059052+0000","last_clean":"2023-07-11T00:30:11.059052+0000","last_became_active":"2023-07-11T00:30:05.911697+0000","last_became_peered":"2023-07-11T00:30:05.911697+0000","last_unstale":"2023-07-11T00:30:11.059052+0000","last_undegraded":"2023-07-11T00:30:11.059052+0000","last_fullsized":"2023-07-11T00:30:11.059052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:50:20.512890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116233+0000","last_change":"2023-07-11T00:30:05.910797+0000","last_active":"2023-07-11T00:30:11.116233+0000","last_peered":"2023-07-11T00:30:11.116233+0000","last_clean":"2023-07-11T00:30:11.116233+0000","last_became_active":"2023-07-11T00:30:05.910438+0000","last_became_peered":"2023-07-11T00:30:05.910438+0000","last_unstale":"2023-07-11T00:30:11.116233+0000","last_undegraded":"2023-07-11T00:30:11.116233+0000","last_fullsized":"2023-07-11T00:30:11.116233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:47:49.437638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057978+0000","last_change":"2023-07-11T00:30:05.918878+0000","last_active":"2023-07-11T00:30:11.057978+0000","last_peered":"2023-07-11T00:30:11.057978+0000","last_clean":"2023-07-11T00:30:11.057978+0000","last_became_active":"2023-07-11T00:30:05.918348+0000","last_became_peered":"2023-07-11T00:30:05.918348+0000","last_unstale":"2023-07-11T00:30:11.057978+0000","last_undegraded":"2023-07-11T00:30:11.057978+0000","last_fullsized":"2023-07-11T00:30:11.057978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:31:53.264979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116625+0000","last_change":"2023-07-11T00:30:05.903228+0000","last_active":"2023-07-11T00:30:11.116625+0000","last_peered":"2023-07-11T00:30:11.116625+0000","last_clean":"2023-07-11T00:30:11.116625+0000","last_became_active":"2023-07-11T00:30:05.902909+0000","last_became_peered":"2023-07-11T00:30:05.902909+0000","last_unstale":"2023-07-11T00:30:11.116625+0000","last_undegraded":"2023-07-11T00:30:11.116625+0000","last_fullsized":"2023-07-11T00:30:11.116625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:53.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115854+0000","last_change":"2023-07-11T00:30:05.908961+0000","last_active":"2023-07-11T00:30:11.115854+0000","last_peered":"2023-07-11T00:30:11.115854+0000","last_clean":"2023-07-11T00:30:11.115854+0000","last_became_active":"2023-07-11T00:30:05.908652+0000","last_became_peered":"2023-07-11T00:30:05.908652+0000","last_unstale":"2023-07-11T00:30:11.115854+0000","last_undegraded":"2023-07-11T00:30:11.115854+0000","last_fullsized":"2023-07-11T00:30:11.115854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:30:34.562898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117973+0000","last_change":"2023-07-11T00:30:05.915154+0000","last_active":"2023-07-11T00:30:11.117973+0000","last_peered":"2023-07-11T00:30:11.117973+0000","last_clean":"2023-07-11T00:30:11.117973+0000","last_became_active":"2023-07-11T00:30:05.914601+0000","last_became_peered":"2023-07-11T00:30:05.914601+0000","last_unstale":"2023-07-11T00:30:11.117973+0000","last_undegraded":"2023-07-11T00:30:11.117973+0000","last_fullsized":"2023-07-11T00:30:11.117973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:05:31.560559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117482+0000","last_change":"2023-07-11T00:30:05.917313+0000","last_active":"2023-07-11T00:30:11.117482+0000","last_peered":"2023-07-11T00:30:11.117482+0000","last_clean":"2023-07-11T00:30:11.117482+0000","last_became_active":"2023-07-11T00:30:05.916948+0000","last_became_peered":"2023-07-11T00:30:05.916948+0000","last_unstale":"2023-07-11T00:30:11.117482+0000","last_undegraded":"2023-07-11T00:30:11.117482+0000","last_fullsized":"2023-07-11T00:30:11.117482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:23:06.035280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116853+0000","last_change":"2023-07-11T00:30:05.907303+0000","last_active":"2023-07-11T00:30:11.116853+0000","last_peered":"2023-07-11T00:30:11.116853+0000","last_clean":"2023-07-11T00:30:11.116853+0000","last_became_active":"2023-07-11T00:30:05.906928+0000","last_became_peered":"2023-07-11T00:30:05.906928+0000","last_unstale":"2023-07-11T00:30:11.116853+0000","last_undegraded":"2023-07-11T00:30:11.116853+0000","last_fullsized":"2023-07-11T00:30:11.116853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:43:56.168273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059619+0000","last_change":"2023-07-11T00:30:10.072865+0000","last_active":"2023-07-11T00:30:11.059619+0000","last_peered":"2023-07-11T00:30:11.059619+0000","last_clean":"2023-07-11T00:30:11.059619+0000","last_became_active":"2023-07-11T00:30:10.072474+0000","last_became_peered":"2023-07-11T00:30:10.072474+0000","last_unstale":"2023-07-11T00:30:11.059619+0000","last_undegraded":"2023-07-11T00:30:11.059619+0000","last_fullsized":"2023-07-11T00:30:11.059619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:48:40.316132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059700+0000","last_change":"2023-07-11T00:30:04.908760+0000","last_active":"2023-07-11T00:30:11.059700+0000","last_peered":"2023-07-11T00:30:11.059700+0000","last_clean":"2023-07-11T00:30:11.059700+0000","last_became_active":"2023-07-11T00:30:04.908468+0000","last_became_peered":"2023-07-11T00:30:04.908468+0000","last_unstale":"2023-07-11T00:30:11.059700+0000","last_undegraded":"2023-07-11T00:30:11.059700+0000","last_fullsized":"2023-07-11T00:30:11.059700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:48:47.561149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119219+0000","last_change":"2023-07-11T00:30:05.915093+0000","last_active":"2023-07-11T00:30:11.119219+0000","last_peered":"2023-07-11T00:30:11.119219+0000","last_clean":"2023-07-11T00:30:11.119219+0000","last_became_active":"2023-07-11T00:30:05.914787+0000","last_became_peered":"2023-07-11T00:30:05.914787+0000","last_unstale":"2023-07-11T00:30:11.119219+0000","last_undegraded":"2023-07-11T00:30:11.119219+0000","last_fullsized":"2023-07-11T00:30:11.119219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:03:00.748490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058408+0000","last_change":"2023-07-11T00:30:10.068761+0000","last_active":"2023-07-11T00:30:11.058408+0000","last_peered":"2023-07-11T00:30:11.058408+0000","last_clean":"2023-07-11T00:30:11.058408+0000","last_became_active":"2023-07-11T00:30:10.068319+0000","last_became_peered":"2023-07-11T00:30:10.068319+0000","last_unstale":"2023-07-11T00:30:11.058408+0000","last_undegraded":"2023-07-11T00:30:11.058408+0000","last_fullsized":"2023-07-11T00:30:11.058408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:56:42.728305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116259+0000","last_change":"2023-07-11T00:30:04.901722+0000","last_active":"2023-07-11T00:30:11.116259+0000","last_peered":"2023-07-11T00:30:11.116259+0000","last_clean":"2023-07-11T00:30:11.116259+0000","last_became_active":"2023-07-11T00:30:04.901326+0000","last_became_peered":"2023-07-11T00:30:04.901326+0000","last_unstale":"2023-07-11T00:30:11.116259+0000","last_undegraded":"2023-07-11T00:30:11.116259+0000","last_fullsized":"2023-07-11T00:30:11.116259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:31:52.262271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058531+0000","last_change":"2023-07-11T00:30:05.908583+0000","last_active":"2023-07-11T00:30:11.058531+0000","last_peered":"2023-07-11T00:30:11.058531+0000","last_clean":"2023-07-11T00:30:11.058531+0000","last_became_active":"2023-07-11T00:30:05.908245+0000","last_became_peered":"2023-07-11T00:30:05.908245+0000","last_unstale":"2023-07-11T00:30:11.058531+0000","last_undegraded":"2023-07-11T00:30:11.058531+0000","last_fullsized":"2023-07-11T00:30:11.058531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:49:28.388344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058698+0000","last_change":"2023-07-11T00:30:10.083710+0000","last_active":"2023-07-11T00:30:11.058698+0000","last_peered":"2023-07-11T00:30:11.058698+0000","last_clean":"2023-07-11T00:30:11.058698+0000","last_became_active":"2023-07-11T00:30:10.080933+0000","last_became_peered":"2023-07-11T00:30:10.080933+0000","last_unstale":"2023-07-11T00:30:11.058698+0000","last_undegraded":"2023-07-11T00:30:11.058698+0000","last_fullsized":"2023-07-11T00:30:11.058698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:04.352361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119152+0000","last_change":"2023-07-11T00:30:04.904239+0000","last_active":"2023-07-11T00:30:11.119152+0000","last_peered":"2023-07-11T00:30:11.119152+0000","last_clean":"2023-07-11T00:30:11.119152+0000","last_became_active":"2023-07-11T00:30:04.903915+0000","last_became_peered":"2023-07-11T00:30:04.903915+0000","last_unstale":"2023-07-11T00:30:11.119152+0000","last_undegraded":"2023-07-11T00:30:11.119152+0000","last_fullsized":"2023-07-11T00:30:11.119152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:50:41.550137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.060203+0000","last_change":"2023-07-11T00:30:05.907358+0000","last_active":"2023-07-11T00:30:11.060203+0000","last_peered":"2023-07-11T00:30:11.060203+0000","last_clean":"2023-07-11T00:30:11.060203+0000","last_became_active":"2023-07-11T00:30:05.907064+0000","last_became_peered":"2023-07-11T00:30:05.907064+0000","last_unstale":"2023-07-11T00:30:11.060203+0000","last_undegraded":"2023-07-11T00:30:11.060203+0000","last_fullsized":"2023-07-11T00:30:11.060203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:59:37.703330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057571+0000","last_change":"2023-07-11T00:30:10.067504+0000","last_active":"2023-07-11T00:30:11.057571+0000","last_peered":"2023-07-11T00:30:11.057571+0000","last_clean":"2023-07-11T00:30:11.057571+0000","last_became_active":"2023-07-11T00:30:10.067052+0000","last_became_peered":"2023-07-11T00:30:10.067052+0000","last_unstale":"2023-07-11T00:30:11.057571+0000","last_undegraded":"2023-07-11T00:30:11.057571+0000","last_fullsized":"2023-07-11T00:30:11.057571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:41:42.919668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058647+0000","last_change":"2023-07-11T00:30:04.911263+0000","last_active":"2023-07-11T00:30:11.058647+0000","last_peered":"2023-07-11T00:30:11.058647+0000","last_clean":"2023-07-11T00:30:11.058647+0000","last_became_active":"2023-07-11T00:30:04.910905+0000","last_became_peered":"2023-07-11T00:30:04.910905+0000","last_unstale":"2023-07-11T00:30:11.058647+0000","last_undegraded":"2023-07-11T00:30:11.058647+0000","last_fullsized":"2023-07-11T00:30:11.058647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:02:20.279699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119100+0000","last_change":"2023-07-11T00:30:05.915099+0000","last_active":"2023-07-11T00:30:11.119100+0000","last_peered":"2023-07-11T00:30:11.119100+0000","last_clean":"2023-07-11T00:30:11.119100+0000","last_became_active":"2023-07-11T00:30:05.914735+0000","last_became_peered":"2023-07-11T00:30:05.914735+0000","last_unstale":"2023-07-11T00:30:11.119100+0000","last_undegraded":"2023-07-11T00:30:11.119100+0000","last_fullsized":"2023-07-11T00:30:11.119100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:48:48.563856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115732+0000","last_change":"2023-07-11T00:30:10.074010+0000","last_active":"2023-07-11T00:30:11.115732+0000","last_peered":"2023-07-11T00:30:11.115732+0000","last_clean":"2023-07-11T00:30:11.115732+0000","last_became_active":"2023-07-11T00:30:10.073513+0000","last_became_peered":"2023-07-11T00:30:10.073513+0000","last_unstale":"2023-07-11T00:30:11.115732+0000","last_undegraded":"2023-07-11T00:30:11.115732+0000","last_fullsized":"2023-07-11T00:30:11.115732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:49:36.751025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117132+0000","last_change":"2023-07-11T00:30:04.908900+0000","last_active":"2023-07-11T00:30:11.117132+0000","last_peered":"2023-07-11T00:30:11.117132+0000","last_clean":"2023-07-11T00:30:11.117132+0000","last_became_active":"2023-07-11T00:30:04.908536+0000","last_became_peered":"2023-07-11T00:30:04.908536+0000","last_unstale":"2023-07-11T00:30:11.117132+0000","last_undegraded":"2023-07-11T00:30:11.117132+0000","last_fullsized":"2023-07-11T00:30:11.117132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:02:49.585404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116540+0000","last_change":"2023-07-11T00:30:05.908015+0000","last_active":"2023-07-11T00:30:11.116540+0000","last_peered":"2023-07-11T00:30:11.116540+0000","last_clean":"2023-07-11T00:30:11.116540+0000","last_became_active":"2023-07-11T00:30:05.907689+0000","last_became_peered":"2023-07-11T00:30:05.907689+0000","last_unstale":"2023-07-11T00:30:11.116540+0000","last_undegraded":"2023-07-11T00:30:11.116540+0000","last_fullsized":"2023-07-11T00:30:11.116540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:07:38.432308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118369+0000","last_change":"2023-07-11T00:30:10.073042+0000","last_active":"2023-07-11T00:30:11.118369+0000","last_peered":"2023-07-11T00:30:11.118369+0000","last_clean":"2023-07-11T00:30:11.118369+0000","last_became_active":"2023-07-11T00:30:10.072755+0000","last_became_peered":"2023-07-11T00:30:10.072755+0000","last_unstale":"2023-07-11T00:30:11.118369+0000","last_undegraded":"2023-07-11T00:30:11.118369+0000","last_fullsized":"2023-07-11T00:30:11.118369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:25:51.347028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116329+0000","last_change":"2023-07-11T00:30:04.906158+0000","last_active":"2023-07-11T00:30:11.116329+0000","last_peered":"2023-07-11T00:30:11.116329+0000","last_clean":"2023-07-11T00:30:11.116329+0000","last_became_active":"2023-07-11T00:30:04.905839+0000","last_became_peered":"2023-07-11T00:30:04.905839+0000","last_unstale":"2023-07-11T00:30:11.116329+0000","last_undegraded":"2023-07-11T00:30:11.116329+0000","last_fullsized":"2023-07-11T00:30:11.116329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:07:37.429600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118929+0000","last_change":"2023-07-11T00:30:05.912619+0000","last_active":"2023-07-11T00:30:11.118929+0000","last_peered":"2023-07-11T00:30:11.118929+0000","last_clean":"2023-07-11T00:30:11.118929+0000","last_became_active":"2023-07-11T00:30:05.912180+0000","last_became_peered":"2023-07-11T00:30:05.912180+0000","last_unstale":"2023-07-11T00:30:11.118929+0000","last_undegraded":"2023-07-11T00:30:11.118929+0000","last_fullsized":"2023-07-11T00:30:11.118929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:37:25.278906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119122+0000","last_change":"2023-07-11T00:30:10.078408+0000","last_active":"2023-07-11T00:30:11.119122+0000","last_peered":"2023-07-11T00:30:11.119122+0000","last_clean":"2023-07-11T00:30:11.119122+0000","last_became_active":"2023-07-11T00:30:10.077825+0000","last_became_peered":"2023-07-11T00:30:10.077825+0000","last_unstale":"2023-07-11T00:30:11.119122+0000","last_undegraded":"2023-07-11T00:30:11.119122+0000","last_fullsized":"2023-07-11T00:30:11.119122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:08:09.069684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'10","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:24.732814+0000","last_change":"2023-07-11T00:30:04.907926+0000","last_active":"2023-07-11T00:30:24.732814+0000","last_peered":"2023-07-11T00:30:24.732814+0000","last_clean":"2023-07-11T00:30:24.732814+0000","last_became_active":"2023-07-11T00:30:04.907603+0000","last_became_peered":"2023-07-11T00:30:04.907603+0000","last_unstale":"2023-07-11T00:30:24.732814+0000","last_undegraded":"2023-07-11T00:30:24.732814+0000","last_fullsized":"2023-07-11T00:30:24.732814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:35:34.386824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058562+0000","last_change":"2023-07-11T00:30:05.911101+0000","last_active":"2023-07-11T00:30:11.058562+0000","last_peered":"2023-07-11T00:30:11.058562+0000","last_clean":"2023-07-11T00:30:11.058562+0000","last_became_active":"2023-07-11T00:30:05.909430+0000","last_became_peered":"2023-07-11T00:30:05.909430+0000","last_unstale":"2023-07-11T00:30:11.058562+0000","last_undegraded":"2023-07-11T00:30:11.058562+0000","last_fullsized":"2023-07-11T00:30:11.058562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:07:38.432308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116172+0000","last_change":"2023-07-11T00:30:10.081247+0000","last_active":"2023-07-11T00:30:11.116172+0000","last_peered":"2023-07-11T00:30:11.116172+0000","last_clean":"2023-07-11T00:30:11.116172+0000","last_became_active":"2023-07-11T00:30:10.080796+0000","last_became_peered":"2023-07-11T00:30:10.080796+0000","last_unstale":"2023-07-11T00:30:11.116172+0000","last_undegraded":"2023-07-11T00:30:11.116172+0000","last_fullsized":"2023-07-11T00:30:11.116172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:05:35.713240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116102+0000","last_change":"2023-07-11T00:30:04.914310+0000","last_active":"2023-07-11T00:30:11.116102+0000","last_peered":"2023-07-11T00:30:11.116102+0000","last_clean":"2023-07-11T00:30:11.116102+0000","last_became_active":"2023-07-11T00:30:04.913972+0000","last_became_peered":"2023-07-11T00:30:04.913972+0000","last_unstale":"2023-07-11T00:30:11.116102+0000","last_undegraded":"2023-07-11T00:30:11.116102+0000","last_fullsized":"2023-07-11T00:30:11.116102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:51:41.689821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116886+0000","last_change":"2023-07-11T00:30:05.917159+0000","last_active":"2023-07-11T00:30:11.116886+0000","last_peered":"2023-07-11T00:30:11.116886+0000","last_clean":"2023-07-11T00:30:11.116886+0000","last_became_active":"2023-07-11T00:30:05.916849+0000","last_became_peered":"2023-07-11T00:30:05.916849+0000","last_unstale":"2023-07-11T00:30:11.116886+0000","last_undegraded":"2023-07-11T00:30:11.116886+0000","last_fullsized":"2023-07-11T00:30:11.116886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:09:26.818205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117167+0000","last_change":"2023-07-11T00:30:10.068364+0000","last_active":"2023-07-11T00:30:11.117167+0000","last_peered":"2023-07-11T00:30:11.117167+0000","last_clean":"2023-07-11T00:30:11.117167+0000","last_became_active":"2023-07-11T00:30:10.066791+0000","last_became_peered":"2023-07-11T00:30:10.066791+0000","last_unstale":"2023-07-11T00:30:11.117167+0000","last_undegraded":"2023-07-11T00:30:11.117167+0000","last_fullsized":"2023-07-11T00:30:11.117167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:23:00.417735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058112+0000","last_change":"2023-07-11T00:30:04.912548+0000","last_active":"2023-07-11T00:30:11.058112+0000","last_peered":"2023-07-11T00:30:11.058112+0000","last_clean":"2023-07-11T00:30:11.058112+0000","last_became_active":"2023-07-11T00:30:04.912228+0000","last_became_peered":"2023-07-11T00:30:04.912228+0000","last_unstale":"2023-07-11T00:30:11.058112+0000","last_undegraded":"2023-07-11T00:30:11.058112+0000","last_fullsized":"2023-07-11T00:30:11.058112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:00:49.062375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116712+0000","last_change":"2023-07-11T00:30:05.907171+0000","last_active":"2023-07-11T00:30:11.116712+0000","last_peered":"2023-07-11T00:30:11.116712+0000","last_clean":"2023-07-11T00:30:11.116712+0000","last_became_active":"2023-07-11T00:30:05.906862+0000","last_became_peered":"2023-07-11T00:30:05.906862+0000","last_unstale":"2023-07-11T00:30:11.116712+0000","last_undegraded":"2023-07-11T00:30:11.116712+0000","last_fullsized":"2023-07-11T00:30:11.116712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:31:07.229483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117405+0000","last_change":"2023-07-11T00:30:10.073795+0000","last_active":"2023-07-11T00:30:11.117405+0000","last_peered":"2023-07-11T00:30:11.117405+0000","last_clean":"2023-07-11T00:30:11.117405+0000","last_became_active":"2023-07-11T00:30:10.073437+0000","last_became_peered":"2023-07-11T00:30:10.073437+0000","last_unstale":"2023-07-11T00:30:11.117405+0000","last_undegraded":"2023-07-11T00:30:11.117405+0000","last_fullsized":"2023-07-11T00:30:11.117405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:35:39.542213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116190+0000","last_change":"2023-07-11T00:30:04.913583+0000","last_active":"2023-07-11T00:30:11.116190+0000","last_peered":"2023-07-11T00:30:11.116190+0000","last_clean":"2023-07-11T00:30:11.116190+0000","last_became_active":"2023-07-11T00:30:04.913217+0000","last_became_peered":"2023-07-11T00:30:04.913217+0000","last_unstale":"2023-07-11T00:30:11.116190+0000","last_undegraded":"2023-07-11T00:30:11.116190+0000","last_fullsized":"2023-07-11T00:30:11.116190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:02:49.585404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058792+0000","last_change":"2023-07-11T00:30:05.904820+0000","last_active":"2023-07-11T00:30:11.058792+0000","last_peered":"2023-07-11T00:30:11.058792+0000","last_clean":"2023-07-11T00:30:11.058792+0000","last_became_active":"2023-07-11T00:30:05.904502+0000","last_became_peered":"2023-07-11T00:30:05.904502+0000","last_unstale":"2023-07-11T00:30:11.058792+0000","last_undegraded":"2023-07-11T00:30:11.058792+0000","last_fullsized":"2023-07-11T00:30:11.058792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:49:32.598344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116686+0000","last_change":"2023-07-11T00:30:10.072170+0000","last_active":"2023-07-11T00:30:11.116686+0000","last_peered":"2023-07-11T00:30:11.116686+0000","last_clean":"2023-07-11T00:30:11.116686+0000","last_became_active":"2023-07-11T00:30:10.071764+0000","last_became_peered":"2023-07-11T00:30:10.071764+0000","last_unstale":"2023-07-11T00:30:11.116686+0000","last_undegraded":"2023-07-11T00:30:11.116686+0000","last_fullsized":"2023-07-11T00:30:11.116686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:19:04.827674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057318+0000","last_change":"2023-07-11T00:30:04.910630+0000","last_active":"2023-07-11T00:30:11.057318+0000","last_peered":"2023-07-11T00:30:11.057318+0000","last_clean":"2023-07-11T00:30:11.057318+0000","last_became_active":"2023-07-11T00:30:04.910150+0000","last_became_peered":"2023-07-11T00:30:04.910150+0000","last_unstale":"2023-07-11T00:30:11.057318+0000","last_undegraded":"2023-07-11T00:30:11.057318+0000","last_fullsized":"2023-07-11T00:30:11.057318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:14:23.274160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117798+0000","last_change":"2023-07-11T00:30:05.907668+0000","last_active":"2023-07-11T00:30:11.117798+0000","last_peered":"2023-07-11T00:30:11.117798+0000","last_clean":"2023-07-11T00:30:11.117798+0000","last_became_active":"2023-07-11T00:30:05.907397+0000","last_became_peered":"2023-07-11T00:30:05.907397+0000","last_unstale":"2023-07-11T00:30:11.117798+0000","last_undegraded":"2023-07-11T00:30:11.117798+0000","last_fullsized":"2023-07-11T00:30:11.117798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:50:20.512890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116720+0000","last_change":"2023-07-11T00:30:10.070415+0000","last_active":"2023-07-11T00:30:11.116720+0000","last_peered":"2023-07-11T00:30:11.116720+0000","last_clean":"2023-07-11T00:30:11.116720+0000","last_became_active":"2023-07-11T00:30:10.069906+0000","last_became_peered":"2023-07-11T00:30:10.069906+0000","last_unstale":"2023-07-11T00:30:11.116720+0000","last_undegraded":"2023-07-11T00:30:11.116720+0000","last_fullsized":"2023-07-11T00:30:11.116720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:57.996558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117336+0000","last_change":"2023-07-11T00:30:04.910800+0000","last_active":"2023-07-11T00:30:11.117336+0000","last_peered":"2023-07-11T00:30:11.117336+0000","last_clean":"2023-07-11T00:30:11.117336+0000","last_became_active":"2023-07-11T00:30:04.910453+0000","last_became_peered":"2023-07-11T00:30:04.910453+0000","last_unstale":"2023-07-11T00:30:11.117336+0000","last_undegraded":"2023-07-11T00:30:11.117336+0000","last_fullsized":"2023-07-11T00:30:11.117336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:38.027150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116206+0000","last_change":"2023-07-11T00:30:05.908168+0000","last_active":"2023-07-11T00:30:11.116206+0000","last_peered":"2023-07-11T00:30:11.116206+0000","last_clean":"2023-07-11T00:30:11.116206+0000","last_became_active":"2023-07-11T00:30:05.907884+0000","last_became_peered":"2023-07-11T00:30:05.907884+0000","last_unstale":"2023-07-11T00:30:11.116206+0000","last_undegraded":"2023-07-11T00:30:11.116206+0000","last_fullsized":"2023-07-11T00:30:11.116206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:00.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117337+0000","last_change":"2023-07-11T00:30:10.074726+0000","last_active":"2023-07-11T00:30:11.117337+0000","last_peered":"2023-07-11T00:30:11.117337+0000","last_clean":"2023-07-11T00:30:11.117337+0000","last_became_active":"2023-07-11T00:30:10.074281+0000","last_became_peered":"2023-07-11T00:30:10.074281+0000","last_unstale":"2023-07-11T00:30:11.117337+0000","last_undegraded":"2023-07-11T00:30:11.117337+0000","last_fullsized":"2023-07-11T00:30:11.117337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:50:00.072430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117143+0000","last_change":"2023-07-11T00:30:04.913460+0000","last_active":"2023-07-11T00:30:11.117143+0000","last_peered":"2023-07-11T00:30:11.117143+0000","last_clean":"2023-07-11T00:30:11.117143+0000","last_became_active":"2023-07-11T00:30:04.913131+0000","last_became_peered":"2023-07-11T00:30:04.913131+0000","last_unstale":"2023-07-11T00:30:11.117143+0000","last_undegraded":"2023-07-11T00:30:11.117143+0000","last_fullsized":"2023-07-11T00:30:11.117143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:09:25.815497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059267+0000","last_change":"2023-07-11T00:30:05.919028+0000","last_active":"2023-07-11T00:30:11.059267+0000","last_peered":"2023-07-11T00:30:11.059267+0000","last_clean":"2023-07-11T00:30:11.059267+0000","last_became_active":"2023-07-11T00:30:05.918727+0000","last_became_peered":"2023-07-11T00:30:05.918727+0000","last_unstale":"2023-07-11T00:30:11.059267+0000","last_undegraded":"2023-07-11T00:30:11.059267+0000","last_fullsized":"2023-07-11T00:30:11.059267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:22:04.654770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118792+0000","last_change":"2023-07-11T00:30:10.076696+0000","last_active":"2023-07-11T00:30:11.118792+0000","last_peered":"2023-07-11T00:30:11.118792+0000","last_clean":"2023-07-11T00:30:11.118792+0000","last_became_active":"2023-07-11T00:30:10.074714+0000","last_became_peered":"2023-07-11T00:30:10.074714+0000","last_unstale":"2023-07-11T00:30:11.118792+0000","last_undegraded":"2023-07-11T00:30:11.118792+0000","last_fullsized":"2023-07-11T00:30:11.118792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:53:44.062751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116091+0000","last_change":"2023-07-11T00:30:04.918352+0000","last_active":"2023-07-11T00:30:11.116091+0000","last_peered":"2023-07-11T00:30:11.116091+0000","last_clean":"2023-07-11T00:30:11.116091+0000","last_became_active":"2023-07-11T00:30:04.918037+0000","last_became_peered":"2023-07-11T00:30:04.918037+0000","last_unstale":"2023-07-11T00:30:11.116091+0000","last_undegraded":"2023-07-11T00:30:11.116091+0000","last_fullsized":"2023-07-11T00:30:11.116091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:33:45.867117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057432+0000","last_change":"2023-07-11T00:30:05.919328+0000","last_active":"2023-07-11T00:30:11.057432+0000","last_peered":"2023-07-11T00:30:11.057432+0000","last_clean":"2023-07-11T00:30:11.057432+0000","last_became_active":"2023-07-11T00:30:05.919010+0000","last_became_peered":"2023-07-11T00:30:05.919010+0000","last_unstale":"2023-07-11T00:30:11.057432+0000","last_undegraded":"2023-07-11T00:30:11.057432+0000","last_fullsized":"2023-07-11T00:30:11.057432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:11:39.510221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116515+0000","last_change":"2023-07-11T00:30:10.061029+0000","last_active":"2023-07-11T00:30:11.116515+0000","last_peered":"2023-07-11T00:30:11.116515+0000","last_clean":"2023-07-11T00:30:11.116515+0000","last_became_active":"2023-07-11T00:30:10.060602+0000","last_became_peered":"2023-07-11T00:30:10.060602+0000","last_unstale":"2023-07-11T00:30:11.116515+0000","last_undegraded":"2023-07-11T00:30:11.116515+0000","last_fullsized":"2023-07-11T00:30:11.116515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:09:45.109946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116660+0000","last_change":"2023-07-11T00:30:04.907017+0000","last_active":"2023-07-11T00:30:11.116660+0000","last_peered":"2023-07-11T00:30:11.116660+0000","last_clean":"2023-07-11T00:30:11.116660+0000","last_became_active":"2023-07-11T00:30:04.906643+0000","last_became_peered":"2023-07-11T00:30:04.906643+0000","last_unstale":"2023-07-11T00:30:11.116660+0000","last_undegraded":"2023-07-11T00:30:11.116660+0000","last_fullsized":"2023-07-11T00:30:11.116660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:59:35.767800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058314+0000","last_change":"2023-07-11T00:30:05.917921+0000","last_active":"2023-07-11T00:30:11.058314+0000","last_peered":"2023-07-11T00:30:11.058314+0000","last_clean":"2023-07-11T00:30:11.058314+0000","last_became_active":"2023-07-11T00:30:05.917626+0000","last_became_peered":"2023-07-11T00:30:05.917626+0000","last_unstale":"2023-07-11T00:30:11.058314+0000","last_undegraded":"2023-07-11T00:30:11.058314+0000","last_fullsized":"2023-07-11T00:30:11.058314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:56:13.450429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117705+0000","last_change":"2023-07-11T00:30:10.074654+0000","last_active":"2023-07-11T00:30:11.117705+0000","last_peered":"2023-07-11T00:30:11.117705+0000","last_clean":"2023-07-11T00:30:11.117705+0000","last_became_active":"2023-07-11T00:30:10.071607+0000","last_became_peered":"2023-07-11T00:30:10.071607+0000","last_unstale":"2023-07-11T00:30:11.117705+0000","last_undegraded":"2023-07-11T00:30:11.117705+0000","last_fullsized":"2023-07-11T00:30:11.117705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:03:08.156374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118186+0000","last_change":"2023-07-11T00:30:04.909409+0000","last_active":"2023-07-11T00:30:11.118186+0000","last_peered":"2023-07-11T00:30:11.118186+0000","last_clean":"2023-07-11T00:30:11.118186+0000","last_became_active":"2023-07-11T00:30:04.909108+0000","last_became_peered":"2023-07-11T00:30:04.909108+0000","last_unstale":"2023-07-11T00:30:11.118186+0000","last_undegraded":"2023-07-11T00:30:11.118186+0000","last_fullsized":"2023-07-11T00:30:11.118186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:22:03.652063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058847+0000","last_change":"2023-07-11T00:30:05.915428+0000","last_active":"2023-07-11T00:30:11.058847+0000","last_peered":"2023-07-11T00:30:11.058847+0000","last_clean":"2023-07-11T00:30:11.058847+0000","last_became_active":"2023-07-11T00:30:05.914309+0000","last_became_peered":"2023-07-11T00:30:05.914309+0000","last_unstale":"2023-07-11T00:30:11.058847+0000","last_undegraded":"2023-07-11T00:30:11.058847+0000","last_fullsized":"2023-07-11T00:30:11.058847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:39.029858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117114+0000","last_change":"2023-07-11T00:30:10.070740+0000","last_active":"2023-07-11T00:30:11.117114+0000","last_peered":"2023-07-11T00:30:11.117114+0000","last_clean":"2023-07-11T00:30:11.117114+0000","last_became_active":"2023-07-11T00:30:10.070140+0000","last_became_peered":"2023-07-11T00:30:10.070140+0000","last_unstale":"2023-07-11T00:30:11.117114+0000","last_undegraded":"2023-07-11T00:30:11.117114+0000","last_fullsized":"2023-07-11T00:30:11.117114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:07:59.464538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057584+0000","last_change":"2023-07-11T00:30:04.912890+0000","last_active":"2023-07-11T00:30:11.057584+0000","last_peered":"2023-07-11T00:30:11.057584+0000","last_clean":"2023-07-11T00:30:11.057584+0000","last_became_active":"2023-07-11T00:30:04.912603+0000","last_became_peered":"2023-07-11T00:30:04.912603+0000","last_unstale":"2023-07-11T00:30:11.057584+0000","last_undegraded":"2023-07-11T00:30:11.057584+0000","last_fullsized":"2023-07-11T00:30:11.057584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:33:16.183321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058428+0000","last_change":"2023-07-11T00:30:05.914876+0000","last_active":"2023-07-11T00:30:11.058428+0000","last_peered":"2023-07-11T00:30:11.058428+0000","last_clean":"2023-07-11T00:30:11.058428+0000","last_became_active":"2023-07-11T00:30:05.914556+0000","last_became_peered":"2023-07-11T00:30:05.914556+0000","last_unstale":"2023-07-11T00:30:11.058428+0000","last_undegraded":"2023-07-11T00:30:11.058428+0000","last_fullsized":"2023-07-11T00:30:11.058428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:01:38.063704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117150+0000","last_change":"2023-07-11T00:30:10.070879+0000","last_active":"2023-07-11T00:30:11.117150+0000","last_peered":"2023-07-11T00:30:11.117150+0000","last_clean":"2023-07-11T00:30:11.117150+0000","last_became_active":"2023-07-11T00:30:10.070373+0000","last_became_peered":"2023-07-11T00:30:10.070373+0000","last_unstale":"2023-07-11T00:30:11.117150+0000","last_undegraded":"2023-07-11T00:30:11.117150+0000","last_fullsized":"2023-07-11T00:30:11.117150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:51:46.845210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058991+0000","last_change":"2023-07-11T00:30:04.914965+0000","last_active":"2023-07-11T00:30:11.058991+0000","last_peered":"2023-07-11T00:30:11.058991+0000","last_clean":"2023-07-11T00:30:11.058991+0000","last_became_active":"2023-07-11T00:30:04.914499+0000","last_became_peered":"2023-07-11T00:30:04.914499+0000","last_unstale":"2023-07-11T00:30:11.058991+0000","last_undegraded":"2023-07-11T00:30:11.058991+0000","last_fullsized":"2023-07-11T00:30:11.058991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:29:02.495865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059980+0000","last_change":"2023-07-11T00:30:05.910772+0000","last_active":"2023-07-11T00:30:11.059980+0000","last_peered":"2023-07-11T00:30:11.059980+0000","last_clean":"2023-07-11T00:30:11.059980+0000","last_became_active":"2023-07-11T00:30:05.909373+0000","last_became_peered":"2023-07-11T00:30:05.909373+0000","last_unstale":"2023-07-11T00:30:11.059980+0000","last_undegraded":"2023-07-11T00:30:11.059980+0000","last_fullsized":"2023-07-11T00:30:11.059980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:39:38.348755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059752+0000","last_change":"2023-07-11T00:30:10.080512+0000","last_active":"2023-07-11T00:30:11.059752+0000","last_peered":"2023-07-11T00:30:11.059752+0000","last_clean":"2023-07-11T00:30:11.059752+0000","last_became_active":"2023-07-11T00:30:10.080095+0000","last_became_peered":"2023-07-11T00:30:10.080095+0000","last_unstale":"2023-07-11T00:30:11.059752+0000","last_undegraded":"2023-07-11T00:30:11.059752+0000","last_fullsized":"2023-07-11T00:30:11.059752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:50:46.705526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119006+0000","last_change":"2023-07-11T00:30:04.901845+0000","last_active":"2023-07-11T00:30:11.119006+0000","last_peered":"2023-07-11T00:30:11.119006+0000","last_clean":"2023-07-11T00:30:11.119006+0000","last_became_active":"2023-07-11T00:30:04.901568+0000","last_became_peered":"2023-07-11T00:30:04.901568+0000","last_unstale":"2023-07-11T00:30:11.119006+0000","last_undegraded":"2023-07-11T00:30:11.119006+0000","last_fullsized":"2023-07-11T00:30:11.119006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:48:35.160743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118215+0000","last_change":"2023-07-11T00:30:05.921748+0000","last_active":"2023-07-11T00:30:11.118215+0000","last_peered":"2023-07-11T00:30:11.118215+0000","last_clean":"2023-07-11T00:30:11.118215+0000","last_became_active":"2023-07-11T00:30:05.921455+0000","last_became_peered":"2023-07-11T00:30:05.921455+0000","last_unstale":"2023-07-11T00:30:11.118215+0000","last_undegraded":"2023-07-11T00:30:11.118215+0000","last_fullsized":"2023-07-11T00:30:11.118215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:49:28.388344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059460+0000","last_change":"2023-07-11T00:30:10.067600+0000","last_active":"2023-07-11T00:30:11.059460+0000","last_peered":"2023-07-11T00:30:11.059460+0000","last_clean":"2023-07-11T00:30:11.059460+0000","last_became_active":"2023-07-11T00:30:10.067214+0000","last_became_peered":"2023-07-11T00:30:10.067214+0000","last_unstale":"2023-07-11T00:30:11.059460+0000","last_undegraded":"2023-07-11T00:30:11.059460+0000","last_fullsized":"2023-07-11T00:30:11.059460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:16:23.912787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117616+0000","last_change":"2023-07-11T00:30:04.904613+0000","last_active":"2023-07-11T00:30:11.117616+0000","last_peered":"2023-07-11T00:30:11.117616+0000","last_clean":"2023-07-11T00:30:11.117616+0000","last_became_active":"2023-07-11T00:30:04.904312+0000","last_became_peered":"2023-07-11T00:30:04.904312+0000","last_unstale":"2023-07-11T00:30:11.117616+0000","last_undegraded":"2023-07-11T00:30:11.117616+0000","last_fullsized":"2023-07-11T00:30:11.117616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:29:02.495865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058655+0000","last_change":"2023-07-11T00:29:59.627086+0000","last_active":"2023-07-11T00:30:11.058655+0000","last_peered":"2023-07-11T00:30:11.058655+0000","last_clean":"2023-07-11T00:30:11.058655+0000","last_became_active":"2023-07-11T00:29:59.626687+0000","last_became_peered":"2023-07-11T00:29:59.626687+0000","last_unstale":"2023-07-11T00:30:11.058655+0000","last_undegraded":"2023-07-11T00:30:11.058655+0000","last_fullsized":"2023-07-11T00:30:11.058655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:31:04.583322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118938+0000","last_change":"2023-07-11T00:30:05.906700+0000","last_active":"2023-07-11T00:30:11.118938+0000","last_peered":"2023-07-11T00:30:11.118938+0000","last_clean":"2023-07-11T00:30:11.118938+0000","last_became_active":"2023-07-11T00:30:05.906333+0000","last_became_peered":"2023-07-11T00:30:05.906333+0000","last_unstale":"2023-07-11T00:30:11.118938+0000","last_undegraded":"2023-07-11T00:30:11.118938+0000","last_fullsized":"2023-07-11T00:30:11.118938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:12:42.514924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118845+0000","last_change":"2023-07-11T00:30:10.068326+0000","last_active":"2023-07-11T00:30:11.118845+0000","last_peered":"2023-07-11T00:30:11.118845+0000","last_clean":"2023-07-11T00:30:11.118845+0000","last_became_active":"2023-07-11T00:30:10.067893+0000","last_became_peered":"2023-07-11T00:30:10.067893+0000","last_unstale":"2023-07-11T00:30:11.118845+0000","last_undegraded":"2023-07-11T00:30:11.118845+0000","last_fullsized":"2023-07-11T00:30:11.118845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:16:23.912787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116953+0000","last_change":"2023-07-11T00:29:59.589317+0000","last_active":"2023-07-11T00:30:11.116953+0000","last_peered":"2023-07-11T00:30:11.116953+0000","last_clean":"2023-07-11T00:30:11.116953+0000","last_became_active":"2023-07-11T00:29:59.588926+0000","last_became_peered":"2023-07-11T00:29:59.588926+0000","last_unstale":"2023-07-11T00:30:11.116953+0000","last_undegraded":"2023-07-11T00:30:11.116953+0000","last_fullsized":"2023-07-11T00:30:11.116953+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:32.725207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058442+0000","last_change":"2023-07-11T00:30:04.907209+0000","last_active":"2023-07-11T00:30:11.058442+0000","last_peered":"2023-07-11T00:30:11.058442+0000","last_clean":"2023-07-11T00:30:11.058442+0000","last_became_active":"2023-07-11T00:30:04.906867+0000","last_became_peered":"2023-07-11T00:30:04.906867+0000","last_unstale":"2023-07-11T00:30:11.058442+0000","last_undegraded":"2023-07-11T00:30:11.058442+0000","last_fullsized":"2023-07-11T00:30:11.058442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:23:05.032572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059163+0000","last_change":"2023-07-11T00:30:05.917328+0000","last_active":"2023-07-11T00:30:11.059163+0000","last_peered":"2023-07-11T00:30:11.059163+0000","last_clean":"2023-07-11T00:30:11.059163+0000","last_became_active":"2023-07-11T00:30:05.916946+0000","last_became_peered":"2023-07-11T00:30:05.916946+0000","last_unstale":"2023-07-11T00:30:11.059163+0000","last_undegraded":"2023-07-11T00:30:11.059163+0000","last_fullsized":"2023-07-11T00:30:11.059163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:13:25.822286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117049+0000","last_change":"2023-07-11T00:30:10.082010+0000","last_active":"2023-07-11T00:30:11.117049+0000","last_peered":"2023-07-11T00:30:11.117049+0000","last_clean":"2023-07-11T00:30:11.117049+0000","last_became_active":"2023-07-11T00:30:10.081582+0000","last_became_peered":"2023-07-11T00:30:10.081582+0000","last_unstale":"2023-07-11T00:30:11.117049+0000","last_undegraded":"2023-07-11T00:30:11.117049+0000","last_fullsized":"2023-07-11T00:30:11.117049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:33:51.022506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118518+0000","last_change":"2023-07-11T00:29:59.585672+0000","last_active":"2023-07-11T00:30:11.118518+0000","last_peered":"2023-07-11T00:30:11.118518+0000","last_clean":"2023-07-11T00:30:11.118518+0000","last_became_active":"2023-07-11T00:29:59.585405+0000","last_became_peered":"2023-07-11T00:29:59.585405+0000","last_unstale":"2023-07-11T00:30:11.118518+0000","last_undegraded":"2023-07-11T00:30:11.118518+0000","last_fullsized":"2023-07-11T00:30:11.118518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:16:53.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115934+0000","last_change":"2023-07-11T00:29:59.589132+0000","last_active":"2023-07-11T00:30:11.115934+0000","last_peered":"2023-07-11T00:30:11.115934+0000","last_clean":"2023-07-11T00:30:11.115934+0000","last_became_active":"2023-07-11T00:29:59.588293+0000","last_became_peered":"2023-07-11T00:29:59.588293+0000","last_unstale":"2023-07-11T00:30:11.115934+0000","last_undegraded":"2023-07-11T00:30:11.115934+0000","last_fullsized":"2023-07-11T00:30:11.115934+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:36:10.586940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057956+0000","last_change":"2023-07-11T00:30:04.913946+0000","last_active":"2023-07-11T00:30:11.057956+0000","last_peered":"2023-07-11T00:30:11.057956+0000","last_clean":"2023-07-11T00:30:11.057956+0000","last_became_active":"2023-07-11T00:30:04.913711+0000","last_became_peered":"2023-07-11T00:30:04.913711+0000","last_unstale":"2023-07-11T00:30:11.057956+0000","last_undegraded":"2023-07-11T00:30:11.057956+0000","last_fullsized":"2023-07-11T00:30:11.057956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:59:36.700622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058778+0000","last_change":"2023-07-11T00:30:05.918327+0000","last_active":"2023-07-11T00:30:11.058778+0000","last_peered":"2023-07-11T00:30:11.058778+0000","last_clean":"2023-07-11T00:30:11.058778+0000","last_became_active":"2023-07-11T00:30:05.917953+0000","last_became_peered":"2023-07-11T00:30:05.917953+0000","last_unstale":"2023-07-11T00:30:11.058778+0000","last_undegraded":"2023-07-11T00:30:11.058778+0000","last_fullsized":"2023-07-11T00:30:11.058778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:44:29.464142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116829+0000","last_change":"2023-07-11T00:30:10.073421+0000","last_active":"2023-07-11T00:30:11.116829+0000","last_peered":"2023-07-11T00:30:11.116829+0000","last_clean":"2023-07-11T00:30:11.116829+0000","last_became_active":"2023-07-11T00:30:10.073124+0000","last_became_peered":"2023-07-11T00:30:10.073124+0000","last_unstale":"2023-07-11T00:30:11.116829+0000","last_undegraded":"2023-07-11T00:30:11.116829+0000","last_fullsized":"2023-07-11T00:30:11.116829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:42:54.748014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115890+0000","last_change":"2023-07-11T00:29:59.978997+0000","last_active":"2023-07-11T00:30:11.115890+0000","last_peered":"2023-07-11T00:30:11.115890+0000","last_clean":"2023-07-11T00:30:11.115890+0000","last_became_active":"2023-07-11T00:29:59.978716+0000","last_became_peered":"2023-07-11T00:29:59.978716+0000","last_unstale":"2023-07-11T00:30:11.115890+0000","last_undegraded":"2023-07-11T00:30:11.115890+0000","last_fullsized":"2023-07-11T00:30:11.115890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:43:49.863623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116128+0000","last_change":"2023-07-11T00:30:04.910937+0000","last_active":"2023-07-11T00:30:11.116128+0000","last_peered":"2023-07-11T00:30:11.116128+0000","last_clean":"2023-07-11T00:30:11.116128+0000","last_became_active":"2023-07-11T00:30:04.910458+0000","last_became_peered":"2023-07-11T00:30:04.910458+0000","last_unstale":"2023-07-11T00:30:11.116128+0000","last_undegraded":"2023-07-11T00:30:11.116128+0000","last_fullsized":"2023-07-11T00:30:11.116128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:59:36.700622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118101+0000","last_change":"2023-07-11T00:30:05.914883+0000","last_active":"2023-07-11T00:30:11.118101+0000","last_peered":"2023-07-11T00:30:11.118101+0000","last_clean":"2023-07-11T00:30:11.118101+0000","last_became_active":"2023-07-11T00:30:05.914349+0000","last_became_peered":"2023-07-11T00:30:05.914349+0000","last_unstale":"2023-07-11T00:30:11.118101+0000","last_undegraded":"2023-07-11T00:30:11.118101+0000","last_fullsized":"2023-07-11T00:30:11.118101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:32:58.816922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117060+0000","last_change":"2023-07-11T00:30:10.074427+0000","last_active":"2023-07-11T00:30:11.117060+0000","last_peered":"2023-07-11T00:30:11.117060+0000","last_clean":"2023-07-11T00:30:11.117060+0000","last_became_active":"2023-07-11T00:30:10.073876+0000","last_became_peered":"2023-07-11T00:30:10.073876+0000","last_unstale":"2023-07-11T00:30:11.117060+0000","last_undegraded":"2023-07-11T00:30:11.117060+0000","last_fullsized":"2023-07-11T00:30:11.117060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:31:15.040654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115771+0000","last_change":"2023-07-11T00:29:59.978976+0000","last_active":"2023-07-11T00:30:11.115771+0000","last_peered":"2023-07-11T00:30:11.115771+0000","last_clean":"2023-07-11T00:30:11.115771+0000","last_became_active":"2023-07-11T00:29:59.978678+0000","last_became_peered":"2023-07-11T00:29:59.978678+0000","last_unstale":"2023-07-11T00:30:11.115771+0000","last_undegraded":"2023-07-11T00:30:11.115771+0000","last_fullsized":"2023-07-11T00:30:11.115771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:54.370342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118862+0000","last_change":"2023-07-11T00:30:04.909677+0000","last_active":"2023-07-11T00:30:11.118862+0000","last_peered":"2023-07-11T00:30:11.118862+0000","last_clean":"2023-07-11T00:30:11.118862+0000","last_became_active":"2023-07-11T00:30:04.909389+0000","last_became_peered":"2023-07-11T00:30:04.909389+0000","last_unstale":"2023-07-11T00:30:11.118862+0000","last_undegraded":"2023-07-11T00:30:11.118862+0000","last_fullsized":"2023-07-11T00:30:11.118862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:41:27.161304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058572+0000","last_change":"2023-07-11T00:30:05.921943+0000","last_active":"2023-07-11T00:30:11.058572+0000","last_peered":"2023-07-11T00:30:11.058572+0000","last_clean":"2023-07-11T00:30:11.058572+0000","last_became_active":"2023-07-11T00:30:05.921610+0000","last_became_peered":"2023-07-11T00:30:05.921610+0000","last_unstale":"2023-07-11T00:30:11.058572+0000","last_undegraded":"2023-07-11T00:30:11.058572+0000","last_fullsized":"2023-07-11T00:30:11.058572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:34:52.723278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058455+0000","last_change":"2023-07-11T00:30:10.073091+0000","last_active":"2023-07-11T00:30:11.058455+0000","last_peered":"2023-07-11T00:30:11.058455+0000","last_clean":"2023-07-11T00:30:11.058455+0000","last_became_active":"2023-07-11T00:30:10.072625+0000","last_became_peered":"2023-07-11T00:30:10.072625+0000","last_unstale":"2023-07-11T00:30:11.058455+0000","last_undegraded":"2023-07-11T00:30:11.058455+0000","last_fullsized":"2023-07-11T00:30:11.058455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:56:33.500478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116185+0000","last_change":"2023-07-11T00:29:59.979163+0000","last_active":"2023-07-11T00:30:11.116185+0000","last_peered":"2023-07-11T00:30:11.116185+0000","last_clean":"2023-07-11T00:30:11.116185+0000","last_became_active":"2023-07-11T00:29:59.978751+0000","last_became_peered":"2023-07-11T00:29:59.978751+0000","last_unstale":"2023-07-11T00:30:11.116185+0000","last_undegraded":"2023-07-11T00:30:11.116185+0000","last_fullsized":"2023-07-11T00:30:11.116185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:32:52.512271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058712+0000","last_change":"2023-07-11T00:30:04.909467+0000","last_active":"2023-07-11T00:30:11.058712+0000","last_peered":"2023-07-11T00:30:11.058712+0000","last_clean":"2023-07-11T00:30:11.058712+0000","last_became_active":"2023-07-11T00:30:04.908512+0000","last_became_peered":"2023-07-11T00:30:04.908512+0000","last_unstale":"2023-07-11T00:30:11.058712+0000","last_undegraded":"2023-07-11T00:30:11.058712+0000","last_fullsized":"2023-07-11T00:30:11.058712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:09:25.815497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116448+0000","last_change":"2023-07-11T00:30:05.915403+0000","last_active":"2023-07-11T00:30:11.116448+0000","last_peered":"2023-07-11T00:30:11.116448+0000","last_clean":"2023-07-11T00:30:11.116448+0000","last_became_active":"2023-07-11T00:30:05.915006+0000","last_became_peered":"2023-07-11T00:30:05.915006+0000","last_unstale":"2023-07-11T00:30:11.116448+0000","last_undegraded":"2023-07-11T00:30:11.116448+0000","last_fullsized":"2023-07-11T00:30:11.116448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:00:50.065083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057855+0000","last_change":"2023-07-11T00:30:10.074777+0000","last_active":"2023-07-11T00:30:11.057855+0000","last_peered":"2023-07-11T00:30:11.057855+0000","last_clean":"2023-07-11T00:30:11.057855+0000","last_became_active":"2023-07-11T00:30:10.073612+0000","last_became_peered":"2023-07-11T00:30:10.073612+0000","last_unstale":"2023-07-11T00:30:11.057855+0000","last_undegraded":"2023-07-11T00:30:11.057855+0000","last_fullsized":"2023-07-11T00:30:11.057855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:37:55.556018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058461+0000","last_change":"2023-07-11T00:29:59.978981+0000","last_active":"2023-07-11T00:30:11.058461+0000","last_peered":"2023-07-11T00:30:11.058461+0000","last_clean":"2023-07-11T00:30:11.058461+0000","last_became_active":"2023-07-11T00:29:59.978633+0000","last_became_peered":"2023-07-11T00:29:59.978633+0000","last_unstale":"2023-07-11T00:30:11.058461+0000","last_undegraded":"2023-07-11T00:30:11.058461+0000","last_fullsized":"2023-07-11T00:30:11.058461+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:39:53.945627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116711+0000","last_change":"2023-07-11T00:30:04.915315+0000","last_active":"2023-07-11T00:30:11.116711+0000","last_peered":"2023-07-11T00:30:11.116711+0000","last_clean":"2023-07-11T00:30:11.116711+0000","last_became_active":"2023-07-11T00:30:04.914975+0000","last_became_peered":"2023-07-11T00:30:04.914975+0000","last_unstale":"2023-07-11T00:30:11.116711+0000","last_undegraded":"2023-07-11T00:30:11.116711+0000","last_fullsized":"2023-07-11T00:30:11.116711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:56:28.345089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058475+0000","last_change":"2023-07-11T00:30:05.911135+0000","last_active":"2023-07-11T00:30:11.058475+0000","last_peered":"2023-07-11T00:30:11.058475+0000","last_clean":"2023-07-11T00:30:11.058475+0000","last_became_active":"2023-07-11T00:30:05.910827+0000","last_became_peered":"2023-07-11T00:30:05.910827+0000","last_unstale":"2023-07-11T00:30:11.058475+0000","last_undegraded":"2023-07-11T00:30:11.058475+0000","last_fullsized":"2023-07-11T00:30:11.058475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:32:58.816922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058181+0000","last_change":"2023-07-11T00:30:10.083291+0000","last_active":"2023-07-11T00:30:11.058181+0000","last_peered":"2023-07-11T00:30:11.058181+0000","last_clean":"2023-07-11T00:30:11.058181+0000","last_became_active":"2023-07-11T00:30:10.082895+0000","last_became_peered":"2023-07-11T00:30:10.082895+0000","last_unstale":"2023-07-11T00:30:11.058181+0000","last_undegraded":"2023-07-11T00:30:11.058181+0000","last_fullsized":"2023-07-11T00:30:11.058181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:21:54.408864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.060161+0000","last_change":"2023-07-11T00:29:59.585652+0000","last_active":"2023-07-11T00:30:11.060161+0000","last_peered":"2023-07-11T00:30:11.060161+0000","last_clean":"2023-07-11T00:30:11.060161+0000","last_became_active":"2023-07-11T00:29:59.585316+0000","last_became_peered":"2023-07-11T00:29:59.585316+0000","last_unstale":"2023-07-11T00:30:11.060161+0000","last_undegraded":"2023-07-11T00:30:11.060161+0000","last_fullsized":"2023-07-11T00:30:11.060161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:14:02.980670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116535+0000","last_change":"2023-07-11T00:30:04.908230+0000","last_active":"2023-07-11T00:30:11.116535+0000","last_peered":"2023-07-11T00:30:11.116535+0000","last_clean":"2023-07-11T00:30:11.116535+0000","last_became_active":"2023-07-11T00:30:04.907876+0000","last_became_peered":"2023-07-11T00:30:04.907876+0000","last_unstale":"2023-07-11T00:30:11.116535+0000","last_undegraded":"2023-07-11T00:30:11.116535+0000","last_fullsized":"2023-07-11T00:30:11.116535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:44:28.461434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118728+0000","last_change":"2023-07-11T00:30:05.909462+0000","last_active":"2023-07-11T00:30:11.118728+0000","last_peered":"2023-07-11T00:30:11.118728+0000","last_clean":"2023-07-11T00:30:11.118728+0000","last_became_active":"2023-07-11T00:30:05.909171+0000","last_became_peered":"2023-07-11T00:30:05.909171+0000","last_unstale":"2023-07-11T00:30:11.118728+0000","last_undegraded":"2023-07-11T00:30:11.118728+0000","last_fullsized":"2023-07-11T00:30:11.118728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:02:21.282407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117001+0000","last_change":"2023-07-11T00:30:10.071266+0000","last_active":"2023-07-11T00:30:11.117001+0000","last_peered":"2023-07-11T00:30:11.117001+0000","last_clean":"2023-07-11T00:30:11.117001+0000","last_became_active":"2023-07-11T00:30:10.070503+0000","last_became_peered":"2023-07-11T00:30:10.070503+0000","last_unstale":"2023-07-11T00:30:11.117001+0000","last_undegraded":"2023-07-11T00:30:11.117001+0000","last_fullsized":"2023-07-11T00:30:11.117001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:57:33.279600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058426+0000","last_change":"2023-07-11T00:30:04.913993+0000","last_active":"2023-07-11T00:30:11.058426+0000","last_peered":"2023-07-11T00:30:11.058426+0000","last_clean":"2023-07-11T00:30:11.058426+0000","last_became_active":"2023-07-11T00:30:04.913642+0000","last_became_peered":"2023-07-11T00:30:04.913642+0000","last_unstale":"2023-07-11T00:30:11.058426+0000","last_undegraded":"2023-07-11T00:30:11.058426+0000","last_fullsized":"2023-07-11T00:30:11.058426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:57:28.124211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118217+0000","last_change":"2023-07-11T00:30:05.919099+0000","last_active":"2023-07-11T00:30:11.118217+0000","last_peered":"2023-07-11T00:30:11.118217+0000","last_clean":"2023-07-11T00:30:11.118217+0000","last_became_active":"2023-07-11T00:30:05.918814+0000","last_became_peered":"2023-07-11T00:30:05.918814+0000","last_unstale":"2023-07-11T00:30:11.118217+0000","last_undegraded":"2023-07-11T00:30:11.118217+0000","last_fullsized":"2023-07-11T00:30:11.118217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:30:43.008997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116071+0000","last_change":"2023-07-11T00:30:10.069011+0000","last_active":"2023-07-11T00:30:11.116071+0000","last_peered":"2023-07-11T00:30:11.116071+0000","last_clean":"2023-07-11T00:30:11.116071+0000","last_became_active":"2023-07-11T00:30:10.068592+0000","last_became_peered":"2023-07-11T00:30:10.068592+0000","last_unstale":"2023-07-11T00:30:11.116071+0000","last_undegraded":"2023-07-11T00:30:11.116071+0000","last_fullsized":"2023-07-11T00:30:11.116071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:59:40.923189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116511+0000","last_change":"2023-07-11T00:30:04.915144+0000","last_active":"2023-07-11T00:30:11.116511+0000","last_peered":"2023-07-11T00:30:11.116511+0000","last_clean":"2023-07-11T00:30:11.116511+0000","last_became_active":"2023-07-11T00:30:04.914857+0000","last_became_peered":"2023-07-11T00:30:04.914857+0000","last_unstale":"2023-07-11T00:30:11.116511+0000","last_undegraded":"2023-07-11T00:30:11.116511+0000","last_fullsized":"2023-07-11T00:30:11.116511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:08:03.914295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058885+0000","last_change":"2023-07-11T00:30:05.915668+0000","last_active":"2023-07-11T00:30:11.058885+0000","last_peered":"2023-07-11T00:30:11.058885+0000","last_clean":"2023-07-11T00:30:11.058885+0000","last_became_active":"2023-07-11T00:30:05.915103+0000","last_became_peered":"2023-07-11T00:30:05.915103+0000","last_unstale":"2023-07-11T00:30:11.058885+0000","last_undegraded":"2023-07-11T00:30:11.058885+0000","last_fullsized":"2023-07-11T00:30:11.058885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:22:56.265053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116786+0000","last_change":"2023-07-11T00:30:10.081391+0000","last_active":"2023-07-11T00:30:11.116786+0000","last_peered":"2023-07-11T00:30:11.116786+0000","last_clean":"2023-07-11T00:30:11.116786+0000","last_became_active":"2023-07-11T00:30:10.080979+0000","last_became_peered":"2023-07-11T00:30:10.080979+0000","last_unstale":"2023-07-11T00:30:11.116786+0000","last_undegraded":"2023-07-11T00:30:11.116786+0000","last_fullsized":"2023-07-11T00:30:11.116786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:49:32.541025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116347+0000","last_change":"2023-07-11T00:30:04.913406+0000","last_active":"2023-07-11T00:30:11.116347+0000","last_peered":"2023-07-11T00:30:11.116347+0000","last_clean":"2023-07-11T00:30:11.116347+0000","last_became_active":"2023-07-11T00:30:04.913025+0000","last_became_peered":"2023-07-11T00:30:04.913025+0000","last_unstale":"2023-07-11T00:30:11.116347+0000","last_undegraded":"2023-07-11T00:30:11.116347+0000","last_fullsized":"2023-07-11T00:30:11.116347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:37:24.276199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059362+0000","last_change":"2023-07-11T00:30:05.916740+0000","last_active":"2023-07-11T00:30:11.059362+0000","last_peered":"2023-07-11T00:30:11.059362+0000","last_clean":"2023-07-11T00:30:11.059362+0000","last_became_active":"2023-07-11T00:30:05.913008+0000","last_became_peered":"2023-07-11T00:30:05.913008+0000","last_unstale":"2023-07-11T00:30:11.059362+0000","last_undegraded":"2023-07-11T00:30:11.059362+0000","last_fullsized":"2023-07-11T00:30:11.059362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:25:47.194347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058162+0000","last_change":"2023-07-11T00:30:10.066428+0000","last_active":"2023-07-11T00:30:11.058162+0000","last_peered":"2023-07-11T00:30:11.058162+0000","last_clean":"2023-07-11T00:30:11.058162+0000","last_became_active":"2023-07-11T00:30:10.065932+0000","last_became_peered":"2023-07-11T00:30:10.065932+0000","last_unstale":"2023-07-11T00:30:11.058162+0000","last_undegraded":"2023-07-11T00:30:11.058162+0000","last_fullsized":"2023-07-11T00:30:11.058162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:02:54.740793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116255+0000","last_change":"2023-07-11T00:30:04.911637+0000","last_active":"2023-07-11T00:30:11.116255+0000","last_peered":"2023-07-11T00:30:11.116255+0000","last_clean":"2023-07-11T00:30:11.116255+0000","last_became_active":"2023-07-11T00:30:04.911311+0000","last_became_peered":"2023-07-11T00:30:04.911311+0000","last_unstale":"2023-07-11T00:30:11.116255+0000","last_undegraded":"2023-07-11T00:30:11.116255+0000","last_fullsized":"2023-07-11T00:30:11.116255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:47:48.434930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116470+0000","last_change":"2023-07-11T00:30:05.908686+0000","last_active":"2023-07-11T00:30:11.116470+0000","last_peered":"2023-07-11T00:30:11.116470+0000","last_clean":"2023-07-11T00:30:11.116470+0000","last_became_active":"2023-07-11T00:30:05.908384+0000","last_became_peered":"2023-07-11T00:30:05.908384+0000","last_unstale":"2023-07-11T00:30:11.116470+0000","last_undegraded":"2023-07-11T00:30:11.116470+0000","last_fullsized":"2023-07-11T00:30:11.116470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:01:38.063704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116672+0000","last_change":"2023-07-11T00:30:10.073737+0000","last_active":"2023-07-11T00:30:11.116672+0000","last_peered":"2023-07-11T00:30:11.116672+0000","last_clean":"2023-07-11T00:30:11.116672+0000","last_became_active":"2023-07-11T00:30:10.073270+0000","last_became_peered":"2023-07-11T00:30:10.073270+0000","last_unstale":"2023-07-11T00:30:11.116672+0000","last_undegraded":"2023-07-11T00:30:11.116672+0000","last_fullsized":"2023-07-11T00:30:11.116672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:56:17.603111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058726+0000","last_change":"2023-07-11T00:30:04.911003+0000","last_active":"2023-07-11T00:30:11.058726+0000","last_peered":"2023-07-11T00:30:11.058726+0000","last_clean":"2023-07-11T00:30:11.058726+0000","last_became_active":"2023-07-11T00:30:04.910696+0000","last_became_peered":"2023-07-11T00:30:04.910696+0000","last_unstale":"2023-07-11T00:30:11.058726+0000","last_undegraded":"2023-07-11T00:30:11.058726+0000","last_fullsized":"2023-07-11T00:30:11.058726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:08:03.914295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058582+0000","last_change":"2023-07-11T00:30:05.910836+0000","last_active":"2023-07-11T00:30:11.058582+0000","last_peered":"2023-07-11T00:30:11.058582+0000","last_clean":"2023-07-11T00:30:11.058582+0000","last_became_active":"2023-07-11T00:30:05.907744+0000","last_became_peered":"2023-07-11T00:30:05.907744+0000","last_unstale":"2023-07-11T00:30:11.058582+0000","last_undegraded":"2023-07-11T00:30:11.058582+0000","last_fullsized":"2023-07-11T00:30:11.058582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:53.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057491+0000","last_change":"2023-07-11T00:30:05.912291+0000","last_active":"2023-07-11T00:30:11.057491+0000","last_peered":"2023-07-11T00:30:11.057491+0000","last_clean":"2023-07-11T00:30:11.057491+0000","last_became_active":"2023-07-11T00:30:05.912020+0000","last_became_peered":"2023-07-11T00:30:05.912020+0000","last_unstale":"2023-07-11T00:30:11.057491+0000","last_undegraded":"2023-07-11T00:30:11.057491+0000","last_fullsized":"2023-07-11T00:30:11.057491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:35:14.541189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116735+0000","last_change":"2023-07-11T00:30:05.915128+0000","last_active":"2023-07-11T00:30:11.116735+0000","last_peered":"2023-07-11T00:30:11.116735+0000","last_clean":"2023-07-11T00:30:11.116735+0000","last_became_active":"2023-07-11T00:30:05.914684+0000","last_became_peered":"2023-07-11T00:30:05.914684+0000","last_unstale":"2023-07-11T00:30:11.116735+0000","last_undegraded":"2023-07-11T00:30:11.116735+0000","last_fullsized":"2023-07-11T00:30:11.116735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:31:10.887973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059928+0000","last_change":"2023-07-11T00:30:05.911543+0000","last_active":"2023-07-11T00:30:11.059928+0000","last_peered":"2023-07-11T00:30:11.059928+0000","last_clean":"2023-07-11T00:30:11.059928+0000","last_became_active":"2023-07-11T00:30:05.911204+0000","last_became_peered":"2023-07-11T00:30:05.911204+0000","last_unstale":"2023-07-11T00:30:11.059928+0000","last_undegraded":"2023-07-11T00:30:11.059928+0000","last_fullsized":"2023-07-11T00:30:11.059928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:08:16.283098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118055+0000","last_change":"2023-07-11T00:30:05.906824+0000","last_active":"2023-07-11T00:30:11.118055+0000","last_peered":"2023-07-11T00:30:11.118055+0000","last_clean":"2023-07-11T00:30:11.118055+0000","last_became_active":"2023-07-11T00:30:05.906357+0000","last_became_peered":"2023-07-11T00:30:05.906357+0000","last_unstale":"2023-07-11T00:30:11.118055+0000","last_undegraded":"2023-07-11T00:30:11.118055+0000","last_fullsized":"2023-07-11T00:30:11.118055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:13:25.822286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116584+0000","last_change":"2023-07-11T00:30:05.914873+0000","last_active":"2023-07-11T00:30:11.116584+0000","last_peered":"2023-07-11T00:30:11.116584+0000","last_clean":"2023-07-11T00:30:11.116584+0000","last_became_active":"2023-07-11T00:30:05.914537+0000","last_became_peered":"2023-07-11T00:30:05.914537+0000","last_unstale":"2023-07-11T00:30:11.116584+0000","last_undegraded":"2023-07-11T00:30:11.116584+0000","last_fullsized":"2023-07-11T00:30:11.116584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:21:50.256183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":876544,"data_stored":699108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":103369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":847872,"data_stored":695098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":103951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":104730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":103459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":108580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":104021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-11T00:30:36.080 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-11T00:30:36.081 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-11T00:30:36.082 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-11T00:30:36.082 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-11T00:30:36.083 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-11T00:30:36.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.311+0000 7f9b16bff700 1 Processor -- start 2023-07-11T00:30:36.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.311+0000 7f9b16bff700 1 -- start start 2023-07-11T00:30:36.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.312+0000 7f9b16bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b1015c460 0x7f9b100b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:36.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.312+0000 7f9b16bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9b100cf8f0 0x7f9b1015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:36.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.312+0000 7f9b16bff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b100d1790 con 0x7f9b100d2640 2023-07-11T00:30:36.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.312+0000 7f9b16bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b100cedd0 con 0x7f9b100cf8f0 2023-07-11T00:30:36.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.312+0000 7f9b16bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b100cd950 con 0x7f9b1015c460 2023-07-11T00:30:36.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.312+0000 7f9b0ffff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9b100d2640 0x7f9b100cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45804/0 (socket says 172.21.15.22:45804) 2023-07-11T00:30:36.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.312+0000 7f9b0ffff700 1 -- 172.21.15.22:0/1488415794 learned_addr learned my addr 172.21.15.22:0/1488415794 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:36.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.313+0000 7f9b1519c700 1 --2- 172.21.15.22:0/1488415794 >> v2:172.21.15.184:3300/0 conn(0x7f9b100cf8f0 0x7f9b1015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:36.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.313+0000 7f9b1499b700 1 --2- 172.21.15.22:0/1488415794 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b1015c460 0x7f9b100b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:36.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.313+0000 7f9b0f7fe700 1 -- 172.21.15.22:0/1488415794 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862430783 0 0) 0x7f9b100d1790 con 0x7f9b100d2640 2023-07-11T00:30:36.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.313+0000 7f9b0f7fe700 1 -- 172.21.15.22:0/1488415794 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b000035b0 con 0x7f9b100d2640 2023-07-11T00:30:36.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.313+0000 7f9b1499b700 1 -- 172.21.15.22:0/1488415794 >> v2:172.21.15.184:3300/0 conn(0x7f9b100cf8f0 msgr2=0x7f9b1015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:36.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.313+0000 7f9b1499b700 1 --2- 172.21.15.22:0/1488415794 >> v2:172.21.15.184:3300/0 conn(0x7f9b100cf8f0 0x7f9b1015fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.313+0000 7f9b1499b700 1 -- 172.21.15.22:0/1488415794 >> v1:172.21.15.22:6789/0 conn(0x7f9b100d2640 legacy=0x7f9b100cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:36.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.313+0000 7f9b1499b700 1 -- 172.21.15.22:0/1488415794 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b100d14b0 con 0x7f9b1015c460 2023-07-11T00:30:36.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.313+0000 7f9b1499b700 1 --2- 172.21.15.22:0/1488415794 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b1015c460 0x7f9b100b59d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009840 tx=0x7f9b04009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27e9e232b85be656 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:36.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.314+0000 7f9b0f7fe700 1 -- 172.21.15.22:0/1488415794 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04011830 con 0x7f9b1015c460 2023-07-11T00:30:36.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.314+0000 7f9b0f7fe700 1 -- 172.21.15.22:0/1488415794 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b04011990 con 0x7f9b1015c460 2023-07-11T00:30:36.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.314+0000 7f9b0f7fe700 1 -- 172.21.15.22:0/1488415794 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04011d20 con 0x7f9b1015c460 2023-07-11T00:30:36.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.314+0000 7f9b16bff700 1 -- 172.21.15.22:0/1488415794 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b1015c460 msgr2=0x7f9b100b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:36.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.314+0000 7f9b16bff700 1 --2- 172.21.15.22:0/1488415794 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b1015c460 0x7f9b100b59d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009840 tx=0x7f9b04009b50 comp rx=0 tx=0).stop 2023-07-11T00:30:36.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.314+0000 7f9b16bff700 1 -- 172.21.15.22:0/1488415794 shutdown_connections 2023-07-11T00:30:36.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.314+0000 7f9b16bff700 1 --2- 172.21.15.22:0/1488415794 >> v2:172.21.15.184:3300/0 conn(0x7f9b100cf8f0 0x7f9b1015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.314+0000 7f9b16bff700 1 --2- 172.21.15.22:0/1488415794 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b1015c460 0x7f9b100b59d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.314+0000 7f9b16bff700 1 -- 172.21.15.22:0/1488415794 >> 172.21.15.22:0/1488415794 conn(0x7f9b10071660 msgr2=0x7f9b10071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:36.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.314+0000 7f9b16bff700 1 -- 172.21.15.22:0/1488415794 shutdown_connections 2023-07-11T00:30:36.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.315+0000 7f9b16bff700 1 -- 172.21.15.22:0/1488415794 wait complete. 2023-07-11T00:30:36.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.316+0000 7f9b16bff700 1 Processor -- start 2023-07-11T00:30:36.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.316+0000 7f9b16bff700 1 -- start start 2023-07-11T00:30:36.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.317+0000 7f9b16bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b100cf8f0 0x7f9b100c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:36.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.317+0000 7f9b16bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b100d2640 0x7f9b10145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:36.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.317+0000 7f9b16bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b1015c460 0x7f9b101458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:36.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.317+0000 7f9b16bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b101e76a0 con 0x7f9b100cf8f0 2023-07-11T00:30:36.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.317+0000 7f9b16bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b101e7980 con 0x7f9b1015c460 2023-07-11T00:30:36.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.317+0000 7f9b16bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b101e7c60 con 0x7f9b100d2640 2023-07-11T00:30:36.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.318+0000 7f9b1499b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b100cf8f0 0x7f9b100c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:36.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.318+0000 7f9b1499b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b100cf8f0 0x7f9b100c66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45470/0 (socket says 172.21.15.22:45470) 2023-07-11T00:30:36.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.318+0000 7f9b1499b700 1 -- 172.21.15.22:0/2485182159 learned_addr learned my addr 172.21.15.22:0/2485182159 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:36.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.318+0000 7f9b0ffff700 1 --2- 172.21.15.22:0/2485182159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b100d2640 0x7f9b10145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:36.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.318+0000 7f9b1519c700 1 --2- 172.21.15.22:0/2485182159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b1015c460 0x7f9b101458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:36.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.318+0000 7f9b1499b700 1 -- 172.21.15.22:0/2485182159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b100d2640 msgr2=0x7f9b10145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:36.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.318+0000 7f9b1499b700 1 --2- 172.21.15.22:0/2485182159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b100d2640 0x7f9b10145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.318+0000 7f9b1499b700 1 -- 172.21.15.22:0/2485182159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b1015c460 msgr2=0x7f9b101458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:36.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.318+0000 7f9b1499b700 1 --2- 172.21.15.22:0/2485182159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b1015c460 0x7f9b101458a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.318+0000 7f9b1499b700 1 -- 172.21.15.22:0/2485182159 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b040094a0 con 0x7f9b100cf8f0 2023-07-11T00:30:36.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.319+0000 7f9b1499b700 1 --2- 172.21.15.22:0/2485182159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b100cf8f0 0x7f9b100c66b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9b04000c00 tx=0x7f9b04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:36.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.319+0000 7f9b0d7fa700 1 -- 172.21.15.22:0/2485182159 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b040036a0 con 0x7f9b100cf8f0 2023-07-11T00:30:36.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.319+0000 7f9b0d7fa700 1 -- 172.21.15.22:0/2485182159 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0401f070 con 0x7f9b100cf8f0 2023-07-11T00:30:36.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.319+0000 7f9b0d7fa700 1 -- 172.21.15.22:0/2485182159 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04003a60 con 0x7f9b100cf8f0 2023-07-11T00:30:36.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.319+0000 7f9b16bff700 1 -- 172.21.15.22:0/2485182159 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b101e7f40 con 0x7f9b100cf8f0 2023-07-11T00:30:36.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.319+0000 7f9b16bff700 1 -- 172.21.15.22:0/2485182159 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b100c6bf0 con 0x7f9b100cf8f0 2023-07-11T00:30:36.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.320+0000 7f9b16bff700 1 -- 172.21.15.22:0/2485182159 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b10066e80 con 0x7f9b100cf8f0 2023-07-11T00:30:36.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.321+0000 7f9b0d7fa700 1 -- 172.21.15.22:0/2485182159 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9b04003bc0 con 0x7f9b100cf8f0 2023-07-11T00:30:36.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.322+0000 7f9b0d7fa700 1 --2- 172.21.15.22:0/2485182159 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9af406ace0 0x7f9af406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:36.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.322+0000 7f9b0d7fa700 1 -- 172.21.15.22:0/2485182159 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9b04021070 con 0x7f9b100cf8f0 2023-07-11T00:30:36.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.323+0000 7f9b0ffff700 1 --2- 172.21.15.22:0/2485182159 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9af406ace0 0x7f9af406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:36.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.323+0000 7f9b0ffff700 1 --2- 172.21.15.22:0/2485182159 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9af406ace0 0x7f9af406d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9afc007fd0 tx=0x7f9afc007dc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:36.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.326+0000 7f9b0d7fa700 1 -- 172.21.15.22:0/2485182159 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9b04055cb0 con 0x7f9b100cf8f0 2023-07-11T00:30:36.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.587+0000 7f9b16bff700 1 -- 172.21.15.22:0/2485182159 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9b1004ea60 con 0x7f9b100cf8f0 2023-07-11T00:30:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.590+0000 7f9b0d7fa700 1 -- 172.21.15.22:0/2485182159 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170843 (secure 0 0 0) 0x7f9b040592d0 con 0x7f9b100cf8f0 2023-07-11T00:30:36.593 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:36.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.593+0000 7f9b16bff700 1 -- 172.21.15.22:0/2485182159 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9af406ace0 msgr2=0x7f9af406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:36.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.593+0000 7f9b16bff700 1 --2- 172.21.15.22:0/2485182159 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9af406ace0 0x7f9af406d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9afc007fd0 tx=0x7f9afc007dc0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.593+0000 7f9b16bff700 1 -- 172.21.15.22:0/2485182159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b100cf8f0 msgr2=0x7f9b100c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:36.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.593+0000 7f9b16bff700 1 --2- 172.21.15.22:0/2485182159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b100cf8f0 0x7f9b100c66b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9b04000c00 tx=0x7f9b04004750 comp rx=0 tx=0).stop 2023-07-11T00:30:36.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.593+0000 7f9b16bff700 1 -- 172.21.15.22:0/2485182159 shutdown_connections 2023-07-11T00:30:36.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.593+0000 7f9b16bff700 1 --2- 172.21.15.22:0/2485182159 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9af406ace0 0x7f9af406d190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.593+0000 7f9b16bff700 1 --2- 172.21.15.22:0/2485182159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b1015c460 0x7f9b101458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.593+0000 7f9b16bff700 1 --2- 172.21.15.22:0/2485182159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b100cf8f0 0x7f9b100c66b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.593+0000 7f9b16bff700 1 --2- 172.21.15.22:0/2485182159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b100d2640 0x7f9b10145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.593+0000 7f9b16bff700 1 -- 172.21.15.22:0/2485182159 >> 172.21.15.22:0/2485182159 conn(0x7f9b10071660 msgr2=0x7f9b100b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:36.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.593+0000 7f9b16bff700 1 -- 172.21.15.22:0/2485182159 shutdown_connections 2023-07-11T00:30:36.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.593+0000 7f9b16bff700 1 -- 172.21.15.22:0/2485182159 wait complete. 2023-07-11T00:30:36.613 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":5,"active_gid":4114,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":380612710},{"type":"v1","addr":"172.21.15.184:6833","nonce":380612710}]},"active_addr":"172.21.15.184:6833/380612710","active_change":"2023-07-11T00:29:52.476379+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4102,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":47588106}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":1145959619}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":3156200396}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":340672893}]}]} 2023-07-11T00:30:36.619 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-11T00:30:36.619 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-11T00:30:36.619 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:30:36.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.819+0000 7f6fd95ff700 1 Processor -- start 2023-07-11T00:30:36.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.819+0000 7f6fd95ff700 1 -- start start 2023-07-11T00:30:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.820+0000 7f6fd95ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6fd40d2640 0x7f6fd40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.820+0000 7f6fd95ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fd40cf8f0 0x7f6fd415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.820+0000 7f6fd95ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd40d1790 con 0x7f6fd415c460 2023-07-11T00:30:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.820+0000 7f6fd95ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd40cedd0 con 0x7f6fd40d2640 2023-07-11T00:30:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.820+0000 7f6fd95ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd40cd950 con 0x7f6fd40cf8f0 2023-07-11T00:30:36.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.820+0000 7f6fd27fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6fd40d2640 0x7f6fd40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:36.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.821+0000 7f6fd27fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6fd40d2640 0x7f6fd40b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45486/0 (socket says 172.21.15.22:45486) 2023-07-11T00:30:36.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.821+0000 7f6fd27fc700 1 -- 172.21.15.22:0/3548471947 learned_addr learned my addr 172.21.15.22:0/3548471947 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:36.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.821+0000 7f6fd37fe700 1 --2- 172.21.15.22:0/3548471947 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fd40cf8f0 0x7f6fd415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:36.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.821+0000 7f6fd2ffd700 1 --1- 172.21.15.22:0/3548471947 >> v1:172.21.15.184:6789/0 conn(0x7f6fd415c460 0x7f6fd40cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:41070/0 (socket says 172.21.15.22:41070) 2023-07-11T00:30:36.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.821+0000 7f6fd27fc700 1 -- 172.21.15.22:0/3548471947 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fd40cf8f0 msgr2=0x7f6fd415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:36.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.821+0000 7f6fd27fc700 1 --2- 172.21.15.22:0/3548471947 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fd40cf8f0 0x7f6fd415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.821+0000 7f6fd27fc700 1 -- 172.21.15.22:0/3548471947 >> v1:172.21.15.184:6789/0 conn(0x7f6fd415c460 legacy=0x7f6fd40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:36.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.821+0000 7f6fd27fc700 1 -- 172.21.15.22:0/3548471947 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd40d14b0 con 0x7f6fd40d2640 2023-07-11T00:30:36.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.821+0000 7f6fd27fc700 1 --2- 172.21.15.22:0/3548471947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fd40d2640 0x7f6fd40b59d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80098f0 tx=0x7f6fc8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300fc765f79a0d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:36.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.822+0000 7f6fd1ffb700 1 -- 172.21.15.22:0/3548471947 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8011830 con 0x7f6fd40d2640 2023-07-11T00:30:36.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.822+0000 7f6fd1ffb700 1 -- 172.21.15.22:0/3548471947 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc8011990 con 0x7f6fd40d2640 2023-07-11T00:30:36.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.822+0000 7f6fd1ffb700 1 -- 172.21.15.22:0/3548471947 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8011d20 con 0x7f6fd40d2640 2023-07-11T00:30:36.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.822+0000 7f6fd95ff700 1 -- 172.21.15.22:0/3548471947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fd40d2640 msgr2=0x7f6fd40b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:36.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.822+0000 7f6fd95ff700 1 --2- 172.21.15.22:0/3548471947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fd40d2640 0x7f6fd40b59d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80098f0 tx=0x7f6fc8009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:36.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.822+0000 7f6fd95ff700 1 -- 172.21.15.22:0/3548471947 shutdown_connections 2023-07-11T00:30:36.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.822+0000 7f6fd95ff700 1 --2- 172.21.15.22:0/3548471947 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fd40cf8f0 0x7f6fd415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.822+0000 7f6fd95ff700 1 --2- 172.21.15.22:0/3548471947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fd40d2640 0x7f6fd40b59d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.822+0000 7f6fd95ff700 1 -- 172.21.15.22:0/3548471947 >> 172.21.15.22:0/3548471947 conn(0x7f6fd4071660 msgr2=0x7f6fd4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:36.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.822+0000 7f6fd95ff700 1 -- 172.21.15.22:0/3548471947 shutdown_connections 2023-07-11T00:30:36.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.822+0000 7f6fd95ff700 1 -- 172.21.15.22:0/3548471947 wait complete. 2023-07-11T00:30:36.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.824+0000 7f6fd95ff700 1 Processor -- start 2023-07-11T00:30:36.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.824+0000 7f6fd95ff700 1 -- start start 2023-07-11T00:30:36.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.825+0000 7f6fd95ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fd40cf8f0 0x7f6fd40cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:36.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.825+0000 7f6fd95ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fd40d2640 0x7f6fd415e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:36.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.825+0000 7f6fd95ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fd415c460 0x7f6fd415e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:36.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.825+0000 7f6fd95ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd40ccce0 con 0x7f6fd40d2640 2023-07-11T00:30:36.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.825+0000 7f6fd95ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd4159a60 con 0x7f6fd40cf8f0 2023-07-11T00:30:36.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.825+0000 7f6fd95ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd4159d40 con 0x7f6fd415c460 2023-07-11T00:30:36.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.825+0000 7f6fd27fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fd40d2640 0x7f6fd415e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:36.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.825+0000 7f6fd27fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fd40d2640 0x7f6fd415e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45492/0 (socket says 172.21.15.22:45492) 2023-07-11T00:30:36.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.825+0000 7f6fd27fc700 1 -- 172.21.15.22:0/3845178093 learned_addr learned my addr 172.21.15.22:0/3845178093 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:36.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.825+0000 7f6fd2ffd700 1 --2- 172.21.15.22:0/3845178093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fd40cf8f0 0x7f6fd40cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:36.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.825+0000 7f6fd37fe700 1 --2- 172.21.15.22:0/3845178093 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fd415c460 0x7f6fd415e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:36.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.826+0000 7f6fd27fc700 1 -- 172.21.15.22:0/3845178093 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fd415c460 msgr2=0x7f6fd415e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:36.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.826+0000 7f6fd27fc700 1 --2- 172.21.15.22:0/3845178093 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fd415c460 0x7f6fd415e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.826+0000 7f6fd27fc700 1 -- 172.21.15.22:0/3845178093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fd40cf8f0 msgr2=0x7f6fd40cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:36.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.826+0000 7f6fd27fc700 1 --2- 172.21.15.22:0/3845178093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fd40cf8f0 0x7f6fd40cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:36.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.826+0000 7f6fd27fc700 1 -- 172.21.15.22:0/3845178093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc8009550 con 0x7f6fd40d2640 2023-07-11T00:30:36.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.826+0000 7f6fd27fc700 1 --2- 172.21.15.22:0/3845178093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fd40d2640 0x7f6fd415e310 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8009c40 tx=0x7f6fc8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:36.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.826+0000 7f6fbb7fe700 1 -- 172.21.15.22:0/3845178093 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc80036a0 con 0x7f6fd40d2640 2023-07-11T00:30:36.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.826+0000 7f6fbb7fe700 1 -- 172.21.15.22:0/3845178093 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc801e070 con 0x7f6fd40d2640 2023-07-11T00:30:36.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.826+0000 7f6fbb7fe700 1 -- 172.21.15.22:0/3845178093 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8003a60 con 0x7f6fd40d2640 2023-07-11T00:30:36.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.826+0000 7f6fd95ff700 1 -- 172.21.15.22:0/3845178093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd415a020 con 0x7f6fd40d2640 2023-07-11T00:30:36.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.826+0000 7f6fd95ff700 1 -- 172.21.15.22:0/3845178093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd415a5e0 con 0x7f6fd40d2640 2023-07-11T00:30:36.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.827+0000 7f6fd95ff700 1 -- 172.21.15.22:0/3845178093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd404ea60 con 0x7f6fd40d2640 2023-07-11T00:30:36.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.828+0000 7f6fbb7fe700 1 -- 172.21.15.22:0/3845178093 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6fc8003bc0 con 0x7f6fd40d2640 2023-07-11T00:30:36.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.829+0000 7f6fbb7fe700 1 --2- 172.21.15.22:0/3845178093 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6fc006ace0 0x7f6fc006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:36.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.829+0000 7f6fbb7fe700 1 -- 172.21.15.22:0/3845178093 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6fc808a760 con 0x7f6fd40d2640 2023-07-11T00:30:36.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.830+0000 7f6fd2ffd700 1 --2- 172.21.15.22:0/3845178093 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6fc006ace0 0x7f6fc006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:36.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.830+0000 7f6fd2ffd700 1 --2- 172.21.15.22:0/3845178093 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6fc006ace0 0x7f6fc006d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4000f60 tx=0x7f6fc4007d10 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:36.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:36.834+0000 7f6fbb7fe700 1 -- 172.21.15.22:0/3845178093 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6fc8055510 con 0x7f6fd40d2640 2023-07-11T00:30:37.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.044+0000 7f6fd95ff700 1 -- 172.21.15.22:0/3845178093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fd40b4fa0 con 0x7f6fd40d2640 2023-07-11T00:30:37.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.045+0000 7f6fbb7fe700 1 -- 172.21.15.22:0/3845178093 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f6fc8058b30 con 0x7f6fd40d2640 2023-07-11T00:30:37.049 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:37.049 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:10.571866+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:30:37.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.048+0000 7f6fd95ff700 1 -- 172.21.15.22:0/3845178093 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6fc006ace0 msgr2=0x7f6fc006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.048+0000 7f6fd95ff700 1 --2- 172.21.15.22:0/3845178093 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6fc006ace0 0x7f6fc006d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4000f60 tx=0x7f6fc4007d10 comp rx=0 tx=0).stop 2023-07-11T00:30:37.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.048+0000 7f6fd95ff700 1 -- 172.21.15.22:0/3845178093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fd40d2640 msgr2=0x7f6fd415e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.048+0000 7f6fd95ff700 1 --2- 172.21.15.22:0/3845178093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fd40d2640 0x7f6fd415e310 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8009c40 tx=0x7f6fc8004750 comp rx=0 tx=0).stop 2023-07-11T00:30:37.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.048+0000 7f6fd95ff700 1 -- 172.21.15.22:0/3845178093 shutdown_connections 2023-07-11T00:30:37.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.048+0000 7f6fd95ff700 1 --2- 172.21.15.22:0/3845178093 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6fc006ace0 0x7f6fc006d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.048+0000 7f6fd95ff700 1 --2- 172.21.15.22:0/3845178093 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fd415c460 0x7f6fd415e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.048+0000 7f6fd95ff700 1 --2- 172.21.15.22:0/3845178093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fd40cf8f0 0x7f6fd40cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.048+0000 7f6fd95ff700 1 --2- 172.21.15.22:0/3845178093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fd40d2640 0x7f6fd415e310 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.048+0000 7f6fd95ff700 1 -- 172.21.15.22:0/3845178093 >> 172.21.15.22:0/3845178093 conn(0x7f6fd4071660 msgr2=0x7f6fd415d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:37.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.048+0000 7f6fd95ff700 1 -- 172.21.15.22:0/3845178093 shutdown_connections 2023-07-11T00:30:37.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.048+0000 7f6fd95ff700 1 -- 172.21.15.22:0/3845178093 wait complete. 2023-07-11T00:30:37.069 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-11T00:30:37.069 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:30:37.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.271+0000 7f7efcdff700 1 Processor -- start 2023-07-11T00:30:37.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.271+0000 7f7efcdff700 1 -- start start 2023-07-11T00:30:37.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.272+0000 7f7efcdff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7ef815c460 0x7f7ef80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.272+0000 7f7efcdff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7ef80cf8f0 0x7f7ef815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.272+0000 7f7efcdff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef80d1790 con 0x7f7ef80d2640 2023-07-11T00:30:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.272+0000 7f7efcdff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef80cedd0 con 0x7f7ef815c460 2023-07-11T00:30:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.272+0000 7f7efcdff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef80cd950 con 0x7f7ef80cf8f0 2023-07-11T00:30:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.272+0000 7f7ef659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7ef815c460 0x7f7ef80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.272+0000 7f7eeffff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7ef80d2640 0x7f7ef80cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45812/0 (socket says 172.21.15.22:45812) 2023-07-11T00:30:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.272+0000 7f7eeffff700 1 -- 172.21.15.22:0/1895188277 learned_addr learned my addr 172.21.15.22:0/1895188277 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.273+0000 7f7ef6d9d700 1 --2- 172.21.15.22:0/1895188277 >> v2:172.21.15.184:3300/0 conn(0x7f7ef80cf8f0 0x7f7ef815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.273+0000 7f7ef659c700 1 -- 172.21.15.22:0/1895188277 >> v2:172.21.15.184:3300/0 conn(0x7f7ef80cf8f0 msgr2=0x7f7ef815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:37.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.273+0000 7f7ef659c700 1 --2- 172.21.15.22:0/1895188277 >> v2:172.21.15.184:3300/0 conn(0x7f7ef80cf8f0 0x7f7ef815fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.273+0000 7f7ef659c700 1 -- 172.21.15.22:0/1895188277 >> v1:172.21.15.22:6789/0 conn(0x7f7ef80d2640 legacy=0x7f7ef80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.273+0000 7f7ef659c700 1 -- 172.21.15.22:0/1895188277 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef80d14b0 con 0x7f7ef815c460 2023-07-11T00:30:37.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.273+0000 7f7ef5d9b700 1 -- 172.21.15.22:0/1895188277 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401977183 0 0) 0x7f7ef80d1790 con 0x7f7ef80d2640 2023-07-11T00:30:37.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.273+0000 7f7ef6d9d700 1 --2- 172.21.15.22:0/1895188277 >> v2:172.21.15.184:3300/0 conn(0x7f7ef80cf8f0 0x7f7ef815fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:37.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.273+0000 7f7ef659c700 1 --2- 172.21.15.22:0/1895188277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef815c460 0x7f7ef80b59d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8072140 tx=0x7f7ee8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126bddb0059f796c server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.273+0000 7f7ef5d9b700 1 -- 172.21.15.22:0/1895188277 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8011830 con 0x7f7ef815c460 2023-07-11T00:30:37.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.273+0000 7f7ef5d9b700 1 -- 172.21.15.22:0/1895188277 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee8011990 con 0x7f7ef815c460 2023-07-11T00:30:37.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.274+0000 7f7ef5d9b700 1 -- 172.21.15.22:0/1895188277 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8011d20 con 0x7f7ef815c460 2023-07-11T00:30:37.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.274+0000 7f7efcdff700 1 -- 172.21.15.22:0/1895188277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef815c460 msgr2=0x7f7ef80b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.274+0000 7f7efcdff700 1 --2- 172.21.15.22:0/1895188277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef815c460 0x7f7ef80b59d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8072140 tx=0x7f7ee8009b20 comp rx=0 tx=0).stop 2023-07-11T00:30:37.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.274+0000 7f7efcdff700 1 -- 172.21.15.22:0/1895188277 shutdown_connections 2023-07-11T00:30:37.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.274+0000 7f7efcdff700 1 --2- 172.21.15.22:0/1895188277 >> v2:172.21.15.184:3300/0 conn(0x7f7ef80cf8f0 0x7f7ef815fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.274+0000 7f7efcdff700 1 --2- 172.21.15.22:0/1895188277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef815c460 0x7f7ef80b59d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.274+0000 7f7efcdff700 1 -- 172.21.15.22:0/1895188277 >> 172.21.15.22:0/1895188277 conn(0x7f7ef8071660 msgr2=0x7f7ef8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:37.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.274+0000 7f7efcdff700 1 -- 172.21.15.22:0/1895188277 shutdown_connections 2023-07-11T00:30:37.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.274+0000 7f7efcdff700 1 -- 172.21.15.22:0/1895188277 wait complete. 2023-07-11T00:30:37.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.276+0000 7f7efcdff700 1 Processor -- start 2023-07-11T00:30:37.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.276+0000 7f7efcdff700 1 -- start start 2023-07-11T00:30:37.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.277+0000 7f7efcdff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ef80cf8f0 0x7f7ef8159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.277+0000 7f7efcdff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ef80d2640 0x7f7ef8155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.277+0000 7f7efcdff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef815c460 0x7f7ef8155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.277+0000 7f7efcdff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef81592e0 con 0x7f7ef815c460 2023-07-11T00:30:37.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.277+0000 7f7efcdff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef8156790 con 0x7f7ef80d2640 2023-07-11T00:30:37.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.277+0000 7f7efcdff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef81558a0 con 0x7f7ef80cf8f0 2023-07-11T00:30:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.277+0000 7f7ef6d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef815c460 0x7f7ef8155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.277+0000 7f7ef6d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef815c460 0x7f7ef8155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45506/0 (socket says 172.21.15.22:45506) 2023-07-11T00:30:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.277+0000 7f7ef6d9d700 1 -- 172.21.15.22:0/2328646167 learned_addr learned my addr 172.21.15.22:0/2328646167 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.277+0000 7f7eeffff700 1 --2- 172.21.15.22:0/2328646167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ef80d2640 0x7f7ef8155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.277+0000 7f7ef659c700 1 --2- 172.21.15.22:0/2328646167 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ef80cf8f0 0x7f7ef8159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.278+0000 7f7ef6d9d700 1 -- 172.21.15.22:0/2328646167 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ef80cf8f0 msgr2=0x7f7ef8159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.278+0000 7f7ef6d9d700 1 --2- 172.21.15.22:0/2328646167 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ef80cf8f0 0x7f7ef8159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.278+0000 7f7ef6d9d700 1 -- 172.21.15.22:0/2328646167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ef80d2640 msgr2=0x7f7ef8155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.278+0000 7f7ef6d9d700 1 --2- 172.21.15.22:0/2328646167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ef80d2640 0x7f7ef8155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.278+0000 7f7ef6d9d700 1 -- 172.21.15.22:0/2328646167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee80094a0 con 0x7f7ef815c460 2023-07-11T00:30:37.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.278+0000 7f7ef6d9d700 1 --2- 172.21.15.22:0/2328646167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef815c460 0x7f7ef8155af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0007e20 tx=0x7f7ef000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.278+0000 7f7eeeffd700 1 -- 172.21.15.22:0/2328646167 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef000dd20 con 0x7f7ef815c460 2023-07-11T00:30:37.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.278+0000 7f7eeeffd700 1 -- 172.21.15.22:0/2328646167 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef000f040 con 0x7f7ef815c460 2023-07-11T00:30:37.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.278+0000 7f7eeeffd700 1 -- 172.21.15.22:0/2328646167 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0003c60 con 0x7f7ef815c460 2023-07-11T00:30:37.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.278+0000 7f7efcdff700 1 -- 172.21.15.22:0/2328646167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef81586d0 con 0x7f7ef815c460 2023-07-11T00:30:37.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.278+0000 7f7efcdff700 1 -- 172.21.15.22:0/2328646167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef8158c90 con 0x7f7ef815c460 2023-07-11T00:30:37.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.279+0000 7f7efcdff700 1 -- 172.21.15.22:0/2328646167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef804ea60 con 0x7f7ef815c460 2023-07-11T00:30:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.280+0000 7f7eeeffd700 1 -- 172.21.15.22:0/2328646167 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ef0004030 con 0x7f7ef815c460 2023-07-11T00:30:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.281+0000 7f7eeeffd700 1 --2- 172.21.15.22:0/2328646167 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7ed806ace0 0x7f7ed806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.281+0000 7f7eeeffd700 1 -- 172.21.15.22:0/2328646167 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7ef0089820 con 0x7f7ef815c460 2023-07-11T00:30:37.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.282+0000 7f7ef659c700 1 --2- 172.21.15.22:0/2328646167 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7ed806ace0 0x7f7ed806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.282+0000 7f7ef659c700 1 --2- 172.21.15.22:0/2328646167 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7ed806ace0 0x7f7ed806d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80090b0 tx=0x7f7ee8008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.285+0000 7f7eeeffd700 1 -- 172.21.15.22:0/2328646167 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7ef0054540 con 0x7f7ef815c460 2023-07-11T00:30:37.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.493+0000 7f7efcdff700 1 -- 172.21.15.22:0/2328646167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ef806c160 con 0x7f7ef815c460 2023-07-11T00:30:37.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.494+0000 7f7eeeffd700 1 -- 172.21.15.22:0/2328646167 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f7ef0057b60 con 0x7f7ef815c460 2023-07-11T00:30:37.497 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:37.498 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:10.571866+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:30:37.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.496+0000 7f7efcdff700 1 -- 172.21.15.22:0/2328646167 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7ed806ace0 msgr2=0x7f7ed806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.496+0000 7f7efcdff700 1 --2- 172.21.15.22:0/2328646167 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7ed806ace0 0x7f7ed806d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80090b0 tx=0x7f7ee8008030 comp rx=0 tx=0).stop 2023-07-11T00:30:37.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.496+0000 7f7efcdff700 1 -- 172.21.15.22:0/2328646167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef815c460 msgr2=0x7f7ef8155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.496+0000 7f7efcdff700 1 --2- 172.21.15.22:0/2328646167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef815c460 0x7f7ef8155af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0007e20 tx=0x7f7ef000d3b0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.497+0000 7f7efcdff700 1 -- 172.21.15.22:0/2328646167 shutdown_connections 2023-07-11T00:30:37.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.497+0000 7f7efcdff700 1 --2- 172.21.15.22:0/2328646167 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7ed806ace0 0x7f7ed806d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.497+0000 7f7efcdff700 1 --2- 172.21.15.22:0/2328646167 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ef80cf8f0 0x7f7ef8159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.497+0000 7f7efcdff700 1 --2- 172.21.15.22:0/2328646167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef815c460 0x7f7ef8155af0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.497+0000 7f7efcdff700 1 --2- 172.21.15.22:0/2328646167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ef80d2640 0x7f7ef8155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.497+0000 7f7efcdff700 1 -- 172.21.15.22:0/2328646167 >> 172.21.15.22:0/2328646167 conn(0x7f7ef8071660 msgr2=0x7f7ef80b6350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:37.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.497+0000 7f7efcdff700 1 -- 172.21.15.22:0/2328646167 shutdown_connections 2023-07-11T00:30:37.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.497+0000 7f7efcdff700 1 -- 172.21.15.22:0/2328646167 wait complete. 2023-07-11T00:30:37.518 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-11T00:30:37.519 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-11T00:30:37.520 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-11T00:30:37.524 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-11T00:30:37.525 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-11T00:30:37.525 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-11T00:30:37.526 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-11T00:30:37.526 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-11T00:30:37.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.885+0000 7f3671bff700 1 Processor -- start 2023-07-11T00:30:37.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.885+0000 7f3671bff700 1 -- start start 2023-07-11T00:30:37.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.888+0000 7f3671bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f366c0c9d40 0x7f366c0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.888+0000 7f3671bff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366c0ce5d0 con 0x7f366c0cb6e0 2023-07-11T00:30:37.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.888+0000 7f3671bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366c0cce20 con 0x7f366c0c9970 2023-07-11T00:30:37.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.888+0000 7f3671bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c0cd100 con 0x7f366c0c9d40 2023-07-11T00:30:37.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.889+0000 7f366affd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f366c0c9d40 0x7f366c0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.889+0000 7f366bfff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f366c0cb6e0 0x7f366c157d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45816/0 (socket says 172.21.15.22:45816) 2023-07-11T00:30:37.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.889+0000 7f366bfff700 1 -- 172.21.15.22:0/4256709344 learned_addr learned my addr 172.21.15.22:0/4256709344 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:37.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.890+0000 7f366affd700 1 -- 172.21.15.22:0/4256709344 >> v1:172.21.15.184:6789/0 conn(0x7f366c0c9970 legacy=0x7f366c0cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.890+0000 7f366affd700 1 -- 172.21.15.22:0/4256709344 >> v1:172.21.15.22:6789/0 conn(0x7f366c0cb6e0 legacy=0x7f366c157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.890+0000 7f366affd700 1 -- 172.21.15.22:0/4256709344 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c0cd3e0 con 0x7f366c0c9d40 2023-07-11T00:30:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.890+0000 7f366affd700 1 --2- 172.21.15.22:0/4256709344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f366c0c9d40 0x7f366c0cb1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f365c00b9a0 tx=0x7f365c00bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73da908d5527f07c server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.891+0000 7f366a7fc700 1 -- 172.21.15.22:0/4256709344 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c004230 con 0x7f366c0c9d40 2023-07-11T00:30:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.891+0000 7f366a7fc700 1 -- 172.21.15.22:0/4256709344 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c004390 con 0x7f366c0c9d40 2023-07-11T00:30:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.891+0000 7f366a7fc700 1 -- 172.21.15.22:0/4256709344 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c009ec0 con 0x7f366c0c9d40 2023-07-11T00:30:37.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.892+0000 7f3671bff700 1 -- 172.21.15.22:0/4256709344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f366c0c9d40 msgr2=0x7f366c0cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.892+0000 7f3671bff700 1 --2- 172.21.15.22:0/4256709344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f366c0c9d40 0x7f366c0cb1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f365c00b9a0 tx=0x7f365c00bcb0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.893+0000 7f3671bff700 1 -- 172.21.15.22:0/4256709344 shutdown_connections 2023-07-11T00:30:37.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.893+0000 7f3671bff700 1 --2- 172.21.15.22:0/4256709344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f366c0c9d40 0x7f366c0cb1a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.893+0000 7f3671bff700 1 -- 172.21.15.22:0/4256709344 >> 172.21.15.22:0/4256709344 conn(0x7f366c06abc0 msgr2=0x7f366c0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:37.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.893+0000 7f3671bff700 1 -- 172.21.15.22:0/4256709344 shutdown_connections 2023-07-11T00:30:37.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.893+0000 7f3671bff700 1 -- 172.21.15.22:0/4256709344 wait complete. 2023-07-11T00:30:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.896+0000 7f3671bff700 1 Processor -- start 2023-07-11T00:30:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.896+0000 7f3671bff700 1 -- start start 2023-07-11T00:30:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.898+0000 7f3671bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f366c0c9970 0x7f366c0c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.898+0000 7f3671bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f366c0c9d40 0x7f366c14aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.898+0000 7f366b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f366c0c9970 0x7f366c0c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.899+0000 7f366b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f366c0c9970 0x7f366c0c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:33784/0 (socket says 172.21.15.22:33784) 2023-07-11T00:30:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.899+0000 7f366affd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f366c0c9d40 0x7f366c14aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.899+0000 7f366affd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f366c0c9d40 0x7f366c14aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:37338/0 (socket says 172.21.15.22:37338) 2023-07-11T00:30:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.899+0000 7f3671bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f366c0cb6e0 0x7f366c143cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.899+0000 7f3671bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c146680 con 0x7f366c0cb6e0 2023-07-11T00:30:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.899+0000 7f3671bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c0c2ed0 con 0x7f366c0c9d40 2023-07-11T00:30:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.899+0000 7f3671bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c0c31b0 con 0x7f366c0c9970 2023-07-11T00:30:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.899+0000 7f366b7fe700 1 -- 172.21.15.22:0/684802366 learned_addr learned my addr 172.21.15.22:0/684802366 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:37.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.900+0000 7f366b7fe700 1 -- 172.21.15.22:0/684802366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f366c0c9d40 msgr2=0x7f366c14aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.900+0000 7f366b7fe700 1 --2- 172.21.15.22:0/684802366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f366c0c9d40 0x7f366c14aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.900+0000 7f366b7fe700 1 -- 172.21.15.22:0/684802366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f366c0cb6e0 msgr2=0x7f366c143cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.900+0000 7f366b7fe700 1 --2- 172.21.15.22:0/684802366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f366c0cb6e0 0x7f366c143cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.900+0000 7f366b7fe700 1 -- 172.21.15.22:0/684802366 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c0094a0 con 0x7f366c0c9970 2023-07-11T00:30:37.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.901+0000 7f366b7fe700 1 --2- 172.21.15.22:0/684802366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f366c0c9970 0x7f366c0c3f70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f366400caf0 tx=0x7f366400ceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.901+0000 7f3653fff700 1 -- 172.21.15.22:0/684802366 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664003e30 con 0x7f366c0c9970 2023-07-11T00:30:37.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.901+0000 7f3653fff700 1 -- 172.21.15.22:0/684802366 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3664005070 con 0x7f366c0c9970 2023-07-11T00:30:37.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.901+0000 7f3653fff700 1 -- 172.21.15.22:0/684802366 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664005420 con 0x7f366c0c9970 2023-07-11T00:30:37.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.901+0000 7f3671bff700 1 -- 172.21.15.22:0/684802366 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c0c3490 con 0x7f366c0c9970 2023-07-11T00:30:37.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.902+0000 7f95a2dff700 1 Processor -- start 2023-07-11T00:30:37.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.902+0000 7f3671bff700 1 -- 172.21.15.22:0/684802366 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c0c3a50 con 0x7f366c0c9970 2023-07-11T00:30:37.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.904+0000 7f3671bff700 1 -- 172.21.15.22:0/684802366 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f366c0cd9a0 con 0x7f366c0c9970 2023-07-11T00:30:37.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.903+0000 7f95a2dff700 1 -- start start 2023-07-11T00:30:37.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.905+0000 7f95a2dff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f959c0c9d40 0x7f959c0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.905+0000 7f95a2dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f959c0cb6e0 0x7f959c157d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.905+0000 7f95a2dff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959c0ce5d0 con 0x7f959c0c9970 2023-07-11T00:30:37.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.905+0000 7f95a2dff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c0cce20 con 0x7f959c0c9d40 2023-07-11T00:30:37.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.905+0000 7f95a2dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c0cd100 con 0x7f959c0cb6e0 2023-07-11T00:30:37.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.906+0000 7f959bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f959c0c9d40 0x7f959c0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.906+0000 7f959bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f959c0c9d40 0x7f959c0cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45544/0 (socket says 172.21.15.22:45544) 2023-07-11T00:30:37.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.906+0000 7f959bfff700 1 -- 172.21.15.22:0/108171363 learned_addr learned my addr 172.21.15.22:0/108171363 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:37.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.906+0000 7f95a139c700 1 --2- 172.21.15.22:0/108171363 >> v2:172.21.15.184:3300/0 conn(0x7f959c0cb6e0 0x7f959c157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.900+0000 7fe463fff700 1 Processor -- start 2023-07-11T00:30:37.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.900+0000 7fe463fff700 1 -- start start 2023-07-11T00:30:37.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.902+0000 7fe463fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe45c0cb8a0 0x7fe45c0cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.902+0000 7fe463fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe45c089570 0x7fe45c0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.903+0000 7fe463fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45c0ce620 con 0x7fe45c16c7e0 2023-07-11T00:30:37.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.903+0000 7fe463fff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45c089e70 con 0x7fe45c0cb8a0 2023-07-11T00:30:37.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.903+0000 7fe463fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45c0caac0 con 0x7fe45c089570 2023-07-11T00:30:37.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.904+0000 7fe46159a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe45c0cb8a0 0x7fe45c0cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.904+0000 7fe46159a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe45c0cb8a0 0x7fe45c0cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45528/0 (socket says 172.21.15.22:45528) 2023-07-11T00:30:37.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.904+0000 7fe46159a700 1 -- 172.21.15.22:0/3986586905 learned_addr learned my addr 172.21.15.22:0/3986586905 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:37.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.907+0000 7fe46259c700 1 --2- 172.21.15.22:0/3986586905 >> v2:172.21.15.184:3300/0 conn(0x7fe45c089570 0x7fe45c0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.906+0000 7f3653fff700 1 -- 172.21.15.22:0/684802366 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3664005580 con 0x7f366c0c9970 2023-07-11T00:30:37.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.907+0000 7f3653fff700 1 --2- 172.21.15.22:0/684802366 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f365806adb0 0x7f365806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.907+0000 7f3653fff700 1 -- 172.21.15.22:0/684802366 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3664088f20 con 0x7f366c0c9970 2023-07-11T00:30:37.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.908+0000 7f3653fff700 1 --2- 172.21.15.22:0/684802366 >> [v2:172.21.15.22:6816/3770043857,v1:172.21.15.22:6817/3770043857] conn(0x7f3658074a00 0x7f3658076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.908+0000 7f3653fff700 1 -- 172.21.15.22:0/684802366 --> [v2:172.21.15.22:6816/3770043857,v1:172.21.15.22:6817/3770043857] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3658077500 con 0x7f3658074a00 2023-07-11T00:30:37.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.908+0000 7f959bfff700 1 -- 172.21.15.22:0/108171363 >> v2:172.21.15.184:3300/0 conn(0x7f959c0cb6e0 msgr2=0x7f959c157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:37.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.908+0000 7f959bfff700 1 --2- 172.21.15.22:0/108171363 >> v2:172.21.15.184:3300/0 conn(0x7f959c0cb6e0 0x7f959c157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.908+0000 7f959bfff700 1 -- 172.21.15.22:0/108171363 >> v1:172.21.15.22:6789/0 conn(0x7f959c0c9970 legacy=0x7f959c0cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:37.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.908+0000 7f959bfff700 1 -- 172.21.15.22:0/108171363 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c0cd3e0 con 0x7f959c0c9d40 2023-07-11T00:30:37.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.908+0000 7f3653fff700 1 -- 172.21.15.22:0/684802366 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3664053d70 con 0x7f366c0c9970 2023-07-11T00:30:37.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.908+0000 7f959bfff700 1 --2- 172.21.15.22:0/108171363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f959c0c9d40 0x7f959c0cb1a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9590007040 tx=0x7f9590007350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d20bbfc0be72c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.909+0000 7fe460d99700 1 -- 172.21.15.22:0/3986586905 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568521694 0 0) 0x7fe454001490 con 0x7fe45c16c7e0 2023-07-11T00:30:37.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.909+0000 7f366affd700 1 --2- 172.21.15.22:0/684802366 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f365806adb0 0x7f365806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.909+0000 7fe460d99700 1 -- 172.21.15.22:0/3986586905 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4480035b0 con 0x7fe45c16c7e0 2023-07-11T00:30:37.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.909+0000 7fe46159a700 1 -- 172.21.15.22:0/3986586905 >> v2:172.21.15.184:3300/0 conn(0x7fe45c089570 msgr2=0x7fe45c0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:37.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.909+0000 7fe46159a700 1 --2- 172.21.15.22:0/3986586905 >> v2:172.21.15.184:3300/0 conn(0x7fe45c089570 0x7fe45c0ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.909+0000 7fe46159a700 1 -- 172.21.15.22:0/3986586905 >> v1:172.21.15.184:6789/0 conn(0x7fe45c16c7e0 legacy=0x7fe45c0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.910+0000 7fe46159a700 1 -- 172.21.15.22:0/3986586905 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c0cc970 con 0x7fe45c0cb8a0 2023-07-11T00:30:37.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.910+0000 7f959b7fe700 1 -- 172.21.15.22:0/108171363 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590007c90 con 0x7f959c0c9d40 2023-07-11T00:30:37.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.910+0000 7f959b7fe700 1 -- 172.21.15.22:0/108171363 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9590007df0 con 0x7f959c0c9d40 2023-07-11T00:30:37.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.910+0000 7f959b7fe700 1 -- 172.21.15.22:0/108171363 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590004250 con 0x7f959c0c9d40 2023-07-11T00:30:37.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.910+0000 7fe46159a700 1 --2- 172.21.15.22:0/3986586905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe45c0cb8a0 0x7fe45c0cda10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0cc320 tx=0x7fe458008650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39491c2378890ad2 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.911+0000 7f95a2dff700 1 -- 172.21.15.22:0/108171363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f959c0c9d40 msgr2=0x7f959c0cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.911+0000 7f95a2dff700 1 --2- 172.21.15.22:0/108171363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f959c0c9d40 0x7f959c0cb1a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9590007040 tx=0x7f9590007350 comp rx=0 tx=0).stop 2023-07-11T00:30:37.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.911+0000 7f95a2dff700 1 -- 172.21.15.22:0/108171363 shutdown_connections 2023-07-11T00:30:37.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.911+0000 7f95a2dff700 1 --2- 172.21.15.22:0/108171363 >> v2:172.21.15.184:3300/0 conn(0x7f959c0cb6e0 0x7f959c157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.911+0000 7f95a2dff700 1 --2- 172.21.15.22:0/108171363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f959c0c9d40 0x7f959c0cb1a0 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9590007040 tx=0x7f9590007350 comp rx=0 tx=0).stop 2023-07-11T00:30:37.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.911+0000 7f95a2dff700 1 -- 172.21.15.22:0/108171363 >> 172.21.15.22:0/108171363 conn(0x7f959c06abc0 msgr2=0x7f959c0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:37.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.912+0000 7fe460d99700 1 -- 172.21.15.22:0/3986586905 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe458008df0 con 0x7fe45c0cb8a0 2023-07-11T00:30:37.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.912+0000 7fe460d99700 1 -- 172.21.15.22:0/3986586905 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45800f800 con 0x7fe45c0cb8a0 2023-07-11T00:30:37.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.912+0000 7fe460d99700 1 -- 172.21.15.22:0/3986586905 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45800fb90 con 0x7fe45c0cb8a0 2023-07-11T00:30:37.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.912+0000 7f366bfff700 1 --2- 172.21.15.22:0/684802366 >> [v2:172.21.15.22:6816/3770043857,v1:172.21.15.22:6817/3770043857] conn(0x7f3658074a00 0x7f3658076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.913+0000 7f366bfff700 1 --2- 172.21.15.22:0/684802366 >> [v2:172.21.15.22:6816/3770043857,v1:172.21.15.22:6817/3770043857] conn(0x7f3658074a00 0x7f3658076e30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.914+0000 7f366affd700 1 --2- 172.21.15.22:0/684802366 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f365806adb0 0x7f365806d260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f365c0090b0 tx=0x7f365c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.916+0000 7f3653fff700 1 -- 172.21.15.22:0/684802366 <== osd.0 v2:172.21.15.22:6816/3770043857 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3658077500 con 0x7f3658074a00 2023-07-11T00:30:37.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.915+0000 7f95a2dff700 1 -- 172.21.15.22:0/108171363 shutdown_connections 2023-07-11T00:30:37.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.916+0000 7f95a2dff700 1 -- 172.21.15.22:0/108171363 wait complete. 2023-07-11T00:30:37.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.913+0000 7fe463fff700 1 -- 172.21.15.22:0/3986586905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe45c0cb8a0 msgr2=0x7fe45c0cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.913+0000 7fe463fff700 1 --2- 172.21.15.22:0/3986586905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe45c0cb8a0 0x7fe45c0cda10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0cc320 tx=0x7fe458008650 comp rx=0 tx=0).stop 2023-07-11T00:30:37.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.916+0000 7fe463fff700 1 -- 172.21.15.22:0/3986586905 shutdown_connections 2023-07-11T00:30:37.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.916+0000 7fe463fff700 1 --2- 172.21.15.22:0/3986586905 >> v2:172.21.15.184:3300/0 conn(0x7fe45c089570 0x7fe45c0ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.916+0000 7fe463fff700 1 --2- 172.21.15.22:0/3986586905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe45c0cb8a0 0x7fe45c0cda10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.916+0000 7fe463fff700 1 -- 172.21.15.22:0/3986586905 >> 172.21.15.22:0/3986586905 conn(0x7fe45c06abc0 msgr2=0x7fe45c0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:37.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.916+0000 7fe463fff700 1 -- 172.21.15.22:0/3986586905 shutdown_connections 2023-07-11T00:30:37.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.914+0000 7f5587dff700 1 Processor -- start 2023-07-11T00:30:37.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.915+0000 7fdc75dff700 1 Processor -- start 2023-07-11T00:30:37.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.915+0000 7fdc75dff700 1 -- start start 2023-07-11T00:30:37.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.917+0000 7fdc75dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc700d2640 0x7fdc700b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.917+0000 7fdc75dff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc700d1790 con 0x7fdc7015c460 2023-07-11T00:30:37.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.917+0000 7fdc75dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc700cd950 con 0x7fdc700cf8f0 2023-07-11T00:30:37.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.917+0000 7fdc75dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc700cedd0 con 0x7fdc700d2640 2023-07-11T00:30:37.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.919+0000 7f95a2dff700 1 Processor -- start 2023-07-11T00:30:37.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.915+0000 7f5587dff700 1 -- start start 2023-07-11T00:30:37.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.917+0000 7f5587dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5580160930 0x7f5580070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.917+0000 7f5587dff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f55800cc390 0x7f55800ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.917+0000 7f5587dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55800ccb70 con 0x7f55800adce0 2023-07-11T00:30:37.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.917+0000 7f5587dff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55800ae160 con 0x7f55800cc390 2023-07-11T00:30:37.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.917+0000 7f5587dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5580165400 con 0x7f5580160930 2023-07-11T00:30:37.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.918+0000 7f5585b9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5580160930 0x7f5580070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.918+0000 7f5585b9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5580160930 0x7f5580070a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:33788/0 (socket says 172.21.15.22:33788) 2023-07-11T00:30:37.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.918+0000 7f5585b9b700 1 -- 172.21.15.22:0/3794051340 learned_addr learned my addr 172.21.15.22:0/3794051340 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:37.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.918+0000 7fdc6ffff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fdc700cf8f0 0x7fdc7015fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:41090/0 (socket says 172.21.15.22:41090) 2023-07-11T00:30:37.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.918+0000 7fdc6ffff700 1 -- 172.21.15.22:0/3047241340 learned_addr learned my addr 172.21.15.22:0/3047241340 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:37.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.918+0000 7fdc6effd700 1 --2- 172.21.15.22:0/3047241340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc700d2640 0x7fdc700b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.919+0000 7fb9e97ff700 1 Processor -- start 2023-07-11T00:30:37.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.919+0000 7fdc6effd700 1 -- 172.21.15.22:0/3047241340 >> v1:172.21.15.184:6789/0 conn(0x7fdc700cf8f0 legacy=0x7fdc7015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.919+0000 7fdc6effd700 1 -- 172.21.15.22:0/3047241340 >> v1:172.21.15.22:6789/0 conn(0x7fdc7015c460 legacy=0x7fdc700cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:37.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.919+0000 7fdc6effd700 1 -- 172.21.15.22:0/3047241340 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc700d14b0 con 0x7fdc700d2640 2023-07-11T00:30:37.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.920+0000 7fdc6effd700 1 --2- 172.21.15.22:0/3047241340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc700d2640 0x7fdc700b59d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdc640097f0 tx=0x7fdc64009b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90bdd0aff8aac2e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.919+0000 7fb9e97ff700 1 -- start start 2023-07-11T00:30:37.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.919+0000 7f95a2dff700 1 -- start start 2023-07-11T00:30:37.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.921+0000 7f95a2dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f959c0c9970 0x7f959c1ff920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.921+0000 7f95a2dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f959c0cb6e0 0x7f959c0c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.921+0000 7f95a2dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f959c0c8180 0x7f959c202590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.921+0000 7f95a2dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c159af0 con 0x7f959c0c9970 2023-07-11T00:30:37.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.921+0000 7f95a2dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c158bb0 con 0x7f959c0c8180 2023-07-11T00:30:37.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.921+0000 7f95a2dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c158030 con 0x7f959c0cb6e0 2023-07-11T00:30:37.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.922+0000 7f959bfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f959c0cb6e0 0x7f959c0c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.922+0000 7f959bfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f959c0cb6e0 0x7f959c0c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:33826/0 (socket says 172.21.15.22:33826) 2023-07-11T00:30:37.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.922+0000 7f959bfff700 1 -- 172.21.15.22:0/76960833 learned_addr learned my addr 172.21.15.22:0/76960833 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:37.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f95a139c700 1 --2- 172.21.15.22:0/76960833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f959c0c8180 0x7f959c202590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.916+0000 7fe463fff700 1 -- 172.21.15.22:0/3986586905 wait complete. 2023-07-11T00:30:37.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.919+0000 7fe463fff700 1 Processor -- start 2023-07-11T00:30:37.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.919+0000 7fe463fff700 1 -- start start 2023-07-11T00:30:37.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.921+0000 7fe463fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe45c089570 0x7fe45c0a7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.921+0000 7fe463fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe45c0cb8a0 0x7fe45c0c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.921+0000 7fe463fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe45c16c7e0 0x7fe45c0c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.921+0000 7fe463fff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c2066c0 con 0x7fe45c089570 2023-07-11T00:30:37.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.921+0000 7fe463fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c1ffa50 con 0x7fe45c16c7e0 2023-07-11T00:30:37.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.921+0000 7fe463fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c0c78f0 con 0x7fe45c0cb8a0 2023-07-11T00:30:37.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.922+0000 7fe46159a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe45c0cb8a0 0x7fe45c0c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.922+0000 7fe46159a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe45c0cb8a0 0x7fe45c0c6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:33812/0 (socket says 172.21.15.22:33812) 2023-07-11T00:30:37.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.922+0000 7fe46159a700 1 -- 172.21.15.22:0/1549066222 learned_addr learned my addr 172.21.15.22:0/1549066222 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:37.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.922+0000 7fe46259c700 1 --2- 172.21.15.22:0/1549066222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe45c16c7e0 0x7fe45c0c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.922+0000 7f5584b99700 1 -- 172.21.15.22:0/3794051340 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831212038 0 0) 0x7f55800ccb70 con 0x7f55800adce0 2023-07-11T00:30:37.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.922+0000 7f5584b99700 1 -- 172.21.15.22:0/3794051340 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f556c0035b0 con 0x7f55800adce0 2023-07-11T00:30:37.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.921+0000 7fb9e97ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9e415c460 0x7fb9e40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.922+0000 7fb9e97ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e40d1790 con 0x7fb9e40cf8f0 2023-07-11T00:30:37.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.922+0000 7fb9e97ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e40cd950 con 0x7fb9e40d2640 2023-07-11T00:30:37.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.922+0000 7fb9e97ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40cedd0 con 0x7fb9e415c460 2023-07-11T00:30:37.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.921+0000 7fdc6e7fc700 1 -- 172.21.15.22:0/3047241340 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc64004230 con 0x7fdc700d2640 2023-07-11T00:30:37.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.921+0000 7fdc6e7fc700 1 -- 172.21.15.22:0/3047241340 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc64004390 con 0x7fdc700d2640 2023-07-11T00:30:37.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.921+0000 7fdc6e7fc700 1 -- 172.21.15.22:0/3047241340 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc640036a0 con 0x7fdc700d2640 2023-07-11T00:30:37.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.922+0000 7fdc75dff700 1 -- 172.21.15.22:0/3047241340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc700d2640 msgr2=0x7fdc700b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.922+0000 7fdc75dff700 1 --2- 172.21.15.22:0/3047241340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc700d2640 0x7fdc700b59d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdc640097f0 tx=0x7fdc64009b00 comp rx=0 tx=0).stop 2023-07-11T00:30:37.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f5584b99700 1 -- 172.21.15.22:0/3794051340 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2755214792 0 0) 0x7f556c0035b0 con 0x7f55800adce0 2023-07-11T00:30:37.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f5584b99700 1 -- 172.21.15.22:0/3794051340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5580160930 msgr2=0x7f5580070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:37.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f5584b99700 1 --2- 172.21.15.22:0/3794051340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5580160930 0x7f5580070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f5584b99700 1 -- 172.21.15.22:0/3794051340 >> v2:172.21.15.22:3300/0 conn(0x7f55800cc390 msgr2=0x7f55800ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:37.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f5584b99700 1 --2- 172.21.15.22:0/3794051340 >> v2:172.21.15.22:3300/0 conn(0x7f55800cc390 0x7f55800ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f5584b99700 1 -- 172.21.15.22:0/3794051340 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5580164640 con 0x7f55800adce0 2023-07-11T00:30:37.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f5584b99700 1 -- 172.21.15.22:0/3794051340 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7f5570001670 con 0x7f55800adce0 2023-07-11T00:30:37.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7fe46159a700 1 -- 172.21.15.22:0/1549066222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe45c16c7e0 msgr2=0x7fe45c0c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7fe46159a700 1 --2- 172.21.15.22:0/1549066222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe45c16c7e0 0x7fe45c0c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7fe46159a700 1 -- 172.21.15.22:0/1549066222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe45c089570 msgr2=0x7fe45c0a7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7fe46159a700 1 --2- 172.21.15.22:0/1549066222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe45c089570 0x7fe45c0a7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7fe46159a700 1 -- 172.21.15.22:0/1549066222 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe458008050 con 0x7fe45c0cb8a0 2023-07-11T00:30:37.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f5584b99700 1 -- 172.21.15.22:0/3794051340 >> v1:172.21.15.184:6789/0 conn(0x7f55800adce0 legacy=0x7f5580069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f5584b99700 1 --2- 172.21.15.22:0/3794051340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f556c003a00 0x7f556c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f5584b99700 1 --2- 172.21.15.22:0/3794051340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f556c004850 0x7f556c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f5584b99700 1 --2- 172.21.15.22:0/3794051340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f556c005200 0x7f556c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f5584b99700 1 -- 172.21.15.22:0/3794051340 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55800ae160 con 0x7f556c003a00 2023-07-11T00:30:37.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f5584b99700 1 -- 172.21.15.22:0/3794051340 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5580165400 con 0x7f556c005200 2023-07-11T00:30:37.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f5584b99700 1 -- 172.21.15.22:0/3794051340 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c00c130 con 0x7f556c004850 2023-07-11T00:30:37.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7fdc75dff700 1 -- 172.21.15.22:0/3047241340 shutdown_connections 2023-07-11T00:30:37.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7fdc75dff700 1 --2- 172.21.15.22:0/3047241340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc700d2640 0x7fdc700b59d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7fdc75dff700 1 -- 172.21.15.22:0/3047241340 >> 172.21.15.22:0/3047241340 conn(0x7fdc70071660 msgr2=0x7fdc70071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:37.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7fe46159a700 1 --2- 172.21.15.22:0/1549066222 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe45c0cb8a0 0x7fe45c0c6b50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe458000c00 tx=0x7fe458004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f959bfff700 1 -- 172.21.15.22:0/76960833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f959c0c8180 msgr2=0x7f959c202590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f959bfff700 1 --2- 172.21.15.22:0/76960833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f959c0c8180 0x7f959c202590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f959bfff700 1 -- 172.21.15.22:0/76960833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f959c0c9970 msgr2=0x7f959c1ff920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f959bfff700 1 --2- 172.21.15.22:0/76960833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f959c0c9970 0x7f959c1ff920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7f959bfff700 1 -- 172.21.15.22:0/76960833 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9590009e70 con 0x7f959c0cb6e0 2023-07-11T00:30:37.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7fb9e27fc700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb9e40d2640 0x7fb9e40cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:41106/0 (socket says 172.21.15.22:41106) 2023-07-11T00:30:37.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7fb9e27fc700 1 -- 172.21.15.22:0/3413337610 learned_addr learned my addr 172.21.15.22:0/3413337610 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:37.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7fb9e2ffd700 1 --2- 172.21.15.22:0/3413337610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9e415c460 0x7fb9e40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.924+0000 7f558539a700 1 --2- 172.21.15.22:0/3794051340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f556c004850 0x7f556c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.923+0000 7fdc75dff700 1 -- 172.21.15.22:0/3047241340 shutdown_connections 2023-07-11T00:30:37.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.924+0000 7f959bfff700 1 --2- 172.21.15.22:0/76960833 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f959c0cb6e0 0x7f959c0c7c40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f959c071580 tx=0x7f9590004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.925+0000 7f95997fa700 1 -- 172.21.15.22:0/76960833 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95900094e0 con 0x7f959c0cb6e0 2023-07-11T00:30:37.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.925+0000 7f95997fa700 1 -- 172.21.15.22:0/76960833 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9590009640 con 0x7f959c0cb6e0 2023-07-11T00:30:37.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.925+0000 7f95997fa700 1 -- 172.21.15.22:0/76960833 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95900038e0 con 0x7f959c0cb6e0 2023-07-11T00:30:37.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.924+0000 7f558639c700 1 --2- 172.21.15.22:0/3794051340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f556c005200 0x7f556c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.924+0000 7f558539a700 1 -- 172.21.15.22:0/3794051340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f556c005200 msgr2=0x7f556c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:37.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.924+0000 7f558539a700 1 --2- 172.21.15.22:0/3794051340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f556c005200 0x7f556c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.924+0000 7f558539a700 1 -- 172.21.15.22:0/3794051340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f556c003a00 msgr2=0x7f556c003e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-11T00:30:37.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.924+0000 7f558539a700 1 --2- 172.21.15.22:0/3794051340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f556c003a00 0x7f556c003e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.924+0000 7f558539a700 1 -- 172.21.15.22:0/3794051340 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c0035b0 con 0x7f556c004850 2023-07-11T00:30:37.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.925+0000 7f558539a700 1 --2- 172.21.15.22:0/3794051340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f556c004850 0x7f556c004cc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f557c009940 tx=0x7f556c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e565362d1a013fa server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.925+0000 7fb9e2ffd700 1 -- 172.21.15.22:0/3413337610 >> v1:172.21.15.184:6789/0 conn(0x7fb9e40d2640 legacy=0x7fb9e40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.925+0000 7fb9e2ffd700 1 -- 172.21.15.22:0/3413337610 >> v1:172.21.15.22:6789/0 conn(0x7fb9e40cf8f0 legacy=0x7fb9e415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:37.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.925+0000 7fb9e2ffd700 1 -- 172.21.15.22:0/3413337610 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40d14b0 con 0x7fb9e415c460 2023-07-11T00:30:37.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.926+0000 7f95a2dff700 1 -- 172.21.15.22:0/76960833 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959c158310 con 0x7f959c0cb6e0 2023-07-11T00:30:37.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.925+0000 7f5584b99700 1 -- 172.21.15.22:0/3794051340 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c011620 con 0x7f556c004850 2023-07-11T00:30:37.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.925+0000 7f5584b99700 1 -- 172.21.15.22:0/3794051340 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c011780 con 0x7f556c004850 2023-07-11T00:30:37.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.925+0000 7f5584b99700 1 -- 172.21.15.22:0/3794051340 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c011b10 con 0x7f556c004850 2023-07-11T00:30:37.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.926+0000 7f5587dff700 1 -- 172.21.15.22:0/3794051340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f556c004850 msgr2=0x7f556c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.926+0000 7f5587dff700 1 --2- 172.21.15.22:0/3794051340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f556c004850 0x7f556c004cc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f557c009940 tx=0x7f556c005880 comp rx=0 tx=0).stop 2023-07-11T00:30:37.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.926+0000 7f558639c700 1 -- 172.21.15.22:0/3794051340 reap_dead start 2023-07-11T00:30:37.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.924+0000 7fdc75dff700 1 -- 172.21.15.22:0/3047241340 wait complete. 2023-07-11T00:30:37.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.926+0000 7f95a2dff700 1 -- 172.21.15.22:0/76960833 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959c1588d0 con 0x7f959c0cb6e0 2023-07-11T00:30:37.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.927+0000 7fed0b9ff700 1 Processor -- start 2023-07-11T00:30:37.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.925+0000 7fe4527fc700 1 -- 172.21.15.22:0/1549066222 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45800f070 con 0x7fe45c0cb8a0 2023-07-11T00:30:37.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.927+0000 7f95a2dff700 1 -- 172.21.15.22:0/76960833 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f959c0cd9a0 con 0x7f959c0cb6e0 2023-07-11T00:30:37.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.929+0000 7f95997fa700 1 -- 172.21.15.22:0/76960833 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9590003a40 con 0x7f959c0cb6e0 2023-07-11T00:30:37.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.925+0000 7fe4527fc700 1 -- 172.21.15.22:0/1549066222 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe458004240 con 0x7fe45c0cb8a0 2023-07-11T00:30:37.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.925+0000 7fe4527fc700 1 -- 172.21.15.22:0/1549066222 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4580045d0 con 0x7fe45c0cb8a0 2023-07-11T00:30:37.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.925+0000 7fe463fff700 1 -- 172.21.15.22:0/1549066222 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45c0c7bd0 con 0x7fe45c0cb8a0 2023-07-11T00:30:37.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.925+0000 7fe463fff700 1 -- 172.21.15.22:0/1549066222 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45c0c8190 con 0x7fe45c0cb8a0 2023-07-11T00:30:37.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.929+0000 7fe463fff700 1 -- 172.21.15.22:0/1549066222 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe444000fc0 con 0x7fe45c0cb8a0 2023-07-11T00:30:37.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.929+0000 7fe4527fc700 1 -- 172.21.15.22:0/1549066222 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe4580036a0 con 0x7fe45c0cb8a0 2023-07-11T00:30:37.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.927+0000 7f5587dff700 1 -- 172.21.15.22:0/3794051340 shutdown_connections 2023-07-11T00:30:37.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.927+0000 7f5587dff700 1 -- 172.21.15.22:0/3794051340 >> 172.21.15.22:0/3794051340 conn(0x7f55800b0390 msgr2=0x7f55800b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:37.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.927+0000 7fb9e2ffd700 1 --2- 172.21.15.22:0/3413337610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9e415c460 0x7fb9e40b59d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009dc0 tx=0x7fb9dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdbc8154ceaeb162 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.928+0000 7fb9e1ffb700 1 -- 172.21.15.22:0/3413337610 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc00e070 con 0x7fb9e415c460 2023-07-11T00:30:37.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.928+0000 7fb9e1ffb700 1 -- 172.21.15.22:0/3413337610 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc00bb90 con 0x7fb9e415c460 2023-07-11T00:30:37.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.928+0000 7fb9e1ffb700 1 -- 172.21.15.22:0/3413337610 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc003a20 con 0x7fb9e415c460 2023-07-11T00:30:37.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.931+0000 7fb9e97ff700 1 -- 172.21.15.22:0/3413337610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9e415c460 msgr2=0x7fb9e40b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.931+0000 7fb9e97ff700 1 --2- 172.21.15.22:0/3413337610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9e415c460 0x7fb9e40b59d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009dc0 tx=0x7fb9dc00b330 comp rx=0 tx=0).stop 2023-07-11T00:30:37.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.927+0000 7fed0b9ff700 1 -- start start 2023-07-11T00:30:37.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.929+0000 7fed0b9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed040ce1b0 0x7fed040cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.929+0000 7fed0b9ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fed040b1c70 0x7fed040ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.929+0000 7fed0b9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0415d230 con 0x7fed0415d6c0 2023-07-11T00:30:37.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.929+0000 7fed0b9ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed040c9e60 con 0x7fed040b1c70 2023-07-11T00:30:37.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.929+0000 7fed0b9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed040cd920 con 0x7fed040ce1b0 2023-07-11T00:30:37.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.931+0000 7f95997fa700 1 --2- 172.21.15.22:0/76960833 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f958806ad30 0x7f958806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.931+0000 7fed0979b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed040ce1b0 0x7fed040cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.931+0000 7fed09f9c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fed0415d6c0 0x7fed04071530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:41122/0 (socket says 172.21.15.22:41122) 2023-07-11T00:30:37.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.931+0000 7fed09f9c700 1 -- 172.21.15.22:0/810521519 learned_addr learned my addr 172.21.15.22:0/810521519 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:37.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.932+0000 7fed08f9a700 1 --2- 172.21.15.22:0/810521519 >> v2:172.21.15.184:3300/0 conn(0x7fed040b1c70 0x7fed040ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.932+0000 7fe4527fc700 1 --2- 172.21.15.22:0/1549066222 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe44006adb0 0x7fe44006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.930+0000 7fdc75dff700 1 Processor -- start 2023-07-11T00:30:37.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.930+0000 7fdc75dff700 1 -- start start 2023-07-11T00:30:37.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.931+0000 7f95997fa700 1 -- 172.21.15.22:0/76960833 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f959000e030 con 0x7f959c0cb6e0 2023-07-11T00:30:37.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.932+0000 7f95997fa700 1 --2- 172.21.15.22:0/76960833 >> [v2:172.21.15.22:6800/1848675559,v1:172.21.15.22:6801/1848675559] conn(0x7f9588074980 0x7f9588076db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.932+0000 7f95997fa700 1 -- 172.21.15.22:0/76960833 --> [v2:172.21.15.22:6800/1848675559,v1:172.21.15.22:6801/1848675559] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9588077480 con 0x7f9588074980 2023-07-11T00:30:37.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.932+0000 7f95997fa700 1 -- 172.21.15.22:0/76960833 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9590054f90 con 0x7f959c0cb6e0 2023-07-11T00:30:37.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.932+0000 7f95a139c700 1 --2- 172.21.15.22:0/76960833 >> [v2:172.21.15.22:6800/1848675559,v1:172.21.15.22:6801/1848675559] conn(0x7f9588074980 0x7f9588076db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.932+0000 7fe4527fc700 1 -- 172.21.15.22:0/1549066222 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe45808a130 con 0x7fe45c0cb8a0 2023-07-11T00:30:37.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.932+0000 7fe4527fc700 1 --2- 172.21.15.22:0/1549066222 >> [v2:172.21.15.22:6821/3888588990,v1:172.21.15.22:6822/3888588990] conn(0x7fe440074a80 0x7fe440076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.932+0000 7fe4527fc700 1 -- 172.21.15.22:0/1549066222 --> [v2:172.21.15.22:6821/3888588990,v1:172.21.15.22:6822/3888588990] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe440077580 con 0x7fe440074a80 2023-07-11T00:30:37.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.932+0000 7fe4527fc700 1 -- 172.21.15.22:0/1549066222 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe45808c750 con 0x7fe45c0cb8a0 2023-07-11T00:30:37.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.933+0000 7fe461d9b700 1 --2- 172.21.15.22:0/1549066222 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe44006adb0 0x7fe44006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.932+0000 7fdc75dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc700cf8f0 0x7fdc701f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.932+0000 7fdc75dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc700d2640 0x7fdc700cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.932+0000 7fdc75dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc7015c460 0x7fdc7015d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.932+0000 7fdc75dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc701591f0 con 0x7fdc7015c460 2023-07-11T00:30:37.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.932+0000 7fdc75dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc701588c0 con 0x7fdc700d2640 2023-07-11T00:30:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.932+0000 7fdc75dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc70158ba0 con 0x7fdc700cf8f0 2023-07-11T00:30:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.933+0000 7fe46259c700 1 --2- 172.21.15.22:0/1549066222 >> [v2:172.21.15.22:6821/3888588990,v1:172.21.15.22:6822/3888588990] conn(0x7fe440074a80 0x7fe440076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.933+0000 7f5587dff700 1 -- 172.21.15.22:0/3794051340 shutdown_connections 2023-07-11T00:30:37.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.933+0000 7f95a139c700 1 --2- 172.21.15.22:0/76960833 >> [v2:172.21.15.22:6800/1848675559,v1:172.21.15.22:6801/1848675559] conn(0x7f9588074980 0x7f9588076db0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.933+0000 7fdc6ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc7015c460 0x7fdc7015d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.933+0000 7fdc6ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc7015c460 0x7fdc7015d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45584/0 (socket says 172.21.15.22:45584) 2023-07-11T00:30:37.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.933+0000 7fdc6ffff700 1 -- 172.21.15.22:0/488525779 learned_addr learned my addr 172.21.15.22:0/488525779 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:37.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.933+0000 7fdc6effd700 1 --2- 172.21.15.22:0/488525779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc700d2640 0x7fdc700cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.934+0000 7fdc6f7fe700 1 --2- 172.21.15.22:0/488525779 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc700cf8f0 0x7fdc701f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.934+0000 7f95a0b9b700 1 --2- 172.21.15.22:0/76960833 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f958806ad30 0x7f958806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.933+0000 7fb9e97ff700 1 -- 172.21.15.22:0/3413337610 shutdown_connections 2023-07-11T00:30:37.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.933+0000 7fb9e97ff700 1 --2- 172.21.15.22:0/3413337610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9e415c460 0x7fb9e40b59d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.933+0000 7fb9e97ff700 1 -- 172.21.15.22:0/3413337610 >> 172.21.15.22:0/3413337610 conn(0x7fb9e4071660 msgr2=0x7fb9e4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:37.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.934+0000 7fecfbfff700 1 -- 172.21.15.22:0/810521519 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426009205 0 0) 0x7fed0415d230 con 0x7fed0415d6c0 2023-07-11T00:30:37.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.935+0000 7fecfbfff700 1 -- 172.21.15.22:0/810521519 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecf00035b0 con 0x7fed0415d6c0 2023-07-11T00:30:37.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.935+0000 7fed08f9a700 1 -- 172.21.15.22:0/810521519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed040ce1b0 msgr2=0x7fed040cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:37.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.935+0000 7fed08f9a700 1 --2- 172.21.15.22:0/810521519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed040ce1b0 0x7fed040cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.935+0000 7fed08f9a700 1 -- 172.21.15.22:0/810521519 >> v1:172.21.15.184:6789/0 conn(0x7fed0415d6c0 legacy=0x7fed04071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.935+0000 7fed08f9a700 1 -- 172.21.15.22:0/810521519 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed040ceac0 con 0x7fed040b1c70 2023-07-11T00:30:37.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.933+0000 7f5587dff700 1 -- 172.21.15.22:0/3794051340 wait complete. 2023-07-11T00:30:37.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.935+0000 7ff4d97ff700 1 Processor -- start 2023-07-11T00:30:37.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.935+0000 7fe461d9b700 1 --2- 172.21.15.22:0/1549066222 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe44006adb0 0x7fe44006d260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe4540015f0 tx=0x7fe454001740 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.935+0000 7fb9e97ff700 1 -- 172.21.15.22:0/3413337610 shutdown_connections 2023-07-11T00:30:37.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.935+0000 7fdc6ffff700 1 -- 172.21.15.22:0/488525779 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc700cf8f0 msgr2=0x7fdc701f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.935+0000 7fdc6ffff700 1 --2- 172.21.15.22:0/488525779 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc700cf8f0 0x7fdc701f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.935+0000 7fdc6ffff700 1 -- 172.21.15.22:0/488525779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc700d2640 msgr2=0x7fdc700cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.935+0000 7fdc6ffff700 1 --2- 172.21.15.22:0/488525779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc700d2640 0x7fdc700cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.935+0000 7fdc6ffff700 1 -- 172.21.15.22:0/488525779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc640094a0 con 0x7fdc7015c460 2023-07-11T00:30:37.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.935+0000 7ff4d97ff700 1 -- start start 2023-07-11T00:30:37.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.936+0000 7fed08f9a700 1 --2- 172.21.15.22:0/810521519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed040b1c70 0x7fed040ce580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed00009840 tx=0x7fed00009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c27d7d1c6f4ed614 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.936+0000 7fecfbfff700 1 -- 172.21.15.22:0/810521519 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed00004230 con 0x7fed040b1c70 2023-07-11T00:30:37.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.936+0000 7fecfbfff700 1 -- 172.21.15.22:0/810521519 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed00004390 con 0x7fed040b1c70 2023-07-11T00:30:37.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.936+0000 7fecfbfff700 1 -- 172.21.15.22:0/810521519 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed000036a0 con 0x7fed040b1c70 2023-07-11T00:30:37.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.936+0000 7fdc6ffff700 1 --2- 172.21.15.22:0/488525779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc7015c460 0x7fdc7015d9b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdc68001f70 tx=0x7fdc6800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.935+0000 7f95a0b9b700 1 --2- 172.21.15.22:0/76960833 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f958806ad30 0x7f958806d1e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f958c003df0 tx=0x7f958c007a40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.935+0000 7f95997fa700 1 -- 172.21.15.22:0/76960833 <== osd.1 v2:172.21.15.22:6800/1848675559 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9588077480 con 0x7f9588074980 2023-07-11T00:30:37.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.936+0000 7f5587dff700 1 Processor -- start 2023-07-11T00:30:37.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.936+0000 7fe46259c700 1 --2- 172.21.15.22:0/1549066222 >> [v2:172.21.15.22:6821/3888588990,v1:172.21.15.22:6822/3888588990] conn(0x7fe440074a80 0x7fe440076eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.937+0000 7f5587dff700 1 -- start start 2023-07-11T00:30:37.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.937+0000 7fdc57fff700 1 -- 172.21.15.22:0/488525779 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6800acd0 con 0x7fdc7015c460 2023-07-11T00:30:37.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.937+0000 7fdc57fff700 1 -- 172.21.15.22:0/488525779 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6800ae30 con 0x7fdc7015c460 2023-07-11T00:30:37.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.937+0000 7fdc57fff700 1 -- 172.21.15.22:0/488525779 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc680072d0 con 0x7fdc7015c460 2023-07-11T00:30:37.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.937+0000 7fdc75dff700 1 -- 172.21.15.22:0/488525779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc70158e80 con 0x7fdc7015c460 2023-07-11T00:30:37.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.937+0000 7fdc75dff700 1 -- 172.21.15.22:0/488525779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7015b520 con 0x7fdc7015c460 2023-07-11T00:30:37.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.938+0000 7f5587dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f556c004850 0x7f5580150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.938+0000 7f5587dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5580150fc0 0x7f5580143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.938+0000 7f5585b9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f556c004850 0x7f5580150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.938+0000 7f5585b9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f556c004850 0x7f5580150a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45590/0 (socket says 172.21.15.22:45590) 2023-07-11T00:30:37.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.939+0000 7fed0b9ff700 1 -- 172.21.15.22:0/810521519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed040b1c70 msgr2=0x7fed040ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.939+0000 7fed0b9ff700 1 --2- 172.21.15.22:0/810521519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed040b1c70 0x7fed040ce580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed00009840 tx=0x7fed00009b50 comp rx=0 tx=0).stop 2023-07-11T00:30:37.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.936+0000 7fb9e97ff700 1 -- 172.21.15.22:0/3413337610 wait complete. 2023-07-11T00:30:37.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.939+0000 7fb9e97ff700 1 Processor -- start 2023-07-11T00:30:37.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.939+0000 7f558539a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5580150fc0 0x7f5580143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.939+0000 7f558539a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5580150fc0 0x7f5580143fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:37408/0 (socket says 172.21.15.22:37408) 2023-07-11T00:30:37.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.939+0000 7fe4527fc700 1 -- 172.21.15.22:0/1549066222 <== osd.2 v2:172.21.15.22:6821/3888588990 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe440077580 con 0x7fe440074a80 2023-07-11T00:30:37.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.939+0000 7ff4d97ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4d4070340 0x7ff4d406a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.939+0000 7ff4d97ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff4d4070a50 0x7ff4d4070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.939+0000 7ff4d97ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d415e210 con 0x7ff4d4157f10 2023-07-11T00:30:37.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.939+0000 7ff4d97ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d406d900 con 0x7ff4d4070a50 2023-07-11T00:30:37.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.939+0000 7ff4d97ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d4071410 con 0x7ff4d4070340 2023-07-11T00:30:37.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.940+0000 7f5587dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5580144510 0x7f5580144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.940+0000 7f5587dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5580151430 con 0x7f556c004850 2023-07-11T00:30:37.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.940+0000 7f5587dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55800c3630 con 0x7f5580150fc0 2023-07-11T00:30:37.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.940+0000 7f5587dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55800c31a0 con 0x7f5580144510 2023-07-11T00:30:37.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.940+0000 7f5585b9b700 1 -- 172.21.15.22:0/2753864543 learned_addr learned my addr 172.21.15.22:0/2753864543 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:37.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.939+0000 7fb9e97ff700 1 -- start start 2023-07-11T00:30:37.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.940+0000 7fdc75dff700 1 -- 172.21.15.22:0/488525779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdc700cd5e0 con 0x7fdc7015c460 2023-07-11T00:30:37.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.940+0000 7ff4d37fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff4d4070a50 0x7ff4d4070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.940+0000 7ff4d37fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff4d4070a50 0x7ff4d4070ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:37416/0 (socket says 172.21.15.22:37416) 2023-07-11T00:30:37.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.940+0000 7ff4d37fe700 1 -- 172.21.15.22:0/3226691634 learned_addr learned my addr 172.21.15.22:0/3226691634 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:37.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.941+0000 7fed0b9ff700 1 -- 172.21.15.22:0/810521519 shutdown_connections 2023-07-11T00:30:37.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.941+0000 7fed0b9ff700 1 --2- 172.21.15.22:0/810521519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed040ce1b0 0x7fed040cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.941+0000 7fed0b9ff700 1 --2- 172.21.15.22:0/810521519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed040b1c70 0x7fed040ce580 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.941+0000 7fed0b9ff700 1 -- 172.21.15.22:0/810521519 >> 172.21.15.22:0/810521519 conn(0x7fed040cc290 msgr2=0x7fed040cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:37.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.941+0000 7f558639c700 1 --2- 172.21.15.22:0/2753864543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5580144510 0x7f5580144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.941+0000 7fed0b9ff700 1 -- 172.21.15.22:0/810521519 shutdown_connections 2023-07-11T00:30:37.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.941+0000 7ff4d27fc700 1 --2- 172.21.15.22:0/3226691634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4d4070340 0x7ff4d406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.941+0000 7fed0b9ff700 1 -- 172.21.15.22:0/810521519 wait complete. 2023-07-11T00:30:37.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.942+0000 7ff4d27fc700 1 -- 172.21.15.22:0/3226691634 >> v2:172.21.15.184:3300/0 conn(0x7ff4d4070a50 msgr2=0x7ff4d4070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:37.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.942+0000 7ff4d27fc700 1 --2- 172.21.15.22:0/3226691634 >> v2:172.21.15.184:3300/0 conn(0x7ff4d4070a50 0x7ff4d4070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.942+0000 7ff4d27fc700 1 -- 172.21.15.22:0/3226691634 >> v1:172.21.15.22:6789/0 conn(0x7ff4d4157f10 legacy=0x7ff4d415e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:37.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.942+0000 7ff4d27fc700 1 -- 172.21.15.22:0/3226691634 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d415dee0 con 0x7ff4d4070340 2023-07-11T00:30:37.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.942+0000 7ff4d37fe700 1 --2- 172.21.15.22:0/3226691634 >> v2:172.21.15.184:3300/0 conn(0x7ff4d4070a50 0x7ff4d4070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:30:37.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.942+0000 7f558639c700 1 -- 172.21.15.22:0/2753864543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5580150fc0 msgr2=0x7f5580143fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.942+0000 7f558639c700 1 --2- 172.21.15.22:0/2753864543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5580150fc0 0x7f5580143fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.942+0000 7f558639c700 1 -- 172.21.15.22:0/2753864543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f556c004850 msgr2=0x7f5580150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.942+0000 7f558639c700 1 --2- 172.21.15.22:0/2753864543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f556c004850 0x7f5580150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.942+0000 7f558639c700 1 -- 172.21.15.22:0/2753864543 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55800c22d0 con 0x7f5580144510 2023-07-11T00:30:37.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.942+0000 7f558639c700 1 --2- 172.21.15.22:0/2753864543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5580144510 0x7f5580144980 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f558006b0d0 tx=0x7f557000e830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.943+0000 7f55767fc700 1 -- 172.21.15.22:0/2753864543 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700052e0 con 0x7f5580144510 2023-07-11T00:30:37.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.943+0000 7f55767fc700 1 -- 172.21.15.22:0/2753864543 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5570005440 con 0x7f5580144510 2023-07-11T00:30:37.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.943+0000 7f55767fc700 1 -- 172.21.15.22:0/2753864543 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700038c0 con 0x7f5580144510 2023-07-11T00:30:37.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.943+0000 7f5587dff700 1 -- 172.21.15.22:0/2753864543 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55800c2590 con 0x7f5580144510 2023-07-11T00:30:37.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.943+0000 7f5587dff700 1 -- 172.21.15.22:0/2753864543 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55800c2b50 con 0x7f5580144510 2023-07-11T00:30:37.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.942+0000 7fdc57fff700 1 -- 172.21.15.22:0/488525779 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc68007430 con 0x7fdc7015c460 2023-07-11T00:30:37.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.944+0000 7fed0b9ff700 1 Processor -- start 2023-07-11T00:30:37.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.944+0000 7ff4d27fc700 1 --2- 172.21.15.22:0/3226691634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4d4070340 0x7ff4d406a940 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009840 tx=0x7ff4c4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83b5484c56681c9c server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.944+0000 7fed0b9ff700 1 -- start start 2023-07-11T00:30:37.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.945+0000 7fb9e97ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9e40cf8f0 0x7fb9e4154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.945+0000 7fb9e97ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9e40d2640 0x7fb9e40cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.945+0000 7fb9e97ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e415c460 0x7fb9e40c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.945+0000 7fb9e97ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e4154670 con 0x7fb9e415c460 2023-07-11T00:30:37.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.945+0000 7fb9e97ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40ccc20 con 0x7fb9e40d2640 2023-07-11T00:30:37.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.945+0000 7fb9e97ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e415ccc0 con 0x7fb9e40cf8f0 2023-07-11T00:30:37.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.946+0000 7fb9e2ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9e40cf8f0 0x7fb9e4154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.946+0000 7fb9e2ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9e40cf8f0 0x7fb9e4154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:33872/0 (socket says 172.21.15.22:33872) 2023-07-11T00:30:37.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.946+0000 7fb9e2ffd700 1 -- 172.21.15.22:0/2786700856 learned_addr learned my addr 172.21.15.22:0/2786700856 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:37.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.946+0000 7fb9e27fc700 1 --2- 172.21.15.22:0/2786700856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9e40d2640 0x7fb9e40cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:37.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.945+0000 7ff4d1ffb700 1 -- 172.21.15.22:0/3226691634 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4004230 con 0x7ff4d4070340 2023-07-11T00:30:37.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.945+0000 7ff4d1ffb700 1 -- 172.21.15.22:0/3226691634 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c4004390 con 0x7ff4d4070340 2023-07-11T00:30:37.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.945+0000 7ff4d1ffb700 1 -- 172.21.15.22:0/3226691634 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c40036a0 con 0x7ff4d4070340 2023-07-11T00:30:37.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.946+0000 7fb9e2ffd700 1 -- 172.21.15.22:0/2786700856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9e40d2640 msgr2=0x7fb9e40cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.946+0000 7fb9e2ffd700 1 --2- 172.21.15.22:0/2786700856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9e40d2640 0x7fb9e40cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.946+0000 7fb9e2ffd700 1 -- 172.21.15.22:0/2786700856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e415c460 msgr2=0x7fb9e40c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.946+0000 7fb9e2ffd700 1 --2- 172.21.15.22:0/2786700856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e415c460 0x7fb9e40c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:37.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.946+0000 7fb9e2ffd700 1 -- 172.21.15.22:0/2786700856 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc009a70 con 0x7fb9e40cf8f0 2023-07-11T00:30:37.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.944+0000 7f5587dff700 1 -- 172.21.15.22:0/2753864543 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5580164c00 con 0x7f5580144510 2023-07-11T00:30:37.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.947+0000 7fb9e2ffd700 1 --2- 172.21.15.22:0/2786700856 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9e40cf8f0 0x7fb9e4154130 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc000f80 tx=0x7fb9dc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:37.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.947+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/2786700856 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc012840 con 0x7fb9e40cf8f0 2023-07-11T00:30:37.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.947+0000 7fb9e97ff700 1 -- 172.21.15.22:0/2786700856 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e415cfa0 con 0x7fb9e40cf8f0 2023-07-11T00:30:37.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.947+0000 7fb9e97ff700 1 -- 172.21.15.22:0/2786700856 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e415d560 con 0x7fb9e40cf8f0 2023-07-11T00:30:37.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.948+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/2786700856 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc0129c0 con 0x7fb9e40cf8f0 2023-07-11T00:30:37.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.948+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/2786700856 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc012d70 con 0x7fb9e40cf8f0 2023-07-11T00:30:37.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.947+0000 7fdc57fff700 1 --2- 172.21.15.22:0/488525779 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdc5c06ad30 0x7fdc5c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.947+0000 7fdc57fff700 1 -- 172.21.15.22:0/488525779 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdc68089590 con 0x7fdc7015c460 2023-07-11T00:30:37.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.947+0000 7fdc57fff700 1 --2- 172.21.15.22:0/488525779 >> [v2:172.21.15.184:6809/1254324024,v1:172.21.15.184:6812/1254324024] conn(0x7fdc5c074980 0x7fdc5c076db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:37.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.947+0000 7fdc57fff700 1 -- 172.21.15.22:0/488525779 --> [v2:172.21.15.184:6809/1254324024,v1:172.21.15.184:6812/1254324024] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc5c077480 con 0x7fdc5c074980 2023-07-11T00:30:37.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.948+0000 7fdc57fff700 1 -- 172.21.15.22:0/488525779 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc680543e0 con 0x7fdc7015c460 2023-07-11T00:30:37.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.948+0000 7ff4d97ff700 1 -- 172.21.15.22:0/3226691634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4d4070340 msgr2=0x7ff4d406a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:37.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.948+0000 7ff4d97ff700 1 --2- 172.21.15.22:0/3226691634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4d4070340 0x7ff4d406a940 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009840 tx=0x7ff4c4009b50 comp rx=0 tx=0).stop 2023-07-11T00:30:37.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.948+0000 7fed0b9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed040b1c70 0x7fed0414cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.948+0000 7fed0b9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed040ce1b0 0x7fed040c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.948+0000 7fed0b9ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed0415d6c0 0x7fed040c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.948+0000 7fed0b9ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed040c4c30 con 0x7fed0415d6c0 2023-07-11T00:30:38.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.948+0000 7fed0b9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed040c4020 con 0x7fed040b1c70 2023-07-11T00:30:38.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.948+0000 7fed0b9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed040c4300 con 0x7fed040ce1b0 2023-07-11T00:30:38.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.949+0000 7fed0979b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed040b1c70 0x7fed0414cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.949+0000 7fed0979b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed040b1c70 0x7fed0414cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:37428/0 (socket says 172.21.15.22:37428) 2023-07-11T00:30:38.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.949+0000 7fed0979b700 1 -- 172.21.15.22:0/3623091739 learned_addr learned my addr 172.21.15.22:0/3623091739 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:38.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.948+0000 7f55767fc700 1 -- 172.21.15.22:0/2753864543 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5570003a20 con 0x7f5580144510 2023-07-11T00:30:38.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.949+0000 7ff4d97ff700 1 -- 172.21.15.22:0/3226691634 shutdown_connections 2023-07-11T00:30:38.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.949+0000 7ff4d97ff700 1 --2- 172.21.15.22:0/3226691634 >> v2:172.21.15.184:3300/0 conn(0x7ff4d4070a50 0x7ff4d4070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.949+0000 7ff4d97ff700 1 --2- 172.21.15.22:0/3226691634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4d4070340 0x7ff4d406a940 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.949+0000 7ff4d97ff700 1 -- 172.21.15.22:0/3226691634 >> 172.21.15.22:0/3226691634 conn(0x7ff4d40b0390 msgr2=0x7ff4d40b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.949+0000 7fed09f9c700 1 --2- 172.21.15.22:0/3623091739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed0415d6c0 0x7fed040c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.949+0000 7fed0979b700 1 -- 172.21.15.22:0/3623091739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed040ce1b0 msgr2=0x7fed040c35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.949+0000 7fed0979b700 1 --2- 172.21.15.22:0/3623091739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed040ce1b0 0x7fed040c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.949+0000 7fed0979b700 1 -- 172.21.15.22:0/3623091739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed0415d6c0 msgr2=0x7fed040c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.949+0000 7fed0979b700 1 --2- 172.21.15.22:0/3623091739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed0415d6c0 0x7fed040c50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.949+0000 7fed0979b700 1 -- 172.21.15.22:0/3623091739 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed000094a0 con 0x7fed040b1c70 2023-07-11T00:30:38.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.950+0000 7fed0979b700 1 --2- 172.21.15.22:0/3623091739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed040b1c70 0x7fed0414cac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fecf400ea40 tx=0x7fecf400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.950+0000 7fecf9ffb700 1 -- 172.21.15.22:0/3623091739 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf400dd10 con 0x7fed040b1c70 2023-07-11T00:30:38.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.950+0000 7fecf9ffb700 1 -- 172.21.15.22:0/3623091739 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf400de70 con 0x7fed040b1c70 2023-07-11T00:30:38.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.950+0000 7fed0b9ff700 1 -- 172.21.15.22:0/3623091739 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed040c45e0 con 0x7fed040b1c70 2023-07-11T00:30:38.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.950+0000 7fecf9ffb700 1 -- 172.21.15.22:0/3623091739 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4010640 con 0x7fed040b1c70 2023-07-11T00:30:38.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.950+0000 7fed0b9ff700 1 -- 172.21.15.22:0/3623091739 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0415b870 con 0x7fed040b1c70 2023-07-11T00:30:38.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.950+0000 7ff4d97ff700 1 -- 172.21.15.22:0/3226691634 shutdown_connections 2023-07-11T00:30:38.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.950+0000 7f55767fc700 1 --2- 172.21.15.22:0/2753864543 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f556406adb0 0x7f556406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.950+0000 7f55767fc700 1 -- 172.21.15.22:0/2753864543 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5570089030 con 0x7f5580144510 2023-07-11T00:30:38.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.951+0000 7f55767fc700 1 --2- 172.21.15.22:0/2753864543 >> [v2:172.21.15.22:6808/3717370188,v1:172.21.15.22:6809/3717370188] conn(0x7f5564074a80 0x7f5564076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.951+0000 7f55767fc700 1 -- 172.21.15.22:0/2753864543 --> [v2:172.21.15.22:6808/3717370188,v1:172.21.15.22:6809/3717370188] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5564077580 con 0x7f5564074a80 2023-07-11T00:30:38.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.951+0000 7f55767fc700 1 -- 172.21.15.22:0/2753864543 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55700893e0 con 0x7f5580144510 2023-07-11T00:30:38.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.951+0000 7fb9e97ff700 1 -- 172.21.15.22:0/2786700856 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb9c4000fc0 con 0x7fb9e40cf8f0 2023-07-11T00:30:38.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.950+0000 7fdc6f7fe700 1 --2- 172.21.15.22:0/488525779 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdc5c06ad30 0x7fdc5c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.950+0000 7ff4d97ff700 1 -- 172.21.15.22:0/3226691634 wait complete. 2023-07-11T00:30:38.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.952+0000 7f5585b9b700 1 --2- 172.21.15.22:0/2753864543 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f556406adb0 0x7f556406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.952+0000 7f558539a700 1 --2- 172.21.15.22:0/2753864543 >> [v2:172.21.15.22:6808/3717370188,v1:172.21.15.22:6809/3717370188] conn(0x7f5564074a80 0x7f5564076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.953+0000 7ff4d97ff700 1 Processor -- start 2023-07-11T00:30:38.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.952+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/2786700856 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb9dc01d420 con 0x7fb9e40cf8f0 2023-07-11T00:30:38.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.953+0000 7fb9cb7fe700 1 --2- 172.21.15.22:0/2786700856 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb9d006ace0 0x7fb9d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.953+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/2786700856 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb9dc08be60 con 0x7fb9e40cf8f0 2023-07-11T00:30:38.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.953+0000 7fb9cb7fe700 1 --2- 172.21.15.22:0/2786700856 >> [v2:172.21.15.184:6808/1848255557,v1:172.21.15.184:6811/1848255557] conn(0x7fb9d00749b0 0x7fb9d0076de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.953+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/2786700856 --> [v2:172.21.15.184:6808/1848255557,v1:172.21.15.184:6811/1848255557] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb9d00774b0 con 0x7fb9d00749b0 2023-07-11T00:30:38.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.953+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/2786700856 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9dc08e480 con 0x7fb9e40cf8f0 2023-07-11T00:30:38.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.953+0000 7f5585b9b700 1 --2- 172.21.15.22:0/2753864543 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f556406adb0 0x7f556406d260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f55780113d0 tx=0x7f557800b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.953+0000 7f558539a700 1 --2- 172.21.15.22:0/2753864543 >> [v2:172.21.15.22:6808/3717370188,v1:172.21.15.22:6809/3717370188] conn(0x7f5564074a80 0x7f5564076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.953+0000 7ff4d97ff700 1 -- start start 2023-07-11T00:30:38.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.953+0000 7fb9e37fe700 1 --2- 172.21.15.22:0/2786700856 >> [v2:172.21.15.184:6808/1848255557,v1:172.21.15.184:6811/1848255557] conn(0x7fb9d00749b0 0x7fb9d0076de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.955+0000 7f3671bff700 1 -- 172.21.15.22:0/684802366 --> [v2:172.21.15.22:6816/3770043857,v1:172.21.15.22:6817/3770043857] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f366c0cd6c0 con 0x7f3658074a00 2023-07-11T00:30:38.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.955+0000 7fb9e27fc700 1 --2- 172.21.15.22:0/2786700856 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb9d006ace0 0x7fb9d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.956+0000 7fb9e37fe700 1 --2- 172.21.15.22:0/2786700856 >> [v2:172.21.15.184:6808/1848255557,v1:172.21.15.184:6811/1848255557] conn(0x7fb9d00749b0 0x7fb9d0076de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.955+0000 7fecef7fe700 1 -- 172.21.15.22:0/3623091739 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fed0415cbe0 con 0x7fed040b1c70 2023-07-11T00:30:38.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.956+0000 7fdc6f7fe700 1 --2- 172.21.15.22:0/488525779 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdc5c06ad30 0x7fdc5c06d1e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdc60007fd0 tx=0x7fdc60009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.955+0000 7ff4d97ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4d4070340 0x7ff4d414d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.955+0000 7ff4d97ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4d4070a50 0x7ff4d40c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.955+0000 7ff4d97ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4d4157f10 0x7ff4d40c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.955+0000 7ff4d97ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d4148bb0 con 0x7ff4d4070340 2023-07-11T00:30:38.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.955+0000 7ff4d97ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40c6d20 con 0x7ff4d4157f10 2023-07-11T00:30:38.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.955+0000 7ff4d97ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d41487f0 con 0x7ff4d4070a50 2023-07-11T00:30:38.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.955+0000 7ff4d37fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4d4157f10 0x7ff4d40c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.955+0000 7ff4d2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4d4070340 0x7ff4d414d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.955+0000 7ff4d37fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4d4157f10 0x7ff4d40c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:37442/0 (socket says 172.21.15.22:37442) 2023-07-11T00:30:38.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.955+0000 7ff4d37fe700 1 -- 172.21.15.22:0/3528107492 learned_addr learned my addr 172.21.15.22:0/3528107492 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:38.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.956+0000 7fb9e27fc700 1 --2- 172.21.15.22:0/2786700856 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb9d006ace0 0x7fb9d006d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4071630 tx=0x7fb9d4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.956+0000 7ff4d27fc700 1 --2- 172.21.15.22:0/3528107492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4d4070a50 0x7ff4d40c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.956+0000 7ff4d37fe700 1 -- 172.21.15.22:0/3528107492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4d4070a50 msgr2=0x7ff4d40c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.956+0000 7ff4d37fe700 1 --2- 172.21.15.22:0/3528107492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4d4070a50 0x7ff4d40c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.956+0000 7ff4d37fe700 1 -- 172.21.15.22:0/3528107492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4d4070340 msgr2=0x7ff4d414d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.956+0000 7ff4d37fe700 1 --2- 172.21.15.22:0/3528107492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4d4070340 0x7ff4d414d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.956+0000 7ff4d37fe700 1 -- 172.21.15.22:0/3528107492 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4cc009b30 con 0x7ff4d4157f10 2023-07-11T00:30:38.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.956+0000 7ff4d37fe700 1 --2- 172.21.15.22:0/3528107492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4d4157f10 0x7ff4d40c67e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00efc0 tx=0x7ff4cc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.957+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/2786700856 <== osd.4 v2:172.21.15.184:6808/1848255557 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb9d00774b0 con 0x7fb9d00749b0 2023-07-11T00:30:38.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.957+0000 7ff4cb7fe700 1 -- 172.21.15.22:0/3528107492 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc018070 con 0x7ff4d4157f10 2023-07-11T00:30:38.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.957+0000 7ff4cb7fe700 1 -- 172.21.15.22:0/3528107492 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc00f040 con 0x7ff4d4157f10 2023-07-11T00:30:38.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.957+0000 7ff4cb7fe700 1 -- 172.21.15.22:0/3528107492 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc003c20 con 0x7ff4d4157f10 2023-07-11T00:30:38.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.957+0000 7ff4d97ff700 1 -- 172.21.15.22:0/3528107492 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c40094a0 con 0x7ff4d4157f10 2023-07-11T00:30:38.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.957+0000 7f55767fc700 1 -- 172.21.15.22:0/2753864543 <== osd.3 v2:172.21.15.22:6808/3717370188 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5564077580 con 0x7f5564074a80 2023-07-11T00:30:38.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.959+0000 7fecf9ffb700 1 -- 172.21.15.22:0/3623091739 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fecf40107a0 con 0x7fed040b1c70 2023-07-11T00:30:38.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.959+0000 7f3653fff700 1 -- 172.21.15.22:0/684802366 <== osd.0 v2:172.21.15.22:6816/3770043857 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f36600011b0 con 0x7f3658074a00 2023-07-11T00:30:38.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.959+0000 7fdc6effd700 1 --2- 172.21.15.22:0/488525779 >> [v2:172.21.15.184:6809/1254324024,v1:172.21.15.184:6812/1254324024] conn(0x7fdc5c074980 0x7fdc5c076db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.959+0000 7f3671bff700 1 -- 172.21.15.22:0/684802366 >> [v2:172.21.15.22:6816/3770043857,v1:172.21.15.22:6817/3770043857] conn(0x7f3658074a00 msgr2=0x7f3658076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.959+0000 7f3671bff700 1 --2- 172.21.15.22:0/684802366 >> [v2:172.21.15.22:6816/3770043857,v1:172.21.15.22:6817/3770043857] conn(0x7f3658074a00 0x7f3658076e30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.957+0000 7ff4d97ff700 1 -- 172.21.15.22:0/3528107492 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d40c7270 con 0x7ff4d4157f10 2023-07-11T00:30:38.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.958+0000 7ff4d97ff700 1 -- 172.21.15.22:0/3528107492 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff4d40c9220 con 0x7ff4d4157f10 2023-07-11T00:30:38.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.960+0000 7fdc6effd700 1 --2- 172.21.15.22:0/488525779 >> [v2:172.21.15.184:6809/1254324024,v1:172.21.15.184:6812/1254324024] conn(0x7fdc5c074980 0x7fdc5c076db0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.960+0000 7fecf9ffb700 1 --2- 172.21.15.22:0/3623091739 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fece806ace0 0x7fece806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.960+0000 7fecf9ffb700 1 -- 172.21.15.22:0/3623091739 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fecf4014070 con 0x7fed040b1c70 2023-07-11T00:30:38.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.961+0000 7fecf9ffb700 1 --2- 172.21.15.22:0/3623091739 >> [v2:172.21.15.184:6800/506475721,v1:172.21.15.184:6801/506475721] conn(0x7fece80749b0 0x7fece8076de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.961+0000 7fecf9ffb700 1 -- 172.21.15.22:0/3623091739 --> [v2:172.21.15.184:6800/506475721,v1:172.21.15.184:6801/506475721] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fece80774b0 con 0x7fece80749b0 2023-07-11T00:30:38.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.961+0000 7f3671bff700 1 -- 172.21.15.22:0/684802366 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f365806adb0 msgr2=0x7f365806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.961+0000 7f3671bff700 1 --2- 172.21.15.22:0/684802366 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f365806adb0 0x7f365806d260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f365c0090b0 tx=0x7f365c008030 comp rx=0 tx=0).stop 2023-07-11T00:30:38.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.961+0000 7f3671bff700 1 -- 172.21.15.22:0/684802366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f366c0c9970 msgr2=0x7f366c0c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.961+0000 7f3671bff700 1 --2- 172.21.15.22:0/684802366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f366c0c9970 0x7f366c0c3f70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f366400caf0 tx=0x7f366400ceb0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.961+0000 7fecf9ffb700 1 -- 172.21.15.22:0/3623091739 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecf408e2a0 con 0x7fed040b1c70 2023-07-11T00:30:38.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.961+0000 7f366bfff700 1 -- 172.21.15.22:0/684802366 reap_dead start 2023-07-11T00:30:38.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.961+0000 7fdc57fff700 1 -- 172.21.15.22:0/488525779 <== osd.6 v2:172.21.15.184:6809/1254324024 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fdc5c077480 con 0x7fdc5c074980 2023-07-11T00:30:38.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.964+0000 7f3671bff700 1 -- 172.21.15.22:0/684802366 shutdown_connections 2023-07-11T00:30:38.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.964+0000 7f3671bff700 1 -- 172.21.15.22:0/684802366 >> 172.21.15.22:0/684802366 conn(0x7f366c06abc0 msgr2=0x7f366c0ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.964+0000 7f3671bff700 1 -- 172.21.15.22:0/684802366 shutdown_connections 2023-07-11T00:30:38.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.964+0000 7f3671bff700 1 -- 172.21.15.22:0/684802366 wait complete. 2023-07-11T00:30:38.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.962+0000 7fed08f9a700 1 --2- 172.21.15.22:0/3623091739 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fece806ace0 0x7fece806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.963+0000 7fed08f9a700 1 --2- 172.21.15.22:0/3623091739 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fece806ace0 0x7fece806d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fed040b1bb0 tx=0x7fed00009f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.964+0000 7fed09f9c700 1 --2- 172.21.15.22:0/3623091739 >> [v2:172.21.15.184:6800/506475721,v1:172.21.15.184:6801/506475721] conn(0x7fece80749b0 0x7fece8076de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.965+0000 7fed09f9c700 1 --2- 172.21.15.22:0/3623091739 >> [v2:172.21.15.184:6800/506475721,v1:172.21.15.184:6801/506475721] conn(0x7fece80749b0 0x7fece8076de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.966+0000 7ff4cb7fe700 1 -- 172.21.15.22:0/3528107492 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff4cc00c930 con 0x7ff4d4157f10 2023-07-11T00:30:38.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.967+0000 7fecf9ffb700 1 -- 172.21.15.22:0/3623091739 <== osd.5 v2:172.21.15.184:6800/506475721 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fece80774b0 con 0x7fece80749b0 2023-07-11T00:30:38.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.967+0000 7ff4cb7fe700 1 --2- 172.21.15.22:0/3528107492 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff4b406adb0 0x7ff4b406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.967+0000 7ff4cb7fe700 1 -- 172.21.15.22:0/3528107492 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff4cc0892c0 con 0x7ff4d4157f10 2023-07-11T00:30:38.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.968+0000 7ff4cb7fe700 1 --2- 172.21.15.22:0/3528107492 >> [v2:172.21.15.184:6810/3866238767,v1:172.21.15.184:6813/3866238767] conn(0x7ff4b4074a80 0x7ff4b4076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.968+0000 7ff4cb7fe700 1 -- 172.21.15.22:0/3528107492 --> [v2:172.21.15.184:6810/3866238767,v1:172.21.15.184:6813/3866238767] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4b4077580 con 0x7ff4b4074a80 2023-07-11T00:30:38.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.968+0000 7ff4cb7fe700 1 -- 172.21.15.22:0/3528107492 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4cc0895c0 con 0x7ff4d4157f10 2023-07-11T00:30:38.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.968+0000 7f95a2dff700 1 -- 172.21.15.22:0/76960833 --> [v2:172.21.15.22:6800/1848675559,v1:172.21.15.22:6801/1848675559] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f959c0cd6c0 con 0x7f9588074980 2023-07-11T00:30:38.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.969+0000 7ff4d2ffd700 1 --2- 172.21.15.22:0/3528107492 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff4b406adb0 0x7ff4b406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.969+0000 7f95997fa700 1 -- 172.21.15.22:0/76960833 <== osd.1 v2:172.21.15.22:6800/1848675559 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9594009cb0 con 0x7f9588074980 2023-07-11T00:30:38.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.969+0000 7ff4d27fc700 1 --2- 172.21.15.22:0/3528107492 >> [v2:172.21.15.184:6810/3866238767,v1:172.21.15.184:6813/3866238767] conn(0x7ff4b4074a80 0x7ff4b4076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.970+0000 7ff4d27fc700 1 --2- 172.21.15.22:0/3528107492 >> [v2:172.21.15.184:6810/3866238767,v1:172.21.15.184:6813/3866238767] conn(0x7ff4b4074a80 0x7ff4b4076eb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.970+0000 7f95a2dff700 1 -- 172.21.15.22:0/76960833 >> [v2:172.21.15.22:6800/1848675559,v1:172.21.15.22:6801/1848675559] conn(0x7f9588074980 msgr2=0x7f9588076db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.970+0000 7f95a2dff700 1 --2- 172.21.15.22:0/76960833 >> [v2:172.21.15.22:6800/1848675559,v1:172.21.15.22:6801/1848675559] conn(0x7f9588074980 0x7f9588076db0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.970+0000 7f95a2dff700 1 -- 172.21.15.22:0/76960833 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f958806ad30 msgr2=0x7f958806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.970+0000 7f95a2dff700 1 --2- 172.21.15.22:0/76960833 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f958806ad30 0x7f958806d1e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f958c003df0 tx=0x7f958c007a40 comp rx=0 tx=0).stop 2023-07-11T00:30:38.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.970+0000 7f95a2dff700 1 -- 172.21.15.22:0/76960833 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f959c0cb6e0 msgr2=0x7f959c0c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.970+0000 7f95a2dff700 1 --2- 172.21.15.22:0/76960833 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f959c0cb6e0 0x7f959c0c7c40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f959c071580 tx=0x7f9590004750 comp rx=0 tx=0).stop 2023-07-11T00:30:38.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.971+0000 7ff4d2ffd700 1 --2- 172.21.15.22:0/3528107492 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff4b406adb0 0x7ff4b406d260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc007fd0 tx=0x7ff4bc007ec0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.971+0000 7ff4cb7fe700 1 -- 172.21.15.22:0/3528107492 <== osd.7 v2:172.21.15.184:6810/3866238767 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff4b4077580 con 0x7ff4b4074a80 2023-07-11T00:30:38.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.972+0000 7f95a139c700 1 -- 172.21.15.22:0/76960833 reap_dead start 2023-07-11T00:30:38.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.972+0000 7fe463fff700 1 -- 172.21.15.22:0/1549066222 --> [v2:172.21.15.22:6821/3888588990,v1:172.21.15.22:6822/3888588990] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe444002d40 con 0x7fe440074a80 2023-07-11T00:30:38.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.972+0000 7f95a2dff700 1 -- 172.21.15.22:0/76960833 shutdown_connections 2023-07-11T00:30:38.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.972+0000 7f95a2dff700 1 -- 172.21.15.22:0/76960833 >> 172.21.15.22:0/76960833 conn(0x7f959c06abc0 msgr2=0x7f959c06e200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.972+0000 7f95a2dff700 1 -- 172.21.15.22:0/76960833 shutdown_connections 2023-07-11T00:30:38.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.972+0000 7f95a2dff700 1 -- 172.21.15.22:0/76960833 wait complete. 2023-07-11T00:30:38.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.974+0000 7fe4527fc700 1 -- 172.21.15.22:0/1549066222 <== osd.2 v2:172.21.15.22:6821/3888588990 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe444002d40 con 0x7fe440074a80 2023-07-11T00:30:38.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.978+0000 7fe463fff700 1 -- 172.21.15.22:0/1549066222 >> [v2:172.21.15.22:6821/3888588990,v1:172.21.15.22:6822/3888588990] conn(0x7fe440074a80 msgr2=0x7fe440076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.978+0000 7fe463fff700 1 --2- 172.21.15.22:0/1549066222 >> [v2:172.21.15.22:6821/3888588990,v1:172.21.15.22:6822/3888588990] conn(0x7fe440074a80 0x7fe440076eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.978+0000 7fe463fff700 1 -- 172.21.15.22:0/1549066222 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe44006adb0 msgr2=0x7fe44006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.978+0000 7fe463fff700 1 --2- 172.21.15.22:0/1549066222 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe44006adb0 0x7fe44006d260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe4540015f0 tx=0x7fe454001740 comp rx=0 tx=0).stop 2023-07-11T00:30:38.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.978+0000 7fe463fff700 1 -- 172.21.15.22:0/1549066222 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe45c0cb8a0 msgr2=0x7fe45c0c6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.978+0000 7fe463fff700 1 --2- 172.21.15.22:0/1549066222 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe45c0cb8a0 0x7fe45c0c6b50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe458000c00 tx=0x7fe458004750 comp rx=0 tx=0).stop 2023-07-11T00:30:38.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.978+0000 7fe46259c700 1 -- 172.21.15.22:0/1549066222 reap_dead start 2023-07-11T00:30:38.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.979+0000 7fe463fff700 1 -- 172.21.15.22:0/1549066222 shutdown_connections 2023-07-11T00:30:38.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.979+0000 7fe463fff700 1 -- 172.21.15.22:0/1549066222 >> 172.21.15.22:0/1549066222 conn(0x7fe45c06abc0 msgr2=0x7fe45c0cd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.982+0000 7f5587dff700 1 -- 172.21.15.22:0/2753864543 --> [v2:172.21.15.22:6808/3717370188,v1:172.21.15.22:6809/3717370188] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5580164920 con 0x7f5564074a80 2023-07-11T00:30:38.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.983+0000 7f55767fc700 1 -- 172.21.15.22:0/2753864543 <== osd.3 v2:172.21.15.22:6808/3717370188 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f557c004040 con 0x7f5564074a80 2023-07-11T00:30:38.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.983+0000 7f5587dff700 1 -- 172.21.15.22:0/2753864543 >> [v2:172.21.15.22:6808/3717370188,v1:172.21.15.22:6809/3717370188] conn(0x7f5564074a80 msgr2=0x7f5564076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.983+0000 7f5587dff700 1 --2- 172.21.15.22:0/2753864543 >> [v2:172.21.15.22:6808/3717370188,v1:172.21.15.22:6809/3717370188] conn(0x7f5564074a80 0x7f5564076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.984+0000 7f5587dff700 1 -- 172.21.15.22:0/2753864543 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f556406adb0 msgr2=0x7f556406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.984+0000 7f5587dff700 1 --2- 172.21.15.22:0/2753864543 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f556406adb0 0x7f556406d260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f55780113d0 tx=0x7f557800b040 comp rx=0 tx=0).stop 2023-07-11T00:30:38.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.984+0000 7f5587dff700 1 -- 172.21.15.22:0/2753864543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5580144510 msgr2=0x7f5580144980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.984+0000 7f5587dff700 1 --2- 172.21.15.22:0/2753864543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5580144510 0x7f5580144980 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f558006b0d0 tx=0x7f557000e830 comp rx=0 tx=0).stop 2023-07-11T00:30:38.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.984+0000 7f558639c700 1 -- 172.21.15.22:0/2753864543 reap_dead start 2023-07-11T00:30:38.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.984+0000 7f5587dff700 1 -- 172.21.15.22:0/2753864543 shutdown_connections 2023-07-11T00:30:38.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.984+0000 7f5587dff700 1 -- 172.21.15.22:0/2753864543 >> 172.21.15.22:0/2753864543 conn(0x7f55800b0390 msgr2=0x7f55800b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.984+0000 7f5587dff700 1 -- 172.21.15.22:0/2753864543 shutdown_connections 2023-07-11T00:30:38.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.984+0000 7f5587dff700 1 -- 172.21.15.22:0/2753864543 wait complete. 2023-07-11T00:30:38.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.985+0000 7fe463fff700 1 -- 172.21.15.22:0/1549066222 shutdown_connections 2023-07-11T00:30:38.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.985+0000 7fe463fff700 1 -- 172.21.15.22:0/1549066222 wait complete. 2023-07-11T00:30:38.038 INFO:teuthology.orchestra.run.smithi022.stdout:55834574859 2023-07-11T00:30:38.039 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-11T00:30:38.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.992+0000 7fb9e97ff700 1 -- 172.21.15.22:0/2786700856 --> [v2:172.21.15.184:6808/1848255557,v1:172.21.15.184:6811/1848255557] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb9c4002d40 con 0x7fb9d00749b0 2023-07-11T00:30:38.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.993+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/2786700856 <== osd.4 v2:172.21.15.184:6808/1848255557 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb9c4002d40 con 0x7fb9d00749b0 2023-07-11T00:30:38.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.994+0000 7fb9e97ff700 1 -- 172.21.15.22:0/2786700856 >> [v2:172.21.15.184:6808/1848255557,v1:172.21.15.184:6811/1848255557] conn(0x7fb9d00749b0 msgr2=0x7fb9d0076de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.994+0000 7fb9e97ff700 1 --2- 172.21.15.22:0/2786700856 >> [v2:172.21.15.184:6808/1848255557,v1:172.21.15.184:6811/1848255557] conn(0x7fb9d00749b0 0x7fb9d0076de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.994+0000 7fb9e97ff700 1 -- 172.21.15.22:0/2786700856 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb9d006ace0 msgr2=0x7fb9d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.994+0000 7fb9e97ff700 1 --2- 172.21.15.22:0/2786700856 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb9d006ace0 0x7fb9d006d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4071630 tx=0x7fb9d4009040 comp rx=0 tx=0).stop 2023-07-11T00:30:38.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.994+0000 7fb9e97ff700 1 -- 172.21.15.22:0/2786700856 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9e40cf8f0 msgr2=0x7fb9e4154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.994+0000 7fb9e97ff700 1 --2- 172.21.15.22:0/2786700856 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9e40cf8f0 0x7fb9e4154130 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc000f80 tx=0x7fb9dc004ad0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.994+0000 7fb9e37fe700 1 -- 172.21.15.22:0/2786700856 reap_dead start 2023-07-11T00:30:38.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.995+0000 7fb9e97ff700 1 -- 172.21.15.22:0/2786700856 shutdown_connections 2023-07-11T00:30:38.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.995+0000 7fb9e97ff700 1 -- 172.21.15.22:0/2786700856 >> 172.21.15.22:0/2786700856 conn(0x7fb9e4071660 msgr2=0x7fb9e4160700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.995+0000 7fb9e97ff700 1 -- 172.21.15.22:0/2786700856 shutdown_connections 2023-07-11T00:30:38.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.995+0000 7fb9e97ff700 1 -- 172.21.15.22:0/2786700856 wait complete. 2023-07-11T00:30:38.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.996+0000 7fdc75dff700 1 -- 172.21.15.22:0/488525779 --> [v2:172.21.15.184:6809/1254324024,v1:172.21.15.184:6812/1254324024] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdc70158a30 con 0x7fdc5c074980 2023-07-11T00:30:38.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.997+0000 7fdc57fff700 1 -- 172.21.15.22:0/488525779 <== osd.6 v2:172.21.15.184:6809/1254324024 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdc70158a30 con 0x7fdc5c074980 2023-07-11T00:30:38.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.999+0000 7fdc75dff700 1 -- 172.21.15.22:0/488525779 >> [v2:172.21.15.184:6809/1254324024,v1:172.21.15.184:6812/1254324024] conn(0x7fdc5c074980 msgr2=0x7fdc5c076db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.999+0000 7fdc75dff700 1 --2- 172.21.15.22:0/488525779 >> [v2:172.21.15.184:6809/1254324024,v1:172.21.15.184:6812/1254324024] conn(0x7fdc5c074980 0x7fdc5c076db0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.999+0000 7fecef7fe700 1 -- 172.21.15.22:0/3623091739 --> [v2:172.21.15.184:6800/506475721,v1:172.21.15.184:6801/506475721] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fed040cdbc0 con 0x7fece80749b0 2023-07-11T00:30:38.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.999+0000 7fdc75dff700 1 -- 172.21.15.22:0/488525779 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdc5c06ad30 msgr2=0x7fdc5c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.999+0000 7fdc75dff700 1 --2- 172.21.15.22:0/488525779 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdc5c06ad30 0x7fdc5c06d1e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdc60007fd0 tx=0x7fdc60009040 comp rx=0 tx=0).stop 2023-07-11T00:30:38.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.999+0000 7fdc75dff700 1 -- 172.21.15.22:0/488525779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc7015c460 msgr2=0x7fdc7015d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:37.999+0000 7fdc75dff700 1 --2- 172.21.15.22:0/488525779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc7015c460 0x7fdc7015d9b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdc68001f70 tx=0x7fdc6800a340 comp rx=0 tx=0).stop 2023-07-11T00:30:38.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.000+0000 7fdc6ffff700 1 -- 172.21.15.22:0/488525779 reap_dead start 2023-07-11T00:30:38.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.000+0000 7fdc75dff700 1 -- 172.21.15.22:0/488525779 shutdown_connections 2023-07-11T00:30:38.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.000+0000 7fdc75dff700 1 -- 172.21.15.22:0/488525779 >> 172.21.15.22:0/488525779 conn(0x7fdc70071660 msgr2=0x7fdc700d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.000+0000 7fecf9ffb700 1 -- 172.21.15.22:0/3623091739 <== osd.5 v2:172.21.15.184:6800/506475721 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fecfc001ec0 con 0x7fece80749b0 2023-07-11T00:30:38.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.000+0000 7fdc75dff700 1 -- 172.21.15.22:0/488525779 shutdown_connections 2023-07-11T00:30:38.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.000+0000 7fdc75dff700 1 -- 172.21.15.22:0/488525779 wait complete. 2023-07-11T00:30:38.047 INFO:teuthology.orchestra.run.smithi022.stdout:55834574858 2023-07-11T00:30:38.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.003+0000 7fecef7fe700 1 -- 172.21.15.22:0/3623091739 >> [v2:172.21.15.184:6800/506475721,v1:172.21.15.184:6801/506475721] conn(0x7fece80749b0 msgr2=0x7fece8076de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.003+0000 7fecef7fe700 1 --2- 172.21.15.22:0/3623091739 >> [v2:172.21.15.184:6800/506475721,v1:172.21.15.184:6801/506475721] conn(0x7fece80749b0 0x7fece8076de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.003+0000 7fecef7fe700 1 -- 172.21.15.22:0/3623091739 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fece806ace0 msgr2=0x7fece806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.003+0000 7fecef7fe700 1 --2- 172.21.15.22:0/3623091739 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fece806ace0 0x7fece806d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fed040b1bb0 tx=0x7fed00009f90 comp rx=0 tx=0).stop 2023-07-11T00:30:38.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.003+0000 7fecef7fe700 1 -- 172.21.15.22:0/3623091739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed040b1c70 msgr2=0x7fed0414cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.003+0000 7fecef7fe700 1 --2- 172.21.15.22:0/3623091739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed040b1c70 0x7fed0414cac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fecf400ea40 tx=0x7fecf400ee00 comp rx=0 tx=0).stop 2023-07-11T00:30:38.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.003+0000 7fed09f9c700 1 -- 172.21.15.22:0/3623091739 reap_dead start 2023-07-11T00:30:38.049 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-11T00:30:38.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.004+0000 7fecef7fe700 1 -- 172.21.15.22:0/3623091739 shutdown_connections 2023-07-11T00:30:38.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.004+0000 7fecef7fe700 1 -- 172.21.15.22:0/3623091739 >> 172.21.15.22:0/3623091739 conn(0x7fed040cc290 msgr2=0x7fed040cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.004+0000 7fecef7fe700 1 -- 172.21.15.22:0/3623091739 shutdown_connections 2023-07-11T00:30:38.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.004+0000 7fecef7fe700 1 -- 172.21.15.22:0/3623091739 wait complete. 2023-07-11T00:30:38.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.005+0000 7ff4d97ff700 1 -- 172.21.15.22:0/3528107492 --> [v2:172.21.15.184:6810/3866238767,v1:172.21.15.184:6813/3866238767] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff4d40c8f40 con 0x7ff4b4074a80 2023-07-11T00:30:38.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.006+0000 7ff4cb7fe700 1 -- 172.21.15.22:0/3528107492 <== osd.7 v2:172.21.15.184:6810/3866238767 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff4c4006ce0 con 0x7ff4b4074a80 2023-07-11T00:30:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.010+0000 7ff4d97ff700 1 -- 172.21.15.22:0/3528107492 >> [v2:172.21.15.184:6810/3866238767,v1:172.21.15.184:6813/3866238767] conn(0x7ff4b4074a80 msgr2=0x7ff4b4076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.010+0000 7ff4d97ff700 1 --2- 172.21.15.22:0/3528107492 >> [v2:172.21.15.184:6810/3866238767,v1:172.21.15.184:6813/3866238767] conn(0x7ff4b4074a80 0x7ff4b4076eb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.011+0000 7ff4d97ff700 1 -- 172.21.15.22:0/3528107492 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff4b406adb0 msgr2=0x7ff4b406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.011+0000 7ff4d97ff700 1 --2- 172.21.15.22:0/3528107492 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff4b406adb0 0x7ff4b406d260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc007fd0 tx=0x7ff4bc007ec0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.011+0000 7ff4d97ff700 1 -- 172.21.15.22:0/3528107492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4d4157f10 msgr2=0x7ff4d40c67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.011+0000 7ff4d97ff700 1 --2- 172.21.15.22:0/3528107492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4d4157f10 0x7ff4d40c67e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00efc0 tx=0x7ff4cc00c3a0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.053 INFO:teuthology.orchestra.run.smithi022.stdout:55834574859 2023-07-11T00:30:38.054 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-11T00:30:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.014+0000 7ff4d37fe700 1 -- 172.21.15.22:0/3528107492 reap_dead start 2023-07-11T00:30:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.014+0000 7ff4d97ff700 1 -- 172.21.15.22:0/3528107492 shutdown_connections 2023-07-11T00:30:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.014+0000 7ff4d97ff700 1 -- 172.21.15.22:0/3528107492 >> 172.21.15.22:0/3528107492 conn(0x7ff4d40b0390 msgr2=0x7ff4d406c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.015+0000 7ff4d97ff700 1 -- 172.21.15.22:0/3528107492 shutdown_connections 2023-07-11T00:30:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.015+0000 7ff4d97ff700 1 -- 172.21.15.22:0/3528107492 wait complete. 2023-07-11T00:30:38.056 INFO:teuthology.orchestra.run.smithi022.stdout:55834574858 2023-07-11T00:30:38.056 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-11T00:30:38.057 INFO:teuthology.orchestra.run.smithi022.stdout:55834574858 2023-07-11T00:30:38.058 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-11T00:30:38.058 INFO:teuthology.orchestra.run.smithi022.stdout:55834574859 2023-07-11T00:30:38.059 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-11T00:30:38.059 INFO:teuthology.orchestra.run.smithi022.stdout:55834574859 2023-07-11T00:30:38.060 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-11T00:30:38.061 INFO:teuthology.orchestra.run.smithi022.stdout:55834574859 2023-07-11T00:30:38.061 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-11T00:30:38.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.451+0000 7f78757ff700 1 Processor -- start 2023-07-11T00:30:38.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.451+0000 7f78757ff700 1 -- start start 2023-07-11T00:30:38.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.456+0000 7f8776bff700 1 Processor -- start 2023-07-11T00:30:38.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.456+0000 7f8776bff700 1 -- start start 2023-07-11T00:30:38.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.454+0000 7f78757ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7870160ab0 0x7f78700ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.454+0000 7f78757ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78700c1d30 con 0x7f78700ad710 2023-07-11T00:30:38.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.454+0000 7f78757ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78700cc840 con 0x7f78701606e0 2023-07-11T00:30:38.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.454+0000 7f78757ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78700ce670 con 0x7f7870160ab0 2023-07-11T00:30:38.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.455+0000 7f786effd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f78701606e0 0x7f787006c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:41124/0 (socket says 172.21.15.22:41124) 2023-07-11T00:30:38.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.455+0000 7f786effd700 1 -- 172.21.15.22:0/3788819151 learned_addr learned my addr 172.21.15.22:0/3788819151 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:38.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.455+0000 7f786e7fc700 1 --2- 172.21.15.22:0/3788819151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7870160ab0 0x7f78700ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.459+0000 7f786dffb700 1 -- 172.21.15.22:0/3788819151 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311736877 0 0) 0x7f78700cc840 con 0x7f78701606e0 2023-07-11T00:30:38.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.459+0000 7f786dffb700 1 -- 172.21.15.22:0/3788819151 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78580035b0 con 0x7f78701606e0 2023-07-11T00:30:38.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.459+0000 7f786dffb700 1 -- 172.21.15.22:0/3788819151 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461488752 0 0) 0x7f7860001040 con 0x7f78700ad710 2023-07-11T00:30:38.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.459+0000 7f786dffb700 1 -- 172.21.15.22:0/3788819151 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78700cc840 con 0x7f78700ad710 2023-07-11T00:30:38.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.458+0000 7f8776bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f87700b0aa0 0x7f87700cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.458+0000 7f8776bff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87700cd100 con 0x7f87700cb8b0 2023-07-11T00:30:38.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.458+0000 7f8776bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87700cd3e0 con 0x7f87700c9700 2023-07-11T00:30:38.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.458+0000 7f8776bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87700cd6c0 con 0x7f87700b0aa0 2023-07-11T00:30:38.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.459+0000 7f876ffff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f87700c9700 0x7f87700cb1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:41132/0 (socket says 172.21.15.22:41132) 2023-07-11T00:30:38.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.459+0000 7f876ffff700 1 -- 172.21.15.22:0/2149225933 learned_addr learned my addr 172.21.15.22:0/2149225933 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:38.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.460+0000 7f877499b700 1 --2- 172.21.15.22:0/2149225933 >> v2:172.21.15.184:3300/0 conn(0x7f87700b0aa0 0x7f87700cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.460+0000 7f877499b700 1 -- 172.21.15.22:0/2149225933 >> v1:172.21.15.184:6789/0 conn(0x7f87700c9700 legacy=0x7f87700cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.460+0000 7f877499b700 1 -- 172.21.15.22:0/2149225933 >> v1:172.21.15.22:6789/0 conn(0x7f87700cb8b0 legacy=0x7f8770157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:38.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.460+0000 7f877499b700 1 -- 172.21.15.22:0/2149225933 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87700cd9a0 con 0x7f87700b0aa0 2023-07-11T00:30:38.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.461+0000 7f877499b700 1 --2- 172.21.15.22:0/2149225933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87700b0aa0 0x7f87700cdec0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8760009840 tx=0x7f8760009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dd77558e156e42d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.460+0000 7f786e7fc700 1 -- 172.21.15.22:0/3788819151 >> v1:172.21.15.184:6789/0 conn(0x7f78701606e0 legacy=0x7f787006c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.460+0000 7f786e7fc700 1 -- 172.21.15.22:0/3788819151 >> v1:172.21.15.22:6789/0 conn(0x7f78700ad710 legacy=0x7f78700cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.460+0000 7f786e7fc700 1 -- 172.21.15.22:0/3788819151 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78700adc60 con 0x7f7870160ab0 2023-07-11T00:30:38.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.461+0000 7f786e7fc700 1 --2- 172.21.15.22:0/3788819151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7870160ab0 0x7f78700ce130 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7864009870 tx=0x7f7864009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16b4c63891b08ec6 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.462+0000 7f876f7fe700 1 -- 172.21.15.22:0/2149225933 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760004230 con 0x7f87700b0aa0 2023-07-11T00:30:38.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.462+0000 7f876f7fe700 1 -- 172.21.15.22:0/2149225933 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8760004390 con 0x7f87700b0aa0 2023-07-11T00:30:38.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.462+0000 7f876f7fe700 1 -- 172.21.15.22:0/2149225933 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87600036a0 con 0x7f87700b0aa0 2023-07-11T00:30:38.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.462+0000 7f786dffb700 1 -- 172.21.15.22:0/3788819151 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864004230 con 0x7f7870160ab0 2023-07-11T00:30:38.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.462+0000 7f786dffb700 1 -- 172.21.15.22:0/3788819151 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7864004390 con 0x7f7870160ab0 2023-07-11T00:30:38.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.462+0000 7f786dffb700 1 -- 172.21.15.22:0/3788819151 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78640036a0 con 0x7f7870160ab0 2023-07-11T00:30:38.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.463+0000 7f8776bff700 1 -- 172.21.15.22:0/2149225933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87700b0aa0 msgr2=0x7f87700cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.463+0000 7f8776bff700 1 --2- 172.21.15.22:0/2149225933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87700b0aa0 0x7f87700cdec0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8760009840 tx=0x7f8760009b50 comp rx=0 tx=0).stop 2023-07-11T00:30:38.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.463+0000 7f8776bff700 1 -- 172.21.15.22:0/2149225933 shutdown_connections 2023-07-11T00:30:38.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.463+0000 7f8776bff700 1 --2- 172.21.15.22:0/2149225933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87700b0aa0 0x7f87700cdec0 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8760009840 tx=0x7f8760009b50 comp rx=0 tx=0).stop 2023-07-11T00:30:38.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.463+0000 7f8776bff700 1 -- 172.21.15.22:0/2149225933 >> 172.21.15.22:0/2149225933 conn(0x7f877006abc0 msgr2=0x7f87700b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.463+0000 7f8776bff700 1 -- 172.21.15.22:0/2149225933 shutdown_connections 2023-07-11T00:30:38.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.463+0000 7f8776bff700 1 -- 172.21.15.22:0/2149225933 wait complete. 2023-07-11T00:30:38.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.463+0000 7f78757ff700 1 -- 172.21.15.22:0/3788819151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7870160ab0 msgr2=0x7f78700ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.463+0000 7f78757ff700 1 --2- 172.21.15.22:0/3788819151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7870160ab0 0x7f78700ce130 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7864009870 tx=0x7f7864009b80 comp rx=0 tx=0).stop 2023-07-11T00:30:38.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.464+0000 7f78757ff700 1 -- 172.21.15.22:0/3788819151 shutdown_connections 2023-07-11T00:30:38.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.464+0000 7f78757ff700 1 --2- 172.21.15.22:0/3788819151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7870160ab0 0x7f78700ce130 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.464+0000 7f78757ff700 1 -- 172.21.15.22:0/3788819151 >> 172.21.15.22:0/3788819151 conn(0x7f787006abc0 msgr2=0x7f78700b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.464+0000 7f78757ff700 1 -- 172.21.15.22:0/3788819151 shutdown_connections 2023-07-11T00:30:38.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.464+0000 7f78757ff700 1 -- 172.21.15.22:0/3788819151 wait complete. 2023-07-11T00:30:38.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.464+0000 7f569edff700 1 Processor -- start 2023-07-11T00:30:38.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.464+0000 7f569edff700 1 -- start start 2023-07-11T00:30:38.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.467+0000 7f569edff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5698160930 0x7f5698070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.467+0000 7f569edff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56980cc390 0x7f56980ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.467+0000 7f569edff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56980ccb70 con 0x7f56980adce0 2023-07-11T00:30:38.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.467+0000 7f569edff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56980ae160 con 0x7f5698160930 2023-07-11T00:30:38.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.467+0000 7f569edff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5698165400 con 0x7f56980cc390 2023-07-11T00:30:38.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.467+0000 7f78757ff700 1 Processor -- start 2023-07-11T00:30:38.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.466+0000 7f8776bff700 1 Processor -- start 2023-07-11T00:30:38.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.466+0000 7f8776bff700 1 -- start start 2023-07-11T00:30:38.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.468+0000 7f8776bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87700c9700 0x7f87700ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.468+0000 7f8776bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87700cb8b0 0x7f87700ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.468+0000 7f8776bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87700c0770 0x7f87700b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.468+0000 7f8776bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87700c0d30 con 0x7f87700c0770 2023-07-11T00:30:38.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.468+0000 7f8776bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87700c1010 con 0x7f87700cb8b0 2023-07-11T00:30:38.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.468+0000 7f8776bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87700c12f0 con 0x7f87700c9700 2023-07-11T00:30:38.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.468+0000 7f5697fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56980cc390 0x7f56980ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.468+0000 7f5697fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56980cc390 0x7f56980ad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:33890/0 (socket says 172.21.15.22:33890) 2023-07-11T00:30:38.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.468+0000 7f5697fff700 1 -- 172.21.15.22:0/2721983352 learned_addr learned my addr 172.21.15.22:0/2721983352 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:38.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.469+0000 7f569cb9b700 1 --2- 172.21.15.22:0/2721983352 >> v2:172.21.15.184:3300/0 conn(0x7f5698160930 0x7f5698070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.469+0000 7f877519c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87700c0770 0x7f87700b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.469+0000 7f877519c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87700c0770 0x7f87700b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45630/0 (socket says 172.21.15.22:45630) 2023-07-11T00:30:38.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.469+0000 7f877519c700 1 -- 172.21.15.22:0/39369118 learned_addr learned my addr 172.21.15.22:0/39369118 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:38.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.469+0000 7f5697fff700 1 -- 172.21.15.22:0/2721983352 >> v2:172.21.15.184:3300/0 conn(0x7f5698160930 msgr2=0x7f5698070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:38.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.469+0000 7f5697fff700 1 --2- 172.21.15.22:0/2721983352 >> v2:172.21.15.184:3300/0 conn(0x7f5698160930 0x7f5698070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.469+0000 7f5697fff700 1 -- 172.21.15.22:0/2721983352 >> v1:172.21.15.184:6789/0 conn(0x7f56980adce0 legacy=0x7f5698069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:38.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.469+0000 7f5697fff700 1 -- 172.21.15.22:0/2721983352 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5698164640 con 0x7f56980cc390 2023-07-11T00:30:38.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.469+0000 7f876ffff700 1 --2- 172.21.15.22:0/39369118 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87700cb8b0 0x7f87700ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.468+0000 7f78757ff700 1 -- start start 2023-07-11T00:30:38.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.469+0000 7f78757ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78700ad710 0x7f78701fe820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.469+0000 7f78757ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78701606e0 0x7f787015bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.469+0000 7f78757ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f787015c1d0 0x7f78701ff280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.469+0000 7f78757ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7870200d20 con 0x7f78700ad710 2023-07-11T00:30:38.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.469+0000 7f78757ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787015c640 con 0x7f78701606e0 2023-07-11T00:30:38.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.469+0000 7f78757ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7870200130 con 0x7f787015c1d0 2023-07-11T00:30:38.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.469+0000 7f877499b700 1 --2- 172.21.15.22:0/39369118 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87700c9700 0x7f87700ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.470+0000 7f786f7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f787015c1d0 0x7f78701ff280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.470+0000 7f786f7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f787015c1d0 0x7f78701ff280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:33906/0 (socket says 172.21.15.22:33906) 2023-07-11T00:30:38.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.470+0000 7f786f7fe700 1 -- 172.21.15.22:0/2187016044 learned_addr learned my addr 172.21.15.22:0/2187016044 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:38.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.470+0000 7f5697fff700 1 --2- 172.21.15.22:0/2721983352 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56980cc390 0x7f56980ad7a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5690009e50 tx=0x7f569000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=def9bfc841587eaa server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.470+0000 7f786e7fc700 1 --2- 172.21.15.22:0/2187016044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78701606e0 0x7f787015bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.470+0000 7f786effd700 1 --2- 172.21.15.22:0/2187016044 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78700ad710 0x7f78701fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.471+0000 7f56977fe700 1 -- 172.21.15.22:0/2721983352 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569000e070 con 0x7f56980cc390 2023-07-11T00:30:38.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.471+0000 7f56977fe700 1 -- 172.21.15.22:0/2721983352 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5690003a20 con 0x7f56980cc390 2023-07-11T00:30:38.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.471+0000 7f56977fe700 1 -- 172.21.15.22:0/2721983352 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690003dd0 con 0x7f56980cc390 2023-07-11T00:30:38.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.471+0000 7f786f7fe700 1 -- 172.21.15.22:0/2187016044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78701606e0 msgr2=0x7f787015bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.471+0000 7f786f7fe700 1 --2- 172.21.15.22:0/2187016044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78701606e0 0x7f787015bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.471+0000 7f786f7fe700 1 -- 172.21.15.22:0/2187016044 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78700ad710 msgr2=0x7f78701fe820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.471+0000 7f786f7fe700 1 --2- 172.21.15.22:0/2187016044 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78700ad710 0x7f78701fe820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.471+0000 7f786f7fe700 1 -- 172.21.15.22:0/2187016044 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78640094a0 con 0x7f787015c1d0 2023-07-11T00:30:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.471+0000 7f877519c700 1 -- 172.21.15.22:0/39369118 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87700c9700 msgr2=0x7f87700ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.471+0000 7f877519c700 1 --2- 172.21.15.22:0/39369118 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87700c9700 0x7f87700ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.471+0000 7f877519c700 1 -- 172.21.15.22:0/39369118 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87700cb8b0 msgr2=0x7f87700ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.471+0000 7f877519c700 1 --2- 172.21.15.22:0/39369118 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87700cb8b0 0x7f87700ae840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.471+0000 7f877519c700 1 -- 172.21.15.22:0/39369118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87600094a0 con 0x7f87700c0770 2023-07-11T00:30:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.472+0000 7f569edff700 1 -- 172.21.15.22:0/2721983352 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56980cc390 msgr2=0x7f56980ad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.472+0000 7f569edff700 1 --2- 172.21.15.22:0/2721983352 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56980cc390 0x7f56980ad7a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5690009e50 tx=0x7f569000b330 comp rx=0 tx=0).stop 2023-07-11T00:30:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.472+0000 7f569edff700 1 -- 172.21.15.22:0/2721983352 shutdown_connections 2023-07-11T00:30:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.472+0000 7f569edff700 1 --2- 172.21.15.22:0/2721983352 >> v2:172.21.15.184:3300/0 conn(0x7f5698160930 0x7f5698070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.472+0000 7f569edff700 1 --2- 172.21.15.22:0/2721983352 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56980cc390 0x7f56980ad7a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.472+0000 7f569edff700 1 -- 172.21.15.22:0/2721983352 >> 172.21.15.22:0/2721983352 conn(0x7f56980b0390 msgr2=0x7f56980b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.472+0000 7f786f7fe700 1 --2- 172.21.15.22:0/2187016044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f787015c1d0 0x7f78701ff280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f786000c430 tx=0x7f786000c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.472+0000 7f569edff700 1 -- 172.21.15.22:0/2721983352 shutdown_connections 2023-07-11T00:30:38.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.472+0000 7f569edff700 1 -- 172.21.15.22:0/2721983352 wait complete. 2023-07-11T00:30:38.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.472+0000 7f78577fe700 1 -- 172.21.15.22:0/2187016044 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78600052d0 con 0x7f787015c1d0 2023-07-11T00:30:38.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.472+0000 7f78577fe700 1 -- 172.21.15.22:0/2187016044 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7860005450 con 0x7f787015c1d0 2023-07-11T00:30:38.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.472+0000 7f78577fe700 1 -- 172.21.15.22:0/2187016044 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78600038c0 con 0x7f787015c1d0 2023-07-11T00:30:38.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.472+0000 7f877519c700 1 --2- 172.21.15.22:0/39369118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87700c0770 0x7f87700b2300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f876800b990 tx=0x7f876800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.473+0000 7f876d7fa700 1 -- 172.21.15.22:0/39369118 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876800d890 con 0x7f87700c0770 2023-07-11T00:30:38.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.473+0000 7f876d7fa700 1 -- 172.21.15.22:0/39369118 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876800d9f0 con 0x7f87700c0770 2023-07-11T00:30:38.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.473+0000 7f876d7fa700 1 -- 172.21.15.22:0/39369118 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876800dda0 con 0x7f87700c0770 2023-07-11T00:30:38.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.474+0000 7f8776bff700 1 -- 172.21.15.22:0/39369118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87700c15d0 con 0x7f87700c0770 2023-07-11T00:30:38.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.474+0000 7f8776bff700 1 -- 172.21.15.22:0/39369118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87700b2840 con 0x7f87700c0770 2023-07-11T00:30:38.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.475+0000 7f78757ff700 1 -- 172.21.15.22:0/2187016044 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78700c60c0 con 0x7f787015c1d0 2023-07-11T00:30:38.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.475+0000 7f78757ff700 1 -- 172.21.15.22:0/2187016044 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7870200660 con 0x7f787015c1d0 2023-07-11T00:30:38.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.475+0000 7f569edff700 1 Processor -- start 2023-07-11T00:30:38.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.475+0000 7f569edff700 1 -- start start 2023-07-11T00:30:38.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.477+0000 7f78757ff700 1 -- 172.21.15.22:0/2187016044 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787004ea60 con 0x7f787015c1d0 2023-07-11T00:30:38.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.477+0000 7f569edff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56980adce0 0x7f56980c22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.477+0000 7f569edff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56980cc390 0x7f569815aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.477+0000 7f569edff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5698160930 0x7f569815eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.477+0000 7f569edff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5698160d00 con 0x7f5698160930 2023-07-11T00:30:38.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.477+0000 7f569edff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5698161510 con 0x7f56980cc390 2023-07-11T00:30:38.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.477+0000 7f569edff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5698160f50 con 0x7f56980adce0 2023-07-11T00:30:38.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.477+0000 7f5697fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56980cc390 0x7f569815aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.477+0000 7f5697fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56980cc390 0x7f569815aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:37480/0 (socket says 172.21.15.22:37480) 2023-07-11T00:30:38.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.477+0000 7f5697fff700 1 -- 172.21.15.22:0/2927872147 learned_addr learned my addr 172.21.15.22:0/2927872147 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:38.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.478+0000 7f569d39c700 1 --2- 172.21.15.22:0/2927872147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5698160930 0x7f569815eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.478+0000 7f569cb9b700 1 --2- 172.21.15.22:0/2927872147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56980adce0 0x7f56980c22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.478+0000 7f5697fff700 1 -- 172.21.15.22:0/2927872147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56980adce0 msgr2=0x7f56980c22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.478+0000 7f5697fff700 1 --2- 172.21.15.22:0/2927872147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56980adce0 0x7f56980c22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.478+0000 7f5697fff700 1 -- 172.21.15.22:0/2927872147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5698160930 msgr2=0x7f569815eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.478+0000 7f5697fff700 1 --2- 172.21.15.22:0/2927872147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5698160930 0x7f569815eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.478+0000 7f5697fff700 1 -- 172.21.15.22:0/2927872147 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5690009b30 con 0x7f56980cc390 2023-07-11T00:30:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.478+0000 7f569cb9b700 1 --2- 172.21.15.22:0/2927872147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56980adce0 0x7f56980c22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.479+0000 7f5697fff700 1 --2- 172.21.15.22:0/2927872147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56980cc390 0x7f569815aae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f569000b730 tx=0x7f5690004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.479+0000 7f56957fa700 1 -- 172.21.15.22:0/2927872147 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690004440 con 0x7f56980cc390 2023-07-11T00:30:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.479+0000 7f56957fa700 1 -- 172.21.15.22:0/2927872147 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56900045c0 con 0x7f56980cc390 2023-07-11T00:30:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.479+0000 7f56957fa700 1 -- 172.21.15.22:0/2927872147 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690004970 con 0x7f56980cc390 2023-07-11T00:30:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.479+0000 7f569edff700 1 -- 172.21.15.22:0/2927872147 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5698161230 con 0x7f56980cc390 2023-07-11T00:30:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.479+0000 7f569edff700 1 -- 172.21.15.22:0/2927872147 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569815b020 con 0x7f56980cc390 2023-07-11T00:30:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.479+0000 7f78577fe700 1 -- 172.21.15.22:0/2187016044 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7860003a20 con 0x7f787015c1d0 2023-07-11T00:30:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.480+0000 7f876d7fa700 1 -- 172.21.15.22:0/39369118 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8768006d50 con 0x7f87700c0770 2023-07-11T00:30:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.480+0000 7f8776bff700 1 -- 172.21.15.22:0/39369118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87700c1af0 con 0x7f87700c0770 2023-07-11T00:30:38.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.481+0000 7f876d7fa700 1 --2- 172.21.15.22:0/39369118 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f875c06adb0 0x7f875c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.482+0000 7f569edff700 1 -- 172.21.15.22:0/2927872147 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569815e7f0 con 0x7f56980cc390 2023-07-11T00:30:38.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.481+0000 7f876d7fa700 1 -- 172.21.15.22:0/39369118 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f87680897a0 con 0x7f87700c0770 2023-07-11T00:30:38.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.483+0000 7f56957fa700 1 -- 172.21.15.22:0/2927872147 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5690019070 con 0x7f56980cc390 2023-07-11T00:30:38.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.481+0000 7f78577fe700 1 --2- 172.21.15.22:0/2187016044 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f785c06adb0 0x7f785c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.481+0000 7f78577fe700 1 -- 172.21.15.22:0/2187016044 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7860088c80 con 0x7f787015c1d0 2023-07-11T00:30:38.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.482+0000 7f786effd700 1 --2- 172.21.15.22:0/2187016044 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f785c06adb0 0x7f785c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.483+0000 7f24cebff700 1 Processor -- start 2023-07-11T00:30:38.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.484+0000 7f24cebff700 1 -- start start 2023-07-11T00:30:38.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.480+0000 7efe67dff700 1 Processor -- start 2023-07-11T00:30:38.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.481+0000 7efe67dff700 1 -- start start 2023-07-11T00:30:38.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.483+0000 7efe67dff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efe601583d0 0x7efe600cc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.483+0000 7efe67dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efe600ad710 0x7efe600adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.483+0000 7efe67dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe600ccf30 con 0x7efe6015ca40 2023-07-11T00:30:38.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.483+0000 7efe67dff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6006c7e0 con 0x7efe601583d0 2023-07-11T00:30:38.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.483+0000 7efe67dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe600ae090 con 0x7efe600ad710 2023-07-11T00:30:38.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.483+0000 7efe6639c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efe600ad710 0x7efe600adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.483+0000 7efe6639c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efe600ad710 0x7efe600adb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:37484/0 (socket says 172.21.15.22:37484) 2023-07-11T00:30:38.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.483+0000 7efe6639c700 1 -- 172.21.15.22:0/1881802847 learned_addr learned my addr 172.21.15.22:0/1881802847 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:38.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.484+0000 7efe6639c700 1 -- 172.21.15.22:0/1881802847 >> v2:172.21.15.22:3300/0 conn(0x7efe601583d0 msgr2=0x7efe600cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:38.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.484+0000 7efe6639c700 1 --2- 172.21.15.22:0/1881802847 >> v2:172.21.15.22:3300/0 conn(0x7efe601583d0 0x7efe600cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.484+0000 7efe6639c700 1 -- 172.21.15.22:0/1881802847 >> v1:172.21.15.184:6789/0 conn(0x7efe6015ca40 legacy=0x7efe600c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.484+0000 7efe6639c700 1 -- 172.21.15.22:0/1881802847 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe600cc970 con 0x7efe600ad710 2023-07-11T00:30:38.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.484+0000 7efe6639c700 1 --2- 172.21.15.22:0/1881802847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe600ad710 0x7efe600adb50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0098f0 tx=0x7efe5c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed58fb05242fe40a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.485+0000 7f877499b700 1 --2- 172.21.15.22:0/39369118 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f875c06adb0 0x7f875c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.485+0000 7f56957fa700 1 --2- 172.21.15.22:0/2927872147 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f568406ace0 0x7f568406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.485+0000 7f56957fa700 1 -- 172.21.15.22:0/2927872147 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f569008a8f0 con 0x7f56980cc390 2023-07-11T00:30:38.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.485+0000 7f569cb9b700 1 --2- 172.21.15.22:0/2927872147 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f568406ace0 0x7f568406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.486+0000 7ff774fff700 1 Processor -- start 2023-07-11T00:30:38.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.486+0000 7ff774fff700 1 -- start start 2023-07-11T00:30:38.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.487+0000 7f786effd700 1 --2- 172.21.15.22:0/2187016044 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f785c06adb0 0x7f785c06d260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f78680012e0 tx=0x7f7868001b70 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.487+0000 7f877499b700 1 --2- 172.21.15.22:0/39369118 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f875c06adb0 0x7f875c06d260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f877006ff00 tx=0x7f8760008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.486+0000 7f24cebff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24c8160930 0x7f24c8070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.486+0000 7f24cebff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c80ccb70 con 0x7f24c80cc390 2023-07-11T00:30:38.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.486+0000 7f24cebff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c8165400 con 0x7f24c80adeb0 2023-07-11T00:30:38.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.486+0000 7f24cebff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c8164640 con 0x7f24c8160930 2023-07-11T00:30:38.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.487+0000 7f569cb9b700 1 --2- 172.21.15.22:0/2927872147 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f568406ace0 0x7f568406d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f56980c42c0 tx=0x7f5688008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.487+0000 7f24cd19c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f24c80adeb0 0x7f24c806c340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:41154/0 (socket says 172.21.15.22:41154) 2023-07-11T00:30:38.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.487+0000 7f24cd19c700 1 -- 172.21.15.22:0/1176451272 learned_addr learned my addr 172.21.15.22:0/1176451272 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:38.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.487+0000 7fd4c43ff700 1 Processor -- start 2023-07-11T00:30:38.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.487+0000 7f78577fe700 1 -- 172.21.15.22:0/2187016044 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7860053a20 con 0x7f787015c1d0 2023-07-11T00:30:38.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.487+0000 7f24cc99b700 1 --2- 172.21.15.22:0/1176451272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24c8160930 0x7f24c8070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.488+0000 7f2abb1ff700 1 Processor -- start 2023-07-11T00:30:38.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.488+0000 7fd4c43ff700 1 -- start start 2023-07-11T00:30:38.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.488+0000 7ff774fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff770160930 0x7ff770070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.488+0000 7ff774fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff7700adeb0 0x7ff77006c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.488+0000 7ff774fff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7700ccb70 con 0x7ff7700cc390 2023-07-11T00:30:38.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.488+0000 7ff774fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff770165400 con 0x7ff7700adeb0 2023-07-11T00:30:38.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.488+0000 7ff774fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff770164640 con 0x7ff770160930 2023-07-11T00:30:38.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.489+0000 7ff76dd9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff7700cc390 0x7ff7700ad7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45876/0 (socket says 172.21.15.22:45876) 2023-07-11T00:30:38.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.489+0000 7ff76dd9b700 1 -- 172.21.15.22:0/3159890816 learned_addr learned my addr 172.21.15.22:0/3159890816 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:38.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.489+0000 7ff76e59c700 1 --2- 172.21.15.22:0/3159890816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff770160930 0x7ff770070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.489+0000 7ff76ed9d700 1 --2- 172.21.15.22:0/3159890816 >> v2:172.21.15.184:3300/0 conn(0x7ff7700adeb0 0x7ff77006c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.489+0000 7ff76e59c700 1 -- 172.21.15.22:0/3159890816 >> v2:172.21.15.184:3300/0 conn(0x7ff7700adeb0 msgr2=0x7ff77006c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:38.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.489+0000 7ff76e59c700 1 --2- 172.21.15.22:0/3159890816 >> v2:172.21.15.184:3300/0 conn(0x7ff7700adeb0 0x7ff77006c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.489+0000 7ff76e59c700 1 -- 172.21.15.22:0/3159890816 >> v1:172.21.15.22:6789/0 conn(0x7ff7700cc390 legacy=0x7ff7700ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.489+0000 7ff76e59c700 1 -- 172.21.15.22:0/3159890816 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff770164920 con 0x7ff770160930 2023-07-11T00:30:38.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.489+0000 7ff76ed9d700 1 --2- 172.21.15.22:0/3159890816 >> v2:172.21.15.184:3300/0 conn(0x7ff7700adeb0 0x7ff77006c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:38.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.489+0000 7f2abb1ff700 1 -- start start 2023-07-11T00:30:38.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.490+0000 7f24cc99b700 1 -- 172.21.15.22:0/1176451272 >> v1:172.21.15.184:6789/0 conn(0x7f24c80adeb0 legacy=0x7f24c806c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.490+0000 7f24cc99b700 1 -- 172.21.15.22:0/1176451272 >> v1:172.21.15.22:6789/0 conn(0x7f24c80cc390 legacy=0x7f24c80ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.490+0000 7f24cc99b700 1 -- 172.21.15.22:0/1176451272 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c8164920 con 0x7f24c8160930 2023-07-11T00:30:38.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.490+0000 7f56957fa700 1 -- 172.21.15.22:0/2927872147 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f56900556a0 con 0x7f56980cc390 2023-07-11T00:30:38.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.490+0000 7fd4c43ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd4bc071160 0x7fd4bc06a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.490+0000 7fd4c43ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc15e210 con 0x7fd4bc070340 2023-07-11T00:30:38.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.490+0000 7fd4c43ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc15dee0 con 0x7fd4bc157f10 2023-07-11T00:30:38.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.490+0000 7fd4c43ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc06d900 con 0x7fd4bc071160 2023-07-11T00:30:38.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.491+0000 7fd4c299c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd4bc071160 0x7fd4bc06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.491+0000 7fd4c299c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd4bc071160 0x7fd4bc06a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:37506/0 (socket says 172.21.15.22:37506) 2023-07-11T00:30:38.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.491+0000 7fd4c299c700 1 -- 172.21.15.22:0/1298521982 learned_addr learned my addr 172.21.15.22:0/1298521982 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:38.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.490+0000 7ff76e59c700 1 --2- 172.21.15.22:0/3159890816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff770160930 0x7ff770070a80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff760009840 tx=0x7ff760009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa166a20a2cc0a8d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.491+0000 7ff76d59a700 1 -- 172.21.15.22:0/3159890816 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760011830 con 0x7ff770160930 2023-07-11T00:30:38.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7ff76d59a700 1 -- 172.21.15.22:0/3159890816 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff760011990 con 0x7ff770160930 2023-07-11T00:30:38.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7ff76d59a700 1 -- 172.21.15.22:0/3159890816 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760011d20 con 0x7ff770160930 2023-07-11T00:30:38.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.490+0000 7efe64b99700 1 -- 172.21.15.22:0/1881802847 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c00b860 con 0x7efe600ad710 2023-07-11T00:30:38.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.490+0000 7efe64b99700 1 -- 172.21.15.22:0/1881802847 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5c00b9c0 con 0x7efe600ad710 2023-07-11T00:30:38.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.490+0000 7efe64b99700 1 -- 172.21.15.22:0/1881802847 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c00bd50 con 0x7efe600ad710 2023-07-11T00:30:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7efe67dff700 1 -- 172.21.15.22:0/1881802847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe600ad710 msgr2=0x7efe600adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7efe67dff700 1 --2- 172.21.15.22:0/1881802847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe600ad710 0x7efe600adb50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0098f0 tx=0x7efe5c009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7fd4c299c700 1 -- 172.21.15.22:0/1298521982 >> v1:172.21.15.184:6789/0 conn(0x7fd4bc157f10 legacy=0x7fd4bc15e6a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-11T00:30:38.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7fd4c299c700 1 -- 172.21.15.22:0/1298521982 >> v1:172.21.15.22:6789/0 conn(0x7fd4bc070340 legacy=0x7fd4bc070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:38.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7fd4c299c700 1 -- 172.21.15.22:0/1298521982 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc0c8f40 con 0x7fd4bc071160 2023-07-11T00:30:38.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7f876d7fa700 1 -- 172.21.15.22:0/39369118 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f87700c1af0 con 0x7f87700c0770 2023-07-11T00:30:38.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7efe67dff700 1 -- 172.21.15.22:0/1881802847 shutdown_connections 2023-07-11T00:30:38.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7efe67dff700 1 --2- 172.21.15.22:0/1881802847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe600ad710 0x7efe600adb50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7efe67dff700 1 --2- 172.21.15.22:0/1881802847 >> v2:172.21.15.22:3300/0 conn(0x7efe601583d0 0x7efe600cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7efe67dff700 1 -- 172.21.15.22:0/1881802847 >> 172.21.15.22:0/1881802847 conn(0x7efe600b0390 msgr2=0x7efe600b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.491+0000 7f2abb1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2ab4070a80 0x7f2ab40ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7f2abb1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab40adce0 0x7f2ab406c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7f2abb1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab40ccb70 con 0x7f2ab4160930 2023-07-11T00:30:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7f2abb1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab40ae160 con 0x7f2ab4070a80 2023-07-11T00:30:38.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7f2abb1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab4165400 con 0x7f2ab40adce0 2023-07-11T00:30:38.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7f2ab8f9b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2ab4160930 0x7f2ab40cc390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:41180/0 (socket says 172.21.15.22:41180) 2023-07-11T00:30:38.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7f2ab8f9b700 1 -- 172.21.15.22:0/310431807 learned_addr learned my addr 172.21.15.22:0/310431807 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:38.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7f2ab979c700 1 --2- 172.21.15.22:0/310431807 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab40adce0 0x7f2ab406c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7fd4c299c700 1 --2- 172.21.15.22:0/1298521982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4bc071160 0x7fd4bc06a940 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40098f0 tx=0x7fd4b4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87e10258eb408fa6 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7ff774fff700 1 -- 172.21.15.22:0/3159890816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff770160930 msgr2=0x7ff770070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.492+0000 7ff774fff700 1 --2- 172.21.15.22:0/3159890816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff770160930 0x7ff770070a80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff760009840 tx=0x7ff760009b50 comp rx=0 tx=0).stop 2023-07-11T00:30:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.493+0000 7efe67dff700 1 -- 172.21.15.22:0/1881802847 shutdown_connections 2023-07-11T00:30:38.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.493+0000 7f24cc99b700 1 --2- 172.21.15.22:0/1176451272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24c8160930 0x7f24c8070a80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009870 tx=0x7f24bc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c069d921c8bf2a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.493+0000 7ff774fff700 1 -- 172.21.15.22:0/3159890816 shutdown_connections 2023-07-11T00:30:38.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.493+0000 7ff774fff700 1 --2- 172.21.15.22:0/3159890816 >> v2:172.21.15.184:3300/0 conn(0x7ff7700adeb0 0x7ff77006c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.493+0000 7ff774fff700 1 --2- 172.21.15.22:0/3159890816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff770160930 0x7ff770070a80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.493+0000 7ff774fff700 1 -- 172.21.15.22:0/3159890816 >> 172.21.15.22:0/3159890816 conn(0x7ff7700b0390 msgr2=0x7ff7700b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.493+0000 7f2ab979c700 1 -- 172.21.15.22:0/310431807 >> v2:172.21.15.184:3300/0 conn(0x7f2ab4070a80 msgr2=0x7f2ab40ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:38.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.493+0000 7f2ab979c700 1 --2- 172.21.15.22:0/310431807 >> v2:172.21.15.184:3300/0 conn(0x7f2ab4070a80 0x7f2ab40ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.493+0000 7f2ab979c700 1 -- 172.21.15.22:0/310431807 >> v1:172.21.15.184:6789/0 conn(0x7f2ab4160930 legacy=0x7f2ab40cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.493+0000 7f2ab979c700 1 -- 172.21.15.22:0/310431807 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab4164640 con 0x7f2ab40adce0 2023-07-11T00:30:38.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.493+0000 7fd4c1199700 1 -- 172.21.15.22:0/1298521982 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4004230 con 0x7fd4bc071160 2023-07-11T00:30:38.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.493+0000 7fd4c1199700 1 -- 172.21.15.22:0/1298521982 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b4004390 con 0x7fd4bc071160 2023-07-11T00:30:38.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.493+0000 7fd4c1199700 1 -- 172.21.15.22:0/1298521982 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40036a0 con 0x7fd4bc071160 2023-07-11T00:30:38.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.493+0000 7f2ab979c700 1 --2- 172.21.15.22:0/310431807 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab40adce0 0x7f2ab406c340 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009840 tx=0x7f2aa4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3425b6405f2a68ef server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.493+0000 7ff774fff700 1 -- 172.21.15.22:0/3159890816 shutdown_connections 2023-07-11T00:30:38.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.494+0000 7fd4c43ff700 1 -- 172.21.15.22:0/1298521982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4bc071160 msgr2=0x7fd4bc06a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.494+0000 7fd4c43ff700 1 --2- 172.21.15.22:0/1298521982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4bc071160 0x7fd4bc06a940 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40098f0 tx=0x7fd4b4009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:38.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.493+0000 7efe67dff700 1 -- 172.21.15.22:0/1881802847 wait complete. 2023-07-11T00:30:38.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.493+0000 7ff774fff700 1 -- 172.21.15.22:0/3159890816 wait complete. 2023-07-11T00:30:38.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.494+0000 7f24c77fe700 1 -- 172.21.15.22:0/1176451272 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc011830 con 0x7f24c8160930 2023-07-11T00:30:38.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.494+0000 7f24c77fe700 1 -- 172.21.15.22:0/1176451272 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc011990 con 0x7f24c8160930 2023-07-11T00:30:38.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.494+0000 7f24c77fe700 1 -- 172.21.15.22:0/1176451272 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc011d20 con 0x7f24c8160930 2023-07-11T00:30:38.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.494+0000 7fd4c43ff700 1 -- 172.21.15.22:0/1298521982 shutdown_connections 2023-07-11T00:30:38.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.494+0000 7fd4c43ff700 1 --2- 172.21.15.22:0/1298521982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4bc071160 0x7fd4bc06a940 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.494+0000 7fd4c43ff700 1 -- 172.21.15.22:0/1298521982 >> 172.21.15.22:0/1298521982 conn(0x7fd4bc0b0390 msgr2=0x7fd4bc0b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.495+0000 7fd4c43ff700 1 -- 172.21.15.22:0/1298521982 shutdown_connections 2023-07-11T00:30:38.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.495+0000 7f24cebff700 1 -- 172.21.15.22:0/1176451272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24c8160930 msgr2=0x7f24c8070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.495+0000 7f24cebff700 1 --2- 172.21.15.22:0/1176451272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24c8160930 0x7f24c8070a80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009870 tx=0x7f24bc009b80 comp rx=0 tx=0).stop 2023-07-11T00:30:38.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.495+0000 7f24cebff700 1 -- 172.21.15.22:0/1176451272 shutdown_connections 2023-07-11T00:30:38.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.495+0000 7f24cebff700 1 --2- 172.21.15.22:0/1176451272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24c8160930 0x7f24c8070a80 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009870 tx=0x7f24bc009b80 comp rx=0 tx=0).stop 2023-07-11T00:30:38.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.495+0000 7f24cebff700 1 -- 172.21.15.22:0/1176451272 >> 172.21.15.22:0/1176451272 conn(0x7f24c80b0390 msgr2=0x7f24c80b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.495+0000 7fd4c43ff700 1 -- 172.21.15.22:0/1298521982 wait complete. 2023-07-11T00:30:38.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.496+0000 7efe67dff700 1 Processor -- start 2023-07-11T00:30:38.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.496+0000 7f2ab37fe700 1 -- 172.21.15.22:0/310431807 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4004230 con 0x7f2ab40adce0 2023-07-11T00:30:38.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.496+0000 7f2ab37fe700 1 -- 172.21.15.22:0/310431807 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa4004390 con 0x7f2ab40adce0 2023-07-11T00:30:38.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.496+0000 7f2ab37fe700 1 -- 172.21.15.22:0/310431807 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40036a0 con 0x7f2ab40adce0 2023-07-11T00:30:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.497+0000 7f2abb1ff700 1 -- 172.21.15.22:0/310431807 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab40adce0 msgr2=0x7f2ab406c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.497+0000 7f2abb1ff700 1 --2- 172.21.15.22:0/310431807 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab40adce0 0x7f2ab406c340 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009840 tx=0x7f2aa4009b50 comp rx=0 tx=0).stop 2023-07-11T00:30:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.497+0000 7f2abb1ff700 1 -- 172.21.15.22:0/310431807 shutdown_connections 2023-07-11T00:30:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.497+0000 7f2abb1ff700 1 --2- 172.21.15.22:0/310431807 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab40adce0 0x7f2ab406c340 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.497+0000 7f2abb1ff700 1 --2- 172.21.15.22:0/310431807 >> v2:172.21.15.184:3300/0 conn(0x7f2ab4070a80 0x7f2ab40ad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.497+0000 7f2abb1ff700 1 -- 172.21.15.22:0/310431807 >> 172.21.15.22:0/310431807 conn(0x7f2ab40b0390 msgr2=0x7f2ab40b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.496+0000 7ff774fff700 1 Processor -- start 2023-07-11T00:30:38.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.497+0000 7fd4c43ff700 1 Processor -- start 2023-07-11T00:30:38.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.496+0000 7ff774fff700 1 -- start start 2023-07-11T00:30:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.496+0000 7efe67dff700 1 -- start start 2023-07-11T00:30:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.498+0000 7efe67dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe600ad710 0x7efe601587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.498+0000 7efe67dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe601583d0 0x7efe60150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.498+0000 7efe67dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe6015ca40 0x7efe601514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.498+0000 7efe67dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6015b680 con 0x7efe601583d0 2023-07-11T00:30:38.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.498+0000 7efe67dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe60158ce0 con 0x7efe6015ca40 2023-07-11T00:30:38.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.498+0000 7efe67dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6015b1f0 con 0x7efe600ad710 2023-07-11T00:30:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.498+0000 7fd4c43ff700 1 -- start start 2023-07-11T00:30:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.498+0000 7ff774fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7700adeb0 0x7ff77015f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.498+0000 7ff774fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7700cc390 0x7ff7700c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.498+0000 7ff774fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff770160930 0x7ff7700be870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.498+0000 7ff774fff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77015fe20 con 0x7ff7700cc390 2023-07-11T00:30:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.498+0000 7ff774fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700c5690 con 0x7ff7700adeb0 2023-07-11T00:30:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.498+0000 7ff774fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700bd7d0 con 0x7ff770160930 2023-07-11T00:30:38.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7efe6539a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe601583d0 0x7efe60150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7efe65b9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe600ad710 0x7efe601587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7efe6539a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe601583d0 0x7efe60150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45680/0 (socket says 172.21.15.22:45680) 2023-07-11T00:30:38.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7ff76e59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7700adeb0 0x7ff77015f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7efe6539a700 1 -- 172.21.15.22:0/2011099767 learned_addr learned my addr 172.21.15.22:0/2011099767 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7efe6639c700 1 --2- 172.21.15.22:0/2011099767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe6015ca40 0x7efe601514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7ff76e59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7700adeb0 0x7ff77015f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:37542/0 (socket says 172.21.15.22:37542) 2023-07-11T00:30:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7ff76e59c700 1 -- 172.21.15.22:0/3845556150 learned_addr learned my addr 172.21.15.22:0/3845556150 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7ff76ed9d700 1 --2- 172.21.15.22:0/3845556150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff770160930 0x7ff7700be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7efe6539a700 1 -- 172.21.15.22:0/2011099767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe600ad710 msgr2=0x7efe601587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7efe6539a700 1 --2- 172.21.15.22:0/2011099767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe600ad710 0x7efe601587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7efe6539a700 1 -- 172.21.15.22:0/2011099767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe6015ca40 msgr2=0x7efe601514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7efe6539a700 1 --2- 172.21.15.22:0/2011099767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe6015ca40 0x7efe601514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7efe6539a700 1 -- 172.21.15.22:0/2011099767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c009550 con 0x7efe601583d0 2023-07-11T00:30:38.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7ff76e59c700 1 -- 172.21.15.22:0/3845556150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff770160930 msgr2=0x7ff7700be870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7ff76e59c700 1 --2- 172.21.15.22:0/3845556150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff770160930 0x7ff7700be870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7ff76e59c700 1 -- 172.21.15.22:0/3845556150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7700cc390 msgr2=0x7ff7700c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7ff76e59c700 1 --2- 172.21.15.22:0/3845556150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7700cc390 0x7ff7700c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.499+0000 7ff76e59c700 1 -- 172.21.15.22:0/3845556150 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7600094a0 con 0x7ff7700adeb0 2023-07-11T00:30:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.500+0000 7efe6539a700 1 --2- 172.21.15.22:0/2011099767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe601583d0 0x7efe60150440 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efe5000c4e0 tx=0x7efe5000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.500+0000 7ff76e59c700 1 --2- 172.21.15.22:0/3845556150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7700adeb0 0x7ff77015f8e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff760000c00 tx=0x7ff760004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.501+0000 7fd4c43ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4bc070340 0x7fd4bc1f1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.501+0000 7fd4c43ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4bc071160 0x7fd4bc0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.501+0000 7fd4c43ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4bc157f10 0x7fd4bc0b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.501+0000 7fd4c43ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc0ac770 con 0x7fd4bc071160 2023-07-11T00:30:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.501+0000 7fd4c43ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc0aca50 con 0x7fd4bc157f10 2023-07-11T00:30:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.501+0000 7fd4c43ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc0acd30 con 0x7fd4bc070340 2023-07-11T00:30:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.502+0000 7f2abb1ff700 1 -- 172.21.15.22:0/310431807 shutdown_connections 2023-07-11T00:30:38.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.501+0000 7fd4c199a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4bc071160 0x7fd4bc0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.501+0000 7fd4c199a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4bc071160 0x7fd4bc0b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45710/0 (socket says 172.21.15.22:45710) 2023-07-11T00:30:38.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.501+0000 7fd4c199a700 1 -- 172.21.15.22:0/2260894857 learned_addr learned my addr 172.21.15.22:0/2260894857 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:38.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.502+0000 7f24cebff700 1 -- 172.21.15.22:0/1176451272 shutdown_connections 2023-07-11T00:30:38.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.502+0000 7fd4c219b700 1 --2- 172.21.15.22:0/2260894857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4bc070340 0x7fd4bc1f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.502+0000 7fd4c199a700 1 -- 172.21.15.22:0/2260894857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4bc070340 msgr2=0x7fd4bc1f1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.502+0000 7fd4c199a700 1 --2- 172.21.15.22:0/2260894857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4bc070340 0x7fd4bc1f1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.502+0000 7fd4c199a700 1 -- 172.21.15.22:0/2260894857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4bc157f10 msgr2=0x7fd4bc0b2100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-11T00:30:38.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.502+0000 7fd4c199a700 1 --2- 172.21.15.22:0/2260894857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4bc157f10 0x7fd4bc0b2100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.502+0000 7fd4c199a700 1 -- 172.21.15.22:0/2260894857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b4009550 con 0x7fd4bc071160 2023-07-11T00:30:38.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.501+0000 7ff766ffd700 1 -- 172.21.15.22:0/3845556150 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760004590 con 0x7ff7700adeb0 2023-07-11T00:30:38.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.501+0000 7ff766ffd700 1 -- 172.21.15.22:0/3845556150 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76001f070 con 0x7ff7700adeb0 2023-07-11T00:30:38.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.501+0000 7ff766ffd700 1 -- 172.21.15.22:0/3845556150 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7600038e0 con 0x7ff7700adeb0 2023-07-11T00:30:38.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.503+0000 7ff774fff700 1 -- 172.21.15.22:0/3845556150 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7700bdab0 con 0x7ff7700adeb0 2023-07-11T00:30:38.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.503+0000 7ff774fff700 1 -- 172.21.15.22:0/3845556150 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7700be070 con 0x7ff7700adeb0 2023-07-11T00:30:38.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.503+0000 7fd4c199a700 1 --2- 172.21.15.22:0/2260894857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4bc071160 0x7fd4bc0b1bc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000c4a0 tx=0x7fd4b000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.503+0000 7fd4baffd700 1 -- 172.21.15.22:0/2260894857 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00054e0 con 0x7fd4bc071160 2023-07-11T00:30:38.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.503+0000 7fd4baffd700 1 -- 172.21.15.22:0/2260894857 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b0003680 con 0x7fd4bc071160 2023-07-11T00:30:38.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.503+0000 7fd4baffd700 1 -- 172.21.15.22:0/2260894857 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0003a30 con 0x7fd4bc071160 2023-07-11T00:30:38.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.504+0000 7fd4c43ff700 1 -- 172.21.15.22:0/2260894857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4bc0ad010 con 0x7fd4bc071160 2023-07-11T00:30:38.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.504+0000 7fd4c43ff700 1 -- 172.21.15.22:0/2260894857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc0ab9b0 con 0x7fd4bc071160 2023-07-11T00:30:38.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.502+0000 7efe567fc700 1 -- 172.21.15.22:0/2011099767 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe500052d0 con 0x7efe601583d0 2023-07-11T00:30:38.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.502+0000 7efe567fc700 1 -- 172.21.15.22:0/2011099767 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe50005430 con 0x7efe601583d0 2023-07-11T00:30:38.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.502+0000 7efe567fc700 1 -- 172.21.15.22:0/2011099767 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50003880 con 0x7efe601583d0 2023-07-11T00:30:38.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.505+0000 7ff774fff700 1 -- 172.21.15.22:0/3845556150 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77004ea60 con 0x7ff7700adeb0 2023-07-11T00:30:38.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.504+0000 7efe67dff700 1 -- 172.21.15.22:0/2011099767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6015a5e0 con 0x7efe601583d0 2023-07-11T00:30:38.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.505+0000 7efe67dff700 1 -- 172.21.15.22:0/2011099767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6015aba0 con 0x7efe601583d0 2023-07-11T00:30:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.502+0000 7f24cebff700 1 -- 172.21.15.22:0/1176451272 wait complete. 2023-07-11T00:30:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.505+0000 7f24cebff700 1 Processor -- start 2023-07-11T00:30:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.505+0000 7f24cebff700 1 -- start start 2023-07-11T00:30:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.506+0000 7efe67dff700 1 -- 172.21.15.22:0/2011099767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6013b6e0 con 0x7efe601583d0 2023-07-11T00:30:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.508+0000 7f2abb1ff700 1 -- 172.21.15.22:0/310431807 wait complete. 2023-07-11T00:30:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.511+0000 7f2abb1ff700 1 Processor -- start 2023-07-11T00:30:38.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.508+0000 7fd4baffd700 1 -- 172.21.15.22:0/2260894857 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd4b0003b90 con 0x7fd4bc071160 2023-07-11T00:30:38.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.509+0000 7fd4baffd700 1 --2- 172.21.15.22:0/2260894857 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd4a806adb0 0x7fd4a806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.510+0000 7fd4baffd700 1 -- 172.21.15.22:0/2260894857 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd4b0088c80 con 0x7fd4bc071160 2023-07-11T00:30:38.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.510+0000 7fd4c43ff700 1 -- 172.21.15.22:0/2260894857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc04ea60 con 0x7fd4bc071160 2023-07-11T00:30:38.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.510+0000 7fd4c219b700 1 --2- 172.21.15.22:0/2260894857 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd4a806adb0 0x7fd4a806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.507+0000 7f24cebff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24c80adeb0 0x7f24c80c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.507+0000 7f24cebff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24c80cc390 0x7f24c80c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.507+0000 7f24cebff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24c80af580 0x7f24c8206ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.507+0000 7f24cebff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c80c34c0 con 0x7f24c80adeb0 2023-07-11T00:30:38.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.507+0000 7f24cebff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c81eade0 con 0x7f24c80af580 2023-07-11T00:30:38.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.507+0000 7f24cebff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c80c3220 con 0x7f24c80cc390 2023-07-11T00:30:38.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.508+0000 7f24cd19c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24c80af580 0x7f24c8206ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.508+0000 7f24c7fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24c80cc390 0x7f24c80c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.509+0000 7f24c7fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24c80cc390 0x7f24c80c2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:33970/0 (socket says 172.21.15.22:33970) 2023-07-11T00:30:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.509+0000 7f24c7fff700 1 -- 172.21.15.22:0/1392192307 learned_addr learned my addr 172.21.15.22:0/1392192307 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.509+0000 7f24c7fff700 1 -- 172.21.15.22:0/1392192307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24c80af580 msgr2=0x7f24c8206ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.509+0000 7f24c7fff700 1 --2- 172.21.15.22:0/1392192307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24c80af580 0x7f24c8206ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.509+0000 7f24c7fff700 1 -- 172.21.15.22:0/1392192307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24c80adeb0 msgr2=0x7f24c80c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.509+0000 7f24c7fff700 1 --2- 172.21.15.22:0/1392192307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24c80adeb0 0x7f24c80c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.509+0000 7f24c7fff700 1 -- 172.21.15.22:0/1392192307 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc0094a0 con 0x7f24c80cc390 2023-07-11T00:30:38.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.510+0000 7f24c7fff700 1 --2- 172.21.15.22:0/1392192307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24c80cc390 0x7f24c80c2ce0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f24b800c4c0 tx=0x7f24b800c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.507+0000 7ff766ffd700 1 -- 172.21.15.22:0/3845556150 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff760003a40 con 0x7ff7700adeb0 2023-07-11T00:30:38.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.509+0000 7ff766ffd700 1 --2- 172.21.15.22:0/3845556150 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff75006adb0 0x7ff75006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.509+0000 7ff766ffd700 1 -- 172.21.15.22:0/3845556150 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff760021070 con 0x7ff7700adeb0 2023-07-11T00:30:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.511+0000 7ff766ffd700 1 -- 172.21.15.22:0/3845556150 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff760056430 con 0x7ff7700adeb0 2023-07-11T00:30:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.511+0000 7f2abb1ff700 1 -- start start 2023-07-11T00:30:38.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.513+0000 7f2abb1ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4070a80 0x7f2ab40b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.513+0000 7f2abb1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab40adce0 0x7f2ab415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.513+0000 7f2abb1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab4160930 0x7f2ab40b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.513+0000 7f2abb1ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab41fee10 con 0x7f2ab4070a80 2023-07-11T00:30:38.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.513+0000 7f2abb1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40b2680 con 0x7f2ab40adce0 2023-07-11T00:30:38.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.513+0000 7f2abb1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40b2960 con 0x7f2ab4160930 2023-07-11T00:30:38.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.514+0000 7ff76dd9b700 1 --2- 172.21.15.22:0/3845556150 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff75006adb0 0x7ff75006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.514+0000 7f2ab3fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab40adce0 0x7f2ab415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.514+0000 7f2ab3fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab40adce0 0x7f2ab415dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:37556/0 (socket says 172.21.15.22:37556) 2023-07-11T00:30:38.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.514+0000 7f2ab3fff700 1 -- 172.21.15.22:0/30471600 learned_addr learned my addr 172.21.15.22:0/30471600 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:38.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.515+0000 7f2ab8f9b700 1 --2- 172.21.15.22:0/30471600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4070a80 0x7f2ab40b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.515+0000 7f2ab979c700 1 --2- 172.21.15.22:0/30471600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab4160930 0x7f2ab40b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.514+0000 7efe567fc700 1 -- 172.21.15.22:0/2011099767 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe500039e0 con 0x7efe601583d0 2023-07-11T00:30:38.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.516+0000 7efe567fc700 1 --2- 172.21.15.22:0/2011099767 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efe4406adb0 0x7efe4406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.515+0000 7f2ab3fff700 1 -- 172.21.15.22:0/30471600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab4160930 msgr2=0x7f2ab40b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.515+0000 7f2ab3fff700 1 --2- 172.21.15.22:0/30471600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab4160930 0x7f2ab40b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.515+0000 7f2ab3fff700 1 -- 172.21.15.22:0/30471600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4070a80 msgr2=0x7f2ab40b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.515+0000 7f2ab3fff700 1 --2- 172.21.15.22:0/30471600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4070a80 0x7f2ab40b2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.515+0000 7f2ab3fff700 1 -- 172.21.15.22:0/30471600 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa40094a0 con 0x7f2ab40adce0 2023-07-11T00:30:38.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.516+0000 7efe567fc700 1 -- 172.21.15.22:0/2011099767 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efe50089380 con 0x7efe601583d0 2023-07-11T00:30:38.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.516+0000 7efe65b9b700 1 --2- 172.21.15.22:0/2011099767 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efe4406adb0 0x7efe4406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.516+0000 7ff76dd9b700 1 --2- 172.21.15.22:0/3845556150 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff75006adb0 0x7ff75006d260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff7580012e0 tx=0x7ff758001590 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.516+0000 7fd4c219b700 1 --2- 172.21.15.22:0/2260894857 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd4a806adb0 0x7fd4a806d260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc15a1c0 tx=0x7fd4ac0094f0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.516+0000 7f2ab3fff700 1 --2- 172.21.15.22:0/30471600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab40adce0 0x7f2ab415dc50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800b4a0 tx=0x7f2aa800b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.516+0000 7f2ab17fa700 1 -- 172.21.15.22:0/30471600 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8011830 con 0x7f2ab40adce0 2023-07-11T00:30:38.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.516+0000 7f2ab17fa700 1 -- 172.21.15.22:0/30471600 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa8011990 con 0x7f2ab40adce0 2023-07-11T00:30:38.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.516+0000 7f2ab17fa700 1 -- 172.21.15.22:0/30471600 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8011d40 con 0x7f2ab40adce0 2023-07-11T00:30:38.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.517+0000 7f24c57fa700 1 -- 172.21.15.22:0/1392192307 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b80052d0 con 0x7f24c80cc390 2023-07-11T00:30:38.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.517+0000 7f24c57fa700 1 -- 172.21.15.22:0/1392192307 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b8005450 con 0x7f24c80cc390 2023-07-11T00:30:38.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.517+0000 7f24c57fa700 1 -- 172.21.15.22:0/1392192307 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8006aa0 con 0x7f24c80cc390 2023-07-11T00:30:38.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.517+0000 7efe567fc700 1 -- 172.21.15.22:0/2011099767 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7efe50054140 con 0x7efe601583d0 2023-07-11T00:30:38.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.517+0000 7efe65b9b700 1 --2- 172.21.15.22:0/2011099767 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efe4406adb0 0x7efe4406d260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efe58009f20 tx=0x7efe580094f0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.518+0000 7f24cebff700 1 -- 172.21.15.22:0/1392192307 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c81ea440 con 0x7f24c80cc390 2023-07-11T00:30:38.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.518+0000 7f24cebff700 1 -- 172.21.15.22:0/1392192307 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c81eaa00 con 0x7f24c80cc390 2023-07-11T00:30:38.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.517+0000 7f2abb1ff700 1 -- 172.21.15.22:0/30471600 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab40b2c40 con 0x7f2ab40adce0 2023-07-11T00:30:38.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.517+0000 7f2abb1ff700 1 -- 172.21.15.22:0/30471600 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab40b4120 con 0x7f2ab40adce0 2023-07-11T00:30:38.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.522+0000 7f24cebff700 1 -- 172.21.15.22:0/1392192307 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c81eaf20 con 0x7f24c80cc390 2023-07-11T00:30:38.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.522+0000 7f2ab17fa700 1 -- 172.21.15.22:0/30471600 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2aa801a400 con 0x7f2ab40adce0 2023-07-11T00:30:38.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.523+0000 7f2abb1ff700 1 -- 172.21.15.22:0/30471600 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a940052f0 con 0x7f2ab40adce0 2023-07-11T00:30:38.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.524+0000 7f2ab17fa700 1 --2- 172.21.15.22:0/30471600 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2aa006adb0 0x7f2aa006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.524+0000 7f2ab17fa700 1 -- 172.21.15.22:0/30471600 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2aa8089760 con 0x7f2ab40adce0 2023-07-11T00:30:38.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.525+0000 7f2ab8f9b700 1 --2- 172.21.15.22:0/30471600 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2aa006adb0 0x7f2aa006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.525+0000 7f24c57fa700 1 -- 172.21.15.22:0/1392192307 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f24b8003680 con 0x7f24c80cc390 2023-07-11T00:30:38.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.526+0000 7f2ab8f9b700 1 --2- 172.21.15.22:0/30471600 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2aa006adb0 0x7f2aa006d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2aac007110 tx=0x7f2aac0019c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.527+0000 7f24c57fa700 1 --2- 172.21.15.22:0/1392192307 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f24b406adb0 0x7f24b406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:38.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.527+0000 7f24c57fa700 1 -- 172.21.15.22:0/1392192307 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f24b8088c00 con 0x7f24c80cc390 2023-07-11T00:30:38.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.529+0000 7f24cc99b700 1 --2- 172.21.15.22:0/1392192307 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f24b406adb0 0x7f24b406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:38.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.530+0000 7f2ab17fa700 1 -- 172.21.15.22:0/30471600 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2aa8054510 con 0x7f2ab40adce0 2023-07-11T00:30:38.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.529+0000 7fd4baffd700 1 -- 172.21.15.22:0/2260894857 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd4b0053a20 con 0x7fd4bc071160 2023-07-11T00:30:38.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.541+0000 7f24c57fa700 1 -- 172.21.15.22:0/1392192307 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f24b8053a30 con 0x7f24c80cc390 2023-07-11T00:30:38.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.567+0000 7f24cc99b700 1 --2- 172.21.15.22:0/1392192307 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f24b406adb0 0x7f24b406d260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f24c806b000 tx=0x7f24bc010000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:38.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.936+0000 7f569edff700 1 -- 172.21.15.22:0/2927872147 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f569804ea60 con 0x7f56980cc390 2023-07-11T00:30:38.942 INFO:teuthology.orchestra.run.smithi022.stdout:55834574857 2023-07-11T00:30:38.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.937+0000 7f56957fa700 1 -- 172.21.15.22:0/2927872147 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5690007310 con 0x7f56980cc390 2023-07-11T00:30:38.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.941+0000 7f569edff700 1 -- 172.21.15.22:0/2927872147 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f568406ace0 msgr2=0x7f568406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.941+0000 7f569edff700 1 --2- 172.21.15.22:0/2927872147 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f568406ace0 0x7f568406d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f56980c42c0 tx=0x7f5688008040 comp rx=0 tx=0).stop 2023-07-11T00:30:38.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.941+0000 7f569edff700 1 -- 172.21.15.22:0/2927872147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56980cc390 msgr2=0x7f569815aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.941+0000 7f569edff700 1 --2- 172.21.15.22:0/2927872147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56980cc390 0x7f569815aae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f569000b730 tx=0x7f5690004ad0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.941+0000 7f569edff700 1 -- 172.21.15.22:0/2927872147 shutdown_connections 2023-07-11T00:30:38.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.941+0000 7f569edff700 1 --2- 172.21.15.22:0/2927872147 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f568406ace0 0x7f568406d190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.941+0000 7f569edff700 1 --2- 172.21.15.22:0/2927872147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56980adce0 0x7f56980c22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.941+0000 7f569edff700 1 --2- 172.21.15.22:0/2927872147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5698160930 0x7f569815eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.941+0000 7f569edff700 1 --2- 172.21.15.22:0/2927872147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56980cc390 0x7f569815aae0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.941+0000 7f569edff700 1 -- 172.21.15.22:0/2927872147 >> 172.21.15.22:0/2927872147 conn(0x7f56980b0390 msgr2=0x7f56980aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.942+0000 7f569edff700 1 -- 172.21.15.22:0/2927872147 shutdown_connections 2023-07-11T00:30:38.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.942+0000 7f569edff700 1 -- 172.21.15.22:0/2927872147 wait complete. 2023-07-11T00:30:38.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.943+0000 7f78757ff700 1 -- 172.21.15.22:0/2187016044 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f78700c1d30 con 0x7f787015c1d0 2023-07-11T00:30:38.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.944+0000 7f78577fe700 1 -- 172.21.15.22:0/2187016044 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78700c1d30 con 0x7f787015c1d0 2023-07-11T00:30:38.951 INFO:teuthology.orchestra.run.smithi022.stdout:55834574856 2023-07-11T00:30:38.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.950+0000 7f78757ff700 1 -- 172.21.15.22:0/2187016044 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f785c06adb0 msgr2=0x7f785c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.950+0000 7f78757ff700 1 --2- 172.21.15.22:0/2187016044 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f785c06adb0 0x7f785c06d260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f78680012e0 tx=0x7f7868001b70 comp rx=0 tx=0).stop 2023-07-11T00:30:38.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.950+0000 7f78757ff700 1 -- 172.21.15.22:0/2187016044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f787015c1d0 msgr2=0x7f78701ff280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.950+0000 7f78757ff700 1 --2- 172.21.15.22:0/2187016044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f787015c1d0 0x7f78701ff280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f786000c430 tx=0x7f786000c740 comp rx=0 tx=0).stop 2023-07-11T00:30:38.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.951+0000 7f78757ff700 1 -- 172.21.15.22:0/2187016044 shutdown_connections 2023-07-11T00:30:38.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.951+0000 7f78757ff700 1 --2- 172.21.15.22:0/2187016044 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f785c06adb0 0x7f785c06d260 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.951+0000 7f78757ff700 1 --2- 172.21.15.22:0/2187016044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f787015c1d0 0x7f78701ff280 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.951+0000 7f78757ff700 1 --2- 172.21.15.22:0/2187016044 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78700ad710 0x7f78701fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.951+0000 7f78757ff700 1 --2- 172.21.15.22:0/2187016044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78701606e0 0x7f787015bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.951+0000 7f78757ff700 1 -- 172.21.15.22:0/2187016044 >> 172.21.15.22:0/2187016044 conn(0x7f787006abc0 msgr2=0x7f78700cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.951+0000 7f78757ff700 1 -- 172.21.15.22:0/2187016044 shutdown_connections 2023-07-11T00:30:38.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.951+0000 7f78757ff700 1 -- 172.21.15.22:0/2187016044 wait complete. 2023-07-11T00:30:38.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.954+0000 7f8776bff700 1 -- 172.21.15.22:0/39369118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f87700c1af0 con 0x7f87700c0770 2023-07-11T00:30:38.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.957+0000 7f876d7fa700 1 -- 172.21.15.22:0/39369118 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f87700c1af0 con 0x7f87700c0770 2023-07-11T00:30:38.963 INFO:teuthology.orchestra.run.smithi022.stdout:55834574857 2023-07-11T00:30:38.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.962+0000 7f8776bff700 1 -- 172.21.15.22:0/39369118 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f875c06adb0 msgr2=0x7f875c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.962+0000 7f8776bff700 1 --2- 172.21.15.22:0/39369118 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f875c06adb0 0x7f875c06d260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f877006ff00 tx=0x7f8760008030 comp rx=0 tx=0).stop 2023-07-11T00:30:38.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.962+0000 7f8776bff700 1 -- 172.21.15.22:0/39369118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87700c0770 msgr2=0x7f87700b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.962+0000 7f8776bff700 1 --2- 172.21.15.22:0/39369118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87700c0770 0x7f87700b2300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f876800b990 tx=0x7f876800bca0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.963+0000 7f8776bff700 1 -- 172.21.15.22:0/39369118 shutdown_connections 2023-07-11T00:30:38.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.963+0000 7f8776bff700 1 --2- 172.21.15.22:0/39369118 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f875c06adb0 0x7f875c06d260 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.963+0000 7f8776bff700 1 --2- 172.21.15.22:0/39369118 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87700c9700 0x7f87700ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.963+0000 7f8776bff700 1 --2- 172.21.15.22:0/39369118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87700c0770 0x7f87700b2300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.963+0000 7f8776bff700 1 --2- 172.21.15.22:0/39369118 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87700cb8b0 0x7f87700ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.963+0000 7f8776bff700 1 -- 172.21.15.22:0/39369118 >> 172.21.15.22:0/39369118 conn(0x7f877006abc0 msgr2=0x7f877006dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.963+0000 7f8776bff700 1 -- 172.21.15.22:0/39369118 shutdown_connections 2023-07-11T00:30:38.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.963+0000 7f8776bff700 1 -- 172.21.15.22:0/39369118 wait complete. 2023-07-11T00:30:38.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.0 2023-07-11T00:30:38.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.975+0000 7ff774fff700 1 -- 172.21.15.22:0/3845556150 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff7700b46f0 con 0x7ff7700adeb0 2023-07-11T00:30:38.979 INFO:teuthology.orchestra.run.smithi022.stdout:55834574857 2023-07-11T00:30:38.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.976+0000 7ff766ffd700 1 -- 172.21.15.22:0/3845556150 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff760059a50 con 0x7ff7700adeb0 2023-07-11T00:30:38.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.980+0000 7ff774fff700 1 -- 172.21.15.22:0/3845556150 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff75006adb0 msgr2=0x7ff75006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.980+0000 7ff774fff700 1 --2- 172.21.15.22:0/3845556150 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff75006adb0 0x7ff75006d260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff7580012e0 tx=0x7ff758001590 comp rx=0 tx=0).stop 2023-07-11T00:30:38.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.980+0000 7ff774fff700 1 -- 172.21.15.22:0/3845556150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7700adeb0 msgr2=0x7ff77015f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.980+0000 7ff774fff700 1 --2- 172.21.15.22:0/3845556150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7700adeb0 0x7ff77015f8e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff760000c00 tx=0x7ff760004750 comp rx=0 tx=0).stop 2023-07-11T00:30:38.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.980+0000 7efe67dff700 1 -- 172.21.15.22:0/2011099767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efe6004ea60 con 0x7efe601583d0 2023-07-11T00:30:38.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.980+0000 7ff774fff700 1 -- 172.21.15.22:0/3845556150 shutdown_connections 2023-07-11T00:30:38.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.980+0000 7ff774fff700 1 --2- 172.21.15.22:0/3845556150 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff75006adb0 0x7ff75006d260 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.980+0000 7ff774fff700 1 --2- 172.21.15.22:0/3845556150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff770160930 0x7ff7700be870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.980+0000 7ff774fff700 1 --2- 172.21.15.22:0/3845556150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7700adeb0 0x7ff77015f8e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.980+0000 7ff774fff700 1 --2- 172.21.15.22:0/3845556150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7700cc390 0x7ff7700c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.980+0000 7ff774fff700 1 -- 172.21.15.22:0/3845556150 >> 172.21.15.22:0/3845556150 conn(0x7ff7700b0390 msgr2=0x7ff7700ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.981+0000 7ff774fff700 1 -- 172.21.15.22:0/3845556150 shutdown_connections 2023-07-11T00:30:38.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.981+0000 7efe567fc700 1 -- 172.21.15.22:0/2011099767 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe50021020 con 0x7efe601583d0 2023-07-11T00:30:38.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.981+0000 7ff774fff700 1 -- 172.21.15.22:0/3845556150 wait complete. 2023-07-11T00:30:38.986 INFO:teuthology.orchestra.run.smithi022.stdout:55834574856 2023-07-11T00:30:38.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.985+0000 7f2abb1ff700 1 -- 172.21.15.22:0/30471600 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2a940055a0 con 0x7f2ab40adce0 2023-07-11T00:30:38.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.1 2023-07-11T00:30:38.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.985+0000 7efe67dff700 1 -- 172.21.15.22:0/2011099767 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efe4406adb0 msgr2=0x7efe4406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.985+0000 7efe67dff700 1 --2- 172.21.15.22:0/2011099767 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efe4406adb0 0x7efe4406d260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efe58009f20 tx=0x7efe580094f0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.985+0000 7efe67dff700 1 -- 172.21.15.22:0/2011099767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe601583d0 msgr2=0x7efe60150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.985+0000 7efe67dff700 1 --2- 172.21.15.22:0/2011099767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe601583d0 0x7efe60150440 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efe5000c4e0 tx=0x7efe5000c7f0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.985+0000 7f2ab17fa700 1 -- 172.21.15.22:0/30471600 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2aa80092b0 con 0x7f2ab40adce0 2023-07-11T00:30:38.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.985+0000 7efe67dff700 1 -- 172.21.15.22:0/2011099767 shutdown_connections 2023-07-11T00:30:38.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.985+0000 7efe67dff700 1 --2- 172.21.15.22:0/2011099767 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efe4406adb0 0x7efe4406d260 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.985+0000 7efe67dff700 1 --2- 172.21.15.22:0/2011099767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe600ad710 0x7efe601587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.985+0000 7efe67dff700 1 --2- 172.21.15.22:0/2011099767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe6015ca40 0x7efe601514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.985+0000 7efe67dff700 1 --2- 172.21.15.22:0/2011099767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe601583d0 0x7efe60150440 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.985+0000 7efe67dff700 1 -- 172.21.15.22:0/2011099767 >> 172.21.15.22:0/2011099767 conn(0x7efe600b0390 msgr2=0x7efe600afae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.992 INFO:teuthology.orchestra.run.smithi022.stdout:55834574856 2023-07-11T00:30:38.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.986+0000 7efe67dff700 1 -- 172.21.15.22:0/2011099767 shutdown_connections 2023-07-11T00:30:38.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.986+0000 7efe67dff700 1 -- 172.21.15.22:0/2011099767 wait complete. 2023-07-11T00:30:38.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.988+0000 7f2abb1ff700 1 -- 172.21.15.22:0/30471600 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2aa006adb0 msgr2=0x7f2aa006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.988+0000 7f2abb1ff700 1 --2- 172.21.15.22:0/30471600 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2aa006adb0 0x7f2aa006d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2aac007110 tx=0x7f2aac0019c0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.988+0000 7f2abb1ff700 1 -- 172.21.15.22:0/30471600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab40adce0 msgr2=0x7f2ab415dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:38.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.988+0000 7f2abb1ff700 1 --2- 172.21.15.22:0/30471600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab40adce0 0x7f2ab415dc50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800b4a0 tx=0x7f2aa800b860 comp rx=0 tx=0).stop 2023-07-11T00:30:38.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.989+0000 7f2abb1ff700 1 -- 172.21.15.22:0/30471600 shutdown_connections 2023-07-11T00:30:38.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.989+0000 7f2abb1ff700 1 --2- 172.21.15.22:0/30471600 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2aa006adb0 0x7f2aa006d260 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.989+0000 7f2abb1ff700 1 --2- 172.21.15.22:0/30471600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab4160930 0x7f2ab40b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.989+0000 7f2abb1ff700 1 --2- 172.21.15.22:0/30471600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4070a80 0x7f2ab40b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.989+0000 7f2abb1ff700 1 --2- 172.21.15.22:0/30471600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab40adce0 0x7f2ab415dc50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:38.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.989+0000 7f2abb1ff700 1 -- 172.21.15.22:0/30471600 >> 172.21.15.22:0/30471600 conn(0x7f2ab40b0390 msgr2=0x7f2ab406cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:38.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.990+0000 7f2abb1ff700 1 -- 172.21.15.22:0/30471600 shutdown_connections 2023-07-11T00:30:38.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.990+0000 7f2abb1ff700 1 -- 172.21.15.22:0/30471600 wait complete. 2023-07-11T00:30:38.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.3 2023-07-11T00:30:39.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:38.999+0000 7fd4c43ff700 1 -- 172.21.15.22:0/2260894857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd4bc0c20d0 con 0x7fd4bc071160 2023-07-11T00:30:39.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.000+0000 7fd4baffd700 1 -- 172.21.15.22:0/2260894857 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd4b0017070 con 0x7fd4bc071160 2023-07-11T00:30:39.003 INFO:teuthology.orchestra.run.smithi022.stdout:55834574857 2023-07-11T00:30:39.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.003+0000 7fd4c43ff700 1 -- 172.21.15.22:0/2260894857 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd4a806adb0 msgr2=0x7fd4a806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:39.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.003+0000 7fd4c43ff700 1 --2- 172.21.15.22:0/2260894857 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd4a806adb0 0x7fd4a806d260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc15a1c0 tx=0x7fd4ac0094f0 comp rx=0 tx=0).stop 2023-07-11T00:30:39.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.003+0000 7fd4c43ff700 1 -- 172.21.15.22:0/2260894857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4bc071160 msgr2=0x7fd4bc0b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:39.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.003+0000 7fd4c43ff700 1 --2- 172.21.15.22:0/2260894857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4bc071160 0x7fd4bc0b1bc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000c4a0 tx=0x7fd4b000c860 comp rx=0 tx=0).stop 2023-07-11T00:30:39.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.003+0000 7fd4c43ff700 1 -- 172.21.15.22:0/2260894857 shutdown_connections 2023-07-11T00:30:39.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.003+0000 7fd4c43ff700 1 --2- 172.21.15.22:0/2260894857 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd4a806adb0 0x7fd4a806d260 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.003+0000 7fd4c43ff700 1 --2- 172.21.15.22:0/2260894857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4bc070340 0x7fd4bc1f1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.003+0000 7fd4c43ff700 1 --2- 172.21.15.22:0/2260894857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4bc157f10 0x7fd4bc0b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.003+0000 7fd4c43ff700 1 --2- 172.21.15.22:0/2260894857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4bc071160 0x7fd4bc0b1bc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.003+0000 7fd4c43ff700 1 -- 172.21.15.22:0/2260894857 >> 172.21.15.22:0/2260894857 conn(0x7fd4bc0b0390 msgr2=0x7fd4bc06ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.004+0000 7fd4c43ff700 1 -- 172.21.15.22:0/2260894857 shutdown_connections 2023-07-11T00:30:39.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.004+0000 7fd4c43ff700 1 -- 172.21.15.22:0/2260894857 wait complete. 2023-07-11T00:30:39.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.006+0000 7f24cebff700 1 -- 172.21.15.22:0/1392192307 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f24c81eaf20 con 0x7f24c80cc390 2023-07-11T00:30:39.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.006+0000 7f24c57fa700 1 -- 172.21.15.22:0/1392192307 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f24c81eaf20 con 0x7f24c80cc390 2023-07-11T00:30:39.010 INFO:teuthology.orchestra.run.smithi022.stdout:55834574857 2023-07-11T00:30:39.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.009+0000 7f24cebff700 1 -- 172.21.15.22:0/1392192307 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f24b406adb0 msgr2=0x7f24b406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:39.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.009+0000 7f24cebff700 1 --2- 172.21.15.22:0/1392192307 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f24b406adb0 0x7f24b406d260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f24c806b000 tx=0x7f24bc010000 comp rx=0 tx=0).stop 2023-07-11T00:30:39.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.009+0000 7f24cebff700 1 -- 172.21.15.22:0/1392192307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24c80cc390 msgr2=0x7f24c80c2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:39.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.009+0000 7f24cebff700 1 --2- 172.21.15.22:0/1392192307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24c80cc390 0x7f24c80c2ce0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f24b800c4c0 tx=0x7f24b800c7d0 comp rx=0 tx=0).stop 2023-07-11T00:30:39.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.009+0000 7f24cebff700 1 -- 172.21.15.22:0/1392192307 shutdown_connections 2023-07-11T00:30:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.009+0000 7f24cebff700 1 --2- 172.21.15.22:0/1392192307 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f24b406adb0 0x7f24b406d260 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.009+0000 7f24cebff700 1 --2- 172.21.15.22:0/1392192307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24c80af580 0x7f24c8206ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.009+0000 7f24cebff700 1 --2- 172.21.15.22:0/1392192307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24c80adeb0 0x7f24c80c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.009+0000 7f24cebff700 1 --2- 172.21.15.22:0/1392192307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24c80cc390 0x7f24c80c2ce0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.009+0000 7f24cebff700 1 -- 172.21.15.22:0/1392192307 >> 172.21.15.22:0/1392192307 conn(0x7f24c80b0390 msgr2=0x7f24c80cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.010+0000 7f24cebff700 1 -- 172.21.15.22:0/1392192307 shutdown_connections 2023-07-11T00:30:39.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:39.010+0000 7f24cebff700 1 -- 172.21.15.22:0/1392192307 wait complete. 2023-07-11T00:30:39.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.7 2023-07-11T00:30:39.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.2 2023-07-11T00:30:39.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.4 2023-07-11T00:30:39.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.6 2023-07-11T00:30:39.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.5 2023-07-11T00:30:39.980 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-11T00:30:39.989 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-11T00:30:39.998 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-11T00:30:40.018 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-11T00:30:40.019 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-11T00:30:40.020 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-11T00:30:40.030 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-11T00:30:40.039 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-11T00:30:40.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.312+0000 7fab7dfff700 1 Processor -- start 2023-07-11T00:30:40.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.313+0000 7fab7dfff700 1 -- start start 2023-07-11T00:30:40.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.315+0000 7fab7dfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab780cb8c0 0x7fab780ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.315+0000 7fab7dfff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab780c1d30 con 0x7fab78160ab0 2023-07-11T00:30:40.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.315+0000 7fab7dfff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab780cc840 con 0x7fab781606e0 2023-07-11T00:30:40.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.315+0000 7fab7dfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab780ce670 con 0x7fab780cb8c0 2023-07-11T00:30:40.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.316+0000 7fab77fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab780cb8c0 0x7fab780ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.316+0000 7fab77fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab780cb8c0 0x7fab780ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:59238/0 (socket says 172.21.15.22:59238) 2023-07-11T00:30:40.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.316+0000 7fab77fff700 1 -- 172.21.15.22:0/26181181 learned_addr learned my addr 172.21.15.22:0/26181181 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:40.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.317+0000 7fab77fff700 1 -- 172.21.15.22:0/26181181 >> v1:172.21.15.184:6789/0 conn(0x7fab781606e0 legacy=0x7fab7806c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.317+0000 7fab77fff700 1 -- 172.21.15.22:0/26181181 >> v1:172.21.15.22:6789/0 conn(0x7fab78160ab0 legacy=0x7fab780cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:40.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.317+0000 7fab77fff700 1 -- 172.21.15.22:0/26181181 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab780adc60 con 0x7fab780cb8c0 2023-07-11T00:30:40.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.318+0000 7fab77fff700 1 --2- 172.21.15.22:0/26181181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab780cb8c0 0x7fab780ce130 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0098a0 tx=0x7fab6c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7db9c952e9bb7433 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.318+0000 7fab767fc700 1 -- 172.21.15.22:0/26181181 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c004230 con 0x7fab780cb8c0 2023-07-11T00:30:40.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.318+0000 7fab767fc700 1 -- 172.21.15.22:0/26181181 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6c004390 con 0x7fab780cb8c0 2023-07-11T00:30:40.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.318+0000 7fab767fc700 1 -- 172.21.15.22:0/26181181 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c0036a0 con 0x7fab780cb8c0 2023-07-11T00:30:40.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.320+0000 7fab7dfff700 1 -- 172.21.15.22:0/26181181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab780cb8c0 msgr2=0x7fab780ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.320+0000 7fab7dfff700 1 --2- 172.21.15.22:0/26181181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab780cb8c0 0x7fab780ce130 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0098a0 tx=0x7fab6c009bb0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.320+0000 7fab7dfff700 1 -- 172.21.15.22:0/26181181 shutdown_connections 2023-07-11T00:30:40.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.320+0000 7fab7dfff700 1 --2- 172.21.15.22:0/26181181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab780cb8c0 0x7fab780ce130 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.320+0000 7fab7dfff700 1 -- 172.21.15.22:0/26181181 >> 172.21.15.22:0/26181181 conn(0x7fab7806abc0 msgr2=0x7fab780b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:40.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.320+0000 7fab7dfff700 1 -- 172.21.15.22:0/26181181 shutdown_connections 2023-07-11T00:30:40.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.320+0000 7fab7dfff700 1 -- 172.21.15.22:0/26181181 wait complete. 2023-07-11T00:30:40.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.323+0000 7fab7dfff700 1 Processor -- start 2023-07-11T00:30:40.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.323+0000 7fab7dfff700 1 -- start start 2023-07-11T00:30:40.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.325+0000 7fab7dfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab780cb8c0 0x7fab7806c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.325+0000 7fab7dfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab781606e0 0x7fab780c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.325+0000 7fab7dfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab78160ab0 0x7fab780c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.325+0000 7fab7dfff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7806c8b0 con 0x7fab781606e0 2023-07-11T00:30:40.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.325+0000 7fab7dfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab780c5010 con 0x7fab780cb8c0 2023-07-11T00:30:40.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.325+0000 7fab7dfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7806cae0 con 0x7fab78160ab0 2023-07-11T00:30:40.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.326+0000 7fab777fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab780cb8c0 0x7fab7806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.326+0000 7fab777fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab780cb8c0 0x7fab7806c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:58854/0 (socket says 172.21.15.22:58854) 2023-07-11T00:30:40.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.326+0000 7fab777fe700 1 -- 172.21.15.22:0/2563538934 learned_addr learned my addr 172.21.15.22:0/2563538934 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:40.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.326+0000 7fab77fff700 1 --2- 172.21.15.22:0/2563538934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab78160ab0 0x7fab780c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.326+0000 7fab76ffd700 1 --2- 172.21.15.22:0/2563538934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab781606e0 0x7fab780c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.327+0000 7fab77fff700 1 -- 172.21.15.22:0/2563538934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab780cb8c0 msgr2=0x7fab7806c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.327+0000 7fab77fff700 1 --2- 172.21.15.22:0/2563538934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab780cb8c0 0x7fab7806c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.327+0000 7fab77fff700 1 -- 172.21.15.22:0/2563538934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab781606e0 msgr2=0x7fab780c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.327+0000 7fab77fff700 1 --2- 172.21.15.22:0/2563538934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab781606e0 0x7fab780c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.327+0000 7fab77fff700 1 -- 172.21.15.22:0/2563538934 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c009550 con 0x7fab78160ab0 2023-07-11T00:30:40.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.328+0000 7fab77fff700 1 --2- 172.21.15.22:0/2563538934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab78160ab0 0x7fab780c4ad0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fab78164300 tx=0x7fab6c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.329+0000 7fab5ffff700 1 -- 172.21.15.22:0/2563538934 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c003de0 con 0x7fab78160ab0 2023-07-11T00:30:40.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.329+0000 7fab5ffff700 1 -- 172.21.15.22:0/2563538934 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6c011630 con 0x7fab78160ab0 2023-07-11T00:30:40.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.329+0000 7fab5ffff700 1 -- 172.21.15.22:0/2563538934 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c0119c0 con 0x7fab78160ab0 2023-07-11T00:30:40.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.329+0000 7fab7dfff700 1 -- 172.21.15.22:0/2563538934 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7806cdc0 con 0x7fab78160ab0 2023-07-11T00:30:40.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.329+0000 7fab7dfff700 1 -- 172.21.15.22:0/2563538934 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7806d380 con 0x7fab78160ab0 2023-07-11T00:30:40.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.338+0000 7fab5ffff700 1 -- 172.21.15.22:0/2563538934 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab6c022070 con 0x7fab78160ab0 2023-07-11T00:30:40.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.339+0000 7fab5ffff700 1 --2- 172.21.15.22:0/2563538934 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fab6006af10 0x7fab6006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.339+0000 7fab5ffff700 1 -- 172.21.15.22:0/2563538934 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fab6c08af40 con 0x7fab78160ab0 2023-07-11T00:30:40.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.341+0000 7fab7dfff700 1 -- 172.21.15.22:0/2563538934 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab580052f0 con 0x7fab78160ab0 2023-07-11T00:30:40.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.341+0000 7fab777fe700 1 --2- 172.21.15.22:0/2563538934 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fab6006af10 0x7fab6006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.343+0000 7fab777fe700 1 --2- 172.21.15.22:0/2563538934 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fab6006af10 0x7fab6006d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fab68001b20 tx=0x7fab68009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.349+0000 7fab5ffff700 1 -- 172.21.15.22:0/2563538934 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fab6c055e90 con 0x7fab78160ab0 2023-07-11T00:30:40.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.371+0000 7f3122dff700 1 Processor -- start 2023-07-11T00:30:40.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.371+0000 7f3122dff700 1 -- start start 2023-07-11T00:30:40.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.375+0000 7f3122dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f311c16c7e0 0x7f311c0cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.375+0000 7f3122dff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f311c089570 0x7f311c0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.375+0000 7f3122dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311c0ce620 con 0x7f311c0cb190 2023-07-11T00:30:40.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.375+0000 7f3122dff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311c089e70 con 0x7f311c089570 2023-07-11T00:30:40.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.375+0000 7f3122dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311c0caac0 con 0x7f311c16c7e0 2023-07-11T00:30:40.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.376+0000 7f3120b9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f311c16c7e0 0x7f311c0cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.376+0000 7f3120b9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f311c16c7e0 0x7f311c0cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:59264/0 (socket says 172.21.15.22:59264) 2023-07-11T00:30:40.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.376+0000 7f3120b9b700 1 -- 172.21.15.22:0/781882564 learned_addr learned my addr 172.21.15.22:0/781882564 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:40.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.376+0000 7f3120b9b700 1 -- 172.21.15.22:0/781882564 >> v2:172.21.15.22:3300/0 conn(0x7f311c089570 msgr2=0x7f311c0ce0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-11T00:30:40.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.376+0000 7f3120b9b700 1 --2- 172.21.15.22:0/781882564 >> v2:172.21.15.22:3300/0 conn(0x7f311c089570 0x7f311c0ce0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.376+0000 7f3120b9b700 1 -- 172.21.15.22:0/781882564 >> v1:172.21.15.184:6789/0 conn(0x7f311c0cb190 legacy=0x7f311c06c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.376+0000 7f3120b9b700 1 -- 172.21.15.22:0/781882564 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c0cc970 con 0x7f311c16c7e0 2023-07-11T00:30:40.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.377+0000 7f3120b9b700 1 --2- 172.21.15.22:0/781882564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f311c16c7e0 0x7f311c0cda10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f31100098f0 tx=0x7f3110009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5237ec59e21dbaf3 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.378+0000 7f311b7fe700 1 -- 172.21.15.22:0/781882564 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311000b8a0 con 0x7f311c16c7e0 2023-07-11T00:30:40.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.378+0000 7f311b7fe700 1 -- 172.21.15.22:0/781882564 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311000ba00 con 0x7f311c16c7e0 2023-07-11T00:30:40.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.378+0000 7f311b7fe700 1 -- 172.21.15.22:0/781882564 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311000bd90 con 0x7f311c16c7e0 2023-07-11T00:30:40.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.379+0000 7f3122dff700 1 -- 172.21.15.22:0/781882564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f311c16c7e0 msgr2=0x7f311c0cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.379+0000 7f3122dff700 1 --2- 172.21.15.22:0/781882564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f311c16c7e0 0x7f311c0cda10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f31100098f0 tx=0x7f3110009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:40.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.379+0000 7f38b2bff700 1 Processor -- start 2023-07-11T00:30:40.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.380+0000 7f38b2bff700 1 -- start start 2023-07-11T00:30:40.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.380+0000 7f3122dff700 1 -- 172.21.15.22:0/781882564 shutdown_connections 2023-07-11T00:30:40.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.380+0000 7f3122dff700 1 --2- 172.21.15.22:0/781882564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f311c16c7e0 0x7f311c0cda10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.380+0000 7f3122dff700 1 --2- 172.21.15.22:0/781882564 >> v2:172.21.15.22:3300/0 conn(0x7f311c089570 0x7f311c0ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.380+0000 7f3122dff700 1 -- 172.21.15.22:0/781882564 >> 172.21.15.22:0/781882564 conn(0x7f311c06abc0 msgr2=0x7f311c0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:40.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.382+0000 7f38b2bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f38ac0ad7c0 0x7f38ac160a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.382+0000 7f38b2bff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ac0ccb20 con 0x7f38ac0c9820 2023-07-11T00:30:40.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.383+0000 7f38b119c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f38ac0cb190 0x7f38ac0cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:54762/0 (socket says 172.21.15.22:54762) 2023-07-11T00:30:40.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.383+0000 7f38b119c700 1 -- 172.21.15.22:0/3711376260 learned_addr learned my addr 172.21.15.22:0/3711376260 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:40.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.383+0000 7f38b2bff700 1 -- 172.21.15.22:0/3711376260 --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ac0cc550 con 0x7f38ac0cb190 2023-07-11T00:30:40.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.383+0000 7f38b2bff700 1 -- 172.21.15.22:0/3711376260 --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38ac0ccd70 con 0x7f38ac0ad7c0 2023-07-11T00:30:40.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.383+0000 7f38b099b700 1 --2- 172.21.15.22:0/3711376260 >> v2:172.21.15.184:3300/0 conn(0x7f38ac0ad7c0 0x7f38ac160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.383+0000 7f38ab7fe700 1 -- 172.21.15.22:0/3711376260 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100148838 0 0) 0x7f38ac0cc550 con 0x7f38ac0cb190 2023-07-11T00:30:40.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.384+0000 7f38ab7fe700 1 -- 172.21.15.22:0/3711376260 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38940035b0 con 0x7f38ac0cb190 2023-07-11T00:30:40.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.384+0000 7f38ab7fe700 1 -- 172.21.15.22:0/3711376260 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1625164251 0 0) 0x7f38940035b0 con 0x7f38ac0cb190 2023-07-11T00:30:40.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.384+0000 7f38ab7fe700 1 -- 172.21.15.22:0/3711376260 >> v2:172.21.15.184:3300/0 conn(0x7f38ac0ad7c0 msgr2=0x7f38ac160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:40.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.384+0000 7f38ab7fe700 1 --2- 172.21.15.22:0/3711376260 >> v2:172.21.15.184:3300/0 conn(0x7f38ac0ad7c0 0x7f38ac160a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.384+0000 7f38ab7fe700 1 -- 172.21.15.22:0/3711376260 >> v1:172.21.15.22:6789/0 conn(0x7f38ac0c9820 legacy=0x7f38ac0ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.384+0000 7f38ab7fe700 1 -- 172.21.15.22:0/3711376260 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac0cd050 con 0x7f38ac0cb190 2023-07-11T00:30:40.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.384+0000 7f38ab7fe700 1 -- 172.21.15.22:0/3711376260 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7f38a40019f0 con 0x7f38ac0cb190 2023-07-11T00:30:40.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.384+0000 7f38ab7fe700 1 -- 172.21.15.22:0/3711376260 >> v1:172.21.15.184:6789/0 conn(0x7f38ac0cb190 legacy=0x7f38ac0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.384+0000 7f38ab7fe700 1 --2- 172.21.15.22:0/3711376260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3894003a00 0x7f3894003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.384+0000 7f38ab7fe700 1 --2- 172.21.15.22:0/3711376260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3894004850 0x7f3894004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.384+0000 7f38ab7fe700 1 --2- 172.21.15.22:0/3711376260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3894005200 0x7f3894014220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.384+0000 7f38ab7fe700 1 -- 172.21.15.22:0/3711376260 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac0ccd70 con 0x7f3894004850 2023-07-11T00:30:40.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.384+0000 7f38ab7fe700 1 -- 172.21.15.22:0/3711376260 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3894014890 con 0x7f3894005200 2023-07-11T00:30:40.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.384+0000 7f38ab7fe700 1 -- 172.21.15.22:0/3711376260 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3894014a50 con 0x7f3894003a00 2023-07-11T00:30:40.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.385+0000 7f38abfff700 1 --2- 172.21.15.22:0/3711376260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3894004850 0x7f3894004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.386+0000 7f38abfff700 1 -- 172.21.15.22:0/3711376260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3894003a00 msgr2=0x7f3894003e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-11T00:30:40.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.386+0000 7f38abfff700 1 --2- 172.21.15.22:0/3711376260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3894003a00 0x7f3894003e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.386+0000 7f38abfff700 1 -- 172.21.15.22:0/3711376260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3894005200 msgr2=0x7f3894014220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-11T00:30:40.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.386+0000 7f38abfff700 1 --2- 172.21.15.22:0/3711376260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3894005200 0x7f3894014220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.386+0000 7f38abfff700 1 -- 172.21.15.22:0/3711376260 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac0cd050 con 0x7f3894004850 2023-07-11T00:30:40.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.386+0000 7f38abfff700 1 --2- 172.21.15.22:0/3711376260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3894004850 0x7f3894004cc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f389c0017c0 tx=0x7f3894005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f38fe8170b69a15 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.387+0000 7f38ab7fe700 1 -- 172.21.15.22:0/3711376260 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c0052d0 con 0x7f3894004850 2023-07-11T00:30:40.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.387+0000 7f38ab7fe700 1 -- 172.21.15.22:0/3711376260 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c005430 con 0x7f3894004850 2023-07-11T00:30:40.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.387+0000 7f38ab7fe700 1 -- 172.21.15.22:0/3711376260 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c0038c0 con 0x7f3894004850 2023-07-11T00:30:40.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.387+0000 7f38b119c700 1 -- 172.21.15.22:0/3711376260 reap_dead start 2023-07-11T00:30:40.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.387+0000 7f3122dff700 1 -- 172.21.15.22:0/781882564 shutdown_connections 2023-07-11T00:30:40.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.388+0000 7f38b2bff700 1 -- 172.21.15.22:0/3711376260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3894004850 msgr2=0x7f3894004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.388+0000 7f38b2bff700 1 --2- 172.21.15.22:0/3711376260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3894004850 0x7f3894004cc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f389c0017c0 tx=0x7f3894005880 comp rx=0 tx=0).stop 2023-07-11T00:30:40.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.388+0000 7f38b2bff700 1 -- 172.21.15.22:0/3711376260 shutdown_connections 2023-07-11T00:30:40.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.388+0000 7f38b2bff700 1 --2- 172.21.15.22:0/3711376260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3894004850 0x7f3894004cc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.388+0000 7f38b2bff700 1 -- 172.21.15.22:0/3711376260 >> 172.21.15.22:0/3711376260 conn(0x7f38ac06abc0 msgr2=0x7f38ac0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.388+0000 7f38b2bff700 1 -- 172.21.15.22:0/3711376260 shutdown_connections 2023-07-11T00:30:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.388+0000 7f38b2bff700 1 -- 172.21.15.22:0/3711376260 wait complete. 2023-07-11T00:30:40.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.391+0000 7f38b2bff700 1 Processor -- start 2023-07-11T00:30:40.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.392+0000 7f38b2bff700 1 -- start start 2023-07-11T00:30:40.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.393+0000 7f38b2bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3894004850 0x7f38ac0b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.393+0000 7f38b2bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38ac156e80 0x7f38ac0b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.393+0000 7f38b2bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38ac157c60 0x7f38ac1580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.393+0000 7f38b2bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac15d550 con 0x7f3894004850 2023-07-11T00:30:40.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.393+0000 7f38b2bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac0b3c70 con 0x7f38ac156e80 2023-07-11T00:30:40.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.393+0000 7f38b2bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac0b3ec0 con 0x7f38ac157c60 2023-07-11T00:30:40.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.395+0000 7f38b099b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3894004850 0x7f38ac0b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.395+0000 7f38b099b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3894004850 0x7f38ac0b3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46368/0 (socket says 172.21.15.22:46368) 2023-07-11T00:30:40.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.395+0000 7f38b099b700 1 -- 172.21.15.22:0/3510303100 learned_addr learned my addr 172.21.15.22:0/3510303100 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:40.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.396+0000 7f38b099b700 1 -- 172.21.15.22:0/3510303100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38ac157c60 msgr2=0x7f38ac1580d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-11T00:30:40.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.396+0000 7f38b099b700 1 --2- 172.21.15.22:0/3510303100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38ac157c60 0x7f38ac1580d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.396+0000 7f38b099b700 1 -- 172.21.15.22:0/3510303100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38ac156e80 msgr2=0x7f38ac0b1cc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-11T00:30:40.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.396+0000 7f38b099b700 1 --2- 172.21.15.22:0/3510303100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38ac156e80 0x7f38ac0b1cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.396+0000 7f38b099b700 1 -- 172.21.15.22:0/3510303100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac0b41a0 con 0x7f3894004850 2023-07-11T00:30:40.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.391+0000 7f3122dff700 1 -- 172.21.15.22:0/781882564 wait complete. 2023-07-11T00:30:40.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.393+0000 7f3122dff700 1 Processor -- start 2023-07-11T00:30:40.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.394+0000 7f3122dff700 1 -- start start 2023-07-11T00:30:40.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.395+0000 7f3122dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f311c089570 0x7f311c1622d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.395+0000 7f3122dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f311c0cb190 0x7f311c06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.395+0000 7f3122dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f311c16c7e0 0x7f311c06de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.395+0000 7f3122dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c163320 con 0x7f311c089570 2023-07-11T00:30:40.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.395+0000 7f3122dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c162d60 con 0x7f311c16c7e0 2023-07-11T00:30:40.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.395+0000 7f3122dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311c163040 con 0x7f311c0cb190 2023-07-11T00:30:40.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.396+0000 7f312139c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f311c16c7e0 0x7f311c06de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.396+0000 7f312139c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f311c16c7e0 0x7f311c06de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:58888/0 (socket says 172.21.15.22:58888) 2023-07-11T00:30:40.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.396+0000 7f312139c700 1 -- 172.21.15.22:0/4153863382 learned_addr learned my addr 172.21.15.22:0/4153863382 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:40.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.396+0000 7f311bfff700 1 --2- 172.21.15.22:0/4153863382 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f311c0cb190 0x7f311c06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.397+0000 7f312139c700 1 -- 172.21.15.22:0/4153863382 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f311c0cb190 msgr2=0x7f311c06d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.397+0000 7f312139c700 1 --2- 172.21.15.22:0/4153863382 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f311c0cb190 0x7f311c06d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.397+0000 7f312139c700 1 -- 172.21.15.22:0/4153863382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f311c089570 msgr2=0x7f311c1622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.397+0000 7f312139c700 1 --2- 172.21.15.22:0/4153863382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f311c089570 0x7f311c1622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.397+0000 7f312139c700 1 -- 172.21.15.22:0/4153863382 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3110009550 con 0x7f311c16c7e0 2023-07-11T00:30:40.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.397+0000 7f311bfff700 1 --2- 172.21.15.22:0/4153863382 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f311c0cb190 0x7f311c06d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:30:40.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.397+0000 7f38b099b700 1 --2- 172.21.15.22:0/3510303100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3894004850 0x7f38ac0b3730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f38a000e950 tx=0x7f38a000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.397+0000 7f312139c700 1 --2- 172.21.15.22:0/4153863382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f311c16c7e0 0x7f311c06de10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f310c00c420 tx=0x7f310c00c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.398+0000 7f38a97fa700 1 -- 172.21.15.22:0/3510303100 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0009730 con 0x7f3894004850 2023-07-11T00:30:40.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.398+0000 7f38a97fa700 1 -- 172.21.15.22:0/3510303100 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a000c7f0 con 0x7f3894004850 2023-07-11T00:30:40.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.398+0000 7f38a97fa700 1 -- 172.21.15.22:0/3510303100 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a000cb80 con 0x7f3894004850 2023-07-11T00:30:40.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.397+0000 7f31197fa700 1 -- 172.21.15.22:0/4153863382 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c0052d0 con 0x7f311c16c7e0 2023-07-11T00:30:40.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.397+0000 7f31197fa700 1 -- 172.21.15.22:0/4153863382 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c005430 con 0x7f311c16c7e0 2023-07-11T00:30:40.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.397+0000 7f31197fa700 1 -- 172.21.15.22:0/4153863382 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c006aa0 con 0x7f311c16c7e0 2023-07-11T00:30:40.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.398+0000 7f3122dff700 1 -- 172.21.15.22:0/4153863382 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311c0c5a30 con 0x7f311c16c7e0 2023-07-11T00:30:40.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.398+0000 7f3122dff700 1 -- 172.21.15.22:0/4153863382 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311c06d2d0 con 0x7f311c16c7e0 2023-07-11T00:30:40.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.400+0000 7ff933fff700 1 Processor -- start 2023-07-11T00:30:40.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.399+0000 7f38b2bff700 1 -- 172.21.15.22:0/3510303100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38ac0b4480 con 0x7f3894004850 2023-07-11T00:30:40.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.399+0000 7f38b2bff700 1 -- 172.21.15.22:0/3510303100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ac157690 con 0x7f3894004850 2023-07-11T00:30:40.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.401+0000 7f38b2bff700 1 -- 172.21.15.22:0/3510303100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38ac04ea60 con 0x7f3894004850 2023-07-11T00:30:40.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.403+0000 7f31197fa700 1 -- 172.21.15.22:0/4153863382 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f310c003680 con 0x7f311c16c7e0 2023-07-11T00:30:40.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.405+0000 7f31197fa700 1 --2- 172.21.15.22:0/4153863382 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f310006adb0 0x7f310006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.405+0000 7f31197fa700 1 -- 172.21.15.22:0/4153863382 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f310c0887c0 con 0x7f311c16c7e0 2023-07-11T00:30:40.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.400+0000 7ff933fff700 1 -- start start 2023-07-11T00:30:40.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.402+0000 7ff933fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff92c070a80 0x7ff92c0ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.403+0000 7ff933fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff92c0adce0 0x7ff92c06c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.403+0000 7ff933fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92c0ccb70 con 0x7ff92c160930 2023-07-11T00:30:40.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.403+0000 7ff933fff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff92c0ae160 con 0x7ff92c0adce0 2023-07-11T00:30:40.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.403+0000 7ff933fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff92c165400 con 0x7ff92c070a80 2023-07-11T00:30:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.404+0000 7ff93159a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff92c070a80 0x7ff92c0ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.405+0000 7ff93159a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff92c070a80 0x7ff92c0ad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:58900/0 (socket says 172.21.15.22:58900) 2023-07-11T00:30:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.405+0000 7ff93159a700 1 -- 172.21.15.22:0/1210235301 learned_addr learned my addr 172.21.15.22:0/1210235301 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.405+0000 7f5d905ff700 1 Processor -- start 2023-07-11T00:30:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.405+0000 7f5d905ff700 1 -- start start 2023-07-11T00:30:40.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.406+0000 7f3120b9b700 1 --2- 172.21.15.22:0/4153863382 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f310006adb0 0x7f310006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.406+0000 7f3122dff700 1 -- 172.21.15.22:0/4153863382 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f80052f0 con 0x7f311c16c7e0 2023-07-11T00:30:40.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.406+0000 7ff93159a700 1 -- 172.21.15.22:0/1210235301 >> v2:172.21.15.22:3300/0 conn(0x7ff92c0adce0 msgr2=0x7ff92c06c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:40.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.406+0000 7ff93159a700 1 --2- 172.21.15.22:0/1210235301 >> v2:172.21.15.22:3300/0 conn(0x7ff92c0adce0 0x7ff92c06c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.406+0000 7ff93159a700 1 -- 172.21.15.22:0/1210235301 >> v1:172.21.15.184:6789/0 conn(0x7ff92c160930 legacy=0x7ff92c0cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.406+0000 7ff93159a700 1 -- 172.21.15.22:0/1210235301 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c164640 con 0x7ff92c070a80 2023-07-11T00:30:40.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.407+0000 7ff93159a700 1 --2- 172.21.15.22:0/1210235301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff92c070a80 0x7ff92c0ad7a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff92c06fd50 tx=0x7ff91c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa62b5aec3838be7 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.408+0000 7f5d905ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5d880ad7c0 0x7f5d88160a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.408+0000 7f5d905ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d880c9820 0x7f5d880ab960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.408+0000 7f5d905ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d880ccb20 con 0x7f5d880abea0 2023-07-11T00:30:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.408+0000 7f5d905ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d880cc550 con 0x7f5d880ad7c0 2023-07-11T00:30:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.408+0000 7f5d905ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d880ccd70 con 0x7f5d880c9820 2023-07-11T00:30:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.408+0000 7f5d8db9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d880c9820 0x7f5d880ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.408+0000 7f5d8db9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d880c9820 0x7f5d880ab960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:59310/0 (socket says 172.21.15.22:59310) 2023-07-11T00:30:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.408+0000 7f5d8db9a700 1 -- 172.21.15.22:0/2766958741 learned_addr learned my addr 172.21.15.22:0/2766958741 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.408+0000 7f3120b9b700 1 --2- 172.21.15.22:0/4153863382 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f310006adb0 0x7f310006d260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3110014040 tx=0x7f3110010000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.409+0000 7f5d8db9a700 1 -- 172.21.15.22:0/2766958741 >> v2:172.21.15.22:3300/0 conn(0x7f5d880ad7c0 msgr2=0x7f5d88160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:40.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.409+0000 7f5d8db9a700 1 --2- 172.21.15.22:0/2766958741 >> v2:172.21.15.22:3300/0 conn(0x7f5d880ad7c0 0x7f5d88160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.409+0000 7f5d8db9a700 1 -- 172.21.15.22:0/2766958741 >> v1:172.21.15.184:6789/0 conn(0x7f5d880abea0 legacy=0x7f5d880cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.409+0000 7f5d8db9a700 1 -- 172.21.15.22:0/2766958741 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d880cd050 con 0x7f5d880c9820 2023-07-11T00:30:40.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.410+0000 7f5d8db9a700 1 --2- 172.21.15.22:0/2766958741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d880c9820 0x7f5d880ab960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5d840098f0 tx=0x7f5d84009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49b34f480f681502 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.410+0000 7f5d8d399700 1 -- 172.21.15.22:0/2766958741 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400b8a0 con 0x7f5d880c9820 2023-07-11T00:30:40.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.410+0000 7f5d8d399700 1 -- 172.21.15.22:0/2766958741 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8400ba00 con 0x7f5d880c9820 2023-07-11T00:30:40.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.410+0000 7f5d8d399700 1 -- 172.21.15.22:0/2766958741 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400bd90 con 0x7f5d880c9820 2023-07-11T00:30:40.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.411+0000 7f5d905ff700 1 -- 172.21.15.22:0/2766958741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d880c9820 msgr2=0x7f5d880ab960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.411+0000 7f5d905ff700 1 --2- 172.21.15.22:0/2766958741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d880c9820 0x7f5d880ab960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5d840098f0 tx=0x7f5d84009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.412+0000 7f5d905ff700 1 -- 172.21.15.22:0/2766958741 shutdown_connections 2023-07-11T00:30:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.412+0000 7f5d905ff700 1 --2- 172.21.15.22:0/2766958741 >> v2:172.21.15.22:3300/0 conn(0x7f5d880ad7c0 0x7f5d88160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.412+0000 7f5d905ff700 1 --2- 172.21.15.22:0/2766958741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d880c9820 0x7f5d880ab960 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.412+0000 7f5d905ff700 1 -- 172.21.15.22:0/2766958741 >> 172.21.15.22:0/2766958741 conn(0x7f5d8806abc0 msgr2=0x7f5d880b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:40.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.412+0000 7f38a97fa700 1 -- 172.21.15.22:0/3510303100 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f38a000cce0 con 0x7f3894004850 2023-07-11T00:30:40.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.413+0000 7f31197fa700 1 -- 172.21.15.22:0/4153863382 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f310c0534d0 con 0x7f311c16c7e0 2023-07-11T00:30:40.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.412+0000 7f5d905ff700 1 -- 172.21.15.22:0/2766958741 shutdown_connections 2023-07-11T00:30:40.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.412+0000 7f5d905ff700 1 -- 172.21.15.22:0/2766958741 wait complete. 2023-07-11T00:30:40.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.413+0000 7ff930d99700 1 -- 172.21.15.22:0/1210235301 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c00b870 con 0x7ff92c070a80 2023-07-11T00:30:40.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.413+0000 7ff930d99700 1 -- 172.21.15.22:0/1210235301 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c00b9d0 con 0x7ff92c070a80 2023-07-11T00:30:40.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.413+0000 7ff930d99700 1 -- 172.21.15.22:0/1210235301 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c00bd60 con 0x7ff92c070a80 2023-07-11T00:30:40.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.414+0000 7f38a97fa700 1 --2- 172.21.15.22:0/3510303100 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f389806ad30 0x7f389806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.414+0000 7f38a97fa700 1 -- 172.21.15.22:0/3510303100 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f38a008a100 con 0x7f3894004850 2023-07-11T00:30:40.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.414+0000 7f38a97fa700 1 -- 172.21.15.22:0/3510303100 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f38a008a4a0 con 0x7f3894004850 2023-07-11T00:30:40.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.414+0000 7ff933fff700 1 -- 172.21.15.22:0/1210235301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff92c070a80 msgr2=0x7ff92c0ad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.414+0000 7ff933fff700 1 --2- 172.21.15.22:0/1210235301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff92c070a80 0x7ff92c0ad7a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff92c06fd50 tx=0x7ff91c009bd0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.415+0000 7ff933fff700 1 -- 172.21.15.22:0/1210235301 shutdown_connections 2023-07-11T00:30:40.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.415+0000 7ff933fff700 1 --2- 172.21.15.22:0/1210235301 >> v2:172.21.15.22:3300/0 conn(0x7ff92c0adce0 0x7ff92c06c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.415+0000 7ff933fff700 1 --2- 172.21.15.22:0/1210235301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff92c070a80 0x7ff92c0ad7a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.415+0000 7ff933fff700 1 -- 172.21.15.22:0/1210235301 >> 172.21.15.22:0/1210235301 conn(0x7ff92c0b0390 msgr2=0x7ff92c0b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:40.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.415+0000 7f5d905ff700 1 Processor -- start 2023-07-11T00:30:40.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.415+0000 7f5d905ff700 1 -- start start 2023-07-11T00:30:40.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.417+0000 7f5d905ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d880abea0 0x7f5d880c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.417+0000 7f5d905ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d880ad7c0 0x7f5d880c22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.417+0000 7f5d905ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d880c9820 0x7f5d880c2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.417+0000 7f5d905ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d880c9590 con 0x7f5d880abea0 2023-07-11T00:30:40.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.417+0000 7f5d905ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d880b1690 con 0x7f5d880c9820 2023-07-11T00:30:40.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.417+0000 7f5d905ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8815cae0 con 0x7f5d880ad7c0 2023-07-11T00:30:40.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.417+0000 7fc5ae5ff700 1 Processor -- start 2023-07-11T00:30:40.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.417+0000 7f5d8db9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d880ad7c0 0x7f5d880c22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.417+0000 7f5d8db9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d880ad7c0 0x7f5d880c22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:59316/0 (socket says 172.21.15.22:59316) 2023-07-11T00:30:40.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.417+0000 7f5d8db9a700 1 -- 172.21.15.22:0/4088773098 learned_addr learned my addr 172.21.15.22:0/4088773098 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:40.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.418+0000 7f5d8e39b700 1 --2- 172.21.15.22:0/4088773098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d880abea0 0x7f5d880c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.418+0000 7ff933fff700 1 -- 172.21.15.22:0/1210235301 shutdown_connections 2023-07-11T00:30:40.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.417+0000 7fc5ae5ff700 1 -- start start 2023-07-11T00:30:40.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.420+0000 7fc5ae5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc5a80b0aa0 0x7fc5a80cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.421+0000 7f38abfff700 1 --2- 172.21.15.22:0/3510303100 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f389806ad30 0x7f389806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.418+0000 7ff933fff700 1 -- 172.21.15.22:0/1210235301 wait complete. 2023-07-11T00:30:40.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.421+0000 7ff933fff700 1 Processor -- start 2023-07-11T00:30:40.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.420+0000 7fc5ae5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5a80cb1a0 0x7fc5a80cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.420+0000 7fc5ae5ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a80cce20 con 0x7fc5a8157d60 2023-07-11T00:30:40.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.420+0000 7fc5ae5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a80cd100 con 0x7fc5a80b0aa0 2023-07-11T00:30:40.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.420+0000 7fc5ae5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a80cd3e0 con 0x7fc5a80cb1a0 2023-07-11T00:30:40.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.421+0000 7fc5a7fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc5a80b0aa0 0x7fc5a80cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.421+0000 7fc5a7fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc5a80b0aa0 0x7fc5a80cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:58920/0 (socket says 172.21.15.22:58920) 2023-07-11T00:30:40.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.421+0000 7fc5a7fff700 1 -- 172.21.15.22:0/155849485 learned_addr learned my addr 172.21.15.22:0/155849485 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:40.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.421+0000 7fc5a7fff700 1 -- 172.21.15.22:0/155849485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5a80cb1a0 msgr2=0x7fc5a80cb610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-11T00:30:40.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.421+0000 7fc5a7fff700 1 --2- 172.21.15.22:0/155849485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5a80cb1a0 0x7fc5a80cb610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.421+0000 7fc5a7fff700 1 -- 172.21.15.22:0/155849485 >> v1:172.21.15.22:6789/0 conn(0x7fc5a8157d60 legacy=0x7fc5a81581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:40.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.422+0000 7fc5a7fff700 1 -- 172.21.15.22:0/155849485 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a80cd6c0 con 0x7fc5a80b0aa0 2023-07-11T00:30:40.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.422+0000 7fc5a7fff700 1 --2- 172.21.15.22:0/155849485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5a80b0aa0 0x7fc5a80cdec0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009e50 tx=0x7fc5a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7976b587db36d626 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.422+0000 7f5d8e39b700 1 -- 172.21.15.22:0/4088773098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d880ad7c0 msgr2=0x7f5d880c22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.422+0000 7f5d8e39b700 1 --2- 172.21.15.22:0/4088773098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d880ad7c0 0x7f5d880c22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.422+0000 7f5d8e39b700 1 -- 172.21.15.22:0/4088773098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d880c9820 msgr2=0x7f5d880c2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.422+0000 7f5d8e39b700 1 --2- 172.21.15.22:0/4088773098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d880c9820 0x7f5d880c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.422+0000 7f5d8e39b700 1 -- 172.21.15.22:0/4088773098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d84009550 con 0x7f5d880abea0 2023-07-11T00:30:40.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.421+0000 7ff933fff700 1 -- start start 2023-07-11T00:30:40.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.422+0000 7ff933fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff92c070a80 0x7ff92c163580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.422+0000 7ff933fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff92c0adce0 0x7ff92c0b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.422+0000 7ff933fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff92c160930 0x7ff92c0b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.422+0000 7ff933fff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c0b3360 con 0x7ff92c160930 2023-07-11T00:30:40.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.422+0000 7ff933fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c1627c0 con 0x7ff92c070a80 2023-07-11T00:30:40.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.422+0000 7ff933fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c162aa0 con 0x7ff92c0adce0 2023-07-11T00:30:40.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.423+0000 7ff931d9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff92c070a80 0x7ff92c163580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.423+0000 7ff931d9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff92c070a80 0x7ff92c163580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:58930/0 (socket says 172.21.15.22:58930) 2023-07-11T00:30:40.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.423+0000 7ff931d9b700 1 -- 172.21.15.22:0/22067730 learned_addr learned my addr 172.21.15.22:0/22067730 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:40.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.423+0000 7f5d8e39b700 1 --2- 172.21.15.22:0/4088773098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d880abea0 0x7f5d880c3cf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5d8000bd70 tx=0x7f5d8000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.424+0000 7fc5a6ffd700 1 -- 172.21.15.22:0/155849485 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a000e070 con 0x7fc5a80b0aa0 2023-07-11T00:30:40.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.424+0000 7fc5a6ffd700 1 -- 172.21.15.22:0/155849485 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a0003a20 con 0x7fc5a80b0aa0 2023-07-11T00:30:40.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.424+0000 7fc5a6ffd700 1 -- 172.21.15.22:0/155849485 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0003dd0 con 0x7fc5a80b0aa0 2023-07-11T00:30:40.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.424+0000 7ff93159a700 1 --2- 172.21.15.22:0/22067730 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff92c0adce0 0x7ff92c0b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.424+0000 7ff931d9b700 1 -- 172.21.15.22:0/22067730 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff92c0adce0 msgr2=0x7ff92c0b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.424+0000 7ff931d9b700 1 --2- 172.21.15.22:0/22067730 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff92c0adce0 0x7ff92c0b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.424+0000 7ff931d9b700 1 -- 172.21.15.22:0/22067730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff92c160930 msgr2=0x7ff92c0b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.424+0000 7ff931d9b700 1 --2- 172.21.15.22:0/22067730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff92c160930 0x7ff92c0b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.424+0000 7ff931d9b700 1 -- 172.21.15.22:0/22067730 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c009550 con 0x7ff92c070a80 2023-07-11T00:30:40.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.425+0000 7ff931d9b700 1 --2- 172.21.15.22:0/22067730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff92c070a80 0x7ff92c163580 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff92800c4e0 tx=0x7ff92800c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.424+0000 7f5d7effd700 1 -- 172.21.15.22:0/4088773098 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8000cd50 con 0x7f5d880abea0 2023-07-11T00:30:40.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.425+0000 7f5d7effd700 1 -- 172.21.15.22:0/4088773098 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d80014440 con 0x7f5d880abea0 2023-07-11T00:30:40.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.425+0000 7f5d7effd700 1 -- 172.21.15.22:0/4088773098 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800147f0 con 0x7f5d880abea0 2023-07-11T00:30:40.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.425+0000 7fc5ae5ff700 1 -- 172.21.15.22:0/155849485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5a80b0aa0 msgr2=0x7fc5a80cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.425+0000 7fc5ae5ff700 1 --2- 172.21.15.22:0/155849485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5a80b0aa0 0x7fc5a80cdec0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009e50 tx=0x7fc5a000b330 comp rx=0 tx=0).stop 2023-07-11T00:30:40.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.426+0000 7ff9227fc700 1 -- 172.21.15.22:0/22067730 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9280052d0 con 0x7ff92c070a80 2023-07-11T00:30:40.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.426+0000 7ff9227fc700 1 -- 172.21.15.22:0/22067730 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff928005430 con 0x7ff92c070a80 2023-07-11T00:30:40.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.426+0000 7ff9227fc700 1 -- 172.21.15.22:0/22067730 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9280038c0 con 0x7ff92c070a80 2023-07-11T00:30:40.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.425+0000 7f5d905ff700 1 -- 172.21.15.22:0/4088773098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d880b18e0 con 0x7f5d880abea0 2023-07-11T00:30:40.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.425+0000 7f5d905ff700 1 -- 172.21.15.22:0/4088773098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d880b1ea0 con 0x7f5d880abea0 2023-07-11T00:30:40.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.426+0000 7f5d905ff700 1 -- 172.21.15.22:0/4088773098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d881602c0 con 0x7f5d880abea0 2023-07-11T00:30:40.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.427+0000 7ff933fff700 1 -- 172.21.15.22:0/22067730 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92c162d80 con 0x7ff92c070a80 2023-07-11T00:30:40.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.428+0000 7ff933fff700 1 -- 172.21.15.22:0/22067730 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92c163ac0 con 0x7ff92c070a80 2023-07-11T00:30:40.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.429+0000 7ff933fff700 1 -- 172.21.15.22:0/22067730 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff92c1632a0 con 0x7ff92c070a80 2023-07-11T00:30:40.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.430+0000 7f38abfff700 1 --2- 172.21.15.22:0/3510303100 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f389806ad30 0x7f389806d1e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0acc20 tx=0x7f389c009030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.433+0000 7fc5ae5ff700 1 -- 172.21.15.22:0/155849485 shutdown_connections 2023-07-11T00:30:40.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.433+0000 7fc5ae5ff700 1 --2- 172.21.15.22:0/155849485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5a80b0aa0 0x7fc5a80cdec0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.433+0000 7fc5ae5ff700 1 --2- 172.21.15.22:0/155849485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5a80cb1a0 0x7fc5a80cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.433+0000 7fc5ae5ff700 1 -- 172.21.15.22:0/155849485 >> 172.21.15.22:0/155849485 conn(0x7fc5a806abc0 msgr2=0x7fc5a80b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:40.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.433+0000 7ff9227fc700 1 -- 172.21.15.22:0/22067730 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff928003a20 con 0x7ff92c070a80 2023-07-11T00:30:40.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.435+0000 7ff9227fc700 1 --2- 172.21.15.22:0/22067730 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff91006adb0 0x7ff91006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.435+0000 7ff9227fc700 1 -- 172.21.15.22:0/22067730 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff928088dd0 con 0x7ff92c070a80 2023-07-11T00:30:40.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.436+0000 7ff93159a700 1 --2- 172.21.15.22:0/22067730 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff91006adb0 0x7ff91006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.437+0000 7ff9227fc700 1 -- 172.21.15.22:0/22067730 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff928053c00 con 0x7ff92c070a80 2023-07-11T00:30:40.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.436+0000 7f5d7effd700 1 -- 172.21.15.22:0/4088773098 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5d8001c360 con 0x7f5d880abea0 2023-07-11T00:30:40.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.438+0000 7fc5ae5ff700 1 -- 172.21.15.22:0/155849485 shutdown_connections 2023-07-11T00:30:40.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.439+0000 7f5d7effd700 1 --2- 172.21.15.22:0/4088773098 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5d6c06adb0 0x7f5d6c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.439+0000 7f5d7effd700 1 -- 172.21.15.22:0/4088773098 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5d80006e40 con 0x7f5d880abea0 2023-07-11T00:30:40.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.440+0000 7f5d7effd700 1 -- 172.21.15.22:0/4088773098 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5d800b5380 con 0x7f5d880abea0 2023-07-11T00:30:40.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.440+0000 7f5d8db9a700 1 --2- 172.21.15.22:0/4088773098 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5d6c06adb0 0x7f5d6c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.440+0000 7fc5ae5ff700 1 -- 172.21.15.22:0/155849485 wait complete. 2023-07-11T00:30:40.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.443+0000 7fc5ae5ff700 1 Processor -- start 2023-07-11T00:30:40.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.443+0000 7fc5ae5ff700 1 -- start start 2023-07-11T00:30:40.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.445+0000 7fc5ae5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5a80b0aa0 0x7fc5a814e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.445+0000 7fc5ae5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5a80cb1a0 0x7fc5a815b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.445+0000 7fc5ae5ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5a8157d60 0x7fc5a80c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.445+0000 7fc5ae5ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a814ef50 con 0x7fc5a8157d60 2023-07-11T00:30:40.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.445+0000 7fc5ae5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a814f230 con 0x7fc5a80b0aa0 2023-07-11T00:30:40.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.445+0000 7fc5ae5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a814f510 con 0x7fc5a80cb1a0 2023-07-11T00:30:40.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.446+0000 7fc5a77fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5a80cb1a0 0x7fc5a815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.446+0000 7fc5a77fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5a80cb1a0 0x7fc5a815b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:59344/0 (socket says 172.21.15.22:59344) 2023-07-11T00:30:40.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.446+0000 7fc5a77fe700 1 -- 172.21.15.22:0/3755692262 learned_addr learned my addr 172.21.15.22:0/3755692262 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:40.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.449+0000 7fc5acb9c700 1 --2- 172.21.15.22:0/3755692262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5a8157d60 0x7fc5a80c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.450+0000 7fc5a7fff700 1 --2- 172.21.15.22:0/3755692262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5a80b0aa0 0x7fc5a814e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.451+0000 7ff93159a700 1 --2- 172.21.15.22:0/22067730 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff91006adb0 0x7ff91006d260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff91c014040 tx=0x7ff91c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.451+0000 7f5d8db9a700 1 --2- 172.21.15.22:0/4088773098 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5d6c06adb0 0x7f5d6c06d260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5d880cc160 tx=0x7f5d84008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.450+0000 7fc5acb9c700 1 -- 172.21.15.22:0/3755692262 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5a80cb1a0 msgr2=0x7fc5a815b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.450+0000 7fc5acb9c700 1 --2- 172.21.15.22:0/3755692262 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5a80cb1a0 0x7fc5a815b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.450+0000 7fc5acb9c700 1 -- 172.21.15.22:0/3755692262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5a80b0aa0 msgr2=0x7fc5a814e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.450+0000 7fc5acb9c700 1 --2- 172.21.15.22:0/3755692262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5a80b0aa0 0x7fc5a814e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.450+0000 7fc5acb9c700 1 -- 172.21.15.22:0/3755692262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a0009b30 con 0x7fc5a8157d60 2023-07-11T00:30:40.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.450+0000 7fc5acb9c700 1 --2- 172.21.15.22:0/3755692262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5a8157d60 0x7fc5a80c6030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc59800b410 tx=0x7fc59800b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.454+0000 7fc5a4ff9700 1 -- 172.21.15.22:0/3755692262 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598011830 con 0x7fc5a8157d60 2023-07-11T00:30:40.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.454+0000 7fc5a4ff9700 1 -- 172.21.15.22:0/3755692262 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc598011990 con 0x7fc5a8157d60 2023-07-11T00:30:40.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.454+0000 7fc5a4ff9700 1 -- 172.21.15.22:0/3755692262 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598011d40 con 0x7fc5a8157d60 2023-07-11T00:30:40.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.455+0000 7fc5ae5ff700 1 -- 172.21.15.22:0/3755692262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a814f7f0 con 0x7fc5a8157d60 2023-07-11T00:30:40.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.455+0000 7fc5ae5ff700 1 -- 172.21.15.22:0/3755692262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a81502f0 con 0x7fc5a8157d60 2023-07-11T00:30:40.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.460+0000 7fc5a4ff9700 1 -- 172.21.15.22:0/3755692262 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc59801a400 con 0x7fc5a8157d60 2023-07-11T00:30:40.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.458+0000 7f53ee7ff700 1 Processor -- start 2023-07-11T00:30:40.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.458+0000 7f53ee7ff700 1 -- start start 2023-07-11T00:30:40.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.460+0000 7f53ee7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53e8160ab0 0x7f53e80ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.460+0000 7f53ee7ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f53e80ad710 0x7f53e80cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.460+0000 7f53ee7ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e80c1d30 con 0x7f53e81606e0 2023-07-11T00:30:40.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.460+0000 7f53ee7ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e80ce670 con 0x7f53e80ad710 2023-07-11T00:30:40.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.460+0000 7f53ee7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e80cc840 con 0x7f53e8160ab0 2023-07-11T00:30:40.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.461+0000 7f53e77fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53e8160ab0 0x7f53e80ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.462+0000 7f53e77fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53e8160ab0 0x7f53e80ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:59346/0 (socket says 172.21.15.22:59346) 2023-07-11T00:30:40.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.462+0000 7f53e77fe700 1 -- 172.21.15.22:0/1846278567 learned_addr learned my addr 172.21.15.22:0/1846278567 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:40.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.462+0000 7f53ecd9c700 1 --2- 172.21.15.22:0/1846278567 >> v2:172.21.15.22:3300/0 conn(0x7f53e80ad710 0x7f53e80cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.462+0000 7fc5a4ff9700 1 --2- 172.21.15.22:0/3755692262 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc58c06ad80 0x7fc58c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.462+0000 7fc5a4ff9700 1 -- 172.21.15.22:0/3755692262 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc598089560 con 0x7fc5a8157d60 2023-07-11T00:30:40.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.463+0000 7f53e77fe700 1 -- 172.21.15.22:0/1846278567 >> v2:172.21.15.22:3300/0 conn(0x7f53e80ad710 msgr2=0x7f53e80cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:40.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.463+0000 7f53e77fe700 1 --2- 172.21.15.22:0/1846278567 >> v2:172.21.15.22:3300/0 conn(0x7f53e80ad710 0x7f53e80cb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.463+0000 7f53e77fe700 1 -- 172.21.15.22:0/1846278567 >> v1:172.21.15.22:6789/0 conn(0x7f53e81606e0 legacy=0x7f53e806c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:40.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.463+0000 7f53e77fe700 1 -- 172.21.15.22:0/1846278567 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e80adc60 con 0x7f53e8160ab0 2023-07-11T00:30:40.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.464+0000 7f53e77fe700 1 --2- 172.21.15.22:0/1846278567 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53e8160ab0 0x7f53e80ce130 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f53dc0098f0 tx=0x7f53dc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f4ff618f80e5d2f server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.464+0000 7fc5ae5ff700 1 -- 172.21.15.22:0/3755692262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a80c2380 con 0x7fc5a8157d60 2023-07-11T00:30:40.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.464+0000 7f53e6ffd700 1 -- 172.21.15.22:0/1846278567 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc004230 con 0x7f53e8160ab0 2023-07-11T00:30:40.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.464+0000 7f53e6ffd700 1 -- 172.21.15.22:0/1846278567 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc004390 con 0x7f53e8160ab0 2023-07-11T00:30:40.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.464+0000 7f53e6ffd700 1 -- 172.21.15.22:0/1846278567 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc0036a0 con 0x7f53e8160ab0 2023-07-11T00:30:40.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.465+0000 7f53ee7ff700 1 -- 172.21.15.22:0/1846278567 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53e8160ab0 msgr2=0x7f53e80ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.465+0000 7f53ee7ff700 1 --2- 172.21.15.22:0/1846278567 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53e8160ab0 0x7f53e80ce130 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f53dc0098f0 tx=0x7f53dc009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:40.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.465+0000 7f53ee7ff700 1 -- 172.21.15.22:0/1846278567 shutdown_connections 2023-07-11T00:30:40.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.465+0000 7f53ee7ff700 1 --2- 172.21.15.22:0/1846278567 >> v2:172.21.15.22:3300/0 conn(0x7f53e80ad710 0x7f53e80cb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.465+0000 7f53ee7ff700 1 --2- 172.21.15.22:0/1846278567 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53e8160ab0 0x7f53e80ce130 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f53dc0098f0 tx=0x7f53dc009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:40.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.465+0000 7f53ee7ff700 1 -- 172.21.15.22:0/1846278567 >> 172.21.15.22:0/1846278567 conn(0x7f53e806abc0 msgr2=0x7f53e80b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:40.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.470+0000 7fc5a7fff700 1 --2- 172.21.15.22:0/3755692262 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc58c06ad80 0x7fc58c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.467+0000 7f53ee7ff700 1 -- 172.21.15.22:0/1846278567 shutdown_connections 2023-07-11T00:30:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.467+0000 7f53ee7ff700 1 -- 172.21.15.22:0/1846278567 wait complete. 2023-07-11T00:30:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.470+0000 7f53ee7ff700 1 Processor -- start 2023-07-11T00:30:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.470+0000 7f53ee7ff700 1 -- start start 2023-07-11T00:30:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.471+0000 7f53ee7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53e80ad710 0x7f53e817cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.471+0000 7f53ee7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53e81606e0 0x7f53e80c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.471+0000 7f53ee7ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53e80c1110 0x7f53e80c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.472+0000 7f53ee7ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e80c3500 con 0x7f53e80c1110 2023-07-11T00:30:40.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.472+0000 7f53ee7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e80c5be0 con 0x7f53e81606e0 2023-07-11T00:30:40.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.472+0000 7f53ee7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e80c5ec0 con 0x7f53e80ad710 2023-07-11T00:30:40.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.474+0000 7fc5a4ff9700 1 -- 172.21.15.22:0/3755692262 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc5a80c2380 con 0x7fc5a8157d60 2023-07-11T00:30:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.478+0000 7fc5a7fff700 1 --2- 172.21.15.22:0/3755692262 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc58c06ad80 0x7fc58c06d230 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0000f80 tx=0x7fc5a0009000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.475+0000 7f53ecd9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53e80c1110 0x7f53e80c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.475+0000 7f53ecd9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53e80c1110 0x7f53e80c7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46462/0 (socket says 172.21.15.22:46462) 2023-07-11T00:30:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.475+0000 7f53ecd9c700 1 -- 172.21.15.22:0/4131256074 learned_addr learned my addr 172.21.15.22:0/4131256074 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.475+0000 7f53e7fff700 1 --2- 172.21.15.22:0/4131256074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53e80ad710 0x7f53e817cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.475+0000 7f53e77fe700 1 --2- 172.21.15.22:0/4131256074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53e81606e0 0x7f53e80c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.476+0000 7f53e7fff700 1 -- 172.21.15.22:0/4131256074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53e81606e0 msgr2=0x7f53e80c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.476+0000 7f53e7fff700 1 --2- 172.21.15.22:0/4131256074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53e81606e0 0x7f53e80c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.476+0000 7f53e7fff700 1 -- 172.21.15.22:0/4131256074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53e80c1110 msgr2=0x7f53e80c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.476+0000 7f53e7fff700 1 --2- 172.21.15.22:0/4131256074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53e80c1110 0x7f53e80c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.476+0000 7f53e7fff700 1 -- 172.21.15.22:0/4131256074 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc009550 con 0x7f53e80ad710 2023-07-11T00:30:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.476+0000 7f53e7fff700 1 --2- 172.21.15.22:0/4131256074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53e80ad710 0x7f53e817cbb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f53d800b410 tx=0x7f53d8009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.477+0000 7f53e4ff9700 1 -- 172.21.15.22:0/4131256074 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8011620 con 0x7f53e80ad710 2023-07-11T00:30:40.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.477+0000 7f53e4ff9700 1 -- 172.21.15.22:0/4131256074 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d80117a0 con 0x7f53e80ad710 2023-07-11T00:30:40.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.477+0000 7f53e4ff9700 1 -- 172.21.15.22:0/4131256074 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8011b50 con 0x7f53e80ad710 2023-07-11T00:30:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.480+0000 7f53ee7ff700 1 -- 172.21.15.22:0/4131256074 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e80c61a0 con 0x7f53e80ad710 2023-07-11T00:30:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.480+0000 7f53ee7ff700 1 -- 172.21.15.22:0/4131256074 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e80c6760 con 0x7f53e80ad710 2023-07-11T00:30:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.481+0000 7f53ee7ff700 1 -- 172.21.15.22:0/4131256074 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e80c6950 con 0x7f53e80ad710 2023-07-11T00:30:40.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.486+0000 7f53e4ff9700 1 -- 172.21.15.22:0/4131256074 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53d8011cb0 con 0x7f53e80ad710 2023-07-11T00:30:40.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.487+0000 7f53e4ff9700 1 --2- 172.21.15.22:0/4131256074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f53d406adb0 0x7f53d406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.488+0000 7f53e4ff9700 1 -- 172.21.15.22:0/4131256074 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f53d8089c20 con 0x7f53e80ad710 2023-07-11T00:30:40.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.488+0000 7f53e4ff9700 1 -- 172.21.15.22:0/4131256074 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f53d8054930 con 0x7f53e80ad710 2023-07-11T00:30:40.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.489+0000 7f408e7ff700 1 Processor -- start 2023-07-11T00:30:40.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.489+0000 7f53e77fe700 1 --2- 172.21.15.22:0/4131256074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f53d406adb0 0x7f53d406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.489+0000 7f408e7ff700 1 -- start start 2023-07-11T00:30:40.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.490+0000 7f53e77fe700 1 --2- 172.21.15.22:0/4131256074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f53d406adb0 0x7f53d406d260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f53e806cb00 tx=0x7f53dc008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.491+0000 7f408e7ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f40880adeb0 0x7f408816b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.491+0000 7f408e7ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40880ccb70 con 0x7f4088160930 2023-07-11T00:30:40.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.491+0000 7f408e7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4088165400 con 0x7f4088070a80 2023-07-11T00:30:40.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.491+0000 7f408e7ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4088164640 con 0x7f40880adeb0 2023-07-11T00:30:40.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.492+0000 7f4087fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4088160930 0x7f40880cc390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52226/0 (socket says 172.21.15.22:52226) 2023-07-11T00:30:40.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.492+0000 7f4087fff700 1 -- 172.21.15.22:0/213142526 learned_addr learned my addr 172.21.15.22:0/213142526 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:40.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.493+0000 7f408cd9c700 1 --2- 172.21.15.22:0/213142526 >> v2:172.21.15.184:3300/0 conn(0x7f40880adeb0 0x7f408816b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.493+0000 7f408cd9c700 1 -- 172.21.15.22:0/213142526 >> v1:172.21.15.184:6789/0 conn(0x7f4088070a80 legacy=0x7f40880ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:40.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.493+0000 7f408cd9c700 1 -- 172.21.15.22:0/213142526 >> v1:172.21.15.22:6789/0 conn(0x7f4088160930 legacy=0x7f40880cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.493+0000 7f408cd9c700 1 -- 172.21.15.22:0/213142526 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4088164920 con 0x7f40880adeb0 2023-07-11T00:30:40.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.497+0000 7f408cd9c700 1 --2- 172.21.15.22:0/213142526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40880adeb0 0x7f408816b840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4080009d90 tx=0x7f408000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c94648e325a5ba9 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.497+0000 7f4086ffd700 1 -- 172.21.15.22:0/213142526 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408000e070 con 0x7f40880adeb0 2023-07-11T00:30:40.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.497+0000 7f4086ffd700 1 -- 172.21.15.22:0/213142526 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408000bad0 con 0x7f40880adeb0 2023-07-11T00:30:40.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.497+0000 7f4086ffd700 1 -- 172.21.15.22:0/213142526 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408000be60 con 0x7f40880adeb0 2023-07-11T00:30:40.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.498+0000 7f408e7ff700 1 -- 172.21.15.22:0/213142526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40880adeb0 msgr2=0x7f408816b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.498+0000 7f408e7ff700 1 --2- 172.21.15.22:0/213142526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40880adeb0 0x7f408816b840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4080009d90 tx=0x7f408000b330 comp rx=0 tx=0).stop 2023-07-11T00:30:40.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.499+0000 7f408e7ff700 1 -- 172.21.15.22:0/213142526 shutdown_connections 2023-07-11T00:30:40.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.499+0000 7f408e7ff700 1 --2- 172.21.15.22:0/213142526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40880adeb0 0x7f408816b840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.499+0000 7f408e7ff700 1 -- 172.21.15.22:0/213142526 >> 172.21.15.22:0/213142526 conn(0x7f40880b0390 msgr2=0x7f40880b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:40.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.501+0000 7f408e7ff700 1 -- 172.21.15.22:0/213142526 shutdown_connections 2023-07-11T00:30:40.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.501+0000 7f408e7ff700 1 -- 172.21.15.22:0/213142526 wait complete. 2023-07-11T00:30:40.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.504+0000 7f408e7ff700 1 Processor -- start 2023-07-11T00:30:40.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.504+0000 7f408e7ff700 1 -- start start 2023-07-11T00:30:40.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.506+0000 7f408e7ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4088070a80 0x7f4088162750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.506+0000 7f408e7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40880adeb0 0x7f40880b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.506+0000 7f408e7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4088160930 0x7f4088162de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.506+0000 7f408e7ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40881620c0 con 0x7f4088070a80 2023-07-11T00:30:40.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.506+0000 7f408e7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40881ead50 con 0x7f4088160930 2023-07-11T00:30:40.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.506+0000 7f408e7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40881eb030 con 0x7f40880adeb0 2023-07-11T00:30:40.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.509+0000 7f4087fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4088070a80 0x7f4088162750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.509+0000 7f4087fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4088070a80 0x7f4088162750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46472/0 (socket says 172.21.15.22:46472) 2023-07-11T00:30:40.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.509+0000 7f4087fff700 1 -- 172.21.15.22:0/2618435869 learned_addr learned my addr 172.21.15.22:0/2618435869 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:40.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.510+0000 7f4087fff700 1 -- 172.21.15.22:0/2618435869 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40880adeb0 msgr2=0x7f40880b4310 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-11T00:30:40.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.510+0000 7f4087fff700 1 --2- 172.21.15.22:0/2618435869 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40880adeb0 0x7f40880b4310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.510+0000 7f4087fff700 1 -- 172.21.15.22:0/2618435869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4088160930 msgr2=0x7f4088162de0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-11T00:30:40.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.510+0000 7f4087fff700 1 --2- 172.21.15.22:0/2618435869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4088160930 0x7f4088162de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.510+0000 7f4087fff700 1 -- 172.21.15.22:0/2618435869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4080009a70 con 0x7f4088070a80 2023-07-11T00:30:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.511+0000 7f4087fff700 1 --2- 172.21.15.22:0/2618435869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4088070a80 0x7f4088162750 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f407800c780 tx=0x7f407800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.512+0000 7f4084ff9700 1 -- 172.21.15.22:0/2618435869 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4078004c80 con 0x7f4088070a80 2023-07-11T00:30:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.512+0000 7f4084ff9700 1 -- 172.21.15.22:0/2618435869 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4078004e00 con 0x7f4088070a80 2023-07-11T00:30:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.512+0000 7f4084ff9700 1 -- 172.21.15.22:0/2618435869 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4078007310 con 0x7f4088070a80 2023-07-11T00:30:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.512+0000 7f408e7ff700 1 -- 172.21.15.22:0/2618435869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40881eb310 con 0x7f4088070a80 2023-07-11T00:30:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.512+0000 7f408e7ff700 1 -- 172.21.15.22:0/2618435869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40881eb8d0 con 0x7f4088070a80 2023-07-11T00:30:40.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.517+0000 7f4084ff9700 1 -- 172.21.15.22:0/2618435869 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4078007470 con 0x7f4088070a80 2023-07-11T00:30:40.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.518+0000 7f408e7ff700 1 -- 172.21.15.22:0/2618435869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40680052f0 con 0x7f4088070a80 2023-07-11T00:30:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.520+0000 7f4084ff9700 1 --2- 172.21.15.22:0/2618435869 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f407406adb0 0x7f407406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.520+0000 7f4084ff9700 1 -- 172.21.15.22:0/2618435869 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4078088df0 con 0x7f4088070a80 2023-07-11T00:30:40.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.524+0000 7f40877fe700 1 --2- 172.21.15.22:0/2618435869 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f407406adb0 0x7f407406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:40.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.529+0000 7f4084ff9700 1 -- 172.21.15.22:0/2618435869 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f4078057620 con 0x7f4088070a80 2023-07-11T00:30:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.571+0000 7f40877fe700 1 --2- 172.21.15.22:0/2618435869 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f407406adb0 0x7f407406d260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4088163d90 tx=0x7f407c006be0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:40.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.798+0000 7fab7dfff700 1 -- 172.21.15.22:0/2563538934 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fab580055a0 con 0x7fab78160ab0 2023-07-11T00:30:40.809 INFO:teuthology.orchestra.run.smithi022.stdout:55834574859 2023-07-11T00:30:40.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.799+0000 7fab5ffff700 1 -- 172.21.15.22:0/2563538934 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab6c0594b0 con 0x7fab78160ab0 2023-07-11T00:30:40.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.803+0000 7fab7dfff700 1 -- 172.21.15.22:0/2563538934 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fab6006af10 msgr2=0x7fab6006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.803+0000 7fab7dfff700 1 --2- 172.21.15.22:0/2563538934 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fab6006af10 0x7fab6006d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fab68001b20 tx=0x7fab68009040 comp rx=0 tx=0).stop 2023-07-11T00:30:40.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.803+0000 7fab7dfff700 1 -- 172.21.15.22:0/2563538934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab78160ab0 msgr2=0x7fab780c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.803+0000 7fab7dfff700 1 --2- 172.21.15.22:0/2563538934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab78160ab0 0x7fab780c4ad0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fab78164300 tx=0x7fab6c004750 comp rx=0 tx=0).stop 2023-07-11T00:30:40.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.804+0000 7fab7dfff700 1 -- 172.21.15.22:0/2563538934 shutdown_connections 2023-07-11T00:30:40.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.804+0000 7fab7dfff700 1 --2- 172.21.15.22:0/2563538934 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fab6006af10 0x7fab6006d3c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.804+0000 7fab7dfff700 1 --2- 172.21.15.22:0/2563538934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab78160ab0 0x7fab780c4ad0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.804+0000 7fab7dfff700 1 --2- 172.21.15.22:0/2563538934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab780cb8c0 0x7fab7806c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.804+0000 7fab7dfff700 1 --2- 172.21.15.22:0/2563538934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab781606e0 0x7fab780c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.804+0000 7fab7dfff700 1 -- 172.21.15.22:0/2563538934 >> 172.21.15.22:0/2563538934 conn(0x7fab7806abc0 msgr2=0x7fab7817dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:40.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.804+0000 7fab7dfff700 1 -- 172.21.15.22:0/2563538934 shutdown_connections 2023-07-11T00:30:40.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.804+0000 7fab7dfff700 1 -- 172.21.15.22:0/2563538934 wait complete. 2023-07-11T00:30:40.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2023-07-11T00:30:40.839 DEBUG:teuthology.parallel:result is None 2023-07-11T00:30:40.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.872+0000 7f3122dff700 1 -- 172.21.15.22:0/4153863382 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f30f80055a0 con 0x7f311c16c7e0 2023-07-11T00:30:40.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.873+0000 7f31197fa700 1 -- 172.21.15.22:0/4153863382 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f310c056af0 con 0x7f311c16c7e0 2023-07-11T00:30:40.876 INFO:teuthology.orchestra.run.smithi022.stdout:55834574859 2023-07-11T00:30:40.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.874+0000 7f38b2bff700 1 -- 172.21.15.22:0/3510303100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f38ac0b4610 con 0x7f3894004850 2023-07-11T00:30:40.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.875+0000 7f38a97fa700 1 -- 172.21.15.22:0/3510303100 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f38a0021090 con 0x7f3894004850 2023-07-11T00:30:40.878 INFO:teuthology.orchestra.run.smithi022.stdout:55834574858 2023-07-11T00:30:40.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.877+0000 7f3122dff700 1 -- 172.21.15.22:0/4153863382 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f310006adb0 msgr2=0x7f310006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.877+0000 7f3122dff700 1 --2- 172.21.15.22:0/4153863382 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f310006adb0 0x7f310006d260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3110014040 tx=0x7f3110010000 comp rx=0 tx=0).stop 2023-07-11T00:30:40.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.877+0000 7f3122dff700 1 -- 172.21.15.22:0/4153863382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f311c16c7e0 msgr2=0x7f311c06de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.877+0000 7f3122dff700 1 --2- 172.21.15.22:0/4153863382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f311c16c7e0 0x7f311c06de10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f310c00c420 tx=0x7f310c00c730 comp rx=0 tx=0).stop 2023-07-11T00:30:40.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.877+0000 7f3122dff700 1 -- 172.21.15.22:0/4153863382 shutdown_connections 2023-07-11T00:30:40.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.877+0000 7f3122dff700 1 --2- 172.21.15.22:0/4153863382 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f310006adb0 0x7f310006d260 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.877+0000 7f3122dff700 1 --2- 172.21.15.22:0/4153863382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f311c16c7e0 0x7f311c06de10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.877+0000 7f3122dff700 1 --2- 172.21.15.22:0/4153863382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f311c089570 0x7f311c1622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.877+0000 7f3122dff700 1 --2- 172.21.15.22:0/4153863382 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f311c0cb190 0x7f311c06d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.877+0000 7f3122dff700 1 -- 172.21.15.22:0/4153863382 >> 172.21.15.22:0/4153863382 conn(0x7f311c06abc0 msgr2=0x7f311c0ad310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:40.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.877+0000 7f3122dff700 1 -- 172.21.15.22:0/4153863382 shutdown_connections 2023-07-11T00:30:40.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.878+0000 7f3122dff700 1 -- 172.21.15.22:0/4153863382 wait complete. 2023-07-11T00:30:40.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.879+0000 7f38b2bff700 1 -- 172.21.15.22:0/3510303100 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f389806ad30 msgr2=0x7f389806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.879+0000 7f38b2bff700 1 --2- 172.21.15.22:0/3510303100 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f389806ad30 0x7f389806d1e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0acc20 tx=0x7f389c009030 comp rx=0 tx=0).stop 2023-07-11T00:30:40.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.879+0000 7f38b2bff700 1 -- 172.21.15.22:0/3510303100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3894004850 msgr2=0x7f38ac0b3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.879+0000 7f38b2bff700 1 --2- 172.21.15.22:0/3510303100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3894004850 0x7f38ac0b3730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f38a000e950 tx=0x7f38a000ed10 comp rx=0 tx=0).stop 2023-07-11T00:30:40.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.879+0000 7f38b2bff700 1 -- 172.21.15.22:0/3510303100 shutdown_connections 2023-07-11T00:30:40.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.879+0000 7f38b2bff700 1 --2- 172.21.15.22:0/3510303100 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f389806ad30 0x7f389806d1e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.879+0000 7f38b2bff700 1 --2- 172.21.15.22:0/3510303100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38ac157c60 0x7f38ac1580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.879+0000 7f38b2bff700 1 --2- 172.21.15.22:0/3510303100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3894004850 0x7f38ac0b3730 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.879+0000 7f38b2bff700 1 --2- 172.21.15.22:0/3510303100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38ac156e80 0x7f38ac0b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.879+0000 7f38b2bff700 1 -- 172.21.15.22:0/3510303100 >> 172.21.15.22:0/3510303100 conn(0x7f38ac06abc0 msgr2=0x7f38ac06c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:40.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.880+0000 7f38b2bff700 1 -- 172.21.15.22:0/3510303100 shutdown_connections 2023-07-11T00:30:40.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.882+0000 7f38b2bff700 1 -- 172.21.15.22:0/3510303100 wait complete. 2023-07-11T00:30:40.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.898+0000 7f53ee7ff700 1 -- 172.21.15.22:0/4131256074 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f53e804ea60 con 0x7f53e80ad710 2023-07-11T00:30:40.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.899+0000 7f53e4ff9700 1 -- 172.21.15.22:0/4131256074 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f53d8015090 con 0x7f53e80ad710 2023-07-11T00:30:40.902 INFO:teuthology.orchestra.run.smithi022.stdout:55834574859 2023-07-11T00:30:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.900+0000 7ff933fff700 1 -- 172.21.15.22:0/22067730 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff92c162900 con 0x7ff92c070a80 2023-07-11T00:30:40.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.901+0000 7ff9227fc700 1 -- 172.21.15.22:0/22067730 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff92c162900 con 0x7ff92c070a80 2023-07-11T00:30:40.904 INFO:teuthology.orchestra.run.smithi022.stdout:55834574859 2023-07-11T00:30:40.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.903+0000 7f53ee7ff700 1 -- 172.21.15.22:0/4131256074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f53d406adb0 msgr2=0x7f53d406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.903+0000 7f53ee7ff700 1 --2- 172.21.15.22:0/4131256074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f53d406adb0 0x7f53d406d260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f53e806cb00 tx=0x7f53dc008030 comp rx=0 tx=0).stop 2023-07-11T00:30:40.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.903+0000 7f53ee7ff700 1 -- 172.21.15.22:0/4131256074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53e80ad710 msgr2=0x7f53e817cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.903+0000 7f53ee7ff700 1 --2- 172.21.15.22:0/4131256074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53e80ad710 0x7f53e817cbb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f53d800b410 tx=0x7f53d8009f90 comp rx=0 tx=0).stop 2023-07-11T00:30:40.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.903+0000 7f53ee7ff700 1 -- 172.21.15.22:0/4131256074 shutdown_connections 2023-07-11T00:30:40.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.903+0000 7f53ee7ff700 1 --2- 172.21.15.22:0/4131256074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f53d406adb0 0x7f53d406d260 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.903+0000 7f53ee7ff700 1 --2- 172.21.15.22:0/4131256074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53e80ad710 0x7f53e817cbb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.903+0000 7f53ee7ff700 1 --2- 172.21.15.22:0/4131256074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53e80c1110 0x7f53e80c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.903+0000 7f53ee7ff700 1 --2- 172.21.15.22:0/4131256074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53e81606e0 0x7f53e80c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.903+0000 7f53ee7ff700 1 -- 172.21.15.22:0/4131256074 >> 172.21.15.22:0/4131256074 conn(0x7f53e806abc0 msgr2=0x7f53e815f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:40.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.903+0000 7f53ee7ff700 1 -- 172.21.15.22:0/4131256074 shutdown_connections 2023-07-11T00:30:40.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.903+0000 7f53ee7ff700 1 -- 172.21.15.22:0/4131256074 wait complete. 2023-07-11T00:30:40.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.906+0000 7ff933fff700 1 -- 172.21.15.22:0/22067730 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff91006adb0 msgr2=0x7ff91006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.906+0000 7ff933fff700 1 --2- 172.21.15.22:0/22067730 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff91006adb0 0x7ff91006d260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff91c014040 tx=0x7ff91c008030 comp rx=0 tx=0).stop 2023-07-11T00:30:40.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.906+0000 7ff933fff700 1 -- 172.21.15.22:0/22067730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff92c070a80 msgr2=0x7ff92c163580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.906+0000 7ff933fff700 1 --2- 172.21.15.22:0/22067730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff92c070a80 0x7ff92c163580 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff92800c4e0 tx=0x7ff92800c8a0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.906+0000 7ff933fff700 1 -- 172.21.15.22:0/22067730 shutdown_connections 2023-07-11T00:30:40.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.906+0000 7ff933fff700 1 --2- 172.21.15.22:0/22067730 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff91006adb0 0x7ff91006d260 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff91c014040 tx=0x7ff91c008030 comp rx=0 tx=0).stop 2023-07-11T00:30:40.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.906+0000 7ff933fff700 1 --2- 172.21.15.22:0/22067730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff92c160930 0x7ff92c0b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.906+0000 7ff933fff700 1 --2- 172.21.15.22:0/22067730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff92c070a80 0x7ff92c163580 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.906+0000 7ff933fff700 1 --2- 172.21.15.22:0/22067730 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff92c0adce0 0x7ff92c0b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.906+0000 7ff933fff700 1 -- 172.21.15.22:0/22067730 >> 172.21.15.22:0/22067730 conn(0x7ff92c0b0390 msgr2=0x7ff92c0ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:40.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2023-07-11T00:30:40.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.907+0000 7ff933fff700 1 -- 172.21.15.22:0/22067730 shutdown_connections 2023-07-11T00:30:40.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.907+0000 7ff933fff700 1 -- 172.21.15.22:0/22067730 wait complete. 2023-07-11T00:30:40.913 DEBUG:teuthology.parallel:result is None 2023-07-11T00:30:40.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2023-07-11T00:30:40.914 DEBUG:teuthology.parallel:result is None 2023-07-11T00:30:40.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.917+0000 7f5d905ff700 1 -- 172.21.15.22:0/4088773098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5d8804ea60 con 0x7f5d880abea0 2023-07-11T00:30:40.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.918+0000 7f5d7effd700 1 -- 172.21.15.22:0/4088773098 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5d80019020 con 0x7f5d880abea0 2023-07-11T00:30:40.921 INFO:teuthology.orchestra.run.smithi022.stdout:55834574858 2023-07-11T00:30:40.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.921+0000 7f5d905ff700 1 -- 172.21.15.22:0/4088773098 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5d6c06adb0 msgr2=0x7f5d6c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.921+0000 7f5d905ff700 1 --2- 172.21.15.22:0/4088773098 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5d6c06adb0 0x7f5d6c06d260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5d880cc160 tx=0x7f5d84008030 comp rx=0 tx=0).stop 2023-07-11T00:30:40.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.921+0000 7f5d905ff700 1 -- 172.21.15.22:0/4088773098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d880abea0 msgr2=0x7f5d880c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.921+0000 7f5d905ff700 1 --2- 172.21.15.22:0/4088773098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d880abea0 0x7f5d880c3cf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5d8000bd70 tx=0x7f5d8000be50 comp rx=0 tx=0).stop 2023-07-11T00:30:40.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.922+0000 7f5d905ff700 1 -- 172.21.15.22:0/4088773098 shutdown_connections 2023-07-11T00:30:40.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.922+0000 7f5d905ff700 1 --2- 172.21.15.22:0/4088773098 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5d6c06adb0 0x7f5d6c06d260 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.922+0000 7f5d905ff700 1 --2- 172.21.15.22:0/4088773098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d880c9820 0x7f5d880c2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.922+0000 7f5d905ff700 1 --2- 172.21.15.22:0/4088773098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d880abea0 0x7f5d880c3cf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.922+0000 7f5d905ff700 1 --2- 172.21.15.22:0/4088773098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d880ad7c0 0x7f5d880c22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.922+0000 7f5d905ff700 1 -- 172.21.15.22:0/4088773098 >> 172.21.15.22:0/4088773098 conn(0x7f5d8806abc0 msgr2=0x7f5d880cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:40.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.922+0000 7f5d905ff700 1 -- 172.21.15.22:0/4088773098 shutdown_connections 2023-07-11T00:30:40.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.922+0000 7f5d905ff700 1 -- 172.21.15.22:0/4088773098 wait complete. 2023-07-11T00:30:40.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2023-07-11T00:30:40.932 DEBUG:teuthology.parallel:result is None 2023-07-11T00:30:40.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2023-07-11T00:30:40.937 DEBUG:teuthology.parallel:result is None 2023-07-11T00:30:40.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.941+0000 7fc5ae5ff700 1 -- 172.21.15.22:0/3755692262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc5a80c2380 con 0x7fc5a8157d60 2023-07-11T00:30:40.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.942+0000 7fc5a4ff9700 1 -- 172.21.15.22:0/3755692262 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc5a80c2380 con 0x7fc5a8157d60 2023-07-11T00:30:40.945 INFO:teuthology.orchestra.run.smithi022.stdout:55834574858 2023-07-11T00:30:40.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.946+0000 7fc5ae5ff700 1 -- 172.21.15.22:0/3755692262 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc58c06ad80 msgr2=0x7fc58c06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.946+0000 7fc5ae5ff700 1 --2- 172.21.15.22:0/3755692262 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc58c06ad80 0x7fc58c06d230 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0000f80 tx=0x7fc5a0009000 comp rx=0 tx=0).stop 2023-07-11T00:30:40.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.946+0000 7fc5ae5ff700 1 -- 172.21.15.22:0/3755692262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5a8157d60 msgr2=0x7fc5a80c6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.946+0000 7fc5ae5ff700 1 --2- 172.21.15.22:0/3755692262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5a8157d60 0x7fc5a80c6030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc59800b410 tx=0x7fc59800b720 comp rx=0 tx=0).stop 2023-07-11T00:30:40.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.946+0000 7fc5ae5ff700 1 -- 172.21.15.22:0/3755692262 shutdown_connections 2023-07-11T00:30:40.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.946+0000 7fc5ae5ff700 1 --2- 172.21.15.22:0/3755692262 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc58c06ad80 0x7fc58c06d230 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.946+0000 7fc5ae5ff700 1 --2- 172.21.15.22:0/3755692262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5a8157d60 0x7fc5a80c6030 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.946+0000 7fc5ae5ff700 1 --2- 172.21.15.22:0/3755692262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5a80b0aa0 0x7fc5a814e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.946+0000 7fc5ae5ff700 1 --2- 172.21.15.22:0/3755692262 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5a80cb1a0 0x7fc5a815b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.946+0000 7fc5ae5ff700 1 -- 172.21.15.22:0/3755692262 >> 172.21.15.22:0/3755692262 conn(0x7fc5a806abc0 msgr2=0x7fc5a806e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:40.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.946+0000 7fc5ae5ff700 1 -- 172.21.15.22:0/3755692262 shutdown_connections 2023-07-11T00:30:40.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.946+0000 7fc5ae5ff700 1 -- 172.21.15.22:0/3755692262 wait complete. 2023-07-11T00:30:40.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2023-07-11T00:30:40.952 DEBUG:teuthology.parallel:result is None 2023-07-11T00:30:40.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.951+0000 7f408e7ff700 1 -- 172.21.15.22:0/2618435869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f40680055a0 con 0x7f4088070a80 2023-07-11T00:30:40.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.951+0000 7f4084ff9700 1 -- 172.21.15.22:0/2618435869 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4078018090 con 0x7f4088070a80 2023-07-11T00:30:40.953 INFO:teuthology.orchestra.run.smithi022.stdout:55834574859 2023-07-11T00:30:40.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.955+0000 7f408e7ff700 1 -- 172.21.15.22:0/2618435869 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f407406adb0 msgr2=0x7f407406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.955+0000 7f408e7ff700 1 --2- 172.21.15.22:0/2618435869 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f407406adb0 0x7f407406d260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4088163d90 tx=0x7f407c006be0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.955+0000 7f408e7ff700 1 -- 172.21.15.22:0/2618435869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4088070a80 msgr2=0x7f4088162750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:40.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.955+0000 7f408e7ff700 1 --2- 172.21.15.22:0/2618435869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4088070a80 0x7f4088162750 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f407800c780 tx=0x7f407800cb40 comp rx=0 tx=0).stop 2023-07-11T00:30:40.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.955+0000 7f408e7ff700 1 -- 172.21.15.22:0/2618435869 shutdown_connections 2023-07-11T00:30:40.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.955+0000 7f408e7ff700 1 --2- 172.21.15.22:0/2618435869 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f407406adb0 0x7f407406d260 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.955+0000 7f408e7ff700 1 --2- 172.21.15.22:0/2618435869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4088160930 0x7f4088162de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.955+0000 7f408e7ff700 1 --2- 172.21.15.22:0/2618435869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4088070a80 0x7f4088162750 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.955+0000 7f408e7ff700 1 --2- 172.21.15.22:0/2618435869 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40880adeb0 0x7f40880b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:40.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.955+0000 7f408e7ff700 1 -- 172.21.15.22:0/2618435869 >> 172.21.15.22:0/2618435869 conn(0x7f40880b0390 msgr2=0x7f40880ce7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:40.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.955+0000 7f408e7ff700 1 -- 172.21.15.22:0/2618435869 shutdown_connections 2023-07-11T00:30:40.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:40.955+0000 7f408e7ff700 1 -- 172.21.15.22:0/2618435869 wait complete. 2023-07-11T00:30:40.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2023-07-11T00:30:40.970 DEBUG:teuthology.parallel:result is None 2023-07-11T00:30:40.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2023-07-11T00:30:40.976 DEBUG:teuthology.parallel:result is None 2023-07-11T00:30:40.976 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-11T00:30:40.976 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-11T00:30:41.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.214+0000 7feb48dff700 1 Processor -- start 2023-07-11T00:30:41.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.215+0000 7feb48dff700 1 -- start start 2023-07-11T00:30:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.216+0000 7feb48dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7feb4415c460 0x7feb440b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.216+0000 7feb48dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb440d2640 0x7feb440cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.216+0000 7feb48dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb440d1790 con 0x7feb440cf720 2023-07-11T00:30:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.216+0000 7feb48dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb440cedd0 con 0x7feb4415c460 2023-07-11T00:30:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.216+0000 7feb48dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb440cd950 con 0x7feb440d2640 2023-07-11T00:30:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.216+0000 7feb4259c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7feb4415c460 0x7feb440b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.216+0000 7feb42d9d700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7feb440cf720 0x7feb440d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:54794/0 (socket says 172.21.15.22:54794) 2023-07-11T00:30:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.216+0000 7feb3bfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb440d2640 0x7feb440cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.216+0000 7feb42d9d700 1 -- 172.21.15.22:0/4175852900 learned_addr learned my addr 172.21.15.22:0/4175852900 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:41.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.217+0000 7feb41d9b700 1 -- 172.21.15.22:0/4175852900 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525721060 0 0) 0x7feb440d1790 con 0x7feb440cf720 2023-07-11T00:30:41.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.217+0000 7feb41d9b700 1 -- 172.21.15.22:0/4175852900 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb300035b0 con 0x7feb440cf720 2023-07-11T00:30:41.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.217+0000 7feb3bfff700 1 -- 172.21.15.22:0/4175852900 >> v2:172.21.15.184:3300/0 conn(0x7feb4415c460 msgr2=0x7feb440b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:41.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.217+0000 7feb3bfff700 1 --2- 172.21.15.22:0/4175852900 >> v2:172.21.15.184:3300/0 conn(0x7feb4415c460 0x7feb440b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:41.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.217+0000 7feb3bfff700 1 -- 172.21.15.22:0/4175852900 >> v1:172.21.15.184:6789/0 conn(0x7feb440cf720 legacy=0x7feb440d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:41.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.217+0000 7feb3bfff700 1 -- 172.21.15.22:0/4175852900 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb440d14b0 con 0x7feb440d2640 2023-07-11T00:30:41.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.217+0000 7feb3bfff700 1 --2- 172.21.15.22:0/4175852900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb440d2640 0x7feb440cf1e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009840 tx=0x7feb2c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=856d47537d18ad0b server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:41.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.217+0000 7feb41d9b700 1 -- 172.21.15.22:0/4175852900 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c011830 con 0x7feb440d2640 2023-07-11T00:30:41.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.217+0000 7feb41d9b700 1 -- 172.21.15.22:0/4175852900 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2c011990 con 0x7feb440d2640 2023-07-11T00:30:41.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.217+0000 7feb41d9b700 1 -- 172.21.15.22:0/4175852900 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c011d20 con 0x7feb440d2640 2023-07-11T00:30:41.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.218+0000 7feb48dff700 1 -- 172.21.15.22:0/4175852900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb440d2640 msgr2=0x7feb440cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:41.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.218+0000 7feb48dff700 1 --2- 172.21.15.22:0/4175852900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb440d2640 0x7feb440cf1e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009840 tx=0x7feb2c009b50 comp rx=0 tx=0).stop 2023-07-11T00:30:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.218+0000 7feb48dff700 1 -- 172.21.15.22:0/4175852900 shutdown_connections 2023-07-11T00:30:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.218+0000 7feb48dff700 1 --2- 172.21.15.22:0/4175852900 >> v2:172.21.15.184:3300/0 conn(0x7feb4415c460 0x7feb440b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.218+0000 7feb48dff700 1 --2- 172.21.15.22:0/4175852900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb440d2640 0x7feb440cf1e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.218+0000 7feb48dff700 1 -- 172.21.15.22:0/4175852900 >> 172.21.15.22:0/4175852900 conn(0x7feb44071660 msgr2=0x7feb44071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.218+0000 7feb48dff700 1 -- 172.21.15.22:0/4175852900 shutdown_connections 2023-07-11T00:30:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.218+0000 7feb48dff700 1 -- 172.21.15.22:0/4175852900 wait complete. 2023-07-11T00:30:41.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.220+0000 7feb48dff700 1 Processor -- start 2023-07-11T00:30:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.220+0000 7feb48dff700 1 -- start start 2023-07-11T00:30:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.221+0000 7feb48dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb440cf720 0x7feb440c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.221+0000 7feb48dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb440d2640 0x7feb441e7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.221+0000 7feb48dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb4415c460 0x7feb440c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.221+0000 7feb48dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb441e8640 con 0x7feb4415c460 2023-07-11T00:30:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.221+0000 7feb48dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb441e7b80 con 0x7feb440cf720 2023-07-11T00:30:41.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.221+0000 7feb48dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb441e7da0 con 0x7feb440d2640 2023-07-11T00:30:41.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.221+0000 7feb42d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb4415c460 0x7feb440c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:41.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.221+0000 7feb3bfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb440d2640 0x7feb441e7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:41.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.221+0000 7feb42d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb4415c460 0x7feb440c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46484/0 (socket says 172.21.15.22:46484) 2023-07-11T00:30:41.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.221+0000 7feb42d9d700 1 -- 172.21.15.22:0/1929989287 learned_addr learned my addr 172.21.15.22:0/1929989287 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:41.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.221+0000 7feb4259c700 1 --2- 172.21.15.22:0/1929989287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb440cf720 0x7feb440c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:41.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.222+0000 7feb3bfff700 1 -- 172.21.15.22:0/1929989287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb440cf720 msgr2=0x7feb440c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:41.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.222+0000 7feb3bfff700 1 --2- 172.21.15.22:0/1929989287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb440cf720 0x7feb440c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:41.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.222+0000 7feb3bfff700 1 -- 172.21.15.22:0/1929989287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb4415c460 msgr2=0x7feb440c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:41.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.222+0000 7feb3bfff700 1 --2- 172.21.15.22:0/1929989287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb4415c460 0x7feb440c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:41.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.222+0000 7feb3bfff700 1 -- 172.21.15.22:0/1929989287 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c0094a0 con 0x7feb440d2640 2023-07-11T00:30:41.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.222+0000 7feb3bfff700 1 --2- 172.21.15.22:0/1929989287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb440d2640 0x7feb441e7640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb2c016000 tx=0x7feb2c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:41.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.222+0000 7feb3affd700 1 -- 172.21.15.22:0/1929989287 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c004590 con 0x7feb440d2640 2023-07-11T00:30:41.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.222+0000 7feb3affd700 1 -- 172.21.15.22:0/1929989287 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2c01e070 con 0x7feb440d2640 2023-07-11T00:30:41.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.222+0000 7feb48dff700 1 -- 172.21.15.22:0/1929989287 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb441e8080 con 0x7feb440d2640 2023-07-11T00:30:41.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.222+0000 7feb3affd700 1 -- 172.21.15.22:0/1929989287 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c0038e0 con 0x7feb440d2640 2023-07-11T00:30:41.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.223+0000 7feb48dff700 1 -- 172.21.15.22:0/1929989287 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb4415d030 con 0x7feb440d2640 2023-07-11T00:30:41.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.224+0000 7feb48dff700 1 -- 172.21.15.22:0/1929989287 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4415d220 con 0x7feb440d2640 2023-07-11T00:30:41.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.224+0000 7feb3affd700 1 -- 172.21.15.22:0/1929989287 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb2c003a40 con 0x7feb440d2640 2023-07-11T00:30:41.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.225+0000 7feb3affd700 1 --2- 172.21.15.22:0/1929989287 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7feb2406ace0 0x7feb2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:41.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.225+0000 7feb3affd700 1 -- 172.21.15.22:0/1929989287 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feb2c08a510 con 0x7feb440d2640 2023-07-11T00:30:41.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.226+0000 7feb4259c700 1 --2- 172.21.15.22:0/1929989287 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7feb2406ace0 0x7feb2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:41.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.226+0000 7feb4259c700 1 --2- 172.21.15.22:0/1929989287 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7feb2406ace0 0x7feb2406d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feb34009be0 tx=0x7feb34009210 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:41.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.230+0000 7feb3affd700 1 -- 172.21.15.22:0/1929989287 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7feb2c055240 con 0x7feb440d2640 2023-07-11T00:30:41.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.435+0000 7feb48dff700 1 -- 172.21.15.22:0/1929989287 --> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb440cd5e0 con 0x7feb2406ace0 2023-07-11T00:30:41.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.446+0000 7feb3affd700 1 -- 172.21.15.22:0/1929989287 <== mgr.4114 v2:172.21.15.184:6832/380612710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367571 (secure 0 0 0) 0x7feb34011860 con 0x7feb2406ace0 2023-07-11T00:30:41.453 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:41.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.451+0000 7feb48dff700 1 -- 172.21.15.22:0/1929989287 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7feb2406ace0 msgr2=0x7feb2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:41.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.451+0000 7feb48dff700 1 --2- 172.21.15.22:0/1929989287 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7feb2406ace0 0x7feb2406d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feb34009be0 tx=0x7feb34009210 comp rx=0 tx=0).stop 2023-07-11T00:30:41.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.451+0000 7feb48dff700 1 -- 172.21.15.22:0/1929989287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb440d2640 msgr2=0x7feb441e7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:41.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.451+0000 7feb48dff700 1 --2- 172.21.15.22:0/1929989287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb440d2640 0x7feb441e7640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb2c016000 tx=0x7feb2c004750 comp rx=0 tx=0).stop 2023-07-11T00:30:41.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.451+0000 7feb48dff700 1 -- 172.21.15.22:0/1929989287 shutdown_connections 2023-07-11T00:30:41.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.451+0000 7feb48dff700 1 --2- 172.21.15.22:0/1929989287 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7feb2406ace0 0x7feb2406d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:41.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.451+0000 7feb48dff700 1 --2- 172.21.15.22:0/1929989287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb4415c460 0x7feb440c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:41.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.451+0000 7feb48dff700 1 --2- 172.21.15.22:0/1929989287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb440cf720 0x7feb440c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:41.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.451+0000 7feb48dff700 1 --2- 172.21.15.22:0/1929989287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb440d2640 0x7feb441e7640 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:41.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.451+0000 7feb48dff700 1 -- 172.21.15.22:0/1929989287 >> 172.21.15.22:0/1929989287 conn(0x7feb44071660 msgr2=0x7feb440b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:41.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.451+0000 7feb48dff700 1 -- 172.21.15.22:0/1929989287 shutdown_connections 2023-07-11T00:30:41.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.451+0000 7feb48dff700 1 -- 172.21.15.22:0/1929989287 wait complete. 2023-07-11T00:30:41.457 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-07-11T00:30:41.472 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-07-11T00:30:40.499775+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219352,"kb_used_data":3192,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755368,"statfs":{"total":773094113280,"available":772869496832,"internally_reserved":0,"allocated":3268608,"data_stored":2022316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003679"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117136+0000","last_change":"2023-07-11T00:30:05.911712+0000","last_active":"2023-07-11T00:30:11.117136+0000","last_peered":"2023-07-11T00:30:11.117136+0000","last_clean":"2023-07-11T00:30:11.117136+0000","last_became_active":"2023-07-11T00:30:05.911450+0000","last_became_peered":"2023-07-11T00:30:05.911450+0000","last_unstale":"2023-07-11T00:30:11.117136+0000","last_undegraded":"2023-07-11T00:30:11.117136+0000","last_fullsized":"2023-07-11T00:30:11.117136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:54:15.307917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116734+0000","last_change":"2023-07-11T00:30:05.920040+0000","last_active":"2023-07-11T00:30:11.116734+0000","last_peered":"2023-07-11T00:30:11.116734+0000","last_clean":"2023-07-11T00:30:11.116734+0000","last_became_active":"2023-07-11T00:30:05.919701+0000","last_became_peered":"2023-07-11T00:30:05.919701+0000","last_unstale":"2023-07-11T00:30:11.116734+0000","last_undegraded":"2023-07-11T00:30:11.116734+0000","last_fullsized":"2023-07-11T00:30:11.116734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:30:34.562898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059575+0000","last_change":"2023-07-11T00:30:05.912536+0000","last_active":"2023-07-11T00:30:11.059575+0000","last_peered":"2023-07-11T00:30:11.059575+0000","last_clean":"2023-07-11T00:30:11.059575+0000","last_became_active":"2023-07-11T00:30:05.912241+0000","last_became_peered":"2023-07-11T00:30:05.912241+0000","last_unstale":"2023-07-11T00:30:11.059575+0000","last_undegraded":"2023-07-11T00:30:11.059575+0000","last_fullsized":"2023-07-11T00:30:11.059575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:12:42.514924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058346+0000","last_change":"2023-07-11T00:30:05.903203+0000","last_active":"2023-07-11T00:30:11.058346+0000","last_peered":"2023-07-11T00:30:11.058346+0000","last_clean":"2023-07-11T00:30:11.058346+0000","last_became_active":"2023-07-11T00:30:05.902858+0000","last_became_peered":"2023-07-11T00:30:05.902858+0000","last_unstale":"2023-07-11T00:30:11.058346+0000","last_undegraded":"2023-07-11T00:30:11.058346+0000","last_fullsized":"2023-07-11T00:30:11.058346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:44:07.446915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058655+0000","last_change":"2023-07-11T00:30:05.905150+0000","last_active":"2023-07-11T00:30:11.058655+0000","last_peered":"2023-07-11T00:30:11.058655+0000","last_clean":"2023-07-11T00:30:11.058655+0000","last_became_active":"2023-07-11T00:30:05.904828+0000","last_became_peered":"2023-07-11T00:30:05.904828+0000","last_unstale":"2023-07-11T00:30:11.058655+0000","last_undegraded":"2023-07-11T00:30:11.058655+0000","last_fullsized":"2023-07-11T00:30:11.058655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:37:25.278906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.060073+0000","last_change":"2023-07-11T00:30:05.918168+0000","last_active":"2023-07-11T00:30:11.060073+0000","last_peered":"2023-07-11T00:30:11.060073+0000","last_clean":"2023-07-11T00:30:11.060073+0000","last_became_active":"2023-07-11T00:30:05.917840+0000","last_became_peered":"2023-07-11T00:30:05.917840+0000","last_unstale":"2023-07-11T00:30:11.060073+0000","last_undegraded":"2023-07-11T00:30:11.060073+0000","last_fullsized":"2023-07-11T00:30:11.060073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:32:32.639916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116327+0000","last_change":"2023-07-11T00:30:05.916111+0000","last_active":"2023-07-11T00:30:11.116327+0000","last_peered":"2023-07-11T00:30:11.116327+0000","last_clean":"2023-07-11T00:30:11.116327+0000","last_became_active":"2023-07-11T00:30:05.915793+0000","last_became_peered":"2023-07-11T00:30:05.915793+0000","last_unstale":"2023-07-11T00:30:11.116327+0000","last_undegraded":"2023-07-11T00:30:11.116327+0000","last_fullsized":"2023-07-11T00:30:11.116327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:01:38.063704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116335+0000","last_change":"2023-07-11T00:30:05.924536+0000","last_active":"2023-07-11T00:30:11.116335+0000","last_peered":"2023-07-11T00:30:11.116335+0000","last_clean":"2023-07-11T00:30:11.116335+0000","last_became_active":"2023-07-11T00:30:05.924214+0000","last_became_peered":"2023-07-11T00:30:05.924214+0000","last_unstale":"2023-07-11T00:30:11.116335+0000","last_undegraded":"2023-07-11T00:30:11.116335+0000","last_fullsized":"2023-07-11T00:30:11.116335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:02:21.282407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058461+0000","last_change":"2023-07-11T00:30:05.912403+0000","last_active":"2023-07-11T00:30:11.058461+0000","last_peered":"2023-07-11T00:30:11.058461+0000","last_clean":"2023-07-11T00:30:11.058461+0000","last_became_active":"2023-07-11T00:30:05.912089+0000","last_became_peered":"2023-07-11T00:30:05.912089+0000","last_unstale":"2023-07-11T00:30:11.058461+0000","last_undegraded":"2023-07-11T00:30:11.058461+0000","last_fullsized":"2023-07-11T00:30:11.058461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:05:31.560559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117009+0000","last_change":"2023-07-11T00:30:05.914190+0000","last_active":"2023-07-11T00:30:11.117009+0000","last_peered":"2023-07-11T00:30:11.117009+0000","last_clean":"2023-07-11T00:30:11.117009+0000","last_became_active":"2023-07-11T00:30:05.913891+0000","last_became_peered":"2023-07-11T00:30:05.913891+0000","last_unstale":"2023-07-11T00:30:11.117009+0000","last_undegraded":"2023-07-11T00:30:11.117009+0000","last_fullsized":"2023-07-11T00:30:11.117009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:36:16.891590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059425+0000","last_change":"2023-07-11T00:30:05.918953+0000","last_active":"2023-07-11T00:30:11.059425+0000","last_peered":"2023-07-11T00:30:11.059425+0000","last_clean":"2023-07-11T00:30:11.059425+0000","last_became_active":"2023-07-11T00:30:05.918621+0000","last_became_peered":"2023-07-11T00:30:05.918621+0000","last_unstale":"2023-07-11T00:30:11.059425+0000","last_undegraded":"2023-07-11T00:30:11.059425+0000","last_fullsized":"2023-07-11T00:30:11.059425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:41:28.164012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118528+0000","last_change":"2023-07-11T00:30:05.914213+0000","last_active":"2023-07-11T00:30:11.118528+0000","last_peered":"2023-07-11T00:30:11.118528+0000","last_clean":"2023-07-11T00:30:11.118528+0000","last_became_active":"2023-07-11T00:30:05.913944+0000","last_became_peered":"2023-07-11T00:30:05.913944+0000","last_unstale":"2023-07-11T00:30:11.118528+0000","last_undegraded":"2023-07-11T00:30:11.118528+0000","last_fullsized":"2023-07-11T00:30:11.118528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:59:16.970501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118774+0000","last_change":"2023-07-11T00:30:05.910052+0000","last_active":"2023-07-11T00:30:11.118774+0000","last_peered":"2023-07-11T00:30:11.118774+0000","last_clean":"2023-07-11T00:30:11.118774+0000","last_became_active":"2023-07-11T00:30:05.909736+0000","last_became_peered":"2023-07-11T00:30:05.909736+0000","last_unstale":"2023-07-11T00:30:11.118774+0000","last_undegraded":"2023-07-11T00:30:11.118774+0000","last_fullsized":"2023-07-11T00:30:11.118774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:21:43.298124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116546+0000","last_change":"2023-07-11T00:30:05.917375+0000","last_active":"2023-07-11T00:30:11.116546+0000","last_peered":"2023-07-11T00:30:11.116546+0000","last_clean":"2023-07-11T00:30:11.116546+0000","last_became_active":"2023-07-11T00:30:05.917073+0000","last_became_peered":"2023-07-11T00:30:05.917073+0000","last_unstale":"2023-07-11T00:30:11.116546+0000","last_undegraded":"2023-07-11T00:30:11.116546+0000","last_fullsized":"2023-07-11T00:30:11.116546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:49:32.598344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115820+0000","last_change":"2023-07-11T00:30:05.915585+0000","last_active":"2023-07-11T00:30:11.115820+0000","last_peered":"2023-07-11T00:30:11.115820+0000","last_clean":"2023-07-11T00:30:11.115820+0000","last_became_active":"2023-07-11T00:30:05.915308+0000","last_became_peered":"2023-07-11T00:30:05.915308+0000","last_unstale":"2023-07-11T00:30:11.115820+0000","last_undegraded":"2023-07-11T00:30:11.115820+0000","last_fullsized":"2023-07-11T00:30:11.115820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:31:07.229483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058415+0000","last_change":"2023-07-11T00:30:05.897489+0000","last_active":"2023-07-11T00:30:11.058415+0000","last_peered":"2023-07-11T00:30:11.058415+0000","last_clean":"2023-07-11T00:30:11.058415+0000","last_became_active":"2023-07-11T00:30:05.897078+0000","last_became_peered":"2023-07-11T00:30:05.897078+0000","last_unstale":"2023-07-11T00:30:11.058415+0000","last_undegraded":"2023-07-11T00:30:11.058415+0000","last_fullsized":"2023-07-11T00:30:11.058415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:47:49.437638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058439+0000","last_change":"2023-07-11T00:30:05.904485+0000","last_active":"2023-07-11T00:30:11.058439+0000","last_peered":"2023-07-11T00:30:11.058439+0000","last_clean":"2023-07-11T00:30:11.058439+0000","last_became_active":"2023-07-11T00:30:05.904198+0000","last_became_peered":"2023-07-11T00:30:05.904198+0000","last_unstale":"2023-07-11T00:30:11.058439+0000","last_undegraded":"2023-07-11T00:30:11.058439+0000","last_fullsized":"2023-07-11T00:30:11.058439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:07:55.311856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059904+0000","last_change":"2023-07-11T00:30:05.916172+0000","last_active":"2023-07-11T00:30:11.059904+0000","last_peered":"2023-07-11T00:30:11.059904+0000","last_clean":"2023-07-11T00:30:11.059904+0000","last_became_active":"2023-07-11T00:30:05.915857+0000","last_became_peered":"2023-07-11T00:30:05.915857+0000","last_unstale":"2023-07-11T00:30:11.059904+0000","last_undegraded":"2023-07-11T00:30:11.059904+0000","last_fullsized":"2023-07-11T00:30:11.059904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:03:00.748490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117907+0000","last_change":"2023-07-11T00:30:05.905623+0000","last_active":"2023-07-11T00:30:11.117907+0000","last_peered":"2023-07-11T00:30:11.117907+0000","last_clean":"2023-07-11T00:30:11.117907+0000","last_became_active":"2023-07-11T00:30:05.905411+0000","last_became_peered":"2023-07-11T00:30:05.905411+0000","last_unstale":"2023-07-11T00:30:11.117907+0000","last_undegraded":"2023-07-11T00:30:11.117907+0000","last_fullsized":"2023-07-11T00:30:11.117907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:59:32.190804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059052+0000","last_change":"2023-07-11T00:30:05.912071+0000","last_active":"2023-07-11T00:30:11.059052+0000","last_peered":"2023-07-11T00:30:11.059052+0000","last_clean":"2023-07-11T00:30:11.059052+0000","last_became_active":"2023-07-11T00:30:05.911697+0000","last_became_peered":"2023-07-11T00:30:05.911697+0000","last_unstale":"2023-07-11T00:30:11.059052+0000","last_undegraded":"2023-07-11T00:30:11.059052+0000","last_fullsized":"2023-07-11T00:30:11.059052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:50:20.512890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116233+0000","last_change":"2023-07-11T00:30:05.910797+0000","last_active":"2023-07-11T00:30:11.116233+0000","last_peered":"2023-07-11T00:30:11.116233+0000","last_clean":"2023-07-11T00:30:11.116233+0000","last_became_active":"2023-07-11T00:30:05.910438+0000","last_became_peered":"2023-07-11T00:30:05.910438+0000","last_unstale":"2023-07-11T00:30:11.116233+0000","last_undegraded":"2023-07-11T00:30:11.116233+0000","last_fullsized":"2023-07-11T00:30:11.116233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:47:49.437638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057978+0000","last_change":"2023-07-11T00:30:05.918878+0000","last_active":"2023-07-11T00:30:11.057978+0000","last_peered":"2023-07-11T00:30:11.057978+0000","last_clean":"2023-07-11T00:30:11.057978+0000","last_became_active":"2023-07-11T00:30:05.918348+0000","last_became_peered":"2023-07-11T00:30:05.918348+0000","last_unstale":"2023-07-11T00:30:11.057978+0000","last_undegraded":"2023-07-11T00:30:11.057978+0000","last_fullsized":"2023-07-11T00:30:11.057978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:31:53.264979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116625+0000","last_change":"2023-07-11T00:30:05.903228+0000","last_active":"2023-07-11T00:30:11.116625+0000","last_peered":"2023-07-11T00:30:11.116625+0000","last_clean":"2023-07-11T00:30:11.116625+0000","last_became_active":"2023-07-11T00:30:05.902909+0000","last_became_peered":"2023-07-11T00:30:05.902909+0000","last_unstale":"2023-07-11T00:30:11.116625+0000","last_undegraded":"2023-07-11T00:30:11.116625+0000","last_fullsized":"2023-07-11T00:30:11.116625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:53.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115854+0000","last_change":"2023-07-11T00:30:05.908961+0000","last_active":"2023-07-11T00:30:11.115854+0000","last_peered":"2023-07-11T00:30:11.115854+0000","last_clean":"2023-07-11T00:30:11.115854+0000","last_became_active":"2023-07-11T00:30:05.908652+0000","last_became_peered":"2023-07-11T00:30:05.908652+0000","last_unstale":"2023-07-11T00:30:11.115854+0000","last_undegraded":"2023-07-11T00:30:11.115854+0000","last_fullsized":"2023-07-11T00:30:11.115854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:30:34.562898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117973+0000","last_change":"2023-07-11T00:30:05.915154+0000","last_active":"2023-07-11T00:30:11.117973+0000","last_peered":"2023-07-11T00:30:11.117973+0000","last_clean":"2023-07-11T00:30:11.117973+0000","last_became_active":"2023-07-11T00:30:05.914601+0000","last_became_peered":"2023-07-11T00:30:05.914601+0000","last_unstale":"2023-07-11T00:30:11.117973+0000","last_undegraded":"2023-07-11T00:30:11.117973+0000","last_fullsized":"2023-07-11T00:30:11.117973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:05:31.560559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117482+0000","last_change":"2023-07-11T00:30:05.917313+0000","last_active":"2023-07-11T00:30:11.117482+0000","last_peered":"2023-07-11T00:30:11.117482+0000","last_clean":"2023-07-11T00:30:11.117482+0000","last_became_active":"2023-07-11T00:30:05.916948+0000","last_became_peered":"2023-07-11T00:30:05.916948+0000","last_unstale":"2023-07-11T00:30:11.117482+0000","last_undegraded":"2023-07-11T00:30:11.117482+0000","last_fullsized":"2023-07-11T00:30:11.117482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:23:06.035280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116853+0000","last_change":"2023-07-11T00:30:05.907303+0000","last_active":"2023-07-11T00:30:11.116853+0000","last_peered":"2023-07-11T00:30:11.116853+0000","last_clean":"2023-07-11T00:30:11.116853+0000","last_became_active":"2023-07-11T00:30:05.906928+0000","last_became_peered":"2023-07-11T00:30:05.906928+0000","last_unstale":"2023-07-11T00:30:11.116853+0000","last_undegraded":"2023-07-11T00:30:11.116853+0000","last_fullsized":"2023-07-11T00:30:11.116853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:43:56.168273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059619+0000","last_change":"2023-07-11T00:30:10.072865+0000","last_active":"2023-07-11T00:30:11.059619+0000","last_peered":"2023-07-11T00:30:11.059619+0000","last_clean":"2023-07-11T00:30:11.059619+0000","last_became_active":"2023-07-11T00:30:10.072474+0000","last_became_peered":"2023-07-11T00:30:10.072474+0000","last_unstale":"2023-07-11T00:30:11.059619+0000","last_undegraded":"2023-07-11T00:30:11.059619+0000","last_fullsized":"2023-07-11T00:30:11.059619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:48:40.316132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059700+0000","last_change":"2023-07-11T00:30:04.908760+0000","last_active":"2023-07-11T00:30:11.059700+0000","last_peered":"2023-07-11T00:30:11.059700+0000","last_clean":"2023-07-11T00:30:11.059700+0000","last_became_active":"2023-07-11T00:30:04.908468+0000","last_became_peered":"2023-07-11T00:30:04.908468+0000","last_unstale":"2023-07-11T00:30:11.059700+0000","last_undegraded":"2023-07-11T00:30:11.059700+0000","last_fullsized":"2023-07-11T00:30:11.059700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:48:47.561149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119219+0000","last_change":"2023-07-11T00:30:05.915093+0000","last_active":"2023-07-11T00:30:11.119219+0000","last_peered":"2023-07-11T00:30:11.119219+0000","last_clean":"2023-07-11T00:30:11.119219+0000","last_became_active":"2023-07-11T00:30:05.914787+0000","last_became_peered":"2023-07-11T00:30:05.914787+0000","last_unstale":"2023-07-11T00:30:11.119219+0000","last_undegraded":"2023-07-11T00:30:11.119219+0000","last_fullsized":"2023-07-11T00:30:11.119219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:03:00.748490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058408+0000","last_change":"2023-07-11T00:30:10.068761+0000","last_active":"2023-07-11T00:30:11.058408+0000","last_peered":"2023-07-11T00:30:11.058408+0000","last_clean":"2023-07-11T00:30:11.058408+0000","last_became_active":"2023-07-11T00:30:10.068319+0000","last_became_peered":"2023-07-11T00:30:10.068319+0000","last_unstale":"2023-07-11T00:30:11.058408+0000","last_undegraded":"2023-07-11T00:30:11.058408+0000","last_fullsized":"2023-07-11T00:30:11.058408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:56:42.728305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116259+0000","last_change":"2023-07-11T00:30:04.901722+0000","last_active":"2023-07-11T00:30:11.116259+0000","last_peered":"2023-07-11T00:30:11.116259+0000","last_clean":"2023-07-11T00:30:11.116259+0000","last_became_active":"2023-07-11T00:30:04.901326+0000","last_became_peered":"2023-07-11T00:30:04.901326+0000","last_unstale":"2023-07-11T00:30:11.116259+0000","last_undegraded":"2023-07-11T00:30:11.116259+0000","last_fullsized":"2023-07-11T00:30:11.116259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:31:52.262271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058531+0000","last_change":"2023-07-11T00:30:05.908583+0000","last_active":"2023-07-11T00:30:11.058531+0000","last_peered":"2023-07-11T00:30:11.058531+0000","last_clean":"2023-07-11T00:30:11.058531+0000","last_became_active":"2023-07-11T00:30:05.908245+0000","last_became_peered":"2023-07-11T00:30:05.908245+0000","last_unstale":"2023-07-11T00:30:11.058531+0000","last_undegraded":"2023-07-11T00:30:11.058531+0000","last_fullsized":"2023-07-11T00:30:11.058531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:49:28.388344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058698+0000","last_change":"2023-07-11T00:30:10.083710+0000","last_active":"2023-07-11T00:30:11.058698+0000","last_peered":"2023-07-11T00:30:11.058698+0000","last_clean":"2023-07-11T00:30:11.058698+0000","last_became_active":"2023-07-11T00:30:10.080933+0000","last_became_peered":"2023-07-11T00:30:10.080933+0000","last_unstale":"2023-07-11T00:30:11.058698+0000","last_undegraded":"2023-07-11T00:30:11.058698+0000","last_fullsized":"2023-07-11T00:30:11.058698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:04.352361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119152+0000","last_change":"2023-07-11T00:30:04.904239+0000","last_active":"2023-07-11T00:30:11.119152+0000","last_peered":"2023-07-11T00:30:11.119152+0000","last_clean":"2023-07-11T00:30:11.119152+0000","last_became_active":"2023-07-11T00:30:04.903915+0000","last_became_peered":"2023-07-11T00:30:04.903915+0000","last_unstale":"2023-07-11T00:30:11.119152+0000","last_undegraded":"2023-07-11T00:30:11.119152+0000","last_fullsized":"2023-07-11T00:30:11.119152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:50:41.550137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.060203+0000","last_change":"2023-07-11T00:30:05.907358+0000","last_active":"2023-07-11T00:30:11.060203+0000","last_peered":"2023-07-11T00:30:11.060203+0000","last_clean":"2023-07-11T00:30:11.060203+0000","last_became_active":"2023-07-11T00:30:05.907064+0000","last_became_peered":"2023-07-11T00:30:05.907064+0000","last_unstale":"2023-07-11T00:30:11.060203+0000","last_undegraded":"2023-07-11T00:30:11.060203+0000","last_fullsized":"2023-07-11T00:30:11.060203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:59:37.703330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057571+0000","last_change":"2023-07-11T00:30:10.067504+0000","last_active":"2023-07-11T00:30:11.057571+0000","last_peered":"2023-07-11T00:30:11.057571+0000","last_clean":"2023-07-11T00:30:11.057571+0000","last_became_active":"2023-07-11T00:30:10.067052+0000","last_became_peered":"2023-07-11T00:30:10.067052+0000","last_unstale":"2023-07-11T00:30:11.057571+0000","last_undegraded":"2023-07-11T00:30:11.057571+0000","last_fullsized":"2023-07-11T00:30:11.057571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:41:42.919668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058647+0000","last_change":"2023-07-11T00:30:04.911263+0000","last_active":"2023-07-11T00:30:11.058647+0000","last_peered":"2023-07-11T00:30:11.058647+0000","last_clean":"2023-07-11T00:30:11.058647+0000","last_became_active":"2023-07-11T00:30:04.910905+0000","last_became_peered":"2023-07-11T00:30:04.910905+0000","last_unstale":"2023-07-11T00:30:11.058647+0000","last_undegraded":"2023-07-11T00:30:11.058647+0000","last_fullsized":"2023-07-11T00:30:11.058647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:02:20.279699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119100+0000","last_change":"2023-07-11T00:30:05.915099+0000","last_active":"2023-07-11T00:30:11.119100+0000","last_peered":"2023-07-11T00:30:11.119100+0000","last_clean":"2023-07-11T00:30:11.119100+0000","last_became_active":"2023-07-11T00:30:05.914735+0000","last_became_peered":"2023-07-11T00:30:05.914735+0000","last_unstale":"2023-07-11T00:30:11.119100+0000","last_undegraded":"2023-07-11T00:30:11.119100+0000","last_fullsized":"2023-07-11T00:30:11.119100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:48:48.563856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115732+0000","last_change":"2023-07-11T00:30:10.074010+0000","last_active":"2023-07-11T00:30:11.115732+0000","last_peered":"2023-07-11T00:30:11.115732+0000","last_clean":"2023-07-11T00:30:11.115732+0000","last_became_active":"2023-07-11T00:30:10.073513+0000","last_became_peered":"2023-07-11T00:30:10.073513+0000","last_unstale":"2023-07-11T00:30:11.115732+0000","last_undegraded":"2023-07-11T00:30:11.115732+0000","last_fullsized":"2023-07-11T00:30:11.115732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:49:36.751025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117132+0000","last_change":"2023-07-11T00:30:04.908900+0000","last_active":"2023-07-11T00:30:11.117132+0000","last_peered":"2023-07-11T00:30:11.117132+0000","last_clean":"2023-07-11T00:30:11.117132+0000","last_became_active":"2023-07-11T00:30:04.908536+0000","last_became_peered":"2023-07-11T00:30:04.908536+0000","last_unstale":"2023-07-11T00:30:11.117132+0000","last_undegraded":"2023-07-11T00:30:11.117132+0000","last_fullsized":"2023-07-11T00:30:11.117132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:02:49.585404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116540+0000","last_change":"2023-07-11T00:30:05.908015+0000","last_active":"2023-07-11T00:30:11.116540+0000","last_peered":"2023-07-11T00:30:11.116540+0000","last_clean":"2023-07-11T00:30:11.116540+0000","last_became_active":"2023-07-11T00:30:05.907689+0000","last_became_peered":"2023-07-11T00:30:05.907689+0000","last_unstale":"2023-07-11T00:30:11.116540+0000","last_undegraded":"2023-07-11T00:30:11.116540+0000","last_fullsized":"2023-07-11T00:30:11.116540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:07:38.432308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118369+0000","last_change":"2023-07-11T00:30:10.073042+0000","last_active":"2023-07-11T00:30:11.118369+0000","last_peered":"2023-07-11T00:30:11.118369+0000","last_clean":"2023-07-11T00:30:11.118369+0000","last_became_active":"2023-07-11T00:30:10.072755+0000","last_became_peered":"2023-07-11T00:30:10.072755+0000","last_unstale":"2023-07-11T00:30:11.118369+0000","last_undegraded":"2023-07-11T00:30:11.118369+0000","last_fullsized":"2023-07-11T00:30:11.118369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:25:51.347028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116329+0000","last_change":"2023-07-11T00:30:04.906158+0000","last_active":"2023-07-11T00:30:11.116329+0000","last_peered":"2023-07-11T00:30:11.116329+0000","last_clean":"2023-07-11T00:30:11.116329+0000","last_became_active":"2023-07-11T00:30:04.905839+0000","last_became_peered":"2023-07-11T00:30:04.905839+0000","last_unstale":"2023-07-11T00:30:11.116329+0000","last_undegraded":"2023-07-11T00:30:11.116329+0000","last_fullsized":"2023-07-11T00:30:11.116329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:07:37.429600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118929+0000","last_change":"2023-07-11T00:30:05.912619+0000","last_active":"2023-07-11T00:30:11.118929+0000","last_peered":"2023-07-11T00:30:11.118929+0000","last_clean":"2023-07-11T00:30:11.118929+0000","last_became_active":"2023-07-11T00:30:05.912180+0000","last_became_peered":"2023-07-11T00:30:05.912180+0000","last_unstale":"2023-07-11T00:30:11.118929+0000","last_undegraded":"2023-07-11T00:30:11.118929+0000","last_fullsized":"2023-07-11T00:30:11.118929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:37:25.278906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119122+0000","last_change":"2023-07-11T00:30:10.078408+0000","last_active":"2023-07-11T00:30:11.119122+0000","last_peered":"2023-07-11T00:30:11.119122+0000","last_clean":"2023-07-11T00:30:11.119122+0000","last_became_active":"2023-07-11T00:30:10.077825+0000","last_became_peered":"2023-07-11T00:30:10.077825+0000","last_unstale":"2023-07-11T00:30:11.119122+0000","last_undegraded":"2023-07-11T00:30:11.119122+0000","last_fullsized":"2023-07-11T00:30:11.119122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:08:09.069684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'10","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:24.732814+0000","last_change":"2023-07-11T00:30:04.907926+0000","last_active":"2023-07-11T00:30:24.732814+0000","last_peered":"2023-07-11T00:30:24.732814+0000","last_clean":"2023-07-11T00:30:24.732814+0000","last_became_active":"2023-07-11T00:30:04.907603+0000","last_became_peered":"2023-07-11T00:30:04.907603+0000","last_unstale":"2023-07-11T00:30:24.732814+0000","last_undegraded":"2023-07-11T00:30:24.732814+0000","last_fullsized":"2023-07-11T00:30:24.732814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:35:34.386824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058562+0000","last_change":"2023-07-11T00:30:05.911101+0000","last_active":"2023-07-11T00:30:11.058562+0000","last_peered":"2023-07-11T00:30:11.058562+0000","last_clean":"2023-07-11T00:30:11.058562+0000","last_became_active":"2023-07-11T00:30:05.909430+0000","last_became_peered":"2023-07-11T00:30:05.909430+0000","last_unstale":"2023-07-11T00:30:11.058562+0000","last_undegraded":"2023-07-11T00:30:11.058562+0000","last_fullsized":"2023-07-11T00:30:11.058562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:07:38.432308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116172+0000","last_change":"2023-07-11T00:30:10.081247+0000","last_active":"2023-07-11T00:30:11.116172+0000","last_peered":"2023-07-11T00:30:11.116172+0000","last_clean":"2023-07-11T00:30:11.116172+0000","last_became_active":"2023-07-11T00:30:10.080796+0000","last_became_peered":"2023-07-11T00:30:10.080796+0000","last_unstale":"2023-07-11T00:30:11.116172+0000","last_undegraded":"2023-07-11T00:30:11.116172+0000","last_fullsized":"2023-07-11T00:30:11.116172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:05:35.713240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116102+0000","last_change":"2023-07-11T00:30:04.914310+0000","last_active":"2023-07-11T00:30:11.116102+0000","last_peered":"2023-07-11T00:30:11.116102+0000","last_clean":"2023-07-11T00:30:11.116102+0000","last_became_active":"2023-07-11T00:30:04.913972+0000","last_became_peered":"2023-07-11T00:30:04.913972+0000","last_unstale":"2023-07-11T00:30:11.116102+0000","last_undegraded":"2023-07-11T00:30:11.116102+0000","last_fullsized":"2023-07-11T00:30:11.116102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:51:41.689821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116886+0000","last_change":"2023-07-11T00:30:05.917159+0000","last_active":"2023-07-11T00:30:11.116886+0000","last_peered":"2023-07-11T00:30:11.116886+0000","last_clean":"2023-07-11T00:30:11.116886+0000","last_became_active":"2023-07-11T00:30:05.916849+0000","last_became_peered":"2023-07-11T00:30:05.916849+0000","last_unstale":"2023-07-11T00:30:11.116886+0000","last_undegraded":"2023-07-11T00:30:11.116886+0000","last_fullsized":"2023-07-11T00:30:11.116886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:09:26.818205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117167+0000","last_change":"2023-07-11T00:30:10.068364+0000","last_active":"2023-07-11T00:30:11.117167+0000","last_peered":"2023-07-11T00:30:11.117167+0000","last_clean":"2023-07-11T00:30:11.117167+0000","last_became_active":"2023-07-11T00:30:10.066791+0000","last_became_peered":"2023-07-11T00:30:10.066791+0000","last_unstale":"2023-07-11T00:30:11.117167+0000","last_undegraded":"2023-07-11T00:30:11.117167+0000","last_fullsized":"2023-07-11T00:30:11.117167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:23:00.417735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058112+0000","last_change":"2023-07-11T00:30:04.912548+0000","last_active":"2023-07-11T00:30:11.058112+0000","last_peered":"2023-07-11T00:30:11.058112+0000","last_clean":"2023-07-11T00:30:11.058112+0000","last_became_active":"2023-07-11T00:30:04.912228+0000","last_became_peered":"2023-07-11T00:30:04.912228+0000","last_unstale":"2023-07-11T00:30:11.058112+0000","last_undegraded":"2023-07-11T00:30:11.058112+0000","last_fullsized":"2023-07-11T00:30:11.058112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:00:49.062375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116712+0000","last_change":"2023-07-11T00:30:05.907171+0000","last_active":"2023-07-11T00:30:11.116712+0000","last_peered":"2023-07-11T00:30:11.116712+0000","last_clean":"2023-07-11T00:30:11.116712+0000","last_became_active":"2023-07-11T00:30:05.906862+0000","last_became_peered":"2023-07-11T00:30:05.906862+0000","last_unstale":"2023-07-11T00:30:11.116712+0000","last_undegraded":"2023-07-11T00:30:11.116712+0000","last_fullsized":"2023-07-11T00:30:11.116712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:31:07.229483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117405+0000","last_change":"2023-07-11T00:30:10.073795+0000","last_active":"2023-07-11T00:30:11.117405+0000","last_peered":"2023-07-11T00:30:11.117405+0000","last_clean":"2023-07-11T00:30:11.117405+0000","last_became_active":"2023-07-11T00:30:10.073437+0000","last_became_peered":"2023-07-11T00:30:10.073437+0000","last_unstale":"2023-07-11T00:30:11.117405+0000","last_undegraded":"2023-07-11T00:30:11.117405+0000","last_fullsized":"2023-07-11T00:30:11.117405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:35:39.542213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116190+0000","last_change":"2023-07-11T00:30:04.913583+0000","last_active":"2023-07-11T00:30:11.116190+0000","last_peered":"2023-07-11T00:30:11.116190+0000","last_clean":"2023-07-11T00:30:11.116190+0000","last_became_active":"2023-07-11T00:30:04.913217+0000","last_became_peered":"2023-07-11T00:30:04.913217+0000","last_unstale":"2023-07-11T00:30:11.116190+0000","last_undegraded":"2023-07-11T00:30:11.116190+0000","last_fullsized":"2023-07-11T00:30:11.116190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:02:49.585404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058792+0000","last_change":"2023-07-11T00:30:05.904820+0000","last_active":"2023-07-11T00:30:11.058792+0000","last_peered":"2023-07-11T00:30:11.058792+0000","last_clean":"2023-07-11T00:30:11.058792+0000","last_became_active":"2023-07-11T00:30:05.904502+0000","last_became_peered":"2023-07-11T00:30:05.904502+0000","last_unstale":"2023-07-11T00:30:11.058792+0000","last_undegraded":"2023-07-11T00:30:11.058792+0000","last_fullsized":"2023-07-11T00:30:11.058792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:49:32.598344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116686+0000","last_change":"2023-07-11T00:30:10.072170+0000","last_active":"2023-07-11T00:30:11.116686+0000","last_peered":"2023-07-11T00:30:11.116686+0000","last_clean":"2023-07-11T00:30:11.116686+0000","last_became_active":"2023-07-11T00:30:10.071764+0000","last_became_peered":"2023-07-11T00:30:10.071764+0000","last_unstale":"2023-07-11T00:30:11.116686+0000","last_undegraded":"2023-07-11T00:30:11.116686+0000","last_fullsized":"2023-07-11T00:30:11.116686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:19:04.827674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057318+0000","last_change":"2023-07-11T00:30:04.910630+0000","last_active":"2023-07-11T00:30:11.057318+0000","last_peered":"2023-07-11T00:30:11.057318+0000","last_clean":"2023-07-11T00:30:11.057318+0000","last_became_active":"2023-07-11T00:30:04.910150+0000","last_became_peered":"2023-07-11T00:30:04.910150+0000","last_unstale":"2023-07-11T00:30:11.057318+0000","last_undegraded":"2023-07-11T00:30:11.057318+0000","last_fullsized":"2023-07-11T00:30:11.057318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:14:23.274160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117798+0000","last_change":"2023-07-11T00:30:05.907668+0000","last_active":"2023-07-11T00:30:11.117798+0000","last_peered":"2023-07-11T00:30:11.117798+0000","last_clean":"2023-07-11T00:30:11.117798+0000","last_became_active":"2023-07-11T00:30:05.907397+0000","last_became_peered":"2023-07-11T00:30:05.907397+0000","last_unstale":"2023-07-11T00:30:11.117798+0000","last_undegraded":"2023-07-11T00:30:11.117798+0000","last_fullsized":"2023-07-11T00:30:11.117798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:50:20.512890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116720+0000","last_change":"2023-07-11T00:30:10.070415+0000","last_active":"2023-07-11T00:30:11.116720+0000","last_peered":"2023-07-11T00:30:11.116720+0000","last_clean":"2023-07-11T00:30:11.116720+0000","last_became_active":"2023-07-11T00:30:10.069906+0000","last_became_peered":"2023-07-11T00:30:10.069906+0000","last_unstale":"2023-07-11T00:30:11.116720+0000","last_undegraded":"2023-07-11T00:30:11.116720+0000","last_fullsized":"2023-07-11T00:30:11.116720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:57.996558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117336+0000","last_change":"2023-07-11T00:30:04.910800+0000","last_active":"2023-07-11T00:30:11.117336+0000","last_peered":"2023-07-11T00:30:11.117336+0000","last_clean":"2023-07-11T00:30:11.117336+0000","last_became_active":"2023-07-11T00:30:04.910453+0000","last_became_peered":"2023-07-11T00:30:04.910453+0000","last_unstale":"2023-07-11T00:30:11.117336+0000","last_undegraded":"2023-07-11T00:30:11.117336+0000","last_fullsized":"2023-07-11T00:30:11.117336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:38.027150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116206+0000","last_change":"2023-07-11T00:30:05.908168+0000","last_active":"2023-07-11T00:30:11.116206+0000","last_peered":"2023-07-11T00:30:11.116206+0000","last_clean":"2023-07-11T00:30:11.116206+0000","last_became_active":"2023-07-11T00:30:05.907884+0000","last_became_peered":"2023-07-11T00:30:05.907884+0000","last_unstale":"2023-07-11T00:30:11.116206+0000","last_undegraded":"2023-07-11T00:30:11.116206+0000","last_fullsized":"2023-07-11T00:30:11.116206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:00.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117337+0000","last_change":"2023-07-11T00:30:10.074726+0000","last_active":"2023-07-11T00:30:11.117337+0000","last_peered":"2023-07-11T00:30:11.117337+0000","last_clean":"2023-07-11T00:30:11.117337+0000","last_became_active":"2023-07-11T00:30:10.074281+0000","last_became_peered":"2023-07-11T00:30:10.074281+0000","last_unstale":"2023-07-11T00:30:11.117337+0000","last_undegraded":"2023-07-11T00:30:11.117337+0000","last_fullsized":"2023-07-11T00:30:11.117337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:50:00.072430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117143+0000","last_change":"2023-07-11T00:30:04.913460+0000","last_active":"2023-07-11T00:30:11.117143+0000","last_peered":"2023-07-11T00:30:11.117143+0000","last_clean":"2023-07-11T00:30:11.117143+0000","last_became_active":"2023-07-11T00:30:04.913131+0000","last_became_peered":"2023-07-11T00:30:04.913131+0000","last_unstale":"2023-07-11T00:30:11.117143+0000","last_undegraded":"2023-07-11T00:30:11.117143+0000","last_fullsized":"2023-07-11T00:30:11.117143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:09:25.815497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059267+0000","last_change":"2023-07-11T00:30:05.919028+0000","last_active":"2023-07-11T00:30:11.059267+0000","last_peered":"2023-07-11T00:30:11.059267+0000","last_clean":"2023-07-11T00:30:11.059267+0000","last_became_active":"2023-07-11T00:30:05.918727+0000","last_became_peered":"2023-07-11T00:30:05.918727+0000","last_unstale":"2023-07-11T00:30:11.059267+0000","last_undegraded":"2023-07-11T00:30:11.059267+0000","last_fullsized":"2023-07-11T00:30:11.059267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:22:04.654770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118792+0000","last_change":"2023-07-11T00:30:10.076696+0000","last_active":"2023-07-11T00:30:11.118792+0000","last_peered":"2023-07-11T00:30:11.118792+0000","last_clean":"2023-07-11T00:30:11.118792+0000","last_became_active":"2023-07-11T00:30:10.074714+0000","last_became_peered":"2023-07-11T00:30:10.074714+0000","last_unstale":"2023-07-11T00:30:11.118792+0000","last_undegraded":"2023-07-11T00:30:11.118792+0000","last_fullsized":"2023-07-11T00:30:11.118792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:53:44.062751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116091+0000","last_change":"2023-07-11T00:30:04.918352+0000","last_active":"2023-07-11T00:30:11.116091+0000","last_peered":"2023-07-11T00:30:11.116091+0000","last_clean":"2023-07-11T00:30:11.116091+0000","last_became_active":"2023-07-11T00:30:04.918037+0000","last_became_peered":"2023-07-11T00:30:04.918037+0000","last_unstale":"2023-07-11T00:30:11.116091+0000","last_undegraded":"2023-07-11T00:30:11.116091+0000","last_fullsized":"2023-07-11T00:30:11.116091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:33:45.867117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057432+0000","last_change":"2023-07-11T00:30:05.919328+0000","last_active":"2023-07-11T00:30:11.057432+0000","last_peered":"2023-07-11T00:30:11.057432+0000","last_clean":"2023-07-11T00:30:11.057432+0000","last_became_active":"2023-07-11T00:30:05.919010+0000","last_became_peered":"2023-07-11T00:30:05.919010+0000","last_unstale":"2023-07-11T00:30:11.057432+0000","last_undegraded":"2023-07-11T00:30:11.057432+0000","last_fullsized":"2023-07-11T00:30:11.057432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:11:39.510221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116515+0000","last_change":"2023-07-11T00:30:10.061029+0000","last_active":"2023-07-11T00:30:11.116515+0000","last_peered":"2023-07-11T00:30:11.116515+0000","last_clean":"2023-07-11T00:30:11.116515+0000","last_became_active":"2023-07-11T00:30:10.060602+0000","last_became_peered":"2023-07-11T00:30:10.060602+0000","last_unstale":"2023-07-11T00:30:11.116515+0000","last_undegraded":"2023-07-11T00:30:11.116515+0000","last_fullsized":"2023-07-11T00:30:11.116515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:09:45.109946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116660+0000","last_change":"2023-07-11T00:30:04.907017+0000","last_active":"2023-07-11T00:30:11.116660+0000","last_peered":"2023-07-11T00:30:11.116660+0000","last_clean":"2023-07-11T00:30:11.116660+0000","last_became_active":"2023-07-11T00:30:04.906643+0000","last_became_peered":"2023-07-11T00:30:04.906643+0000","last_unstale":"2023-07-11T00:30:11.116660+0000","last_undegraded":"2023-07-11T00:30:11.116660+0000","last_fullsized":"2023-07-11T00:30:11.116660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:59:35.767800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058314+0000","last_change":"2023-07-11T00:30:05.917921+0000","last_active":"2023-07-11T00:30:11.058314+0000","last_peered":"2023-07-11T00:30:11.058314+0000","last_clean":"2023-07-11T00:30:11.058314+0000","last_became_active":"2023-07-11T00:30:05.917626+0000","last_became_peered":"2023-07-11T00:30:05.917626+0000","last_unstale":"2023-07-11T00:30:11.058314+0000","last_undegraded":"2023-07-11T00:30:11.058314+0000","last_fullsized":"2023-07-11T00:30:11.058314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:56:13.450429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117705+0000","last_change":"2023-07-11T00:30:10.074654+0000","last_active":"2023-07-11T00:30:11.117705+0000","last_peered":"2023-07-11T00:30:11.117705+0000","last_clean":"2023-07-11T00:30:11.117705+0000","last_became_active":"2023-07-11T00:30:10.071607+0000","last_became_peered":"2023-07-11T00:30:10.071607+0000","last_unstale":"2023-07-11T00:30:11.117705+0000","last_undegraded":"2023-07-11T00:30:11.117705+0000","last_fullsized":"2023-07-11T00:30:11.117705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:03:08.156374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118186+0000","last_change":"2023-07-11T00:30:04.909409+0000","last_active":"2023-07-11T00:30:11.118186+0000","last_peered":"2023-07-11T00:30:11.118186+0000","last_clean":"2023-07-11T00:30:11.118186+0000","last_became_active":"2023-07-11T00:30:04.909108+0000","last_became_peered":"2023-07-11T00:30:04.909108+0000","last_unstale":"2023-07-11T00:30:11.118186+0000","last_undegraded":"2023-07-11T00:30:11.118186+0000","last_fullsized":"2023-07-11T00:30:11.118186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:22:03.652063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058847+0000","last_change":"2023-07-11T00:30:05.915428+0000","last_active":"2023-07-11T00:30:11.058847+0000","last_peered":"2023-07-11T00:30:11.058847+0000","last_clean":"2023-07-11T00:30:11.058847+0000","last_became_active":"2023-07-11T00:30:05.914309+0000","last_became_peered":"2023-07-11T00:30:05.914309+0000","last_unstale":"2023-07-11T00:30:11.058847+0000","last_undegraded":"2023-07-11T00:30:11.058847+0000","last_fullsized":"2023-07-11T00:30:11.058847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:39.029858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117114+0000","last_change":"2023-07-11T00:30:10.070740+0000","last_active":"2023-07-11T00:30:11.117114+0000","last_peered":"2023-07-11T00:30:11.117114+0000","last_clean":"2023-07-11T00:30:11.117114+0000","last_became_active":"2023-07-11T00:30:10.070140+0000","last_became_peered":"2023-07-11T00:30:10.070140+0000","last_unstale":"2023-07-11T00:30:11.117114+0000","last_undegraded":"2023-07-11T00:30:11.117114+0000","last_fullsized":"2023-07-11T00:30:11.117114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:07:59.464538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057584+0000","last_change":"2023-07-11T00:30:04.912890+0000","last_active":"2023-07-11T00:30:11.057584+0000","last_peered":"2023-07-11T00:30:11.057584+0000","last_clean":"2023-07-11T00:30:11.057584+0000","last_became_active":"2023-07-11T00:30:04.912603+0000","last_became_peered":"2023-07-11T00:30:04.912603+0000","last_unstale":"2023-07-11T00:30:11.057584+0000","last_undegraded":"2023-07-11T00:30:11.057584+0000","last_fullsized":"2023-07-11T00:30:11.057584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:33:16.183321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058428+0000","last_change":"2023-07-11T00:30:05.914876+0000","last_active":"2023-07-11T00:30:11.058428+0000","last_peered":"2023-07-11T00:30:11.058428+0000","last_clean":"2023-07-11T00:30:11.058428+0000","last_became_active":"2023-07-11T00:30:05.914556+0000","last_became_peered":"2023-07-11T00:30:05.914556+0000","last_unstale":"2023-07-11T00:30:11.058428+0000","last_undegraded":"2023-07-11T00:30:11.058428+0000","last_fullsized":"2023-07-11T00:30:11.058428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:01:38.063704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117150+0000","last_change":"2023-07-11T00:30:10.070879+0000","last_active":"2023-07-11T00:30:11.117150+0000","last_peered":"2023-07-11T00:30:11.117150+0000","last_clean":"2023-07-11T00:30:11.117150+0000","last_became_active":"2023-07-11T00:30:10.070373+0000","last_became_peered":"2023-07-11T00:30:10.070373+0000","last_unstale":"2023-07-11T00:30:11.117150+0000","last_undegraded":"2023-07-11T00:30:11.117150+0000","last_fullsized":"2023-07-11T00:30:11.117150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:51:46.845210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058991+0000","last_change":"2023-07-11T00:30:04.914965+0000","last_active":"2023-07-11T00:30:11.058991+0000","last_peered":"2023-07-11T00:30:11.058991+0000","last_clean":"2023-07-11T00:30:11.058991+0000","last_became_active":"2023-07-11T00:30:04.914499+0000","last_became_peered":"2023-07-11T00:30:04.914499+0000","last_unstale":"2023-07-11T00:30:11.058991+0000","last_undegraded":"2023-07-11T00:30:11.058991+0000","last_fullsized":"2023-07-11T00:30:11.058991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:29:02.495865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059980+0000","last_change":"2023-07-11T00:30:05.910772+0000","last_active":"2023-07-11T00:30:11.059980+0000","last_peered":"2023-07-11T00:30:11.059980+0000","last_clean":"2023-07-11T00:30:11.059980+0000","last_became_active":"2023-07-11T00:30:05.909373+0000","last_became_peered":"2023-07-11T00:30:05.909373+0000","last_unstale":"2023-07-11T00:30:11.059980+0000","last_undegraded":"2023-07-11T00:30:11.059980+0000","last_fullsized":"2023-07-11T00:30:11.059980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:39:38.348755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059752+0000","last_change":"2023-07-11T00:30:10.080512+0000","last_active":"2023-07-11T00:30:11.059752+0000","last_peered":"2023-07-11T00:30:11.059752+0000","last_clean":"2023-07-11T00:30:11.059752+0000","last_became_active":"2023-07-11T00:30:10.080095+0000","last_became_peered":"2023-07-11T00:30:10.080095+0000","last_unstale":"2023-07-11T00:30:11.059752+0000","last_undegraded":"2023-07-11T00:30:11.059752+0000","last_fullsized":"2023-07-11T00:30:11.059752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:50:46.705526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119006+0000","last_change":"2023-07-11T00:30:04.901845+0000","last_active":"2023-07-11T00:30:11.119006+0000","last_peered":"2023-07-11T00:30:11.119006+0000","last_clean":"2023-07-11T00:30:11.119006+0000","last_became_active":"2023-07-11T00:30:04.901568+0000","last_became_peered":"2023-07-11T00:30:04.901568+0000","last_unstale":"2023-07-11T00:30:11.119006+0000","last_undegraded":"2023-07-11T00:30:11.119006+0000","last_fullsized":"2023-07-11T00:30:11.119006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:48:35.160743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118215+0000","last_change":"2023-07-11T00:30:05.921748+0000","last_active":"2023-07-11T00:30:11.118215+0000","last_peered":"2023-07-11T00:30:11.118215+0000","last_clean":"2023-07-11T00:30:11.118215+0000","last_became_active":"2023-07-11T00:30:05.921455+0000","last_became_peered":"2023-07-11T00:30:05.921455+0000","last_unstale":"2023-07-11T00:30:11.118215+0000","last_undegraded":"2023-07-11T00:30:11.118215+0000","last_fullsized":"2023-07-11T00:30:11.118215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:49:28.388344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059460+0000","last_change":"2023-07-11T00:30:10.067600+0000","last_active":"2023-07-11T00:30:11.059460+0000","last_peered":"2023-07-11T00:30:11.059460+0000","last_clean":"2023-07-11T00:30:11.059460+0000","last_became_active":"2023-07-11T00:30:10.067214+0000","last_became_peered":"2023-07-11T00:30:10.067214+0000","last_unstale":"2023-07-11T00:30:11.059460+0000","last_undegraded":"2023-07-11T00:30:11.059460+0000","last_fullsized":"2023-07-11T00:30:11.059460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:16:23.912787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117616+0000","last_change":"2023-07-11T00:30:04.904613+0000","last_active":"2023-07-11T00:30:11.117616+0000","last_peered":"2023-07-11T00:30:11.117616+0000","last_clean":"2023-07-11T00:30:11.117616+0000","last_became_active":"2023-07-11T00:30:04.904312+0000","last_became_peered":"2023-07-11T00:30:04.904312+0000","last_unstale":"2023-07-11T00:30:11.117616+0000","last_undegraded":"2023-07-11T00:30:11.117616+0000","last_fullsized":"2023-07-11T00:30:11.117616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:29:02.495865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058655+0000","last_change":"2023-07-11T00:29:59.627086+0000","last_active":"2023-07-11T00:30:11.058655+0000","last_peered":"2023-07-11T00:30:11.058655+0000","last_clean":"2023-07-11T00:30:11.058655+0000","last_became_active":"2023-07-11T00:29:59.626687+0000","last_became_peered":"2023-07-11T00:29:59.626687+0000","last_unstale":"2023-07-11T00:30:11.058655+0000","last_undegraded":"2023-07-11T00:30:11.058655+0000","last_fullsized":"2023-07-11T00:30:11.058655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:31:04.583322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118938+0000","last_change":"2023-07-11T00:30:05.906700+0000","last_active":"2023-07-11T00:30:11.118938+0000","last_peered":"2023-07-11T00:30:11.118938+0000","last_clean":"2023-07-11T00:30:11.118938+0000","last_became_active":"2023-07-11T00:30:05.906333+0000","last_became_peered":"2023-07-11T00:30:05.906333+0000","last_unstale":"2023-07-11T00:30:11.118938+0000","last_undegraded":"2023-07-11T00:30:11.118938+0000","last_fullsized":"2023-07-11T00:30:11.118938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:12:42.514924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118845+0000","last_change":"2023-07-11T00:30:10.068326+0000","last_active":"2023-07-11T00:30:11.118845+0000","last_peered":"2023-07-11T00:30:11.118845+0000","last_clean":"2023-07-11T00:30:11.118845+0000","last_became_active":"2023-07-11T00:30:10.067893+0000","last_became_peered":"2023-07-11T00:30:10.067893+0000","last_unstale":"2023-07-11T00:30:11.118845+0000","last_undegraded":"2023-07-11T00:30:11.118845+0000","last_fullsized":"2023-07-11T00:30:11.118845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:16:23.912787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116953+0000","last_change":"2023-07-11T00:29:59.589317+0000","last_active":"2023-07-11T00:30:11.116953+0000","last_peered":"2023-07-11T00:30:11.116953+0000","last_clean":"2023-07-11T00:30:11.116953+0000","last_became_active":"2023-07-11T00:29:59.588926+0000","last_became_peered":"2023-07-11T00:29:59.588926+0000","last_unstale":"2023-07-11T00:30:11.116953+0000","last_undegraded":"2023-07-11T00:30:11.116953+0000","last_fullsized":"2023-07-11T00:30:11.116953+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:32.725207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058442+0000","last_change":"2023-07-11T00:30:04.907209+0000","last_active":"2023-07-11T00:30:11.058442+0000","last_peered":"2023-07-11T00:30:11.058442+0000","last_clean":"2023-07-11T00:30:11.058442+0000","last_became_active":"2023-07-11T00:30:04.906867+0000","last_became_peered":"2023-07-11T00:30:04.906867+0000","last_unstale":"2023-07-11T00:30:11.058442+0000","last_undegraded":"2023-07-11T00:30:11.058442+0000","last_fullsized":"2023-07-11T00:30:11.058442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:23:05.032572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059163+0000","last_change":"2023-07-11T00:30:05.917328+0000","last_active":"2023-07-11T00:30:11.059163+0000","last_peered":"2023-07-11T00:30:11.059163+0000","last_clean":"2023-07-11T00:30:11.059163+0000","last_became_active":"2023-07-11T00:30:05.916946+0000","last_became_peered":"2023-07-11T00:30:05.916946+0000","last_unstale":"2023-07-11T00:30:11.059163+0000","last_undegraded":"2023-07-11T00:30:11.059163+0000","last_fullsized":"2023-07-11T00:30:11.059163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:13:25.822286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117049+0000","last_change":"2023-07-11T00:30:10.082010+0000","last_active":"2023-07-11T00:30:11.117049+0000","last_peered":"2023-07-11T00:30:11.117049+0000","last_clean":"2023-07-11T00:30:11.117049+0000","last_became_active":"2023-07-11T00:30:10.081582+0000","last_became_peered":"2023-07-11T00:30:10.081582+0000","last_unstale":"2023-07-11T00:30:11.117049+0000","last_undegraded":"2023-07-11T00:30:11.117049+0000","last_fullsized":"2023-07-11T00:30:11.117049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:33:51.022506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118518+0000","last_change":"2023-07-11T00:29:59.585672+0000","last_active":"2023-07-11T00:30:11.118518+0000","last_peered":"2023-07-11T00:30:11.118518+0000","last_clean":"2023-07-11T00:30:11.118518+0000","last_became_active":"2023-07-11T00:29:59.585405+0000","last_became_peered":"2023-07-11T00:29:59.585405+0000","last_unstale":"2023-07-11T00:30:11.118518+0000","last_undegraded":"2023-07-11T00:30:11.118518+0000","last_fullsized":"2023-07-11T00:30:11.118518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:16:53.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115934+0000","last_change":"2023-07-11T00:29:59.589132+0000","last_active":"2023-07-11T00:30:11.115934+0000","last_peered":"2023-07-11T00:30:11.115934+0000","last_clean":"2023-07-11T00:30:11.115934+0000","last_became_active":"2023-07-11T00:29:59.588293+0000","last_became_peered":"2023-07-11T00:29:59.588293+0000","last_unstale":"2023-07-11T00:30:11.115934+0000","last_undegraded":"2023-07-11T00:30:11.115934+0000","last_fullsized":"2023-07-11T00:30:11.115934+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:36:10.586940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057956+0000","last_change":"2023-07-11T00:30:04.913946+0000","last_active":"2023-07-11T00:30:11.057956+0000","last_peered":"2023-07-11T00:30:11.057956+0000","last_clean":"2023-07-11T00:30:11.057956+0000","last_became_active":"2023-07-11T00:30:04.913711+0000","last_became_peered":"2023-07-11T00:30:04.913711+0000","last_unstale":"2023-07-11T00:30:11.057956+0000","last_undegraded":"2023-07-11T00:30:11.057956+0000","last_fullsized":"2023-07-11T00:30:11.057956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:59:36.700622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058778+0000","last_change":"2023-07-11T00:30:05.918327+0000","last_active":"2023-07-11T00:30:11.058778+0000","last_peered":"2023-07-11T00:30:11.058778+0000","last_clean":"2023-07-11T00:30:11.058778+0000","last_became_active":"2023-07-11T00:30:05.917953+0000","last_became_peered":"2023-07-11T00:30:05.917953+0000","last_unstale":"2023-07-11T00:30:11.058778+0000","last_undegraded":"2023-07-11T00:30:11.058778+0000","last_fullsized":"2023-07-11T00:30:11.058778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:44:29.464142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116829+0000","last_change":"2023-07-11T00:30:10.073421+0000","last_active":"2023-07-11T00:30:11.116829+0000","last_peered":"2023-07-11T00:30:11.116829+0000","last_clean":"2023-07-11T00:30:11.116829+0000","last_became_active":"2023-07-11T00:30:10.073124+0000","last_became_peered":"2023-07-11T00:30:10.073124+0000","last_unstale":"2023-07-11T00:30:11.116829+0000","last_undegraded":"2023-07-11T00:30:11.116829+0000","last_fullsized":"2023-07-11T00:30:11.116829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:42:54.748014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115890+0000","last_change":"2023-07-11T00:29:59.978997+0000","last_active":"2023-07-11T00:30:11.115890+0000","last_peered":"2023-07-11T00:30:11.115890+0000","last_clean":"2023-07-11T00:30:11.115890+0000","last_became_active":"2023-07-11T00:29:59.978716+0000","last_became_peered":"2023-07-11T00:29:59.978716+0000","last_unstale":"2023-07-11T00:30:11.115890+0000","last_undegraded":"2023-07-11T00:30:11.115890+0000","last_fullsized":"2023-07-11T00:30:11.115890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:43:49.863623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116128+0000","last_change":"2023-07-11T00:30:04.910937+0000","last_active":"2023-07-11T00:30:11.116128+0000","last_peered":"2023-07-11T00:30:11.116128+0000","last_clean":"2023-07-11T00:30:11.116128+0000","last_became_active":"2023-07-11T00:30:04.910458+0000","last_became_peered":"2023-07-11T00:30:04.910458+0000","last_unstale":"2023-07-11T00:30:11.116128+0000","last_undegraded":"2023-07-11T00:30:11.116128+0000","last_fullsized":"2023-07-11T00:30:11.116128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:59:36.700622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118101+0000","last_change":"2023-07-11T00:30:05.914883+0000","last_active":"2023-07-11T00:30:11.118101+0000","last_peered":"2023-07-11T00:30:11.118101+0000","last_clean":"2023-07-11T00:30:11.118101+0000","last_became_active":"2023-07-11T00:30:05.914349+0000","last_became_peered":"2023-07-11T00:30:05.914349+0000","last_unstale":"2023-07-11T00:30:11.118101+0000","last_undegraded":"2023-07-11T00:30:11.118101+0000","last_fullsized":"2023-07-11T00:30:11.118101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:32:58.816922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117060+0000","last_change":"2023-07-11T00:30:10.074427+0000","last_active":"2023-07-11T00:30:11.117060+0000","last_peered":"2023-07-11T00:30:11.117060+0000","last_clean":"2023-07-11T00:30:11.117060+0000","last_became_active":"2023-07-11T00:30:10.073876+0000","last_became_peered":"2023-07-11T00:30:10.073876+0000","last_unstale":"2023-07-11T00:30:11.117060+0000","last_undegraded":"2023-07-11T00:30:11.117060+0000","last_fullsized":"2023-07-11T00:30:11.117060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:31:15.040654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115771+0000","last_change":"2023-07-11T00:29:59.978976+0000","last_active":"2023-07-11T00:30:11.115771+0000","last_peered":"2023-07-11T00:30:11.115771+0000","last_clean":"2023-07-11T00:30:11.115771+0000","last_became_active":"2023-07-11T00:29:59.978678+0000","last_became_peered":"2023-07-11T00:29:59.978678+0000","last_unstale":"2023-07-11T00:30:11.115771+0000","last_undegraded":"2023-07-11T00:30:11.115771+0000","last_fullsized":"2023-07-11T00:30:11.115771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:54.370342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118862+0000","last_change":"2023-07-11T00:30:04.909677+0000","last_active":"2023-07-11T00:30:11.118862+0000","last_peered":"2023-07-11T00:30:11.118862+0000","last_clean":"2023-07-11T00:30:11.118862+0000","last_became_active":"2023-07-11T00:30:04.909389+0000","last_became_peered":"2023-07-11T00:30:04.909389+0000","last_unstale":"2023-07-11T00:30:11.118862+0000","last_undegraded":"2023-07-11T00:30:11.118862+0000","last_fullsized":"2023-07-11T00:30:11.118862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:41:27.161304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058572+0000","last_change":"2023-07-11T00:30:05.921943+0000","last_active":"2023-07-11T00:30:11.058572+0000","last_peered":"2023-07-11T00:30:11.058572+0000","last_clean":"2023-07-11T00:30:11.058572+0000","last_became_active":"2023-07-11T00:30:05.921610+0000","last_became_peered":"2023-07-11T00:30:05.921610+0000","last_unstale":"2023-07-11T00:30:11.058572+0000","last_undegraded":"2023-07-11T00:30:11.058572+0000","last_fullsized":"2023-07-11T00:30:11.058572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:34:52.723278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058455+0000","last_change":"2023-07-11T00:30:10.073091+0000","last_active":"2023-07-11T00:30:11.058455+0000","last_peered":"2023-07-11T00:30:11.058455+0000","last_clean":"2023-07-11T00:30:11.058455+0000","last_became_active":"2023-07-11T00:30:10.072625+0000","last_became_peered":"2023-07-11T00:30:10.072625+0000","last_unstale":"2023-07-11T00:30:11.058455+0000","last_undegraded":"2023-07-11T00:30:11.058455+0000","last_fullsized":"2023-07-11T00:30:11.058455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:56:33.500478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116185+0000","last_change":"2023-07-11T00:29:59.979163+0000","last_active":"2023-07-11T00:30:11.116185+0000","last_peered":"2023-07-11T00:30:11.116185+0000","last_clean":"2023-07-11T00:30:11.116185+0000","last_became_active":"2023-07-11T00:29:59.978751+0000","last_became_peered":"2023-07-11T00:29:59.978751+0000","last_unstale":"2023-07-11T00:30:11.116185+0000","last_undegraded":"2023-07-11T00:30:11.116185+0000","last_fullsized":"2023-07-11T00:30:11.116185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:32:52.512271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058712+0000","last_change":"2023-07-11T00:30:04.909467+0000","last_active":"2023-07-11T00:30:11.058712+0000","last_peered":"2023-07-11T00:30:11.058712+0000","last_clean":"2023-07-11T00:30:11.058712+0000","last_became_active":"2023-07-11T00:30:04.908512+0000","last_became_peered":"2023-07-11T00:30:04.908512+0000","last_unstale":"2023-07-11T00:30:11.058712+0000","last_undegraded":"2023-07-11T00:30:11.058712+0000","last_fullsized":"2023-07-11T00:30:11.058712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:09:25.815497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116448+0000","last_change":"2023-07-11T00:30:05.915403+0000","last_active":"2023-07-11T00:30:11.116448+0000","last_peered":"2023-07-11T00:30:11.116448+0000","last_clean":"2023-07-11T00:30:11.116448+0000","last_became_active":"2023-07-11T00:30:05.915006+0000","last_became_peered":"2023-07-11T00:30:05.915006+0000","last_unstale":"2023-07-11T00:30:11.116448+0000","last_undegraded":"2023-07-11T00:30:11.116448+0000","last_fullsized":"2023-07-11T00:30:11.116448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:00:50.065083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057855+0000","last_change":"2023-07-11T00:30:10.074777+0000","last_active":"2023-07-11T00:30:11.057855+0000","last_peered":"2023-07-11T00:30:11.057855+0000","last_clean":"2023-07-11T00:30:11.057855+0000","last_became_active":"2023-07-11T00:30:10.073612+0000","last_became_peered":"2023-07-11T00:30:10.073612+0000","last_unstale":"2023-07-11T00:30:11.057855+0000","last_undegraded":"2023-07-11T00:30:11.057855+0000","last_fullsized":"2023-07-11T00:30:11.057855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:37:55.556018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058461+0000","last_change":"2023-07-11T00:29:59.978981+0000","last_active":"2023-07-11T00:30:11.058461+0000","last_peered":"2023-07-11T00:30:11.058461+0000","last_clean":"2023-07-11T00:30:11.058461+0000","last_became_active":"2023-07-11T00:29:59.978633+0000","last_became_peered":"2023-07-11T00:29:59.978633+0000","last_unstale":"2023-07-11T00:30:11.058461+0000","last_undegraded":"2023-07-11T00:30:11.058461+0000","last_fullsized":"2023-07-11T00:30:11.058461+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:39:53.945627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116711+0000","last_change":"2023-07-11T00:30:04.915315+0000","last_active":"2023-07-11T00:30:11.116711+0000","last_peered":"2023-07-11T00:30:11.116711+0000","last_clean":"2023-07-11T00:30:11.116711+0000","last_became_active":"2023-07-11T00:30:04.914975+0000","last_became_peered":"2023-07-11T00:30:04.914975+0000","last_unstale":"2023-07-11T00:30:11.116711+0000","last_undegraded":"2023-07-11T00:30:11.116711+0000","last_fullsized":"2023-07-11T00:30:11.116711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:56:28.345089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058475+0000","last_change":"2023-07-11T00:30:05.911135+0000","last_active":"2023-07-11T00:30:11.058475+0000","last_peered":"2023-07-11T00:30:11.058475+0000","last_clean":"2023-07-11T00:30:11.058475+0000","last_became_active":"2023-07-11T00:30:05.910827+0000","last_became_peered":"2023-07-11T00:30:05.910827+0000","last_unstale":"2023-07-11T00:30:11.058475+0000","last_undegraded":"2023-07-11T00:30:11.058475+0000","last_fullsized":"2023-07-11T00:30:11.058475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:32:58.816922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058181+0000","last_change":"2023-07-11T00:30:10.083291+0000","last_active":"2023-07-11T00:30:11.058181+0000","last_peered":"2023-07-11T00:30:11.058181+0000","last_clean":"2023-07-11T00:30:11.058181+0000","last_became_active":"2023-07-11T00:30:10.082895+0000","last_became_peered":"2023-07-11T00:30:10.082895+0000","last_unstale":"2023-07-11T00:30:11.058181+0000","last_undegraded":"2023-07-11T00:30:11.058181+0000","last_fullsized":"2023-07-11T00:30:11.058181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:21:54.408864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.060161+0000","last_change":"2023-07-11T00:29:59.585652+0000","last_active":"2023-07-11T00:30:11.060161+0000","last_peered":"2023-07-11T00:30:11.060161+0000","last_clean":"2023-07-11T00:30:11.060161+0000","last_became_active":"2023-07-11T00:29:59.585316+0000","last_became_peered":"2023-07-11T00:29:59.585316+0000","last_unstale":"2023-07-11T00:30:11.060161+0000","last_undegraded":"2023-07-11T00:30:11.060161+0000","last_fullsized":"2023-07-11T00:30:11.060161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:14:02.980670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116535+0000","last_change":"2023-07-11T00:30:04.908230+0000","last_active":"2023-07-11T00:30:11.116535+0000","last_peered":"2023-07-11T00:30:11.116535+0000","last_clean":"2023-07-11T00:30:11.116535+0000","last_became_active":"2023-07-11T00:30:04.907876+0000","last_became_peered":"2023-07-11T00:30:04.907876+0000","last_unstale":"2023-07-11T00:30:11.116535+0000","last_undegraded":"2023-07-11T00:30:11.116535+0000","last_fullsized":"2023-07-11T00:30:11.116535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:44:28.461434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118728+0000","last_change":"2023-07-11T00:30:05.909462+0000","last_active":"2023-07-11T00:30:11.118728+0000","last_peered":"2023-07-11T00:30:11.118728+0000","last_clean":"2023-07-11T00:30:11.118728+0000","last_became_active":"2023-07-11T00:30:05.909171+0000","last_became_peered":"2023-07-11T00:30:05.909171+0000","last_unstale":"2023-07-11T00:30:11.118728+0000","last_undegraded":"2023-07-11T00:30:11.118728+0000","last_fullsized":"2023-07-11T00:30:11.118728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:02:21.282407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117001+0000","last_change":"2023-07-11T00:30:10.071266+0000","last_active":"2023-07-11T00:30:11.117001+0000","last_peered":"2023-07-11T00:30:11.117001+0000","last_clean":"2023-07-11T00:30:11.117001+0000","last_became_active":"2023-07-11T00:30:10.070503+0000","last_became_peered":"2023-07-11T00:30:10.070503+0000","last_unstale":"2023-07-11T00:30:11.117001+0000","last_undegraded":"2023-07-11T00:30:11.117001+0000","last_fullsized":"2023-07-11T00:30:11.117001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:57:33.279600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058426+0000","last_change":"2023-07-11T00:30:04.913993+0000","last_active":"2023-07-11T00:30:11.058426+0000","last_peered":"2023-07-11T00:30:11.058426+0000","last_clean":"2023-07-11T00:30:11.058426+0000","last_became_active":"2023-07-11T00:30:04.913642+0000","last_became_peered":"2023-07-11T00:30:04.913642+0000","last_unstale":"2023-07-11T00:30:11.058426+0000","last_undegraded":"2023-07-11T00:30:11.058426+0000","last_fullsized":"2023-07-11T00:30:11.058426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:57:28.124211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118217+0000","last_change":"2023-07-11T00:30:05.919099+0000","last_active":"2023-07-11T00:30:11.118217+0000","last_peered":"2023-07-11T00:30:11.118217+0000","last_clean":"2023-07-11T00:30:11.118217+0000","last_became_active":"2023-07-11T00:30:05.918814+0000","last_became_peered":"2023-07-11T00:30:05.918814+0000","last_unstale":"2023-07-11T00:30:11.118217+0000","last_undegraded":"2023-07-11T00:30:11.118217+0000","last_fullsized":"2023-07-11T00:30:11.118217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:30:43.008997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116071+0000","last_change":"2023-07-11T00:30:10.069011+0000","last_active":"2023-07-11T00:30:11.116071+0000","last_peered":"2023-07-11T00:30:11.116071+0000","last_clean":"2023-07-11T00:30:11.116071+0000","last_became_active":"2023-07-11T00:30:10.068592+0000","last_became_peered":"2023-07-11T00:30:10.068592+0000","last_unstale":"2023-07-11T00:30:11.116071+0000","last_undegraded":"2023-07-11T00:30:11.116071+0000","last_fullsized":"2023-07-11T00:30:11.116071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:59:40.923189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116511+0000","last_change":"2023-07-11T00:30:04.915144+0000","last_active":"2023-07-11T00:30:11.116511+0000","last_peered":"2023-07-11T00:30:11.116511+0000","last_clean":"2023-07-11T00:30:11.116511+0000","last_became_active":"2023-07-11T00:30:04.914857+0000","last_became_peered":"2023-07-11T00:30:04.914857+0000","last_unstale":"2023-07-11T00:30:11.116511+0000","last_undegraded":"2023-07-11T00:30:11.116511+0000","last_fullsized":"2023-07-11T00:30:11.116511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:08:03.914295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058885+0000","last_change":"2023-07-11T00:30:05.915668+0000","last_active":"2023-07-11T00:30:11.058885+0000","last_peered":"2023-07-11T00:30:11.058885+0000","last_clean":"2023-07-11T00:30:11.058885+0000","last_became_active":"2023-07-11T00:30:05.915103+0000","last_became_peered":"2023-07-11T00:30:05.915103+0000","last_unstale":"2023-07-11T00:30:11.058885+0000","last_undegraded":"2023-07-11T00:30:11.058885+0000","last_fullsized":"2023-07-11T00:30:11.058885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:22:56.265053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116786+0000","last_change":"2023-07-11T00:30:10.081391+0000","last_active":"2023-07-11T00:30:11.116786+0000","last_peered":"2023-07-11T00:30:11.116786+0000","last_clean":"2023-07-11T00:30:11.116786+0000","last_became_active":"2023-07-11T00:30:10.080979+0000","last_became_peered":"2023-07-11T00:30:10.080979+0000","last_unstale":"2023-07-11T00:30:11.116786+0000","last_undegraded":"2023-07-11T00:30:11.116786+0000","last_fullsized":"2023-07-11T00:30:11.116786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:49:32.541025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116347+0000","last_change":"2023-07-11T00:30:04.913406+0000","last_active":"2023-07-11T00:30:11.116347+0000","last_peered":"2023-07-11T00:30:11.116347+0000","last_clean":"2023-07-11T00:30:11.116347+0000","last_became_active":"2023-07-11T00:30:04.913025+0000","last_became_peered":"2023-07-11T00:30:04.913025+0000","last_unstale":"2023-07-11T00:30:11.116347+0000","last_undegraded":"2023-07-11T00:30:11.116347+0000","last_fullsized":"2023-07-11T00:30:11.116347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:37:24.276199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059362+0000","last_change":"2023-07-11T00:30:05.916740+0000","last_active":"2023-07-11T00:30:11.059362+0000","last_peered":"2023-07-11T00:30:11.059362+0000","last_clean":"2023-07-11T00:30:11.059362+0000","last_became_active":"2023-07-11T00:30:05.913008+0000","last_became_peered":"2023-07-11T00:30:05.913008+0000","last_unstale":"2023-07-11T00:30:11.059362+0000","last_undegraded":"2023-07-11T00:30:11.059362+0000","last_fullsized":"2023-07-11T00:30:11.059362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:25:47.194347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058162+0000","last_change":"2023-07-11T00:30:10.066428+0000","last_active":"2023-07-11T00:30:11.058162+0000","last_peered":"2023-07-11T00:30:11.058162+0000","last_clean":"2023-07-11T00:30:11.058162+0000","last_became_active":"2023-07-11T00:30:10.065932+0000","last_became_peered":"2023-07-11T00:30:10.065932+0000","last_unstale":"2023-07-11T00:30:11.058162+0000","last_undegraded":"2023-07-11T00:30:11.058162+0000","last_fullsized":"2023-07-11T00:30:11.058162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:02:54.740793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116255+0000","last_change":"2023-07-11T00:30:04.911637+0000","last_active":"2023-07-11T00:30:11.116255+0000","last_peered":"2023-07-11T00:30:11.116255+0000","last_clean":"2023-07-11T00:30:11.116255+0000","last_became_active":"2023-07-11T00:30:04.911311+0000","last_became_peered":"2023-07-11T00:30:04.911311+0000","last_unstale":"2023-07-11T00:30:11.116255+0000","last_undegraded":"2023-07-11T00:30:11.116255+0000","last_fullsized":"2023-07-11T00:30:11.116255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:47:48.434930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116470+0000","last_change":"2023-07-11T00:30:05.908686+0000","last_active":"2023-07-11T00:30:11.116470+0000","last_peered":"2023-07-11T00:30:11.116470+0000","last_clean":"2023-07-11T00:30:11.116470+0000","last_became_active":"2023-07-11T00:30:05.908384+0000","last_became_peered":"2023-07-11T00:30:05.908384+0000","last_unstale":"2023-07-11T00:30:11.116470+0000","last_undegraded":"2023-07-11T00:30:11.116470+0000","last_fullsized":"2023-07-11T00:30:11.116470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:01:38.063704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116672+0000","last_change":"2023-07-11T00:30:10.073737+0000","last_active":"2023-07-11T00:30:11.116672+0000","last_peered":"2023-07-11T00:30:11.116672+0000","last_clean":"2023-07-11T00:30:11.116672+0000","last_became_active":"2023-07-11T00:30:10.073270+0000","last_became_peered":"2023-07-11T00:30:10.073270+0000","last_unstale":"2023-07-11T00:30:11.116672+0000","last_undegraded":"2023-07-11T00:30:11.116672+0000","last_fullsized":"2023-07-11T00:30:11.116672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:56:17.603111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058726+0000","last_change":"2023-07-11T00:30:04.911003+0000","last_active":"2023-07-11T00:30:11.058726+0000","last_peered":"2023-07-11T00:30:11.058726+0000","last_clean":"2023-07-11T00:30:11.058726+0000","last_became_active":"2023-07-11T00:30:04.910696+0000","last_became_peered":"2023-07-11T00:30:04.910696+0000","last_unstale":"2023-07-11T00:30:11.058726+0000","last_undegraded":"2023-07-11T00:30:11.058726+0000","last_fullsized":"2023-07-11T00:30:11.058726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:08:03.914295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058582+0000","last_change":"2023-07-11T00:30:05.910836+0000","last_active":"2023-07-11T00:30:11.058582+0000","last_peered":"2023-07-11T00:30:11.058582+0000","last_clean":"2023-07-11T00:30:11.058582+0000","last_became_active":"2023-07-11T00:30:05.907744+0000","last_became_peered":"2023-07-11T00:30:05.907744+0000","last_unstale":"2023-07-11T00:30:11.058582+0000","last_undegraded":"2023-07-11T00:30:11.058582+0000","last_fullsized":"2023-07-11T00:30:11.058582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:53.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057491+0000","last_change":"2023-07-11T00:30:05.912291+0000","last_active":"2023-07-11T00:30:11.057491+0000","last_peered":"2023-07-11T00:30:11.057491+0000","last_clean":"2023-07-11T00:30:11.057491+0000","last_became_active":"2023-07-11T00:30:05.912020+0000","last_became_peered":"2023-07-11T00:30:05.912020+0000","last_unstale":"2023-07-11T00:30:11.057491+0000","last_undegraded":"2023-07-11T00:30:11.057491+0000","last_fullsized":"2023-07-11T00:30:11.057491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:35:14.541189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116735+0000","last_change":"2023-07-11T00:30:05.915128+0000","last_active":"2023-07-11T00:30:11.116735+0000","last_peered":"2023-07-11T00:30:11.116735+0000","last_clean":"2023-07-11T00:30:11.116735+0000","last_became_active":"2023-07-11T00:30:05.914684+0000","last_became_peered":"2023-07-11T00:30:05.914684+0000","last_unstale":"2023-07-11T00:30:11.116735+0000","last_undegraded":"2023-07-11T00:30:11.116735+0000","last_fullsized":"2023-07-11T00:30:11.116735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:31:10.887973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059928+0000","last_change":"2023-07-11T00:30:05.911543+0000","last_active":"2023-07-11T00:30:11.059928+0000","last_peered":"2023-07-11T00:30:11.059928+0000","last_clean":"2023-07-11T00:30:11.059928+0000","last_became_active":"2023-07-11T00:30:05.911204+0000","last_became_peered":"2023-07-11T00:30:05.911204+0000","last_unstale":"2023-07-11T00:30:11.059928+0000","last_undegraded":"2023-07-11T00:30:11.059928+0000","last_fullsized":"2023-07-11T00:30:11.059928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:08:16.283098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118055+0000","last_change":"2023-07-11T00:30:05.906824+0000","last_active":"2023-07-11T00:30:11.118055+0000","last_peered":"2023-07-11T00:30:11.118055+0000","last_clean":"2023-07-11T00:30:11.118055+0000","last_became_active":"2023-07-11T00:30:05.906357+0000","last_became_peered":"2023-07-11T00:30:05.906357+0000","last_unstale":"2023-07-11T00:30:11.118055+0000","last_undegraded":"2023-07-11T00:30:11.118055+0000","last_fullsized":"2023-07-11T00:30:11.118055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:13:25.822286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116584+0000","last_change":"2023-07-11T00:30:05.914873+0000","last_active":"2023-07-11T00:30:11.116584+0000","last_peered":"2023-07-11T00:30:11.116584+0000","last_clean":"2023-07-11T00:30:11.116584+0000","last_became_active":"2023-07-11T00:30:05.914537+0000","last_became_peered":"2023-07-11T00:30:05.914537+0000","last_unstale":"2023-07-11T00:30:11.116584+0000","last_undegraded":"2023-07-11T00:30:11.116584+0000","last_fullsized":"2023-07-11T00:30:11.116584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:21:50.256183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":876544,"data_stored":699108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":103369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.9930000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.9800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.978999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":847872,"data_stored":695098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":103951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":104730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2989999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0779999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":103459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5640000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6040000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":108580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":104021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-11T00:30:41.480 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-11T00:30:41.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.711+0000 7fcd36dff700 1 Processor -- start 2023-07-11T00:30:41.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.711+0000 7fcd36dff700 1 -- start start 2023-07-11T00:30:41.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.712+0000 7fcd36dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcd300b4cc0 0x7fcd300cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:41.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.712+0000 7fcd36dff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd300cf3b0 con 0x7fcd300b8320 2023-07-11T00:30:41.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.712+0000 7fcd36dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd300b86f0 con 0x7fcd300d1cd0 2023-07-11T00:30:41.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.712+0000 7fcd36dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd300cf0d0 con 0x7fcd300b4cc0 2023-07-11T00:30:41.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.713+0000 7fcd34b9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fcd300b8320 0x7fcd300b45b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52236/0 (socket says 172.21.15.22:52236) 2023-07-11T00:30:41.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.713+0000 7fcd34b9b700 1 -- 172.21.15.22:0/3067676813 learned_addr learned my addr 172.21.15.22:0/3067676813 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:41.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.713+0000 7fcd2ffff700 1 --2- 172.21.15.22:0/3067676813 >> v2:172.21.15.184:3300/0 conn(0x7fcd300b4cc0 0x7fcd300cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:41.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.713+0000 7fcd2f7fe700 1 -- 172.21.15.22:0/3067676813 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140350478 0 0) 0x7fcd300cf3b0 con 0x7fcd300b8320 2023-07-11T00:30:41.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.713+0000 7fcd2f7fe700 1 -- 172.21.15.22:0/3067676813 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd200035b0 con 0x7fcd300b8320 2023-07-11T00:30:41.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.713+0000 7fcd2ffff700 1 -- 172.21.15.22:0/3067676813 >> v1:172.21.15.184:6789/0 conn(0x7fcd300d1cd0 legacy=0x7fcd300d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:41.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.713+0000 7fcd2ffff700 1 -- 172.21.15.22:0/3067676813 >> v1:172.21.15.22:6789/0 conn(0x7fcd300b8320 legacy=0x7fcd300b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:41.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.713+0000 7fcd2ffff700 1 -- 172.21.15.22:0/3067676813 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd300d22c0 con 0x7fcd300b4cc0 2023-07-11T00:30:41.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.714+0000 7fcd2ffff700 1 --2- 172.21.15.22:0/3067676813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd300b4cc0 0x7fcd300cd4f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009840 tx=0x7fcd1c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c50bbb6df67435f server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:41.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.714+0000 7fcd2f7fe700 1 -- 172.21.15.22:0/3067676813 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c011830 con 0x7fcd300b4cc0 2023-07-11T00:30:41.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.714+0000 7fcd2f7fe700 1 -- 172.21.15.22:0/3067676813 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c011990 con 0x7fcd300b4cc0 2023-07-11T00:30:41.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.714+0000 7fcd2f7fe700 1 -- 172.21.15.22:0/3067676813 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c011d20 con 0x7fcd300b4cc0 2023-07-11T00:30:41.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.714+0000 7fcd36dff700 1 -- 172.21.15.22:0/3067676813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd300b4cc0 msgr2=0x7fcd300cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:41.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.714+0000 7fcd36dff700 1 --2- 172.21.15.22:0/3067676813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd300b4cc0 0x7fcd300cd4f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009840 tx=0x7fcd1c009b50 comp rx=0 tx=0).stop 2023-07-11T00:30:41.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.715+0000 7fcd36dff700 1 -- 172.21.15.22:0/3067676813 shutdown_connections 2023-07-11T00:30:41.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.715+0000 7fcd36dff700 1 --2- 172.21.15.22:0/3067676813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd300b4cc0 0x7fcd300cd4f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:41.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.715+0000 7fcd36dff700 1 -- 172.21.15.22:0/3067676813 >> 172.21.15.22:0/3067676813 conn(0x7fcd300722b0 msgr2=0x7fcd300cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:41.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.715+0000 7fcd36dff700 1 -- 172.21.15.22:0/3067676813 shutdown_connections 2023-07-11T00:30:41.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.715+0000 7fcd36dff700 1 -- 172.21.15.22:0/3067676813 wait complete. 2023-07-11T00:30:41.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.716+0000 7fcd36dff700 1 Processor -- start 2023-07-11T00:30:41.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.716+0000 7fcd36dff700 1 -- start start 2023-07-11T00:30:41.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.717+0000 7fcd36dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd300b8320 0x7fcd300aa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:41.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.717+0000 7fcd36dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd300d1cd0 0x7fcd301ef200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:41.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.717+0000 7fcd36dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd300b6320 0x7fcd301f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:41.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.717+0000 7fcd36dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300cacb0 con 0x7fcd300b8320 2023-07-11T00:30:41.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.717+0000 7fcd36dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300b6bc0 con 0x7fcd300b6320 2023-07-11T00:30:41.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.717+0000 7fcd36dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300b6ea0 con 0x7fcd300d1cd0 2023-07-11T00:30:41.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.718+0000 7fcd34b9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd300b8320 0x7fcd300aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:41.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.718+0000 7fcd34b9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd300b8320 0x7fcd300aa220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46490/0 (socket says 172.21.15.22:46490) 2023-07-11T00:30:41.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.718+0000 7fcd34b9b700 1 -- 172.21.15.22:0/736625254 learned_addr learned my addr 172.21.15.22:0/736625254 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:41.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.718+0000 7fcd34b9b700 1 -- 172.21.15.22:0/736625254 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd300d1cd0 msgr2=0x7fcd301ef200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:41.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.718+0000 7fcd34b9b700 1 --2- 172.21.15.22:0/736625254 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd300d1cd0 0x7fcd301ef200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:41.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.718+0000 7fcd34b9b700 1 -- 172.21.15.22:0/736625254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd300b6320 msgr2=0x7fcd301f5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:41.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.718+0000 7fcd3539c700 1 --2- 172.21.15.22:0/736625254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd300b6320 0x7fcd301f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:41.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.718+0000 7fcd34b9b700 1 --2- 172.21.15.22:0/736625254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd300b6320 0x7fcd301f5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:41.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.718+0000 7fcd34b9b700 1 -- 172.21.15.22:0/736625254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c0094a0 con 0x7fcd300b8320 2023-07-11T00:30:41.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.718+0000 7fcd3539c700 1 --2- 172.21.15.22:0/736625254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd300b6320 0x7fcd301f5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:30:41.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.718+0000 7fcd34b9b700 1 --2- 172.21.15.22:0/736625254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd300b8320 0x7fcd300aa220 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400c700 tx=0x7fcd2400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:41.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.719+0000 7fcd2d7fa700 1 -- 172.21.15.22:0/736625254 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd24005d70 con 0x7fcd300b8320 2023-07-11T00:30:41.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.719+0000 7fcd2d7fa700 1 -- 172.21.15.22:0/736625254 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd240070d0 con 0x7fcd300b8320 2023-07-11T00:30:41.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.719+0000 7fcd36dff700 1 -- 172.21.15.22:0/736625254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd300b7180 con 0x7fcd300b8320 2023-07-11T00:30:41.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.719+0000 7fcd2d7fa700 1 -- 172.21.15.22:0/736625254 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd24007460 con 0x7fcd300b8320 2023-07-11T00:30:41.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.719+0000 7fcd36dff700 1 -- 172.21.15.22:0/736625254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd301ef740 con 0x7fcd300b8320 2023-07-11T00:30:41.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.720+0000 7fcd36dff700 1 -- 172.21.15.22:0/736625254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd300cb190 con 0x7fcd300b8320 2023-07-11T00:30:41.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.721+0000 7fcd2d7fa700 1 -- 172.21.15.22:0/736625254 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcd240075c0 con 0x7fcd300b8320 2023-07-11T00:30:41.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.722+0000 7fcd2d7fa700 1 --2- 172.21.15.22:0/736625254 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fcd1406ace0 0x7fcd1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:41.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.722+0000 7fcd2d7fa700 1 -- 172.21.15.22:0/736625254 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcd24088e80 con 0x7fcd300b8320 2023-07-11T00:30:41.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.722+0000 7fcd2ffff700 1 --2- 172.21.15.22:0/736625254 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fcd1406ace0 0x7fcd1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:41.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.723+0000 7fcd2ffff700 1 --2- 172.21.15.22:0/736625254 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fcd1406ace0 0x7fcd1406d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009840 tx=0x7fcd1c010000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:41.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.726+0000 7fcd2d7fa700 1 -- 172.21.15.22:0/736625254 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fcd300cb190 con 0x7fcd300b8320 2023-07-11T00:30:41.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.927+0000 7fcd36dff700 1 -- 172.21.15.22:0/736625254 --> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd300ced80 con 0x7fcd1406ace0 2023-07-11T00:30:41.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.938+0000 7fcd2d7fa700 1 -- 172.21.15.22:0/736625254 <== mgr.4114 v2:172.21.15.184:6832/380612710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367571 (secure 0 0 0) 0x7fcd1c01f070 con 0x7fcd1406ace0 2023-07-11T00:30:41.945 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:41.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.943+0000 7fcd36dff700 1 -- 172.21.15.22:0/736625254 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fcd1406ace0 msgr2=0x7fcd1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:41.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.943+0000 7fcd36dff700 1 --2- 172.21.15.22:0/736625254 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fcd1406ace0 0x7fcd1406d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009840 tx=0x7fcd1c010000 comp rx=0 tx=0).stop 2023-07-11T00:30:41.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.943+0000 7fcd36dff700 1 -- 172.21.15.22:0/736625254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd300b8320 msgr2=0x7fcd300aa220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:41.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.943+0000 7fcd36dff700 1 --2- 172.21.15.22:0/736625254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd300b8320 0x7fcd300aa220 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400c700 tx=0x7fcd2400cac0 comp rx=0 tx=0).stop 2023-07-11T00:30:41.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.943+0000 7fcd36dff700 1 -- 172.21.15.22:0/736625254 shutdown_connections 2023-07-11T00:30:41.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.943+0000 7fcd36dff700 1 --2- 172.21.15.22:0/736625254 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fcd1406ace0 0x7fcd1406d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:41.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.943+0000 7fcd36dff700 1 --2- 172.21.15.22:0/736625254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd300b6320 0x7fcd301f5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:41.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.943+0000 7fcd36dff700 1 --2- 172.21.15.22:0/736625254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd300b8320 0x7fcd300aa220 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:41.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.943+0000 7fcd36dff700 1 --2- 172.21.15.22:0/736625254 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd300d1cd0 0x7fcd301ef200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:41.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.943+0000 7fcd36dff700 1 -- 172.21.15.22:0/736625254 >> 172.21.15.22:0/736625254 conn(0x7fcd300b4cc0 msgr2=0x7fcd300b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:41.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.943+0000 7fcd36dff700 1 -- 172.21.15.22:0/736625254 shutdown_connections 2023-07-11T00:30:41.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:41.943+0000 7fcd36dff700 1 -- 172.21.15.22:0/736625254 wait complete. 2023-07-11T00:30:41.949 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-07-11T00:30:41.964 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-07-11T00:30:40.499775+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219352,"kb_used_data":3192,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755368,"statfs":{"total":773094113280,"available":772869496832,"internally_reserved":0,"allocated":3268608,"data_stored":2022316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003679"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117136+0000","last_change":"2023-07-11T00:30:05.911712+0000","last_active":"2023-07-11T00:30:11.117136+0000","last_peered":"2023-07-11T00:30:11.117136+0000","last_clean":"2023-07-11T00:30:11.117136+0000","last_became_active":"2023-07-11T00:30:05.911450+0000","last_became_peered":"2023-07-11T00:30:05.911450+0000","last_unstale":"2023-07-11T00:30:11.117136+0000","last_undegraded":"2023-07-11T00:30:11.117136+0000","last_fullsized":"2023-07-11T00:30:11.117136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:54:15.307917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116734+0000","last_change":"2023-07-11T00:30:05.920040+0000","last_active":"2023-07-11T00:30:11.116734+0000","last_peered":"2023-07-11T00:30:11.116734+0000","last_clean":"2023-07-11T00:30:11.116734+0000","last_became_active":"2023-07-11T00:30:05.919701+0000","last_became_peered":"2023-07-11T00:30:05.919701+0000","last_unstale":"2023-07-11T00:30:11.116734+0000","last_undegraded":"2023-07-11T00:30:11.116734+0000","last_fullsized":"2023-07-11T00:30:11.116734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:30:34.562898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059575+0000","last_change":"2023-07-11T00:30:05.912536+0000","last_active":"2023-07-11T00:30:11.059575+0000","last_peered":"2023-07-11T00:30:11.059575+0000","last_clean":"2023-07-11T00:30:11.059575+0000","last_became_active":"2023-07-11T00:30:05.912241+0000","last_became_peered":"2023-07-11T00:30:05.912241+0000","last_unstale":"2023-07-11T00:30:11.059575+0000","last_undegraded":"2023-07-11T00:30:11.059575+0000","last_fullsized":"2023-07-11T00:30:11.059575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:12:42.514924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058346+0000","last_change":"2023-07-11T00:30:05.903203+0000","last_active":"2023-07-11T00:30:11.058346+0000","last_peered":"2023-07-11T00:30:11.058346+0000","last_clean":"2023-07-11T00:30:11.058346+0000","last_became_active":"2023-07-11T00:30:05.902858+0000","last_became_peered":"2023-07-11T00:30:05.902858+0000","last_unstale":"2023-07-11T00:30:11.058346+0000","last_undegraded":"2023-07-11T00:30:11.058346+0000","last_fullsized":"2023-07-11T00:30:11.058346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:44:07.446915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058655+0000","last_change":"2023-07-11T00:30:05.905150+0000","last_active":"2023-07-11T00:30:11.058655+0000","last_peered":"2023-07-11T00:30:11.058655+0000","last_clean":"2023-07-11T00:30:11.058655+0000","last_became_active":"2023-07-11T00:30:05.904828+0000","last_became_peered":"2023-07-11T00:30:05.904828+0000","last_unstale":"2023-07-11T00:30:11.058655+0000","last_undegraded":"2023-07-11T00:30:11.058655+0000","last_fullsized":"2023-07-11T00:30:11.058655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:37:25.278906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.060073+0000","last_change":"2023-07-11T00:30:05.918168+0000","last_active":"2023-07-11T00:30:11.060073+0000","last_peered":"2023-07-11T00:30:11.060073+0000","last_clean":"2023-07-11T00:30:11.060073+0000","last_became_active":"2023-07-11T00:30:05.917840+0000","last_became_peered":"2023-07-11T00:30:05.917840+0000","last_unstale":"2023-07-11T00:30:11.060073+0000","last_undegraded":"2023-07-11T00:30:11.060073+0000","last_fullsized":"2023-07-11T00:30:11.060073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:32:32.639916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116327+0000","last_change":"2023-07-11T00:30:05.916111+0000","last_active":"2023-07-11T00:30:11.116327+0000","last_peered":"2023-07-11T00:30:11.116327+0000","last_clean":"2023-07-11T00:30:11.116327+0000","last_became_active":"2023-07-11T00:30:05.915793+0000","last_became_peered":"2023-07-11T00:30:05.915793+0000","last_unstale":"2023-07-11T00:30:11.116327+0000","last_undegraded":"2023-07-11T00:30:11.116327+0000","last_fullsized":"2023-07-11T00:30:11.116327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:01:38.063704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116335+0000","last_change":"2023-07-11T00:30:05.924536+0000","last_active":"2023-07-11T00:30:11.116335+0000","last_peered":"2023-07-11T00:30:11.116335+0000","last_clean":"2023-07-11T00:30:11.116335+0000","last_became_active":"2023-07-11T00:30:05.924214+0000","last_became_peered":"2023-07-11T00:30:05.924214+0000","last_unstale":"2023-07-11T00:30:11.116335+0000","last_undegraded":"2023-07-11T00:30:11.116335+0000","last_fullsized":"2023-07-11T00:30:11.116335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:02:21.282407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058461+0000","last_change":"2023-07-11T00:30:05.912403+0000","last_active":"2023-07-11T00:30:11.058461+0000","last_peered":"2023-07-11T00:30:11.058461+0000","last_clean":"2023-07-11T00:30:11.058461+0000","last_became_active":"2023-07-11T00:30:05.912089+0000","last_became_peered":"2023-07-11T00:30:05.912089+0000","last_unstale":"2023-07-11T00:30:11.058461+0000","last_undegraded":"2023-07-11T00:30:11.058461+0000","last_fullsized":"2023-07-11T00:30:11.058461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:05:31.560559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117009+0000","last_change":"2023-07-11T00:30:05.914190+0000","last_active":"2023-07-11T00:30:11.117009+0000","last_peered":"2023-07-11T00:30:11.117009+0000","last_clean":"2023-07-11T00:30:11.117009+0000","last_became_active":"2023-07-11T00:30:05.913891+0000","last_became_peered":"2023-07-11T00:30:05.913891+0000","last_unstale":"2023-07-11T00:30:11.117009+0000","last_undegraded":"2023-07-11T00:30:11.117009+0000","last_fullsized":"2023-07-11T00:30:11.117009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:36:16.891590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059425+0000","last_change":"2023-07-11T00:30:05.918953+0000","last_active":"2023-07-11T00:30:11.059425+0000","last_peered":"2023-07-11T00:30:11.059425+0000","last_clean":"2023-07-11T00:30:11.059425+0000","last_became_active":"2023-07-11T00:30:05.918621+0000","last_became_peered":"2023-07-11T00:30:05.918621+0000","last_unstale":"2023-07-11T00:30:11.059425+0000","last_undegraded":"2023-07-11T00:30:11.059425+0000","last_fullsized":"2023-07-11T00:30:11.059425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:41:28.164012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118528+0000","last_change":"2023-07-11T00:30:05.914213+0000","last_active":"2023-07-11T00:30:11.118528+0000","last_peered":"2023-07-11T00:30:11.118528+0000","last_clean":"2023-07-11T00:30:11.118528+0000","last_became_active":"2023-07-11T00:30:05.913944+0000","last_became_peered":"2023-07-11T00:30:05.913944+0000","last_unstale":"2023-07-11T00:30:11.118528+0000","last_undegraded":"2023-07-11T00:30:11.118528+0000","last_fullsized":"2023-07-11T00:30:11.118528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:59:16.970501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118774+0000","last_change":"2023-07-11T00:30:05.910052+0000","last_active":"2023-07-11T00:30:11.118774+0000","last_peered":"2023-07-11T00:30:11.118774+0000","last_clean":"2023-07-11T00:30:11.118774+0000","last_became_active":"2023-07-11T00:30:05.909736+0000","last_became_peered":"2023-07-11T00:30:05.909736+0000","last_unstale":"2023-07-11T00:30:11.118774+0000","last_undegraded":"2023-07-11T00:30:11.118774+0000","last_fullsized":"2023-07-11T00:30:11.118774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:21:43.298124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116546+0000","last_change":"2023-07-11T00:30:05.917375+0000","last_active":"2023-07-11T00:30:11.116546+0000","last_peered":"2023-07-11T00:30:11.116546+0000","last_clean":"2023-07-11T00:30:11.116546+0000","last_became_active":"2023-07-11T00:30:05.917073+0000","last_became_peered":"2023-07-11T00:30:05.917073+0000","last_unstale":"2023-07-11T00:30:11.116546+0000","last_undegraded":"2023-07-11T00:30:11.116546+0000","last_fullsized":"2023-07-11T00:30:11.116546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:49:32.598344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115820+0000","last_change":"2023-07-11T00:30:05.915585+0000","last_active":"2023-07-11T00:30:11.115820+0000","last_peered":"2023-07-11T00:30:11.115820+0000","last_clean":"2023-07-11T00:30:11.115820+0000","last_became_active":"2023-07-11T00:30:05.915308+0000","last_became_peered":"2023-07-11T00:30:05.915308+0000","last_unstale":"2023-07-11T00:30:11.115820+0000","last_undegraded":"2023-07-11T00:30:11.115820+0000","last_fullsized":"2023-07-11T00:30:11.115820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:31:07.229483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058415+0000","last_change":"2023-07-11T00:30:05.897489+0000","last_active":"2023-07-11T00:30:11.058415+0000","last_peered":"2023-07-11T00:30:11.058415+0000","last_clean":"2023-07-11T00:30:11.058415+0000","last_became_active":"2023-07-11T00:30:05.897078+0000","last_became_peered":"2023-07-11T00:30:05.897078+0000","last_unstale":"2023-07-11T00:30:11.058415+0000","last_undegraded":"2023-07-11T00:30:11.058415+0000","last_fullsized":"2023-07-11T00:30:11.058415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:47:49.437638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058439+0000","last_change":"2023-07-11T00:30:05.904485+0000","last_active":"2023-07-11T00:30:11.058439+0000","last_peered":"2023-07-11T00:30:11.058439+0000","last_clean":"2023-07-11T00:30:11.058439+0000","last_became_active":"2023-07-11T00:30:05.904198+0000","last_became_peered":"2023-07-11T00:30:05.904198+0000","last_unstale":"2023-07-11T00:30:11.058439+0000","last_undegraded":"2023-07-11T00:30:11.058439+0000","last_fullsized":"2023-07-11T00:30:11.058439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:07:55.311856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059904+0000","last_change":"2023-07-11T00:30:05.916172+0000","last_active":"2023-07-11T00:30:11.059904+0000","last_peered":"2023-07-11T00:30:11.059904+0000","last_clean":"2023-07-11T00:30:11.059904+0000","last_became_active":"2023-07-11T00:30:05.915857+0000","last_became_peered":"2023-07-11T00:30:05.915857+0000","last_unstale":"2023-07-11T00:30:11.059904+0000","last_undegraded":"2023-07-11T00:30:11.059904+0000","last_fullsized":"2023-07-11T00:30:11.059904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:03:00.748490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117907+0000","last_change":"2023-07-11T00:30:05.905623+0000","last_active":"2023-07-11T00:30:11.117907+0000","last_peered":"2023-07-11T00:30:11.117907+0000","last_clean":"2023-07-11T00:30:11.117907+0000","last_became_active":"2023-07-11T00:30:05.905411+0000","last_became_peered":"2023-07-11T00:30:05.905411+0000","last_unstale":"2023-07-11T00:30:11.117907+0000","last_undegraded":"2023-07-11T00:30:11.117907+0000","last_fullsized":"2023-07-11T00:30:11.117907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:59:32.190804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059052+0000","last_change":"2023-07-11T00:30:05.912071+0000","last_active":"2023-07-11T00:30:11.059052+0000","last_peered":"2023-07-11T00:30:11.059052+0000","last_clean":"2023-07-11T00:30:11.059052+0000","last_became_active":"2023-07-11T00:30:05.911697+0000","last_became_peered":"2023-07-11T00:30:05.911697+0000","last_unstale":"2023-07-11T00:30:11.059052+0000","last_undegraded":"2023-07-11T00:30:11.059052+0000","last_fullsized":"2023-07-11T00:30:11.059052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:50:20.512890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116233+0000","last_change":"2023-07-11T00:30:05.910797+0000","last_active":"2023-07-11T00:30:11.116233+0000","last_peered":"2023-07-11T00:30:11.116233+0000","last_clean":"2023-07-11T00:30:11.116233+0000","last_became_active":"2023-07-11T00:30:05.910438+0000","last_became_peered":"2023-07-11T00:30:05.910438+0000","last_unstale":"2023-07-11T00:30:11.116233+0000","last_undegraded":"2023-07-11T00:30:11.116233+0000","last_fullsized":"2023-07-11T00:30:11.116233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:47:49.437638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057978+0000","last_change":"2023-07-11T00:30:05.918878+0000","last_active":"2023-07-11T00:30:11.057978+0000","last_peered":"2023-07-11T00:30:11.057978+0000","last_clean":"2023-07-11T00:30:11.057978+0000","last_became_active":"2023-07-11T00:30:05.918348+0000","last_became_peered":"2023-07-11T00:30:05.918348+0000","last_unstale":"2023-07-11T00:30:11.057978+0000","last_undegraded":"2023-07-11T00:30:11.057978+0000","last_fullsized":"2023-07-11T00:30:11.057978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:31:53.264979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116625+0000","last_change":"2023-07-11T00:30:05.903228+0000","last_active":"2023-07-11T00:30:11.116625+0000","last_peered":"2023-07-11T00:30:11.116625+0000","last_clean":"2023-07-11T00:30:11.116625+0000","last_became_active":"2023-07-11T00:30:05.902909+0000","last_became_peered":"2023-07-11T00:30:05.902909+0000","last_unstale":"2023-07-11T00:30:11.116625+0000","last_undegraded":"2023-07-11T00:30:11.116625+0000","last_fullsized":"2023-07-11T00:30:11.116625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:53.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115854+0000","last_change":"2023-07-11T00:30:05.908961+0000","last_active":"2023-07-11T00:30:11.115854+0000","last_peered":"2023-07-11T00:30:11.115854+0000","last_clean":"2023-07-11T00:30:11.115854+0000","last_became_active":"2023-07-11T00:30:05.908652+0000","last_became_peered":"2023-07-11T00:30:05.908652+0000","last_unstale":"2023-07-11T00:30:11.115854+0000","last_undegraded":"2023-07-11T00:30:11.115854+0000","last_fullsized":"2023-07-11T00:30:11.115854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:30:34.562898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117973+0000","last_change":"2023-07-11T00:30:05.915154+0000","last_active":"2023-07-11T00:30:11.117973+0000","last_peered":"2023-07-11T00:30:11.117973+0000","last_clean":"2023-07-11T00:30:11.117973+0000","last_became_active":"2023-07-11T00:30:05.914601+0000","last_became_peered":"2023-07-11T00:30:05.914601+0000","last_unstale":"2023-07-11T00:30:11.117973+0000","last_undegraded":"2023-07-11T00:30:11.117973+0000","last_fullsized":"2023-07-11T00:30:11.117973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:05:31.560559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117482+0000","last_change":"2023-07-11T00:30:05.917313+0000","last_active":"2023-07-11T00:30:11.117482+0000","last_peered":"2023-07-11T00:30:11.117482+0000","last_clean":"2023-07-11T00:30:11.117482+0000","last_became_active":"2023-07-11T00:30:05.916948+0000","last_became_peered":"2023-07-11T00:30:05.916948+0000","last_unstale":"2023-07-11T00:30:11.117482+0000","last_undegraded":"2023-07-11T00:30:11.117482+0000","last_fullsized":"2023-07-11T00:30:11.117482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:23:06.035280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116853+0000","last_change":"2023-07-11T00:30:05.907303+0000","last_active":"2023-07-11T00:30:11.116853+0000","last_peered":"2023-07-11T00:30:11.116853+0000","last_clean":"2023-07-11T00:30:11.116853+0000","last_became_active":"2023-07-11T00:30:05.906928+0000","last_became_peered":"2023-07-11T00:30:05.906928+0000","last_unstale":"2023-07-11T00:30:11.116853+0000","last_undegraded":"2023-07-11T00:30:11.116853+0000","last_fullsized":"2023-07-11T00:30:11.116853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:43:56.168273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059619+0000","last_change":"2023-07-11T00:30:10.072865+0000","last_active":"2023-07-11T00:30:11.059619+0000","last_peered":"2023-07-11T00:30:11.059619+0000","last_clean":"2023-07-11T00:30:11.059619+0000","last_became_active":"2023-07-11T00:30:10.072474+0000","last_became_peered":"2023-07-11T00:30:10.072474+0000","last_unstale":"2023-07-11T00:30:11.059619+0000","last_undegraded":"2023-07-11T00:30:11.059619+0000","last_fullsized":"2023-07-11T00:30:11.059619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:48:40.316132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059700+0000","last_change":"2023-07-11T00:30:04.908760+0000","last_active":"2023-07-11T00:30:11.059700+0000","last_peered":"2023-07-11T00:30:11.059700+0000","last_clean":"2023-07-11T00:30:11.059700+0000","last_became_active":"2023-07-11T00:30:04.908468+0000","last_became_peered":"2023-07-11T00:30:04.908468+0000","last_unstale":"2023-07-11T00:30:11.059700+0000","last_undegraded":"2023-07-11T00:30:11.059700+0000","last_fullsized":"2023-07-11T00:30:11.059700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:48:47.561149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119219+0000","last_change":"2023-07-11T00:30:05.915093+0000","last_active":"2023-07-11T00:30:11.119219+0000","last_peered":"2023-07-11T00:30:11.119219+0000","last_clean":"2023-07-11T00:30:11.119219+0000","last_became_active":"2023-07-11T00:30:05.914787+0000","last_became_peered":"2023-07-11T00:30:05.914787+0000","last_unstale":"2023-07-11T00:30:11.119219+0000","last_undegraded":"2023-07-11T00:30:11.119219+0000","last_fullsized":"2023-07-11T00:30:11.119219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:03:00.748490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058408+0000","last_change":"2023-07-11T00:30:10.068761+0000","last_active":"2023-07-11T00:30:11.058408+0000","last_peered":"2023-07-11T00:30:11.058408+0000","last_clean":"2023-07-11T00:30:11.058408+0000","last_became_active":"2023-07-11T00:30:10.068319+0000","last_became_peered":"2023-07-11T00:30:10.068319+0000","last_unstale":"2023-07-11T00:30:11.058408+0000","last_undegraded":"2023-07-11T00:30:11.058408+0000","last_fullsized":"2023-07-11T00:30:11.058408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:56:42.728305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116259+0000","last_change":"2023-07-11T00:30:04.901722+0000","last_active":"2023-07-11T00:30:11.116259+0000","last_peered":"2023-07-11T00:30:11.116259+0000","last_clean":"2023-07-11T00:30:11.116259+0000","last_became_active":"2023-07-11T00:30:04.901326+0000","last_became_peered":"2023-07-11T00:30:04.901326+0000","last_unstale":"2023-07-11T00:30:11.116259+0000","last_undegraded":"2023-07-11T00:30:11.116259+0000","last_fullsized":"2023-07-11T00:30:11.116259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:31:52.262271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058531+0000","last_change":"2023-07-11T00:30:05.908583+0000","last_active":"2023-07-11T00:30:11.058531+0000","last_peered":"2023-07-11T00:30:11.058531+0000","last_clean":"2023-07-11T00:30:11.058531+0000","last_became_active":"2023-07-11T00:30:05.908245+0000","last_became_peered":"2023-07-11T00:30:05.908245+0000","last_unstale":"2023-07-11T00:30:11.058531+0000","last_undegraded":"2023-07-11T00:30:11.058531+0000","last_fullsized":"2023-07-11T00:30:11.058531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:49:28.388344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058698+0000","last_change":"2023-07-11T00:30:10.083710+0000","last_active":"2023-07-11T00:30:11.058698+0000","last_peered":"2023-07-11T00:30:11.058698+0000","last_clean":"2023-07-11T00:30:11.058698+0000","last_became_active":"2023-07-11T00:30:10.080933+0000","last_became_peered":"2023-07-11T00:30:10.080933+0000","last_unstale":"2023-07-11T00:30:11.058698+0000","last_undegraded":"2023-07-11T00:30:11.058698+0000","last_fullsized":"2023-07-11T00:30:11.058698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:04.352361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119152+0000","last_change":"2023-07-11T00:30:04.904239+0000","last_active":"2023-07-11T00:30:11.119152+0000","last_peered":"2023-07-11T00:30:11.119152+0000","last_clean":"2023-07-11T00:30:11.119152+0000","last_became_active":"2023-07-11T00:30:04.903915+0000","last_became_peered":"2023-07-11T00:30:04.903915+0000","last_unstale":"2023-07-11T00:30:11.119152+0000","last_undegraded":"2023-07-11T00:30:11.119152+0000","last_fullsized":"2023-07-11T00:30:11.119152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:50:41.550137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.060203+0000","last_change":"2023-07-11T00:30:05.907358+0000","last_active":"2023-07-11T00:30:11.060203+0000","last_peered":"2023-07-11T00:30:11.060203+0000","last_clean":"2023-07-11T00:30:11.060203+0000","last_became_active":"2023-07-11T00:30:05.907064+0000","last_became_peered":"2023-07-11T00:30:05.907064+0000","last_unstale":"2023-07-11T00:30:11.060203+0000","last_undegraded":"2023-07-11T00:30:11.060203+0000","last_fullsized":"2023-07-11T00:30:11.060203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:59:37.703330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057571+0000","last_change":"2023-07-11T00:30:10.067504+0000","last_active":"2023-07-11T00:30:11.057571+0000","last_peered":"2023-07-11T00:30:11.057571+0000","last_clean":"2023-07-11T00:30:11.057571+0000","last_became_active":"2023-07-11T00:30:10.067052+0000","last_became_peered":"2023-07-11T00:30:10.067052+0000","last_unstale":"2023-07-11T00:30:11.057571+0000","last_undegraded":"2023-07-11T00:30:11.057571+0000","last_fullsized":"2023-07-11T00:30:11.057571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:41:42.919668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058647+0000","last_change":"2023-07-11T00:30:04.911263+0000","last_active":"2023-07-11T00:30:11.058647+0000","last_peered":"2023-07-11T00:30:11.058647+0000","last_clean":"2023-07-11T00:30:11.058647+0000","last_became_active":"2023-07-11T00:30:04.910905+0000","last_became_peered":"2023-07-11T00:30:04.910905+0000","last_unstale":"2023-07-11T00:30:11.058647+0000","last_undegraded":"2023-07-11T00:30:11.058647+0000","last_fullsized":"2023-07-11T00:30:11.058647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:02:20.279699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119100+0000","last_change":"2023-07-11T00:30:05.915099+0000","last_active":"2023-07-11T00:30:11.119100+0000","last_peered":"2023-07-11T00:30:11.119100+0000","last_clean":"2023-07-11T00:30:11.119100+0000","last_became_active":"2023-07-11T00:30:05.914735+0000","last_became_peered":"2023-07-11T00:30:05.914735+0000","last_unstale":"2023-07-11T00:30:11.119100+0000","last_undegraded":"2023-07-11T00:30:11.119100+0000","last_fullsized":"2023-07-11T00:30:11.119100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:48:48.563856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115732+0000","last_change":"2023-07-11T00:30:10.074010+0000","last_active":"2023-07-11T00:30:11.115732+0000","last_peered":"2023-07-11T00:30:11.115732+0000","last_clean":"2023-07-11T00:30:11.115732+0000","last_became_active":"2023-07-11T00:30:10.073513+0000","last_became_peered":"2023-07-11T00:30:10.073513+0000","last_unstale":"2023-07-11T00:30:11.115732+0000","last_undegraded":"2023-07-11T00:30:11.115732+0000","last_fullsized":"2023-07-11T00:30:11.115732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:49:36.751025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117132+0000","last_change":"2023-07-11T00:30:04.908900+0000","last_active":"2023-07-11T00:30:11.117132+0000","last_peered":"2023-07-11T00:30:11.117132+0000","last_clean":"2023-07-11T00:30:11.117132+0000","last_became_active":"2023-07-11T00:30:04.908536+0000","last_became_peered":"2023-07-11T00:30:04.908536+0000","last_unstale":"2023-07-11T00:30:11.117132+0000","last_undegraded":"2023-07-11T00:30:11.117132+0000","last_fullsized":"2023-07-11T00:30:11.117132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:02:49.585404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116540+0000","last_change":"2023-07-11T00:30:05.908015+0000","last_active":"2023-07-11T00:30:11.116540+0000","last_peered":"2023-07-11T00:30:11.116540+0000","last_clean":"2023-07-11T00:30:11.116540+0000","last_became_active":"2023-07-11T00:30:05.907689+0000","last_became_peered":"2023-07-11T00:30:05.907689+0000","last_unstale":"2023-07-11T00:30:11.116540+0000","last_undegraded":"2023-07-11T00:30:11.116540+0000","last_fullsized":"2023-07-11T00:30:11.116540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:07:38.432308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118369+0000","last_change":"2023-07-11T00:30:10.073042+0000","last_active":"2023-07-11T00:30:11.118369+0000","last_peered":"2023-07-11T00:30:11.118369+0000","last_clean":"2023-07-11T00:30:11.118369+0000","last_became_active":"2023-07-11T00:30:10.072755+0000","last_became_peered":"2023-07-11T00:30:10.072755+0000","last_unstale":"2023-07-11T00:30:11.118369+0000","last_undegraded":"2023-07-11T00:30:11.118369+0000","last_fullsized":"2023-07-11T00:30:11.118369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:25:51.347028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116329+0000","last_change":"2023-07-11T00:30:04.906158+0000","last_active":"2023-07-11T00:30:11.116329+0000","last_peered":"2023-07-11T00:30:11.116329+0000","last_clean":"2023-07-11T00:30:11.116329+0000","last_became_active":"2023-07-11T00:30:04.905839+0000","last_became_peered":"2023-07-11T00:30:04.905839+0000","last_unstale":"2023-07-11T00:30:11.116329+0000","last_undegraded":"2023-07-11T00:30:11.116329+0000","last_fullsized":"2023-07-11T00:30:11.116329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:07:37.429600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118929+0000","last_change":"2023-07-11T00:30:05.912619+0000","last_active":"2023-07-11T00:30:11.118929+0000","last_peered":"2023-07-11T00:30:11.118929+0000","last_clean":"2023-07-11T00:30:11.118929+0000","last_became_active":"2023-07-11T00:30:05.912180+0000","last_became_peered":"2023-07-11T00:30:05.912180+0000","last_unstale":"2023-07-11T00:30:11.118929+0000","last_undegraded":"2023-07-11T00:30:11.118929+0000","last_fullsized":"2023-07-11T00:30:11.118929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:37:25.278906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119122+0000","last_change":"2023-07-11T00:30:10.078408+0000","last_active":"2023-07-11T00:30:11.119122+0000","last_peered":"2023-07-11T00:30:11.119122+0000","last_clean":"2023-07-11T00:30:11.119122+0000","last_became_active":"2023-07-11T00:30:10.077825+0000","last_became_peered":"2023-07-11T00:30:10.077825+0000","last_unstale":"2023-07-11T00:30:11.119122+0000","last_undegraded":"2023-07-11T00:30:11.119122+0000","last_fullsized":"2023-07-11T00:30:11.119122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:08:09.069684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'10","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:24.732814+0000","last_change":"2023-07-11T00:30:04.907926+0000","last_active":"2023-07-11T00:30:24.732814+0000","last_peered":"2023-07-11T00:30:24.732814+0000","last_clean":"2023-07-11T00:30:24.732814+0000","last_became_active":"2023-07-11T00:30:04.907603+0000","last_became_peered":"2023-07-11T00:30:04.907603+0000","last_unstale":"2023-07-11T00:30:24.732814+0000","last_undegraded":"2023-07-11T00:30:24.732814+0000","last_fullsized":"2023-07-11T00:30:24.732814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:35:34.386824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058562+0000","last_change":"2023-07-11T00:30:05.911101+0000","last_active":"2023-07-11T00:30:11.058562+0000","last_peered":"2023-07-11T00:30:11.058562+0000","last_clean":"2023-07-11T00:30:11.058562+0000","last_became_active":"2023-07-11T00:30:05.909430+0000","last_became_peered":"2023-07-11T00:30:05.909430+0000","last_unstale":"2023-07-11T00:30:11.058562+0000","last_undegraded":"2023-07-11T00:30:11.058562+0000","last_fullsized":"2023-07-11T00:30:11.058562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:07:38.432308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116172+0000","last_change":"2023-07-11T00:30:10.081247+0000","last_active":"2023-07-11T00:30:11.116172+0000","last_peered":"2023-07-11T00:30:11.116172+0000","last_clean":"2023-07-11T00:30:11.116172+0000","last_became_active":"2023-07-11T00:30:10.080796+0000","last_became_peered":"2023-07-11T00:30:10.080796+0000","last_unstale":"2023-07-11T00:30:11.116172+0000","last_undegraded":"2023-07-11T00:30:11.116172+0000","last_fullsized":"2023-07-11T00:30:11.116172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:05:35.713240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116102+0000","last_change":"2023-07-11T00:30:04.914310+0000","last_active":"2023-07-11T00:30:11.116102+0000","last_peered":"2023-07-11T00:30:11.116102+0000","last_clean":"2023-07-11T00:30:11.116102+0000","last_became_active":"2023-07-11T00:30:04.913972+0000","last_became_peered":"2023-07-11T00:30:04.913972+0000","last_unstale":"2023-07-11T00:30:11.116102+0000","last_undegraded":"2023-07-11T00:30:11.116102+0000","last_fullsized":"2023-07-11T00:30:11.116102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:51:41.689821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116886+0000","last_change":"2023-07-11T00:30:05.917159+0000","last_active":"2023-07-11T00:30:11.116886+0000","last_peered":"2023-07-11T00:30:11.116886+0000","last_clean":"2023-07-11T00:30:11.116886+0000","last_became_active":"2023-07-11T00:30:05.916849+0000","last_became_peered":"2023-07-11T00:30:05.916849+0000","last_unstale":"2023-07-11T00:30:11.116886+0000","last_undegraded":"2023-07-11T00:30:11.116886+0000","last_fullsized":"2023-07-11T00:30:11.116886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:09:26.818205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117167+0000","last_change":"2023-07-11T00:30:10.068364+0000","last_active":"2023-07-11T00:30:11.117167+0000","last_peered":"2023-07-11T00:30:11.117167+0000","last_clean":"2023-07-11T00:30:11.117167+0000","last_became_active":"2023-07-11T00:30:10.066791+0000","last_became_peered":"2023-07-11T00:30:10.066791+0000","last_unstale":"2023-07-11T00:30:11.117167+0000","last_undegraded":"2023-07-11T00:30:11.117167+0000","last_fullsized":"2023-07-11T00:30:11.117167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:23:00.417735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058112+0000","last_change":"2023-07-11T00:30:04.912548+0000","last_active":"2023-07-11T00:30:11.058112+0000","last_peered":"2023-07-11T00:30:11.058112+0000","last_clean":"2023-07-11T00:30:11.058112+0000","last_became_active":"2023-07-11T00:30:04.912228+0000","last_became_peered":"2023-07-11T00:30:04.912228+0000","last_unstale":"2023-07-11T00:30:11.058112+0000","last_undegraded":"2023-07-11T00:30:11.058112+0000","last_fullsized":"2023-07-11T00:30:11.058112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:00:49.062375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116712+0000","last_change":"2023-07-11T00:30:05.907171+0000","last_active":"2023-07-11T00:30:11.116712+0000","last_peered":"2023-07-11T00:30:11.116712+0000","last_clean":"2023-07-11T00:30:11.116712+0000","last_became_active":"2023-07-11T00:30:05.906862+0000","last_became_peered":"2023-07-11T00:30:05.906862+0000","last_unstale":"2023-07-11T00:30:11.116712+0000","last_undegraded":"2023-07-11T00:30:11.116712+0000","last_fullsized":"2023-07-11T00:30:11.116712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:31:07.229483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117405+0000","last_change":"2023-07-11T00:30:10.073795+0000","last_active":"2023-07-11T00:30:11.117405+0000","last_peered":"2023-07-11T00:30:11.117405+0000","last_clean":"2023-07-11T00:30:11.117405+0000","last_became_active":"2023-07-11T00:30:10.073437+0000","last_became_peered":"2023-07-11T00:30:10.073437+0000","last_unstale":"2023-07-11T00:30:11.117405+0000","last_undegraded":"2023-07-11T00:30:11.117405+0000","last_fullsized":"2023-07-11T00:30:11.117405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:35:39.542213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116190+0000","last_change":"2023-07-11T00:30:04.913583+0000","last_active":"2023-07-11T00:30:11.116190+0000","last_peered":"2023-07-11T00:30:11.116190+0000","last_clean":"2023-07-11T00:30:11.116190+0000","last_became_active":"2023-07-11T00:30:04.913217+0000","last_became_peered":"2023-07-11T00:30:04.913217+0000","last_unstale":"2023-07-11T00:30:11.116190+0000","last_undegraded":"2023-07-11T00:30:11.116190+0000","last_fullsized":"2023-07-11T00:30:11.116190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:02:49.585404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058792+0000","last_change":"2023-07-11T00:30:05.904820+0000","last_active":"2023-07-11T00:30:11.058792+0000","last_peered":"2023-07-11T00:30:11.058792+0000","last_clean":"2023-07-11T00:30:11.058792+0000","last_became_active":"2023-07-11T00:30:05.904502+0000","last_became_peered":"2023-07-11T00:30:05.904502+0000","last_unstale":"2023-07-11T00:30:11.058792+0000","last_undegraded":"2023-07-11T00:30:11.058792+0000","last_fullsized":"2023-07-11T00:30:11.058792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:49:32.598344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116686+0000","last_change":"2023-07-11T00:30:10.072170+0000","last_active":"2023-07-11T00:30:11.116686+0000","last_peered":"2023-07-11T00:30:11.116686+0000","last_clean":"2023-07-11T00:30:11.116686+0000","last_became_active":"2023-07-11T00:30:10.071764+0000","last_became_peered":"2023-07-11T00:30:10.071764+0000","last_unstale":"2023-07-11T00:30:11.116686+0000","last_undegraded":"2023-07-11T00:30:11.116686+0000","last_fullsized":"2023-07-11T00:30:11.116686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:19:04.827674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057318+0000","last_change":"2023-07-11T00:30:04.910630+0000","last_active":"2023-07-11T00:30:11.057318+0000","last_peered":"2023-07-11T00:30:11.057318+0000","last_clean":"2023-07-11T00:30:11.057318+0000","last_became_active":"2023-07-11T00:30:04.910150+0000","last_became_peered":"2023-07-11T00:30:04.910150+0000","last_unstale":"2023-07-11T00:30:11.057318+0000","last_undegraded":"2023-07-11T00:30:11.057318+0000","last_fullsized":"2023-07-11T00:30:11.057318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:14:23.274160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117798+0000","last_change":"2023-07-11T00:30:05.907668+0000","last_active":"2023-07-11T00:30:11.117798+0000","last_peered":"2023-07-11T00:30:11.117798+0000","last_clean":"2023-07-11T00:30:11.117798+0000","last_became_active":"2023-07-11T00:30:05.907397+0000","last_became_peered":"2023-07-11T00:30:05.907397+0000","last_unstale":"2023-07-11T00:30:11.117798+0000","last_undegraded":"2023-07-11T00:30:11.117798+0000","last_fullsized":"2023-07-11T00:30:11.117798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:50:20.512890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116720+0000","last_change":"2023-07-11T00:30:10.070415+0000","last_active":"2023-07-11T00:30:11.116720+0000","last_peered":"2023-07-11T00:30:11.116720+0000","last_clean":"2023-07-11T00:30:11.116720+0000","last_became_active":"2023-07-11T00:30:10.069906+0000","last_became_peered":"2023-07-11T00:30:10.069906+0000","last_unstale":"2023-07-11T00:30:11.116720+0000","last_undegraded":"2023-07-11T00:30:11.116720+0000","last_fullsized":"2023-07-11T00:30:11.116720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:57.996558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117336+0000","last_change":"2023-07-11T00:30:04.910800+0000","last_active":"2023-07-11T00:30:11.117336+0000","last_peered":"2023-07-11T00:30:11.117336+0000","last_clean":"2023-07-11T00:30:11.117336+0000","last_became_active":"2023-07-11T00:30:04.910453+0000","last_became_peered":"2023-07-11T00:30:04.910453+0000","last_unstale":"2023-07-11T00:30:11.117336+0000","last_undegraded":"2023-07-11T00:30:11.117336+0000","last_fullsized":"2023-07-11T00:30:11.117336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:38.027150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116206+0000","last_change":"2023-07-11T00:30:05.908168+0000","last_active":"2023-07-11T00:30:11.116206+0000","last_peered":"2023-07-11T00:30:11.116206+0000","last_clean":"2023-07-11T00:30:11.116206+0000","last_became_active":"2023-07-11T00:30:05.907884+0000","last_became_peered":"2023-07-11T00:30:05.907884+0000","last_unstale":"2023-07-11T00:30:11.116206+0000","last_undegraded":"2023-07-11T00:30:11.116206+0000","last_fullsized":"2023-07-11T00:30:11.116206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:00.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117337+0000","last_change":"2023-07-11T00:30:10.074726+0000","last_active":"2023-07-11T00:30:11.117337+0000","last_peered":"2023-07-11T00:30:11.117337+0000","last_clean":"2023-07-11T00:30:11.117337+0000","last_became_active":"2023-07-11T00:30:10.074281+0000","last_became_peered":"2023-07-11T00:30:10.074281+0000","last_unstale":"2023-07-11T00:30:11.117337+0000","last_undegraded":"2023-07-11T00:30:11.117337+0000","last_fullsized":"2023-07-11T00:30:11.117337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:50:00.072430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117143+0000","last_change":"2023-07-11T00:30:04.913460+0000","last_active":"2023-07-11T00:30:11.117143+0000","last_peered":"2023-07-11T00:30:11.117143+0000","last_clean":"2023-07-11T00:30:11.117143+0000","last_became_active":"2023-07-11T00:30:04.913131+0000","last_became_peered":"2023-07-11T00:30:04.913131+0000","last_unstale":"2023-07-11T00:30:11.117143+0000","last_undegraded":"2023-07-11T00:30:11.117143+0000","last_fullsized":"2023-07-11T00:30:11.117143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:09:25.815497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059267+0000","last_change":"2023-07-11T00:30:05.919028+0000","last_active":"2023-07-11T00:30:11.059267+0000","last_peered":"2023-07-11T00:30:11.059267+0000","last_clean":"2023-07-11T00:30:11.059267+0000","last_became_active":"2023-07-11T00:30:05.918727+0000","last_became_peered":"2023-07-11T00:30:05.918727+0000","last_unstale":"2023-07-11T00:30:11.059267+0000","last_undegraded":"2023-07-11T00:30:11.059267+0000","last_fullsized":"2023-07-11T00:30:11.059267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:22:04.654770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118792+0000","last_change":"2023-07-11T00:30:10.076696+0000","last_active":"2023-07-11T00:30:11.118792+0000","last_peered":"2023-07-11T00:30:11.118792+0000","last_clean":"2023-07-11T00:30:11.118792+0000","last_became_active":"2023-07-11T00:30:10.074714+0000","last_became_peered":"2023-07-11T00:30:10.074714+0000","last_unstale":"2023-07-11T00:30:11.118792+0000","last_undegraded":"2023-07-11T00:30:11.118792+0000","last_fullsized":"2023-07-11T00:30:11.118792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:53:44.062751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116091+0000","last_change":"2023-07-11T00:30:04.918352+0000","last_active":"2023-07-11T00:30:11.116091+0000","last_peered":"2023-07-11T00:30:11.116091+0000","last_clean":"2023-07-11T00:30:11.116091+0000","last_became_active":"2023-07-11T00:30:04.918037+0000","last_became_peered":"2023-07-11T00:30:04.918037+0000","last_unstale":"2023-07-11T00:30:11.116091+0000","last_undegraded":"2023-07-11T00:30:11.116091+0000","last_fullsized":"2023-07-11T00:30:11.116091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:33:45.867117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057432+0000","last_change":"2023-07-11T00:30:05.919328+0000","last_active":"2023-07-11T00:30:11.057432+0000","last_peered":"2023-07-11T00:30:11.057432+0000","last_clean":"2023-07-11T00:30:11.057432+0000","last_became_active":"2023-07-11T00:30:05.919010+0000","last_became_peered":"2023-07-11T00:30:05.919010+0000","last_unstale":"2023-07-11T00:30:11.057432+0000","last_undegraded":"2023-07-11T00:30:11.057432+0000","last_fullsized":"2023-07-11T00:30:11.057432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:11:39.510221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116515+0000","last_change":"2023-07-11T00:30:10.061029+0000","last_active":"2023-07-11T00:30:11.116515+0000","last_peered":"2023-07-11T00:30:11.116515+0000","last_clean":"2023-07-11T00:30:11.116515+0000","last_became_active":"2023-07-11T00:30:10.060602+0000","last_became_peered":"2023-07-11T00:30:10.060602+0000","last_unstale":"2023-07-11T00:30:11.116515+0000","last_undegraded":"2023-07-11T00:30:11.116515+0000","last_fullsized":"2023-07-11T00:30:11.116515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:09:45.109946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116660+0000","last_change":"2023-07-11T00:30:04.907017+0000","last_active":"2023-07-11T00:30:11.116660+0000","last_peered":"2023-07-11T00:30:11.116660+0000","last_clean":"2023-07-11T00:30:11.116660+0000","last_became_active":"2023-07-11T00:30:04.906643+0000","last_became_peered":"2023-07-11T00:30:04.906643+0000","last_unstale":"2023-07-11T00:30:11.116660+0000","last_undegraded":"2023-07-11T00:30:11.116660+0000","last_fullsized":"2023-07-11T00:30:11.116660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:59:35.767800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058314+0000","last_change":"2023-07-11T00:30:05.917921+0000","last_active":"2023-07-11T00:30:11.058314+0000","last_peered":"2023-07-11T00:30:11.058314+0000","last_clean":"2023-07-11T00:30:11.058314+0000","last_became_active":"2023-07-11T00:30:05.917626+0000","last_became_peered":"2023-07-11T00:30:05.917626+0000","last_unstale":"2023-07-11T00:30:11.058314+0000","last_undegraded":"2023-07-11T00:30:11.058314+0000","last_fullsized":"2023-07-11T00:30:11.058314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:56:13.450429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117705+0000","last_change":"2023-07-11T00:30:10.074654+0000","last_active":"2023-07-11T00:30:11.117705+0000","last_peered":"2023-07-11T00:30:11.117705+0000","last_clean":"2023-07-11T00:30:11.117705+0000","last_became_active":"2023-07-11T00:30:10.071607+0000","last_became_peered":"2023-07-11T00:30:10.071607+0000","last_unstale":"2023-07-11T00:30:11.117705+0000","last_undegraded":"2023-07-11T00:30:11.117705+0000","last_fullsized":"2023-07-11T00:30:11.117705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:03:08.156374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118186+0000","last_change":"2023-07-11T00:30:04.909409+0000","last_active":"2023-07-11T00:30:11.118186+0000","last_peered":"2023-07-11T00:30:11.118186+0000","last_clean":"2023-07-11T00:30:11.118186+0000","last_became_active":"2023-07-11T00:30:04.909108+0000","last_became_peered":"2023-07-11T00:30:04.909108+0000","last_unstale":"2023-07-11T00:30:11.118186+0000","last_undegraded":"2023-07-11T00:30:11.118186+0000","last_fullsized":"2023-07-11T00:30:11.118186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:22:03.652063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058847+0000","last_change":"2023-07-11T00:30:05.915428+0000","last_active":"2023-07-11T00:30:11.058847+0000","last_peered":"2023-07-11T00:30:11.058847+0000","last_clean":"2023-07-11T00:30:11.058847+0000","last_became_active":"2023-07-11T00:30:05.914309+0000","last_became_peered":"2023-07-11T00:30:05.914309+0000","last_unstale":"2023-07-11T00:30:11.058847+0000","last_undegraded":"2023-07-11T00:30:11.058847+0000","last_fullsized":"2023-07-11T00:30:11.058847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:39.029858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117114+0000","last_change":"2023-07-11T00:30:10.070740+0000","last_active":"2023-07-11T00:30:11.117114+0000","last_peered":"2023-07-11T00:30:11.117114+0000","last_clean":"2023-07-11T00:30:11.117114+0000","last_became_active":"2023-07-11T00:30:10.070140+0000","last_became_peered":"2023-07-11T00:30:10.070140+0000","last_unstale":"2023-07-11T00:30:11.117114+0000","last_undegraded":"2023-07-11T00:30:11.117114+0000","last_fullsized":"2023-07-11T00:30:11.117114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:07:59.464538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057584+0000","last_change":"2023-07-11T00:30:04.912890+0000","last_active":"2023-07-11T00:30:11.057584+0000","last_peered":"2023-07-11T00:30:11.057584+0000","last_clean":"2023-07-11T00:30:11.057584+0000","last_became_active":"2023-07-11T00:30:04.912603+0000","last_became_peered":"2023-07-11T00:30:04.912603+0000","last_unstale":"2023-07-11T00:30:11.057584+0000","last_undegraded":"2023-07-11T00:30:11.057584+0000","last_fullsized":"2023-07-11T00:30:11.057584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:33:16.183321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058428+0000","last_change":"2023-07-11T00:30:05.914876+0000","last_active":"2023-07-11T00:30:11.058428+0000","last_peered":"2023-07-11T00:30:11.058428+0000","last_clean":"2023-07-11T00:30:11.058428+0000","last_became_active":"2023-07-11T00:30:05.914556+0000","last_became_peered":"2023-07-11T00:30:05.914556+0000","last_unstale":"2023-07-11T00:30:11.058428+0000","last_undegraded":"2023-07-11T00:30:11.058428+0000","last_fullsized":"2023-07-11T00:30:11.058428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:01:38.063704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117150+0000","last_change":"2023-07-11T00:30:10.070879+0000","last_active":"2023-07-11T00:30:11.117150+0000","last_peered":"2023-07-11T00:30:11.117150+0000","last_clean":"2023-07-11T00:30:11.117150+0000","last_became_active":"2023-07-11T00:30:10.070373+0000","last_became_peered":"2023-07-11T00:30:10.070373+0000","last_unstale":"2023-07-11T00:30:11.117150+0000","last_undegraded":"2023-07-11T00:30:11.117150+0000","last_fullsized":"2023-07-11T00:30:11.117150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:51:46.845210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058991+0000","last_change":"2023-07-11T00:30:04.914965+0000","last_active":"2023-07-11T00:30:11.058991+0000","last_peered":"2023-07-11T00:30:11.058991+0000","last_clean":"2023-07-11T00:30:11.058991+0000","last_became_active":"2023-07-11T00:30:04.914499+0000","last_became_peered":"2023-07-11T00:30:04.914499+0000","last_unstale":"2023-07-11T00:30:11.058991+0000","last_undegraded":"2023-07-11T00:30:11.058991+0000","last_fullsized":"2023-07-11T00:30:11.058991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:29:02.495865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059980+0000","last_change":"2023-07-11T00:30:05.910772+0000","last_active":"2023-07-11T00:30:11.059980+0000","last_peered":"2023-07-11T00:30:11.059980+0000","last_clean":"2023-07-11T00:30:11.059980+0000","last_became_active":"2023-07-11T00:30:05.909373+0000","last_became_peered":"2023-07-11T00:30:05.909373+0000","last_unstale":"2023-07-11T00:30:11.059980+0000","last_undegraded":"2023-07-11T00:30:11.059980+0000","last_fullsized":"2023-07-11T00:30:11.059980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:39:38.348755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059752+0000","last_change":"2023-07-11T00:30:10.080512+0000","last_active":"2023-07-11T00:30:11.059752+0000","last_peered":"2023-07-11T00:30:11.059752+0000","last_clean":"2023-07-11T00:30:11.059752+0000","last_became_active":"2023-07-11T00:30:10.080095+0000","last_became_peered":"2023-07-11T00:30:10.080095+0000","last_unstale":"2023-07-11T00:30:11.059752+0000","last_undegraded":"2023-07-11T00:30:11.059752+0000","last_fullsized":"2023-07-11T00:30:11.059752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:50:46.705526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.119006+0000","last_change":"2023-07-11T00:30:04.901845+0000","last_active":"2023-07-11T00:30:11.119006+0000","last_peered":"2023-07-11T00:30:11.119006+0000","last_clean":"2023-07-11T00:30:11.119006+0000","last_became_active":"2023-07-11T00:30:04.901568+0000","last_became_peered":"2023-07-11T00:30:04.901568+0000","last_unstale":"2023-07-11T00:30:11.119006+0000","last_undegraded":"2023-07-11T00:30:11.119006+0000","last_fullsized":"2023-07-11T00:30:11.119006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:48:35.160743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118215+0000","last_change":"2023-07-11T00:30:05.921748+0000","last_active":"2023-07-11T00:30:11.118215+0000","last_peered":"2023-07-11T00:30:11.118215+0000","last_clean":"2023-07-11T00:30:11.118215+0000","last_became_active":"2023-07-11T00:30:05.921455+0000","last_became_peered":"2023-07-11T00:30:05.921455+0000","last_unstale":"2023-07-11T00:30:11.118215+0000","last_undegraded":"2023-07-11T00:30:11.118215+0000","last_fullsized":"2023-07-11T00:30:11.118215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:49:28.388344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059460+0000","last_change":"2023-07-11T00:30:10.067600+0000","last_active":"2023-07-11T00:30:11.059460+0000","last_peered":"2023-07-11T00:30:11.059460+0000","last_clean":"2023-07-11T00:30:11.059460+0000","last_became_active":"2023-07-11T00:30:10.067214+0000","last_became_peered":"2023-07-11T00:30:10.067214+0000","last_unstale":"2023-07-11T00:30:11.059460+0000","last_undegraded":"2023-07-11T00:30:11.059460+0000","last_fullsized":"2023-07-11T00:30:11.059460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:16:23.912787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117616+0000","last_change":"2023-07-11T00:30:04.904613+0000","last_active":"2023-07-11T00:30:11.117616+0000","last_peered":"2023-07-11T00:30:11.117616+0000","last_clean":"2023-07-11T00:30:11.117616+0000","last_became_active":"2023-07-11T00:30:04.904312+0000","last_became_peered":"2023-07-11T00:30:04.904312+0000","last_unstale":"2023-07-11T00:30:11.117616+0000","last_undegraded":"2023-07-11T00:30:11.117616+0000","last_fullsized":"2023-07-11T00:30:11.117616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:29:02.495865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058655+0000","last_change":"2023-07-11T00:29:59.627086+0000","last_active":"2023-07-11T00:30:11.058655+0000","last_peered":"2023-07-11T00:30:11.058655+0000","last_clean":"2023-07-11T00:30:11.058655+0000","last_became_active":"2023-07-11T00:29:59.626687+0000","last_became_peered":"2023-07-11T00:29:59.626687+0000","last_unstale":"2023-07-11T00:30:11.058655+0000","last_undegraded":"2023-07-11T00:30:11.058655+0000","last_fullsized":"2023-07-11T00:30:11.058655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:31:04.583322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118938+0000","last_change":"2023-07-11T00:30:05.906700+0000","last_active":"2023-07-11T00:30:11.118938+0000","last_peered":"2023-07-11T00:30:11.118938+0000","last_clean":"2023-07-11T00:30:11.118938+0000","last_became_active":"2023-07-11T00:30:05.906333+0000","last_became_peered":"2023-07-11T00:30:05.906333+0000","last_unstale":"2023-07-11T00:30:11.118938+0000","last_undegraded":"2023-07-11T00:30:11.118938+0000","last_fullsized":"2023-07-11T00:30:11.118938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:12:42.514924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118845+0000","last_change":"2023-07-11T00:30:10.068326+0000","last_active":"2023-07-11T00:30:11.118845+0000","last_peered":"2023-07-11T00:30:11.118845+0000","last_clean":"2023-07-11T00:30:11.118845+0000","last_became_active":"2023-07-11T00:30:10.067893+0000","last_became_peered":"2023-07-11T00:30:10.067893+0000","last_unstale":"2023-07-11T00:30:11.118845+0000","last_undegraded":"2023-07-11T00:30:11.118845+0000","last_fullsized":"2023-07-11T00:30:11.118845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:16:23.912787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116953+0000","last_change":"2023-07-11T00:29:59.589317+0000","last_active":"2023-07-11T00:30:11.116953+0000","last_peered":"2023-07-11T00:30:11.116953+0000","last_clean":"2023-07-11T00:30:11.116953+0000","last_became_active":"2023-07-11T00:29:59.588926+0000","last_became_peered":"2023-07-11T00:29:59.588926+0000","last_unstale":"2023-07-11T00:30:11.116953+0000","last_undegraded":"2023-07-11T00:30:11.116953+0000","last_fullsized":"2023-07-11T00:30:11.116953+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:32.725207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058442+0000","last_change":"2023-07-11T00:30:04.907209+0000","last_active":"2023-07-11T00:30:11.058442+0000","last_peered":"2023-07-11T00:30:11.058442+0000","last_clean":"2023-07-11T00:30:11.058442+0000","last_became_active":"2023-07-11T00:30:04.906867+0000","last_became_peered":"2023-07-11T00:30:04.906867+0000","last_unstale":"2023-07-11T00:30:11.058442+0000","last_undegraded":"2023-07-11T00:30:11.058442+0000","last_fullsized":"2023-07-11T00:30:11.058442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:23:05.032572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059163+0000","last_change":"2023-07-11T00:30:05.917328+0000","last_active":"2023-07-11T00:30:11.059163+0000","last_peered":"2023-07-11T00:30:11.059163+0000","last_clean":"2023-07-11T00:30:11.059163+0000","last_became_active":"2023-07-11T00:30:05.916946+0000","last_became_peered":"2023-07-11T00:30:05.916946+0000","last_unstale":"2023-07-11T00:30:11.059163+0000","last_undegraded":"2023-07-11T00:30:11.059163+0000","last_fullsized":"2023-07-11T00:30:11.059163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:13:25.822286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117049+0000","last_change":"2023-07-11T00:30:10.082010+0000","last_active":"2023-07-11T00:30:11.117049+0000","last_peered":"2023-07-11T00:30:11.117049+0000","last_clean":"2023-07-11T00:30:11.117049+0000","last_became_active":"2023-07-11T00:30:10.081582+0000","last_became_peered":"2023-07-11T00:30:10.081582+0000","last_unstale":"2023-07-11T00:30:11.117049+0000","last_undegraded":"2023-07-11T00:30:11.117049+0000","last_fullsized":"2023-07-11T00:30:11.117049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:33:51.022506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118518+0000","last_change":"2023-07-11T00:29:59.585672+0000","last_active":"2023-07-11T00:30:11.118518+0000","last_peered":"2023-07-11T00:30:11.118518+0000","last_clean":"2023-07-11T00:30:11.118518+0000","last_became_active":"2023-07-11T00:29:59.585405+0000","last_became_peered":"2023-07-11T00:29:59.585405+0000","last_unstale":"2023-07-11T00:30:11.118518+0000","last_undegraded":"2023-07-11T00:30:11.118518+0000","last_fullsized":"2023-07-11T00:30:11.118518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:16:53.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115934+0000","last_change":"2023-07-11T00:29:59.589132+0000","last_active":"2023-07-11T00:30:11.115934+0000","last_peered":"2023-07-11T00:30:11.115934+0000","last_clean":"2023-07-11T00:30:11.115934+0000","last_became_active":"2023-07-11T00:29:59.588293+0000","last_became_peered":"2023-07-11T00:29:59.588293+0000","last_unstale":"2023-07-11T00:30:11.115934+0000","last_undegraded":"2023-07-11T00:30:11.115934+0000","last_fullsized":"2023-07-11T00:30:11.115934+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:36:10.586940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057956+0000","last_change":"2023-07-11T00:30:04.913946+0000","last_active":"2023-07-11T00:30:11.057956+0000","last_peered":"2023-07-11T00:30:11.057956+0000","last_clean":"2023-07-11T00:30:11.057956+0000","last_became_active":"2023-07-11T00:30:04.913711+0000","last_became_peered":"2023-07-11T00:30:04.913711+0000","last_unstale":"2023-07-11T00:30:11.057956+0000","last_undegraded":"2023-07-11T00:30:11.057956+0000","last_fullsized":"2023-07-11T00:30:11.057956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:59:36.700622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058778+0000","last_change":"2023-07-11T00:30:05.918327+0000","last_active":"2023-07-11T00:30:11.058778+0000","last_peered":"2023-07-11T00:30:11.058778+0000","last_clean":"2023-07-11T00:30:11.058778+0000","last_became_active":"2023-07-11T00:30:05.917953+0000","last_became_peered":"2023-07-11T00:30:05.917953+0000","last_unstale":"2023-07-11T00:30:11.058778+0000","last_undegraded":"2023-07-11T00:30:11.058778+0000","last_fullsized":"2023-07-11T00:30:11.058778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:44:29.464142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116829+0000","last_change":"2023-07-11T00:30:10.073421+0000","last_active":"2023-07-11T00:30:11.116829+0000","last_peered":"2023-07-11T00:30:11.116829+0000","last_clean":"2023-07-11T00:30:11.116829+0000","last_became_active":"2023-07-11T00:30:10.073124+0000","last_became_peered":"2023-07-11T00:30:10.073124+0000","last_unstale":"2023-07-11T00:30:11.116829+0000","last_undegraded":"2023-07-11T00:30:11.116829+0000","last_fullsized":"2023-07-11T00:30:11.116829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:42:54.748014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115890+0000","last_change":"2023-07-11T00:29:59.978997+0000","last_active":"2023-07-11T00:30:11.115890+0000","last_peered":"2023-07-11T00:30:11.115890+0000","last_clean":"2023-07-11T00:30:11.115890+0000","last_became_active":"2023-07-11T00:29:59.978716+0000","last_became_peered":"2023-07-11T00:29:59.978716+0000","last_unstale":"2023-07-11T00:30:11.115890+0000","last_undegraded":"2023-07-11T00:30:11.115890+0000","last_fullsized":"2023-07-11T00:30:11.115890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:43:49.863623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116128+0000","last_change":"2023-07-11T00:30:04.910937+0000","last_active":"2023-07-11T00:30:11.116128+0000","last_peered":"2023-07-11T00:30:11.116128+0000","last_clean":"2023-07-11T00:30:11.116128+0000","last_became_active":"2023-07-11T00:30:04.910458+0000","last_became_peered":"2023-07-11T00:30:04.910458+0000","last_unstale":"2023-07-11T00:30:11.116128+0000","last_undegraded":"2023-07-11T00:30:11.116128+0000","last_fullsized":"2023-07-11T00:30:11.116128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:59:36.700622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118101+0000","last_change":"2023-07-11T00:30:05.914883+0000","last_active":"2023-07-11T00:30:11.118101+0000","last_peered":"2023-07-11T00:30:11.118101+0000","last_clean":"2023-07-11T00:30:11.118101+0000","last_became_active":"2023-07-11T00:30:05.914349+0000","last_became_peered":"2023-07-11T00:30:05.914349+0000","last_unstale":"2023-07-11T00:30:11.118101+0000","last_undegraded":"2023-07-11T00:30:11.118101+0000","last_fullsized":"2023-07-11T00:30:11.118101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:32:58.816922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117060+0000","last_change":"2023-07-11T00:30:10.074427+0000","last_active":"2023-07-11T00:30:11.117060+0000","last_peered":"2023-07-11T00:30:11.117060+0000","last_clean":"2023-07-11T00:30:11.117060+0000","last_became_active":"2023-07-11T00:30:10.073876+0000","last_became_peered":"2023-07-11T00:30:10.073876+0000","last_unstale":"2023-07-11T00:30:11.117060+0000","last_undegraded":"2023-07-11T00:30:11.117060+0000","last_fullsized":"2023-07-11T00:30:11.117060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:31:15.040654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.115771+0000","last_change":"2023-07-11T00:29:59.978976+0000","last_active":"2023-07-11T00:30:11.115771+0000","last_peered":"2023-07-11T00:30:11.115771+0000","last_clean":"2023-07-11T00:30:11.115771+0000","last_became_active":"2023-07-11T00:29:59.978678+0000","last_became_peered":"2023-07-11T00:29:59.978678+0000","last_unstale":"2023-07-11T00:30:11.115771+0000","last_undegraded":"2023-07-11T00:30:11.115771+0000","last_fullsized":"2023-07-11T00:30:11.115771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:54.370342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118862+0000","last_change":"2023-07-11T00:30:04.909677+0000","last_active":"2023-07-11T00:30:11.118862+0000","last_peered":"2023-07-11T00:30:11.118862+0000","last_clean":"2023-07-11T00:30:11.118862+0000","last_became_active":"2023-07-11T00:30:04.909389+0000","last_became_peered":"2023-07-11T00:30:04.909389+0000","last_unstale":"2023-07-11T00:30:11.118862+0000","last_undegraded":"2023-07-11T00:30:11.118862+0000","last_fullsized":"2023-07-11T00:30:11.118862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:41:27.161304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058572+0000","last_change":"2023-07-11T00:30:05.921943+0000","last_active":"2023-07-11T00:30:11.058572+0000","last_peered":"2023-07-11T00:30:11.058572+0000","last_clean":"2023-07-11T00:30:11.058572+0000","last_became_active":"2023-07-11T00:30:05.921610+0000","last_became_peered":"2023-07-11T00:30:05.921610+0000","last_unstale":"2023-07-11T00:30:11.058572+0000","last_undegraded":"2023-07-11T00:30:11.058572+0000","last_fullsized":"2023-07-11T00:30:11.058572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:34:52.723278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058455+0000","last_change":"2023-07-11T00:30:10.073091+0000","last_active":"2023-07-11T00:30:11.058455+0000","last_peered":"2023-07-11T00:30:11.058455+0000","last_clean":"2023-07-11T00:30:11.058455+0000","last_became_active":"2023-07-11T00:30:10.072625+0000","last_became_peered":"2023-07-11T00:30:10.072625+0000","last_unstale":"2023-07-11T00:30:11.058455+0000","last_undegraded":"2023-07-11T00:30:11.058455+0000","last_fullsized":"2023-07-11T00:30:11.058455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:56:33.500478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116185+0000","last_change":"2023-07-11T00:29:59.979163+0000","last_active":"2023-07-11T00:30:11.116185+0000","last_peered":"2023-07-11T00:30:11.116185+0000","last_clean":"2023-07-11T00:30:11.116185+0000","last_became_active":"2023-07-11T00:29:59.978751+0000","last_became_peered":"2023-07-11T00:29:59.978751+0000","last_unstale":"2023-07-11T00:30:11.116185+0000","last_undegraded":"2023-07-11T00:30:11.116185+0000","last_fullsized":"2023-07-11T00:30:11.116185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:32:52.512271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058712+0000","last_change":"2023-07-11T00:30:04.909467+0000","last_active":"2023-07-11T00:30:11.058712+0000","last_peered":"2023-07-11T00:30:11.058712+0000","last_clean":"2023-07-11T00:30:11.058712+0000","last_became_active":"2023-07-11T00:30:04.908512+0000","last_became_peered":"2023-07-11T00:30:04.908512+0000","last_unstale":"2023-07-11T00:30:11.058712+0000","last_undegraded":"2023-07-11T00:30:11.058712+0000","last_fullsized":"2023-07-11T00:30:11.058712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:09:25.815497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116448+0000","last_change":"2023-07-11T00:30:05.915403+0000","last_active":"2023-07-11T00:30:11.116448+0000","last_peered":"2023-07-11T00:30:11.116448+0000","last_clean":"2023-07-11T00:30:11.116448+0000","last_became_active":"2023-07-11T00:30:05.915006+0000","last_became_peered":"2023-07-11T00:30:05.915006+0000","last_unstale":"2023-07-11T00:30:11.116448+0000","last_undegraded":"2023-07-11T00:30:11.116448+0000","last_fullsized":"2023-07-11T00:30:11.116448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:00:50.065083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057855+0000","last_change":"2023-07-11T00:30:10.074777+0000","last_active":"2023-07-11T00:30:11.057855+0000","last_peered":"2023-07-11T00:30:11.057855+0000","last_clean":"2023-07-11T00:30:11.057855+0000","last_became_active":"2023-07-11T00:30:10.073612+0000","last_became_peered":"2023-07-11T00:30:10.073612+0000","last_unstale":"2023-07-11T00:30:11.057855+0000","last_undegraded":"2023-07-11T00:30:11.057855+0000","last_fullsized":"2023-07-11T00:30:11.057855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:37:55.556018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058461+0000","last_change":"2023-07-11T00:29:59.978981+0000","last_active":"2023-07-11T00:30:11.058461+0000","last_peered":"2023-07-11T00:30:11.058461+0000","last_clean":"2023-07-11T00:30:11.058461+0000","last_became_active":"2023-07-11T00:29:59.978633+0000","last_became_peered":"2023-07-11T00:29:59.978633+0000","last_unstale":"2023-07-11T00:30:11.058461+0000","last_undegraded":"2023-07-11T00:30:11.058461+0000","last_fullsized":"2023-07-11T00:30:11.058461+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:39:53.945627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116711+0000","last_change":"2023-07-11T00:30:04.915315+0000","last_active":"2023-07-11T00:30:11.116711+0000","last_peered":"2023-07-11T00:30:11.116711+0000","last_clean":"2023-07-11T00:30:11.116711+0000","last_became_active":"2023-07-11T00:30:04.914975+0000","last_became_peered":"2023-07-11T00:30:04.914975+0000","last_unstale":"2023-07-11T00:30:11.116711+0000","last_undegraded":"2023-07-11T00:30:11.116711+0000","last_fullsized":"2023-07-11T00:30:11.116711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:56:28.345089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058475+0000","last_change":"2023-07-11T00:30:05.911135+0000","last_active":"2023-07-11T00:30:11.058475+0000","last_peered":"2023-07-11T00:30:11.058475+0000","last_clean":"2023-07-11T00:30:11.058475+0000","last_became_active":"2023-07-11T00:30:05.910827+0000","last_became_peered":"2023-07-11T00:30:05.910827+0000","last_unstale":"2023-07-11T00:30:11.058475+0000","last_undegraded":"2023-07-11T00:30:11.058475+0000","last_fullsized":"2023-07-11T00:30:11.058475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:32:58.816922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058181+0000","last_change":"2023-07-11T00:30:10.083291+0000","last_active":"2023-07-11T00:30:11.058181+0000","last_peered":"2023-07-11T00:30:11.058181+0000","last_clean":"2023-07-11T00:30:11.058181+0000","last_became_active":"2023-07-11T00:30:10.082895+0000","last_became_peered":"2023-07-11T00:30:10.082895+0000","last_unstale":"2023-07-11T00:30:11.058181+0000","last_undegraded":"2023-07-11T00:30:11.058181+0000","last_fullsized":"2023-07-11T00:30:11.058181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:21:54.408864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.060161+0000","last_change":"2023-07-11T00:29:59.585652+0000","last_active":"2023-07-11T00:30:11.060161+0000","last_peered":"2023-07-11T00:30:11.060161+0000","last_clean":"2023-07-11T00:30:11.060161+0000","last_became_active":"2023-07-11T00:29:59.585316+0000","last_became_peered":"2023-07-11T00:29:59.585316+0000","last_unstale":"2023-07-11T00:30:11.060161+0000","last_undegraded":"2023-07-11T00:30:11.060161+0000","last_fullsized":"2023-07-11T00:30:11.060161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:14:02.980670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116535+0000","last_change":"2023-07-11T00:30:04.908230+0000","last_active":"2023-07-11T00:30:11.116535+0000","last_peered":"2023-07-11T00:30:11.116535+0000","last_clean":"2023-07-11T00:30:11.116535+0000","last_became_active":"2023-07-11T00:30:04.907876+0000","last_became_peered":"2023-07-11T00:30:04.907876+0000","last_unstale":"2023-07-11T00:30:11.116535+0000","last_undegraded":"2023-07-11T00:30:11.116535+0000","last_fullsized":"2023-07-11T00:30:11.116535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:44:28.461434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118728+0000","last_change":"2023-07-11T00:30:05.909462+0000","last_active":"2023-07-11T00:30:11.118728+0000","last_peered":"2023-07-11T00:30:11.118728+0000","last_clean":"2023-07-11T00:30:11.118728+0000","last_became_active":"2023-07-11T00:30:05.909171+0000","last_became_peered":"2023-07-11T00:30:05.909171+0000","last_unstale":"2023-07-11T00:30:11.118728+0000","last_undegraded":"2023-07-11T00:30:11.118728+0000","last_fullsized":"2023-07-11T00:30:11.118728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:02:21.282407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.117001+0000","last_change":"2023-07-11T00:30:10.071266+0000","last_active":"2023-07-11T00:30:11.117001+0000","last_peered":"2023-07-11T00:30:11.117001+0000","last_clean":"2023-07-11T00:30:11.117001+0000","last_became_active":"2023-07-11T00:30:10.070503+0000","last_became_peered":"2023-07-11T00:30:10.070503+0000","last_unstale":"2023-07-11T00:30:11.117001+0000","last_undegraded":"2023-07-11T00:30:11.117001+0000","last_fullsized":"2023-07-11T00:30:11.117001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:57:33.279600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058426+0000","last_change":"2023-07-11T00:30:04.913993+0000","last_active":"2023-07-11T00:30:11.058426+0000","last_peered":"2023-07-11T00:30:11.058426+0000","last_clean":"2023-07-11T00:30:11.058426+0000","last_became_active":"2023-07-11T00:30:04.913642+0000","last_became_peered":"2023-07-11T00:30:04.913642+0000","last_unstale":"2023-07-11T00:30:11.058426+0000","last_undegraded":"2023-07-11T00:30:11.058426+0000","last_fullsized":"2023-07-11T00:30:11.058426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:57:28.124211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118217+0000","last_change":"2023-07-11T00:30:05.919099+0000","last_active":"2023-07-11T00:30:11.118217+0000","last_peered":"2023-07-11T00:30:11.118217+0000","last_clean":"2023-07-11T00:30:11.118217+0000","last_became_active":"2023-07-11T00:30:05.918814+0000","last_became_peered":"2023-07-11T00:30:05.918814+0000","last_unstale":"2023-07-11T00:30:11.118217+0000","last_undegraded":"2023-07-11T00:30:11.118217+0000","last_fullsized":"2023-07-11T00:30:11.118217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:30:43.008997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116071+0000","last_change":"2023-07-11T00:30:10.069011+0000","last_active":"2023-07-11T00:30:11.116071+0000","last_peered":"2023-07-11T00:30:11.116071+0000","last_clean":"2023-07-11T00:30:11.116071+0000","last_became_active":"2023-07-11T00:30:10.068592+0000","last_became_peered":"2023-07-11T00:30:10.068592+0000","last_unstale":"2023-07-11T00:30:11.116071+0000","last_undegraded":"2023-07-11T00:30:11.116071+0000","last_fullsized":"2023-07-11T00:30:11.116071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:59:40.923189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116511+0000","last_change":"2023-07-11T00:30:04.915144+0000","last_active":"2023-07-11T00:30:11.116511+0000","last_peered":"2023-07-11T00:30:11.116511+0000","last_clean":"2023-07-11T00:30:11.116511+0000","last_became_active":"2023-07-11T00:30:04.914857+0000","last_became_peered":"2023-07-11T00:30:04.914857+0000","last_unstale":"2023-07-11T00:30:11.116511+0000","last_undegraded":"2023-07-11T00:30:11.116511+0000","last_fullsized":"2023-07-11T00:30:11.116511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:08:03.914295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058885+0000","last_change":"2023-07-11T00:30:05.915668+0000","last_active":"2023-07-11T00:30:11.058885+0000","last_peered":"2023-07-11T00:30:11.058885+0000","last_clean":"2023-07-11T00:30:11.058885+0000","last_became_active":"2023-07-11T00:30:05.915103+0000","last_became_peered":"2023-07-11T00:30:05.915103+0000","last_unstale":"2023-07-11T00:30:11.058885+0000","last_undegraded":"2023-07-11T00:30:11.058885+0000","last_fullsized":"2023-07-11T00:30:11.058885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:22:56.265053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116786+0000","last_change":"2023-07-11T00:30:10.081391+0000","last_active":"2023-07-11T00:30:11.116786+0000","last_peered":"2023-07-11T00:30:11.116786+0000","last_clean":"2023-07-11T00:30:11.116786+0000","last_became_active":"2023-07-11T00:30:10.080979+0000","last_became_peered":"2023-07-11T00:30:10.080979+0000","last_unstale":"2023-07-11T00:30:11.116786+0000","last_undegraded":"2023-07-11T00:30:11.116786+0000","last_fullsized":"2023-07-11T00:30:11.116786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:49:32.541025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116347+0000","last_change":"2023-07-11T00:30:04.913406+0000","last_active":"2023-07-11T00:30:11.116347+0000","last_peered":"2023-07-11T00:30:11.116347+0000","last_clean":"2023-07-11T00:30:11.116347+0000","last_became_active":"2023-07-11T00:30:04.913025+0000","last_became_peered":"2023-07-11T00:30:04.913025+0000","last_unstale":"2023-07-11T00:30:11.116347+0000","last_undegraded":"2023-07-11T00:30:11.116347+0000","last_fullsized":"2023-07-11T00:30:11.116347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:37:24.276199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059362+0000","last_change":"2023-07-11T00:30:05.916740+0000","last_active":"2023-07-11T00:30:11.059362+0000","last_peered":"2023-07-11T00:30:11.059362+0000","last_clean":"2023-07-11T00:30:11.059362+0000","last_became_active":"2023-07-11T00:30:05.913008+0000","last_became_peered":"2023-07-11T00:30:05.913008+0000","last_unstale":"2023-07-11T00:30:11.059362+0000","last_undegraded":"2023-07-11T00:30:11.059362+0000","last_fullsized":"2023-07-11T00:30:11.059362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:25:47.194347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058162+0000","last_change":"2023-07-11T00:30:10.066428+0000","last_active":"2023-07-11T00:30:11.058162+0000","last_peered":"2023-07-11T00:30:11.058162+0000","last_clean":"2023-07-11T00:30:11.058162+0000","last_became_active":"2023-07-11T00:30:10.065932+0000","last_became_peered":"2023-07-11T00:30:10.065932+0000","last_unstale":"2023-07-11T00:30:11.058162+0000","last_undegraded":"2023-07-11T00:30:11.058162+0000","last_fullsized":"2023-07-11T00:30:11.058162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:02:54.740793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116255+0000","last_change":"2023-07-11T00:30:04.911637+0000","last_active":"2023-07-11T00:30:11.116255+0000","last_peered":"2023-07-11T00:30:11.116255+0000","last_clean":"2023-07-11T00:30:11.116255+0000","last_became_active":"2023-07-11T00:30:04.911311+0000","last_became_peered":"2023-07-11T00:30:04.911311+0000","last_unstale":"2023-07-11T00:30:11.116255+0000","last_undegraded":"2023-07-11T00:30:11.116255+0000","last_fullsized":"2023-07-11T00:30:11.116255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:47:48.434930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116470+0000","last_change":"2023-07-11T00:30:05.908686+0000","last_active":"2023-07-11T00:30:11.116470+0000","last_peered":"2023-07-11T00:30:11.116470+0000","last_clean":"2023-07-11T00:30:11.116470+0000","last_became_active":"2023-07-11T00:30:05.908384+0000","last_became_peered":"2023-07-11T00:30:05.908384+0000","last_unstale":"2023-07-11T00:30:11.116470+0000","last_undegraded":"2023-07-11T00:30:11.116470+0000","last_fullsized":"2023-07-11T00:30:11.116470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:01:38.063704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116672+0000","last_change":"2023-07-11T00:30:10.073737+0000","last_active":"2023-07-11T00:30:11.116672+0000","last_peered":"2023-07-11T00:30:11.116672+0000","last_clean":"2023-07-11T00:30:11.116672+0000","last_became_active":"2023-07-11T00:30:10.073270+0000","last_became_peered":"2023-07-11T00:30:10.073270+0000","last_unstale":"2023-07-11T00:30:11.116672+0000","last_undegraded":"2023-07-11T00:30:11.116672+0000","last_fullsized":"2023-07-11T00:30:11.116672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:09.031763+0000","last_clean_scrub_stamp":"2023-07-11T00:30:09.031763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:56:17.603111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058726+0000","last_change":"2023-07-11T00:30:04.911003+0000","last_active":"2023-07-11T00:30:11.058726+0000","last_peered":"2023-07-11T00:30:11.058726+0000","last_clean":"2023-07-11T00:30:11.058726+0000","last_became_active":"2023-07-11T00:30:04.910696+0000","last_became_peered":"2023-07-11T00:30:04.910696+0000","last_unstale":"2023-07-11T00:30:11.058726+0000","last_undegraded":"2023-07-11T00:30:11.058726+0000","last_fullsized":"2023-07-11T00:30:11.058726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:03.876374+0000","last_clean_scrub_stamp":"2023-07-11T00:30:03.876374+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:08:03.914295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.058582+0000","last_change":"2023-07-11T00:30:05.910836+0000","last_active":"2023-07-11T00:30:11.058582+0000","last_peered":"2023-07-11T00:30:11.058582+0000","last_clean":"2023-07-11T00:30:11.058582+0000","last_became_active":"2023-07-11T00:30:05.907744+0000","last_became_peered":"2023-07-11T00:30:05.907744+0000","last_unstale":"2023-07-11T00:30:11.058582+0000","last_undegraded":"2023-07-11T00:30:11.058582+0000","last_fullsized":"2023-07-11T00:30:11.058582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:53.843877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.057491+0000","last_change":"2023-07-11T00:30:05.912291+0000","last_active":"2023-07-11T00:30:11.057491+0000","last_peered":"2023-07-11T00:30:11.057491+0000","last_clean":"2023-07-11T00:30:11.057491+0000","last_became_active":"2023-07-11T00:30:05.912020+0000","last_became_peered":"2023-07-11T00:30:05.912020+0000","last_unstale":"2023-07-11T00:30:11.057491+0000","last_undegraded":"2023-07-11T00:30:11.057491+0000","last_fullsized":"2023-07-11T00:30:11.057491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:35:14.541189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116735+0000","last_change":"2023-07-11T00:30:05.915128+0000","last_active":"2023-07-11T00:30:11.116735+0000","last_peered":"2023-07-11T00:30:11.116735+0000","last_clean":"2023-07-11T00:30:11.116735+0000","last_became_active":"2023-07-11T00:30:05.914684+0000","last_became_peered":"2023-07-11T00:30:05.914684+0000","last_unstale":"2023-07-11T00:30:11.116735+0000","last_undegraded":"2023-07-11T00:30:11.116735+0000","last_fullsized":"2023-07-11T00:30:11.116735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:31:10.887973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.059928+0000","last_change":"2023-07-11T00:30:05.911543+0000","last_active":"2023-07-11T00:30:11.059928+0000","last_peered":"2023-07-11T00:30:11.059928+0000","last_clean":"2023-07-11T00:30:11.059928+0000","last_became_active":"2023-07-11T00:30:05.911204+0000","last_became_peered":"2023-07-11T00:30:05.911204+0000","last_unstale":"2023-07-11T00:30:11.059928+0000","last_undegraded":"2023-07-11T00:30:11.059928+0000","last_fullsized":"2023-07-11T00:30:11.059928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:08:16.283098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.118055+0000","last_change":"2023-07-11T00:30:05.906824+0000","last_active":"2023-07-11T00:30:11.118055+0000","last_peered":"2023-07-11T00:30:11.118055+0000","last_clean":"2023-07-11T00:30:11.118055+0000","last_became_active":"2023-07-11T00:30:05.906357+0000","last_became_peered":"2023-07-11T00:30:05.906357+0000","last_unstale":"2023-07-11T00:30:11.118055+0000","last_undegraded":"2023-07-11T00:30:11.118055+0000","last_fullsized":"2023-07-11T00:30:11.118055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:13:25.822286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-11T00:30:11.116584+0000","last_change":"2023-07-11T00:30:05.914873+0000","last_active":"2023-07-11T00:30:11.116584+0000","last_peered":"2023-07-11T00:30:11.116584+0000","last_clean":"2023-07-11T00:30:11.116584+0000","last_became_active":"2023-07-11T00:30:05.914537+0000","last_became_peered":"2023-07-11T00:30:05.914537+0000","last_unstale":"2023-07-11T00:30:11.116584+0000","last_undegraded":"2023-07-11T00:30:11.116584+0000","last_fullsized":"2023-07-11T00:30:11.116584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:30:04.879082+0000","last_clean_scrub_stamp":"2023-07-11T00:30:04.879082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:21:50.256183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":876544,"data_stored":699108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":103369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.9930000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.9800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.978999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":847872,"data_stored":695098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":103951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":104730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2989999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0779999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":103459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5640000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6040000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":108580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":104021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-11T00:30:41.972 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-11T00:30:41.973 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-11T00:30:41.973 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-11T00:30:41.973 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-11T00:30:42.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.204+0000 7f89fd9ff700 1 Processor -- start 2023-07-11T00:30:42.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.205+0000 7f89fd9ff700 1 -- start start 2023-07-11T00:30:42.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.206+0000 7f89fd9ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f89f815c460 0x7f89f80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:42.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.206+0000 7f89fd9ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f89f80d2640 0x7f89f80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:42.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.206+0000 7f89fd9ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f80d1790 con 0x7f89f80cf720 2023-07-11T00:30:42.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.206+0000 7f89fd9ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f80cedd0 con 0x7f89f815c460 2023-07-11T00:30:42.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.206+0000 7f89fd9ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f80cd950 con 0x7f89f80d2640 2023-07-11T00:30:42.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.206+0000 7f89f6ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f89f815c460 0x7f89f80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.206+0000 7f89f77fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f89f80cf720 0x7f89f80d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52248/0 (socket says 172.21.15.22:52248) 2023-07-11T00:30:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.206+0000 7f89f77fe700 1 -- 172.21.15.22:0/2295817152 learned_addr learned my addr 172.21.15.22:0/2295817152 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.207+0000 7f89f67fc700 1 --2- 172.21.15.22:0/2295817152 >> v2:172.21.15.184:3300/0 conn(0x7f89f80d2640 0x7f89f80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:42.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.207+0000 7f89f6ffd700 1 -- 172.21.15.22:0/2295817152 >> v2:172.21.15.184:3300/0 conn(0x7f89f80d2640 msgr2=0x7f89f80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:42.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.207+0000 7f89f6ffd700 1 --2- 172.21.15.22:0/2295817152 >> v2:172.21.15.184:3300/0 conn(0x7f89f80d2640 0x7f89f80cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.207+0000 7f89f6ffd700 1 -- 172.21.15.22:0/2295817152 >> v1:172.21.15.22:6789/0 conn(0x7f89f80cf720 legacy=0x7f89f80d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:42.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.207+0000 7f89f6ffd700 1 -- 172.21.15.22:0/2295817152 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f80d14b0 con 0x7f89f815c460 2023-07-11T00:30:42.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.207+0000 7f89f5ffb700 1 -- 172.21.15.22:0/2295817152 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126497104 0 0) 0x7f89f80d1790 con 0x7f89f80cf720 2023-07-11T00:30:42.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.207+0000 7f89f6ffd700 1 --2- 172.21.15.22:0/2295817152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89f815c460 0x7f89f80b59d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f89f815fd80 tx=0x7f89e8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0ee53071966eed server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:42.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.207+0000 7f89f5ffb700 1 -- 172.21.15.22:0/2295817152 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8011830 con 0x7f89f815c460 2023-07-11T00:30:42.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.207+0000 7f89f5ffb700 1 -- 172.21.15.22:0/2295817152 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8011990 con 0x7f89f815c460 2023-07-11T00:30:42.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.207+0000 7f89f5ffb700 1 -- 172.21.15.22:0/2295817152 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8011d20 con 0x7f89f815c460 2023-07-11T00:30:42.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.208+0000 7f89fd9ff700 1 -- 172.21.15.22:0/2295817152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89f815c460 msgr2=0x7f89f80b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:42.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.208+0000 7f89fd9ff700 1 --2- 172.21.15.22:0/2295817152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89f815c460 0x7f89f80b59d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f89f815fd80 tx=0x7f89e8009b20 comp rx=0 tx=0).stop 2023-07-11T00:30:42.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.208+0000 7f89fd9ff700 1 -- 172.21.15.22:0/2295817152 shutdown_connections 2023-07-11T00:30:42.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.208+0000 7f89fd9ff700 1 --2- 172.21.15.22:0/2295817152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89f815c460 0x7f89f80b59d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.208+0000 7f89fd9ff700 1 --2- 172.21.15.22:0/2295817152 >> v2:172.21.15.184:3300/0 conn(0x7f89f80d2640 0x7f89f80cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.208+0000 7f89fd9ff700 1 -- 172.21.15.22:0/2295817152 >> 172.21.15.22:0/2295817152 conn(0x7f89f8071660 msgr2=0x7f89f8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:42.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.208+0000 7f89fd9ff700 1 -- 172.21.15.22:0/2295817152 shutdown_connections 2023-07-11T00:30:42.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.208+0000 7f89fd9ff700 1 -- 172.21.15.22:0/2295817152 wait complete. 2023-07-11T00:30:42.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.210+0000 7f89fd9ff700 1 Processor -- start 2023-07-11T00:30:42.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.210+0000 7f89fd9ff700 1 -- start start 2023-07-11T00:30:42.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.211+0000 7f89fd9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89f80cf720 0x7f89f81e5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:42.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.211+0000 7f89fd9ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89f80d2640 0x7f89f80c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:42.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.211+0000 7f89fd9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89f815c460 0x7f89f81477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:42.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.211+0000 7f89fd9ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f8146790 con 0x7f89f80d2640 2023-07-11T00:30:42.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.211+0000 7f89fd9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f8146a30 con 0x7f89f80cf720 2023-07-11T00:30:42.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.211+0000 7f89fd9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f8146d10 con 0x7f89f815c460 2023-07-11T00:30:42.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.211+0000 7f89f67fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89f80d2640 0x7f89f80c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:42.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.211+0000 7f89f67fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89f80d2640 0x7f89f80c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46500/0 (socket says 172.21.15.22:46500) 2023-07-11T00:30:42.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.211+0000 7f89f67fc700 1 -- 172.21.15.22:0/3895695499 learned_addr learned my addr 172.21.15.22:0/3895695499 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:42.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.211+0000 7f89f6ffd700 1 --2- 172.21.15.22:0/3895695499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89f80cf720 0x7f89f81e5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:42.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.211+0000 7f89f77fe700 1 --2- 172.21.15.22:0/3895695499 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89f815c460 0x7f89f81477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:42.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.212+0000 7f89f67fc700 1 -- 172.21.15.22:0/3895695499 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89f815c460 msgr2=0x7f89f81477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:42.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.212+0000 7f89f67fc700 1 --2- 172.21.15.22:0/3895695499 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89f815c460 0x7f89f81477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.212+0000 7f89f67fc700 1 -- 172.21.15.22:0/3895695499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89f80cf720 msgr2=0x7f89f81e5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:42.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.212+0000 7f89f67fc700 1 --2- 172.21.15.22:0/3895695499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89f80cf720 0x7f89f81e5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.212+0000 7f89f67fc700 1 -- 172.21.15.22:0/3895695499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e80094a0 con 0x7f89f80d2640 2023-07-11T00:30:42.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.212+0000 7f89f77fe700 1 --2- 172.21.15.22:0/3895695499 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89f815c460 0x7f89f81477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:42.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.212+0000 7f89f67fc700 1 --2- 172.21.15.22:0/3895695499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89f80d2640 0x7f89f80c9db0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00d800 tx=0x7f89ec00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:42.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.212+0000 7f89dffff700 1 -- 172.21.15.22:0/3895695499 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec0125f0 con 0x7f89f80d2640 2023-07-11T00:30:42.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.212+0000 7f89dffff700 1 -- 172.21.15.22:0/3895695499 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec012750 con 0x7f89f80d2640 2023-07-11T00:30:42.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.212+0000 7f89dffff700 1 -- 172.21.15.22:0/3895695499 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec012b00 con 0x7f89f80d2640 2023-07-11T00:30:42.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.212+0000 7f89fd9ff700 1 -- 172.21.15.22:0/3895695499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f8146ff0 con 0x7f89f80d2640 2023-07-11T00:30:42.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.212+0000 7f89fd9ff700 1 -- 172.21.15.22:0/3895695499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f80ca2f0 con 0x7f89f80d2640 2023-07-11T00:30:42.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.213+0000 7f89fd9ff700 1 -- 172.21.15.22:0/3895695499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f8147510 con 0x7f89f80d2640 2023-07-11T00:30:42.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.214+0000 7f89dffff700 1 -- 172.21.15.22:0/3895695499 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f89ec012c60 con 0x7f89f80d2640 2023-07-11T00:30:42.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.215+0000 7f89dffff700 1 --2- 172.21.15.22:0/3895695499 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f89e406ace0 0x7f89e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:42.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.215+0000 7f89dffff700 1 -- 172.21.15.22:0/3895695499 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f89ec089ad0 con 0x7f89f80d2640 2023-07-11T00:30:42.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.216+0000 7f89f6ffd700 1 --2- 172.21.15.22:0/3895695499 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f89e406ace0 0x7f89e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:42.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.216+0000 7f89f6ffd700 1 --2- 172.21.15.22:0/3895695499 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f89e406ace0 0x7f89e406d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f89e80090b0 tx=0x7f89e8008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:42.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.220+0000 7f89dffff700 1 -- 172.21.15.22:0/3895695499 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f89f8147510 con 0x7f89f80d2640 2023-07-11T00:30:42.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.470+0000 7f89fd9ff700 1 -- 172.21.15.22:0/3895695499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f89f8147510 con 0x7f89f80d2640 2023-07-11T00:30:42.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.471+0000 7f89dffff700 1 -- 172.21.15.22:0/3895695499 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f89f8147510 con 0x7f89f80d2640 2023-07-11T00:30:42.475 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:42.475 INFO:teuthology.orchestra.run.smithi022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-11T00:30:42.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.473+0000 7f89fd9ff700 1 -- 172.21.15.22:0/3895695499 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f89e406ace0 msgr2=0x7f89e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:42.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.473+0000 7f89fd9ff700 1 --2- 172.21.15.22:0/3895695499 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f89e406ace0 0x7f89e406d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f89e80090b0 tx=0x7f89e8008030 comp rx=0 tx=0).stop 2023-07-11T00:30:42.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.473+0000 7f89fd9ff700 1 -- 172.21.15.22:0/3895695499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89f80d2640 msgr2=0x7f89f80c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:42.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.473+0000 7f89fd9ff700 1 --2- 172.21.15.22:0/3895695499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89f80d2640 0x7f89f80c9db0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00d800 tx=0x7f89ec00db10 comp rx=0 tx=0).stop 2023-07-11T00:30:42.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.473+0000 7f89fd9ff700 1 -- 172.21.15.22:0/3895695499 shutdown_connections 2023-07-11T00:30:42.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.473+0000 7f89fd9ff700 1 --2- 172.21.15.22:0/3895695499 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f89e406ace0 0x7f89e406d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.473+0000 7f89fd9ff700 1 --2- 172.21.15.22:0/3895695499 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89f815c460 0x7f89f81477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.473+0000 7f89fd9ff700 1 --2- 172.21.15.22:0/3895695499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89f80cf720 0x7f89f81e5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.473+0000 7f89fd9ff700 1 --2- 172.21.15.22:0/3895695499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89f80d2640 0x7f89f80c9db0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.473+0000 7f89fd9ff700 1 -- 172.21.15.22:0/3895695499 >> 172.21.15.22:0/3895695499 conn(0x7f89f8071660 msgr2=0x7f89f8156b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:42.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.473+0000 7f89fd9ff700 1 -- 172.21.15.22:0/3895695499 shutdown_connections 2023-07-11T00:30:42.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.473+0000 7f89fd9ff700 1 -- 172.21.15.22:0/3895695499 wait complete. 2023-07-11T00:30:42.493 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-11T00:30:42.494 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:30:42.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.694+0000 7fc7bbdff700 1 Processor -- start 2023-07-11T00:30:42.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.694+0000 7fc7bbdff700 1 -- start start 2023-07-11T00:30:42.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.696+0000 7fc7bbdff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc7b415c460 0x7fc7b40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:42.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.696+0000 7fc7bbdff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc7b40d2640 0x7fc7b40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:42.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.696+0000 7fc7bbdff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b40d1790 con 0x7fc7b40cf720 2023-07-11T00:30:42.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.696+0000 7fc7bbdff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b40cedd0 con 0x7fc7b40d2640 2023-07-11T00:30:42.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.696+0000 7fc7bbdff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b40cd950 con 0x7fc7b415c460 2023-07-11T00:30:42.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.696+0000 7fc7b939a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc7b40d2640 0x7fc7b40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:42.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.696+0000 7fc7b939a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc7b40d2640 0x7fc7b40cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46502/0 (socket says 172.21.15.22:46502) 2023-07-11T00:30:42.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.696+0000 7fc7b939a700 1 -- 172.21.15.22:0/2801712401 learned_addr learned my addr 172.21.15.22:0/2801712401 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:42.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.696+0000 7fc7b9b9b700 1 --2- 172.21.15.22:0/2801712401 >> v2:172.21.15.184:3300/0 conn(0x7fc7b415c460 0x7fc7b40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:42.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.697+0000 7fc7b939a700 1 -- 172.21.15.22:0/2801712401 >> v2:172.21.15.184:3300/0 conn(0x7fc7b415c460 msgr2=0x7fc7b40b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:42.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.697+0000 7fc7b939a700 1 --2- 172.21.15.22:0/2801712401 >> v2:172.21.15.184:3300/0 conn(0x7fc7b415c460 0x7fc7b40b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.697+0000 7fc7b939a700 1 -- 172.21.15.22:0/2801712401 >> v1:172.21.15.184:6789/0 conn(0x7fc7b40cf720 legacy=0x7fc7b40d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:42.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.697+0000 7fc7b939a700 1 -- 172.21.15.22:0/2801712401 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b40d14b0 con 0x7fc7b40d2640 2023-07-11T00:30:42.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.697+0000 7fc7b939a700 1 --2- 172.21.15.22:0/2801712401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7b40d2640 0x7fc7b40cf1e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40b4f00 tx=0x7fc7a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ac6e401e47b80 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:42.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.697+0000 7fc7b8b99700 1 -- 172.21.15.22:0/2801712401 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4011830 con 0x7fc7b40d2640 2023-07-11T00:30:42.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.697+0000 7fc7b8b99700 1 -- 172.21.15.22:0/2801712401 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a4011990 con 0x7fc7b40d2640 2023-07-11T00:30:42.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.697+0000 7fc7b8b99700 1 -- 172.21.15.22:0/2801712401 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4011d20 con 0x7fc7b40d2640 2023-07-11T00:30:42.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.698+0000 7fc7bbdff700 1 -- 172.21.15.22:0/2801712401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7b40d2640 msgr2=0x7fc7b40cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:42.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.698+0000 7fc7bbdff700 1 --2- 172.21.15.22:0/2801712401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7b40d2640 0x7fc7b40cf1e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40b4f00 tx=0x7fc7a4009bd0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.698+0000 7fc7bbdff700 1 -- 172.21.15.22:0/2801712401 shutdown_connections 2023-07-11T00:30:42.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.698+0000 7fc7bbdff700 1 --2- 172.21.15.22:0/2801712401 >> v2:172.21.15.184:3300/0 conn(0x7fc7b415c460 0x7fc7b40b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.698+0000 7fc7bbdff700 1 --2- 172.21.15.22:0/2801712401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7b40d2640 0x7fc7b40cf1e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.698+0000 7fc7bbdff700 1 -- 172.21.15.22:0/2801712401 >> 172.21.15.22:0/2801712401 conn(0x7fc7b4071660 msgr2=0x7fc7b4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:42.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.698+0000 7fc7bbdff700 1 -- 172.21.15.22:0/2801712401 shutdown_connections 2023-07-11T00:30:42.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.698+0000 7fc7bbdff700 1 -- 172.21.15.22:0/2801712401 wait complete. 2023-07-11T00:30:42.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.700+0000 7fc7bbdff700 1 Processor -- start 2023-07-11T00:30:42.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.700+0000 7fc7bbdff700 1 -- start start 2023-07-11T00:30:42.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.701+0000 7fc7bbdff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7b40cf720 0x7fc7b4154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:42.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.701+0000 7fc7bbdff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7b40d2640 0x7fc7b40c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:42.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.701+0000 7fc7bbdff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7b415c460 0x7fc7b406b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:42.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.701+0000 7fc7bbdff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b41f32a0 con 0x7fc7b415c460 2023-07-11T00:30:42.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.701+0000 7fc7bbdff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b4154d60 con 0x7fc7b40d2640 2023-07-11T00:30:42.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.701+0000 7fc7bbdff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b41f2720 con 0x7fc7b40cf720 2023-07-11T00:30:42.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.701+0000 7fc7ba39c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7b415c460 0x7fc7b406b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:42.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.701+0000 7fc7b939a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7b40d2640 0x7fc7b40c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:42.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.701+0000 7fc7b9b9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7b40cf720 0x7fc7b4154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:42.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.701+0000 7fc7b939a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7b40d2640 0x7fc7b40c66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:59046/0 (socket says 172.21.15.22:59046) 2023-07-11T00:30:42.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.701+0000 7fc7b939a700 1 -- 172.21.15.22:0/2456220050 learned_addr learned my addr 172.21.15.22:0/2456220050 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:42.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.702+0000 7fc7ba39c700 1 -- 172.21.15.22:0/2456220050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7b40cf720 msgr2=0x7fc7b4154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:42.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.702+0000 7fc7ba39c700 1 --2- 172.21.15.22:0/2456220050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7b40cf720 0x7fc7b4154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.702+0000 7fc7ba39c700 1 -- 172.21.15.22:0/2456220050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7b40d2640 msgr2=0x7fc7b40c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:42.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.702+0000 7fc7ba39c700 1 --2- 172.21.15.22:0/2456220050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7b40d2640 0x7fc7b40c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.702+0000 7fc7ba39c700 1 -- 172.21.15.22:0/2456220050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a4009550 con 0x7fc7b415c460 2023-07-11T00:30:42.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.702+0000 7fc7b939a700 1 --2- 172.21.15.22:0/2456220050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7b40d2640 0x7fc7b40c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:30:42.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.702+0000 7fc7ba39c700 1 --2- 172.21.15.22:0/2456220050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7b415c460 0x7fc7b406b2e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00cae0 tx=0x7fc7ac00cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:42.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.702+0000 7fc7aa7fc700 1 -- 172.21.15.22:0/2456220050 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac003c00 con 0x7fc7b415c460 2023-07-11T00:30:42.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.702+0000 7fc7aa7fc700 1 -- 172.21.15.22:0/2456220050 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac003d60 con 0x7fc7b415c460 2023-07-11T00:30:42.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.702+0000 7fc7bbdff700 1 -- 172.21.15.22:0/2456220050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b41f2a00 con 0x7fc7b415c460 2023-07-11T00:30:42.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.702+0000 7fc7aa7fc700 1 -- 172.21.15.22:0/2456220050 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac00aa20 con 0x7fc7b415c460 2023-07-11T00:30:42.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.702+0000 7fc7bbdff700 1 -- 172.21.15.22:0/2456220050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b41f2fc0 con 0x7fc7b415c460 2023-07-11T00:30:42.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.703+0000 7fc7bbdff700 1 -- 172.21.15.22:0/2456220050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b40c71b0 con 0x7fc7b415c460 2023-07-11T00:30:42.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.704+0000 7fc7aa7fc700 1 -- 172.21.15.22:0/2456220050 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc7ac00ab80 con 0x7fc7b415c460 2023-07-11T00:30:42.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.706+0000 7fc7aa7fc700 1 --2- 172.21.15.22:0/2456220050 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc79806ace0 0x7fc79806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:42.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.706+0000 7fc7aa7fc700 1 -- 172.21.15.22:0/2456220050 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc7ac089550 con 0x7fc7b415c460 2023-07-11T00:30:42.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.706+0000 7fc7b9b9b700 1 --2- 172.21.15.22:0/2456220050 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc79806ace0 0x7fc79806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:42.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.707+0000 7fc7b9b9b700 1 --2- 172.21.15.22:0/2456220050 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc79806ace0 0x7fc79806d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40d1100 tx=0x7fc7b0009210 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:42.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.710+0000 7fc7aa7fc700 1 -- 172.21.15.22:0/2456220050 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc7ac054300 con 0x7fc7b415c460 2023-07-11T00:30:42.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.917+0000 7fc7bbdff700 1 -- 172.21.15.22:0/2456220050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7b40d1130 con 0x7fc7b415c460 2023-07-11T00:30:42.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.919+0000 7fc7aa7fc700 1 -- 172.21.15.22:0/2456220050 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20062 (secure 0 0 0) 0x7fc7ac057920 con 0x7fc7b415c460 2023-07-11T00:30:42.922 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:42.922 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:10.571866+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:30:42.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.921+0000 7fc7bbdff700 1 -- 172.21.15.22:0/2456220050 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc79806ace0 msgr2=0x7fc79806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:42.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.921+0000 7fc7bbdff700 1 --2- 172.21.15.22:0/2456220050 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc79806ace0 0x7fc79806d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40d1100 tx=0x7fc7b0009210 comp rx=0 tx=0).stop 2023-07-11T00:30:42.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.921+0000 7fc7bbdff700 1 -- 172.21.15.22:0/2456220050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7b415c460 msgr2=0x7fc7b406b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:42.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.921+0000 7fc7bbdff700 1 --2- 172.21.15.22:0/2456220050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7b415c460 0x7fc7b406b2e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00cae0 tx=0x7fc7ac00cdf0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.921+0000 7fc7bbdff700 1 -- 172.21.15.22:0/2456220050 shutdown_connections 2023-07-11T00:30:42.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.921+0000 7fc7bbdff700 1 --2- 172.21.15.22:0/2456220050 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc79806ace0 0x7fc79806d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.921+0000 7fc7bbdff700 1 --2- 172.21.15.22:0/2456220050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7b40cf720 0x7fc7b4154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.921+0000 7fc7bbdff700 1 --2- 172.21.15.22:0/2456220050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7b415c460 0x7fc7b406b2e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.921+0000 7fc7bbdff700 1 --2- 172.21.15.22:0/2456220050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7b40d2640 0x7fc7b40c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:42.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.921+0000 7fc7bbdff700 1 -- 172.21.15.22:0/2456220050 >> 172.21.15.22:0/2456220050 conn(0x7fc7b4071660 msgr2=0x7fc7b40b70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:42.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.922+0000 7fc7bbdff700 1 -- 172.21.15.22:0/2456220050 shutdown_connections 2023-07-11T00:30:42.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:42.922+0000 7fc7bbdff700 1 -- 172.21.15.22:0/2456220050 wait complete. 2023-07-11T00:30:42.944 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:29:57.631007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:29:58.547599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:30:03.826184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:30:04.383448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-11T00:30:08.075875+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-11T00:30:42.945 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:30:43.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.148+0000 7f244b1ff700 1 Processor -- start 2023-07-11T00:30:43.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.149+0000 7f244b1ff700 1 -- start start 2023-07-11T00:30:43.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.150+0000 7f244b1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24440b8430 0x7f24440cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:43.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.150+0000 7f244b1ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24440d0b20 con 0x7f24440cfc60 2023-07-11T00:30:43.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.150+0000 7f244b1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24440b4ee0 con 0x7f24440d3730 2023-07-11T00:30:43.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.150+0000 7f244b1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24440b8800 con 0x7f24440b8430 2023-07-11T00:30:43.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.150+0000 7f244979c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f24440cfc60 0x7f24440d0fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52254/0 (socket says 172.21.15.22:52254) 2023-07-11T00:30:43.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.150+0000 7f244979c700 1 -- 172.21.15.22:0/3965977446 learned_addr learned my addr 172.21.15.22:0/3965977446 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:43.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.150+0000 7f2448f9b700 1 --2- 172.21.15.22:0/3965977446 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24440b8430 0x7f24440cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:43.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.150+0000 7f24437fe700 1 -- 172.21.15.22:0/3965977446 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266702953 0 0) 0x7f24440d0b20 con 0x7f24440cfc60 2023-07-11T00:30:43.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.151+0000 7f24437fe700 1 -- 172.21.15.22:0/3965977446 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24340035b0 con 0x7f24440cfc60 2023-07-11T00:30:43.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.151+0000 7f24437fe700 1 -- 172.21.15.22:0/3965977446 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553309298 0 0) 0x7f24440b4ee0 con 0x7f24440d3730 2023-07-11T00:30:43.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.151+0000 7f24437fe700 1 -- 172.21.15.22:0/3965977446 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24440d0b20 con 0x7f24440d3730 2023-07-11T00:30:43.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.151+0000 7f2448f9b700 1 -- 172.21.15.22:0/3965977446 >> v1:172.21.15.184:6789/0 conn(0x7f24440d3730 legacy=0x7f24440cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:43.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.151+0000 7f2448f9b700 1 -- 172.21.15.22:0/3965977446 >> v1:172.21.15.22:6789/0 conn(0x7f24440cfc60 legacy=0x7f24440d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:43.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.151+0000 7f2448f9b700 1 -- 172.21.15.22:0/3965977446 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24440b51c0 con 0x7f24440b8430 2023-07-11T00:30:43.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.151+0000 7f2448f9b700 1 --2- 172.21.15.22:0/3965977446 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24440b8430 0x7f24440cd320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2438009870 tx=0x7f2438009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d90d91892f68dd61 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:43.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.152+0000 7f24437fe700 1 -- 172.21.15.22:0/3965977446 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c0019f0 con 0x7f24440b8430 2023-07-11T00:30:43.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.152+0000 7f24437fe700 1 -- 172.21.15.22:0/3965977446 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2438004030 con 0x7f24440b8430 2023-07-11T00:30:43.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.152+0000 7f24437fe700 1 -- 172.21.15.22:0/3965977446 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24380043c0 con 0x7f24440b8430 2023-07-11T00:30:43.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.152+0000 7f244b1ff700 1 -- 172.21.15.22:0/3965977446 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24440b8430 msgr2=0x7f24440cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:43.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.152+0000 7f244b1ff700 1 --2- 172.21.15.22:0/3965977446 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24440b8430 0x7f24440cd320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2438009870 tx=0x7f2438009b80 comp rx=0 tx=0).stop 2023-07-11T00:30:43.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.152+0000 7f244b1ff700 1 -- 172.21.15.22:0/3965977446 shutdown_connections 2023-07-11T00:30:43.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.152+0000 7f244b1ff700 1 --2- 172.21.15.22:0/3965977446 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24440b8430 0x7f24440cd320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.152+0000 7f244b1ff700 1 -- 172.21.15.22:0/3965977446 >> 172.21.15.22:0/3965977446 conn(0x7f244406b3f0 msgr2=0x7f244406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:43.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.153+0000 7f244b1ff700 1 -- 172.21.15.22:0/3965977446 shutdown_connections 2023-07-11T00:30:43.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.153+0000 7f244b1ff700 1 -- 172.21.15.22:0/3965977446 wait complete. 2023-07-11T00:30:43.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.154+0000 7f244b1ff700 1 Processor -- start 2023-07-11T00:30:43.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.154+0000 7f244b1ff700 1 -- start start 2023-07-11T00:30:43.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.155+0000 7f244b1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24440b8430 0x7f24440c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:43.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.155+0000 7f244b1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24440cfc60 0x7f2444160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:43.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.155+0000 7f244b1ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24440d3730 0x7f244415ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:43.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.155+0000 7f244b1ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24440c9ca0 con 0x7f24440d3730 2023-07-11T00:30:43.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.155+0000 7f244b1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24440c6c10 con 0x7f24440b8430 2023-07-11T00:30:43.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.155+0000 7f244b1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24440c6ef0 con 0x7f24440cfc60 2023-07-11T00:30:43.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.156+0000 7f244979c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24440d3730 0x7f244415ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:43.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.156+0000 7f244979c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24440d3730 0x7f244415ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46532/0 (socket says 172.21.15.22:46532) 2023-07-11T00:30:43.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.156+0000 7f244979c700 1 -- 172.21.15.22:0/3417519334 learned_addr learned my addr 172.21.15.22:0/3417519334 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:43.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.156+0000 7f2448f9b700 1 --2- 172.21.15.22:0/3417519334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24440b8430 0x7f24440c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:43.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.156+0000 7f2443fff700 1 --2- 172.21.15.22:0/3417519334 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24440cfc60 0x7f2444160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:43.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.156+0000 7f244979c700 1 -- 172.21.15.22:0/3417519334 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24440cfc60 msgr2=0x7f2444160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:43.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.156+0000 7f244979c700 1 --2- 172.21.15.22:0/3417519334 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24440cfc60 0x7f2444160650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.156+0000 7f244979c700 1 -- 172.21.15.22:0/3417519334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24440b8430 msgr2=0x7f24440c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:43.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.156+0000 7f244979c700 1 --2- 172.21.15.22:0/3417519334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24440b8430 0x7f24440c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.156+0000 7f244979c700 1 -- 172.21.15.22:0/3417519334 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24380094a0 con 0x7f24440d3730 2023-07-11T00:30:43.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.156+0000 7f244979c700 1 --2- 172.21.15.22:0/3417519334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24440d3730 0x7f244415ca70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f243c002090 tx=0x7f243c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:43.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.157+0000 7f24417fa700 1 -- 172.21.15.22:0/3417519334 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c00acd0 con 0x7f24440d3730 2023-07-11T00:30:43.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.157+0000 7f24417fa700 1 -- 172.21.15.22:0/3417519334 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c00ae30 con 0x7f24440d3730 2023-07-11T00:30:43.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.157+0000 7f24417fa700 1 -- 172.21.15.22:0/3417519334 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c007310 con 0x7f24440d3730 2023-07-11T00:30:43.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.157+0000 7f244b1ff700 1 -- 172.21.15.22:0/3417519334 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24440c71d0 con 0x7f24440d3730 2023-07-11T00:30:43.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.157+0000 7f244b1ff700 1 -- 172.21.15.22:0/3417519334 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24440c85d0 con 0x7f24440d3730 2023-07-11T00:30:43.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.158+0000 7f244b1ff700 1 -- 172.21.15.22:0/3417519334 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244404ea60 con 0x7f24440d3730 2023-07-11T00:30:43.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.159+0000 7f24417fa700 1 -- 172.21.15.22:0/3417519334 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f243c007470 con 0x7f24440d3730 2023-07-11T00:30:43.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.160+0000 7f24417fa700 1 --2- 172.21.15.22:0/3417519334 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f242806ace0 0x7f242806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:43.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.160+0000 7f24417fa700 1 -- 172.21.15.22:0/3417519334 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f243c0893c0 con 0x7f24440d3730 2023-07-11T00:30:43.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.160+0000 7f2448f9b700 1 --2- 172.21.15.22:0/3417519334 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f242806ace0 0x7f242806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:43.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.161+0000 7f2448f9b700 1 --2- 172.21.15.22:0/3417519334 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f242806ace0 0x7f242806d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2438000c00 tx=0x7f2438008000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:43.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.164+0000 7f24417fa700 1 -- 172.21.15.22:0/3417519334 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f243c054170 con 0x7f24440d3730 2023-07-11T00:30:43.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.368+0000 7f244b1ff700 1 -- 172.21.15.22:0/3417519334 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f24440cf6c0 con 0x7f24440d3730 2023-07-11T00:30:43.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.369+0000 7f24417fa700 1 -- 172.21.15.22:0/3417519334 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f243c057790 con 0x7f24440d3730 2023-07-11T00:30:43.371 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2023-07-11T00:30:43.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.371+0000 7f244b1ff700 1 -- 172.21.15.22:0/3417519334 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f242806ace0 msgr2=0x7f242806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:43.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.371+0000 7f244b1ff700 1 --2- 172.21.15.22:0/3417519334 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f242806ace0 0x7f242806d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2438000c00 tx=0x7f2438008000 comp rx=0 tx=0).stop 2023-07-11T00:30:43.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.371+0000 7f244b1ff700 1 -- 172.21.15.22:0/3417519334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24440d3730 msgr2=0x7f244415ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:43.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.371+0000 7f244b1ff700 1 --2- 172.21.15.22:0/3417519334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24440d3730 0x7f244415ca70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f243c002090 tx=0x7f243c00a340 comp rx=0 tx=0).stop 2023-07-11T00:30:43.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.371+0000 7f244b1ff700 1 -- 172.21.15.22:0/3417519334 shutdown_connections 2023-07-11T00:30:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.371+0000 7f244b1ff700 1 --2- 172.21.15.22:0/3417519334 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f242806ace0 0x7f242806d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.371+0000 7f244b1ff700 1 --2- 172.21.15.22:0/3417519334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24440d3730 0x7f244415ca70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.371+0000 7f244b1ff700 1 --2- 172.21.15.22:0/3417519334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24440b8430 0x7f24440c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.371+0000 7f244b1ff700 1 --2- 172.21.15.22:0/3417519334 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24440cfc60 0x7f2444160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.371+0000 7f244b1ff700 1 -- 172.21.15.22:0/3417519334 >> 172.21.15.22:0/3417519334 conn(0x7f244406b3f0 msgr2=0x7f244415bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.371+0000 7f244b1ff700 1 -- 172.21.15.22:0/3417519334 shutdown_connections 2023-07-11T00:30:43.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.371+0000 7f244b1ff700 1 -- 172.21.15.22:0/3417519334 wait complete. 2023-07-11T00:30:43.391 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:30:43.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.595+0000 7f2d9b5ff700 1 Processor -- start 2023-07-11T00:30:43.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.595+0000 7f2d9b5ff700 1 -- start start 2023-07-11T00:30:43.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.596+0000 7f2d9b5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2d940b8430 0x7f2d940cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:43.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.596+0000 7f2d9b5ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d940d0b20 con 0x7f2d940d3730 2023-07-11T00:30:43.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.596+0000 7f2d9b5ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d940b4ee0 con 0x7f2d940cfc60 2023-07-11T00:30:43.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.596+0000 7f2d9b5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d940b8800 con 0x7f2d940b8430 2023-07-11T00:30:43.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.597+0000 7f2d98b9a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2d940d3730 0x7f2d940cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52270/0 (socket says 172.21.15.22:52270) 2023-07-11T00:30:43.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.597+0000 7f2d98b9a700 1 -- 172.21.15.22:0/1112150415 learned_addr learned my addr 172.21.15.22:0/1112150415 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:43.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.597+0000 7f2d9939b700 1 --2- 172.21.15.22:0/1112150415 >> v2:172.21.15.184:3300/0 conn(0x7f2d940b8430 0x7f2d940cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:43.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.597+0000 7f2d8bfff700 1 -- 172.21.15.22:0/1112150415 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234851416 0 0) 0x7f2d940d0b20 con 0x7f2d940d3730 2023-07-11T00:30:43.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.597+0000 7f2d8bfff700 1 -- 172.21.15.22:0/1112150415 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d800035b0 con 0x7f2d940d3730 2023-07-11T00:30:43.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.597+0000 7f2d8bfff700 1 -- 172.21.15.22:0/1112150415 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634766031 0 0) 0x7f2d940b4ee0 con 0x7f2d940cfc60 2023-07-11T00:30:43.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.597+0000 7f2d8bfff700 1 -- 172.21.15.22:0/1112150415 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d940d0b20 con 0x7f2d940cfc60 2023-07-11T00:30:43.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.597+0000 7f2d8bfff700 1 -- 172.21.15.22:0/1112150415 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2171617809 0 0) 0x7f2d800035b0 con 0x7f2d940d3730 2023-07-11T00:30:43.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.597+0000 7f2d8bfff700 1 -- 172.21.15.22:0/1112150415 >> v2:172.21.15.184:3300/0 conn(0x7f2d940b8430 msgr2=0x7f2d940cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:43.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.597+0000 7f2d8bfff700 1 --2- 172.21.15.22:0/1112150415 >> v2:172.21.15.184:3300/0 conn(0x7f2d940b8430 0x7f2d940cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.597+0000 7f2d8bfff700 1 -- 172.21.15.22:0/1112150415 >> v1:172.21.15.184:6789/0 conn(0x7f2d940cfc60 legacy=0x7f2d940d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:43.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.597+0000 7f2d8bfff700 1 -- 172.21.15.22:0/1112150415 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d940b51c0 con 0x7f2d940d3730 2023-07-11T00:30:43.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.597+0000 7f2d8bfff700 1 -- 172.21.15.22:0/1112150415 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7f2d84001670 con 0x7f2d940d3730 2023-07-11T00:30:43.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.597+0000 7f2d8bfff700 1 -- 172.21.15.22:0/1112150415 >> v1:172.21.15.22:6789/0 conn(0x7f2d940d3730 legacy=0x7f2d940cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:43.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.597+0000 7f2d8bfff700 1 --2- 172.21.15.22:0/1112150415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d80003be0 0x7f2d80003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:43.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.598+0000 7f2d8bfff700 1 --2- 172.21.15.22:0/1112150415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d80004850 0x7f2d80004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:43.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.598+0000 7f2d8bfff700 1 --2- 172.21.15.22:0/1112150415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d80005200 0x7f2d8000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:43.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.598+0000 7f2d8bfff700 1 -- 172.21.15.22:0/1112150415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d940b8800 con 0x7f2d80003be0 2023-07-11T00:30:43.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.598+0000 7f2d8bfff700 1 -- 172.21.15.22:0/1112150415 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8000c0e0 con 0x7f2d80004850 2023-07-11T00:30:43.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.598+0000 7f2d8bfff700 1 -- 172.21.15.22:0/1112150415 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8000c270 con 0x7f2d80005200 2023-07-11T00:30:43.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.598+0000 7f2d9939b700 1 --2- 172.21.15.22:0/1112150415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d80003be0 0x7f2d80003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:43.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.598+0000 7f2d98b9a700 1 --2- 172.21.15.22:0/1112150415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d80004850 0x7f2d80004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:43.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.598+0000 7f2d99b9c700 1 --2- 172.21.15.22:0/1112150415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d80005200 0x7f2d8000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:43.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.598+0000 7f2d9939b700 1 -- 172.21.15.22:0/1112150415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d80005200 msgr2=0x7f2d8000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:43.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.598+0000 7f2d9939b700 1 --2- 172.21.15.22:0/1112150415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d80005200 0x7f2d8000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.598+0000 7f2d9939b700 1 -- 172.21.15.22:0/1112150415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d80004850 msgr2=0x7f2d80004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:43.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.598+0000 7f2d9939b700 1 --2- 172.21.15.22:0/1112150415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d80004850 0x7f2d80004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.598+0000 7f2d9939b700 1 -- 172.21.15.22:0/1112150415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d800035b0 con 0x7f2d80003be0 2023-07-11T00:30:43.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.598+0000 7f2d98b9a700 1 --2- 172.21.15.22:0/1112150415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d80004850 0x7f2d80004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:43.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.598+0000 7f2d99b9c700 1 -- 172.21.15.22:0/1112150415 reap_dead start 2023-07-11T00:30:43.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.598+0000 7f2d9939b700 1 --2- 172.21.15.22:0/1112150415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d80003be0 0x7f2d80003fd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009b30 tx=0x7f2d80005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac56470d774f305e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:43.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.599+0000 7f2d8bfff700 1 -- 172.21.15.22:0/1112150415 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000e6c0 con 0x7f2d80003be0 2023-07-11T00:30:43.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.599+0000 7f2d8bfff700 1 -- 172.21.15.22:0/1112150415 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9000e820 con 0x7f2d80003be0 2023-07-11T00:30:43.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.599+0000 7f2d8bfff700 1 -- 172.21.15.22:0/1112150415 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000eb90 con 0x7f2d80003be0 2023-07-11T00:30:43.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.599+0000 7f2d9b5ff700 1 -- 172.21.15.22:0/1112150415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d80003be0 msgr2=0x7f2d80003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:43.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.599+0000 7f2d9b5ff700 1 --2- 172.21.15.22:0/1112150415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d80003be0 0x7f2d80003fd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009b30 tx=0x7f2d80005880 comp rx=0 tx=0).stop 2023-07-11T00:30:43.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.599+0000 7f2d9b5ff700 1 -- 172.21.15.22:0/1112150415 shutdown_connections 2023-07-11T00:30:43.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.599+0000 7f2d9b5ff700 1 --2- 172.21.15.22:0/1112150415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d80003be0 0x7f2d80003fd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.599+0000 7f2d9b5ff700 1 -- 172.21.15.22:0/1112150415 >> 172.21.15.22:0/1112150415 conn(0x7f2d9406b3f0 msgr2=0x7f2d9406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:43.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.599+0000 7f2d9b5ff700 1 -- 172.21.15.22:0/1112150415 shutdown_connections 2023-07-11T00:30:43.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.599+0000 7f2d9b5ff700 1 -- 172.21.15.22:0/1112150415 wait complete. 2023-07-11T00:30:43.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.601+0000 7f2d9b5ff700 1 Processor -- start 2023-07-11T00:30:43.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.601+0000 7f2d9b5ff700 1 -- start start 2023-07-11T00:30:43.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.602+0000 7f2d9b5ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d80003be0 0x7f2d940c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:43.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.602+0000 7f2d9b5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d940c6fd0 0x7f2d941506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:43.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.602+0000 7f2d9b5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d940b24b0 0x7f2d941f5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:43.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.602+0000 7f2d9b5ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d940caa80 con 0x7f2d80003be0 2023-07-11T00:30:43.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.602+0000 7f2d9b5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d940cad20 con 0x7f2d940c6fd0 2023-07-11T00:30:43.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.602+0000 7f2d9b5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d940cb000 con 0x7f2d940b24b0 2023-07-11T00:30:43.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.602+0000 7f2d9939b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d80003be0 0x7f2d940c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:43.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.602+0000 7f2d9939b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d80003be0 0x7f2d940c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46548/0 (socket says 172.21.15.22:46548) 2023-07-11T00:30:43.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.602+0000 7f2d9939b700 1 -- 172.21.15.22:0/1252881097 learned_addr learned my addr 172.21.15.22:0/1252881097 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:43.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.603+0000 7f2d98b9a700 1 --2- 172.21.15.22:0/1252881097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d940c6fd0 0x7f2d941506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:43.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.603+0000 7f2d99b9c700 1 --2- 172.21.15.22:0/1252881097 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d940b24b0 0x7f2d941f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:43.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.603+0000 7f2d9939b700 1 -- 172.21.15.22:0/1252881097 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d940b24b0 msgr2=0x7f2d941f5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:43.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.603+0000 7f2d9939b700 1 --2- 172.21.15.22:0/1252881097 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d940b24b0 0x7f2d941f5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.603+0000 7f2d9939b700 1 -- 172.21.15.22:0/1252881097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d940c6fd0 msgr2=0x7f2d941506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:43.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.603+0000 7f2d9939b700 1 --2- 172.21.15.22:0/1252881097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d940c6fd0 0x7f2d941506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.603+0000 7f2d9939b700 1 -- 172.21.15.22:0/1252881097 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d940cb2e0 con 0x7f2d80003be0 2023-07-11T00:30:43.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.603+0000 7f2d98b9a700 1 --2- 172.21.15.22:0/1252881097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d940c6fd0 0x7f2d941506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:43.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.603+0000 7f2d9939b700 1 --2- 172.21.15.22:0/1252881097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d80003be0 0x7f2d940c9240 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2d800047a0 tx=0x7f2d900047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:43.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.603+0000 7f2d89ffb700 1 -- 172.21.15.22:0/1252881097 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000e6c0 con 0x7f2d80003be0 2023-07-11T00:30:43.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.603+0000 7f2d89ffb700 1 -- 172.21.15.22:0/1252881097 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d90003af0 con 0x7f2d80003be0 2023-07-11T00:30:43.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.603+0000 7f2d89ffb700 1 -- 172.21.15.22:0/1252881097 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90003ea0 con 0x7f2d80003be0 2023-07-11T00:30:43.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.603+0000 7f2d9b5ff700 1 -- 172.21.15.22:0/1252881097 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d94150c10 con 0x7f2d80003be0 2023-07-11T00:30:43.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.604+0000 7f2d9b5ff700 1 -- 172.21.15.22:0/1252881097 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d940c7420 con 0x7f2d80003be0 2023-07-11T00:30:43.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.605+0000 7f2d9b5ff700 1 -- 172.21.15.22:0/1252881097 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9404ea60 con 0x7f2d80003be0 2023-07-11T00:30:43.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.605+0000 7f2d89ffb700 1 -- 172.21.15.22:0/1252881097 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d90013470 con 0x7f2d80003be0 2023-07-11T00:30:43.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.606+0000 7f2d89ffb700 1 --2- 172.21.15.22:0/1252881097 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2d7806ad10 0x7f2d7806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:43.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.606+0000 7f2d89ffb700 1 -- 172.21.15.22:0/1252881097 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2d9008af90 con 0x7f2d80003be0 2023-07-11T00:30:43.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.607+0000 7f2d98b9a700 1 --2- 172.21.15.22:0/1252881097 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2d7806ad10 0x7f2d7806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:43.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.607+0000 7f2d98b9a700 1 --2- 172.21.15.22:0/1252881097 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2d7806ad10 0x7f2d7806d1c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2d9415fbc0 tx=0x7f2d84009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:43.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.611+0000 7f2d89ffb700 1 -- 172.21.15.22:0/1252881097 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2d90055e60 con 0x7f2d80003be0 2023-07-11T00:30:43.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.816+0000 7f2d9b5ff700 1 -- 172.21.15.22:0/1252881097 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d940cf110 con 0x7f2d80003be0 2023-07-11T00:30:43.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.817+0000 7f2d89ffb700 1 -- 172.21.15.22:0/1252881097 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d90059480 con 0x7f2d80003be0 2023-07-11T00:30:43.820 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-07-11T00:30:43.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.819+0000 7f2d9b5ff700 1 -- 172.21.15.22:0/1252881097 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2d7806ad10 msgr2=0x7f2d7806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:43.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.819+0000 7f2d9b5ff700 1 --2- 172.21.15.22:0/1252881097 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2d7806ad10 0x7f2d7806d1c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2d9415fbc0 tx=0x7f2d84009040 comp rx=0 tx=0).stop 2023-07-11T00:30:43.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.819+0000 7f2d9b5ff700 1 -- 172.21.15.22:0/1252881097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d80003be0 msgr2=0x7f2d940c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:43.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.819+0000 7f2d9b5ff700 1 --2- 172.21.15.22:0/1252881097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d80003be0 0x7f2d940c9240 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2d800047a0 tx=0x7f2d900047c0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.819+0000 7f2d9b5ff700 1 -- 172.21.15.22:0/1252881097 shutdown_connections 2023-07-11T00:30:43.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.819+0000 7f2d9b5ff700 1 --2- 172.21.15.22:0/1252881097 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2d7806ad10 0x7f2d7806d1c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.819+0000 7f2d9b5ff700 1 --2- 172.21.15.22:0/1252881097 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d940b24b0 0x7f2d941f5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.819+0000 7f2d9b5ff700 1 --2- 172.21.15.22:0/1252881097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d80003be0 0x7f2d940c9240 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.819+0000 7f2d9b5ff700 1 --2- 172.21.15.22:0/1252881097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d940c6fd0 0x7f2d941506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:43.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.819+0000 7f2d9b5ff700 1 -- 172.21.15.22:0/1252881097 >> 172.21.15.22:0/1252881097 conn(0x7f2d9406b3f0 msgr2=0x7f2d940d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:43.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.819+0000 7f2d9b5ff700 1 -- 172.21.15.22:0/1252881097 shutdown_connections 2023-07-11T00:30:43.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:43.819+0000 7f2d9b5ff700 1 -- 172.21.15.22:0/1252881097 wait complete. 2023-07-11T00:30:43.839 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:30:44.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.041+0000 7fb665bff700 1 Processor -- start 2023-07-11T00:30:44.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.042+0000 7fb665bff700 1 -- start start 2023-07-11T00:30:44.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.043+0000 7fb665bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6600cfc60 0x7fb660167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:44.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.043+0000 7fb665bff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6600d0b20 con 0x7fb6600b8430 2023-07-11T00:30:44.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.043+0000 7fb665bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6600b4ee0 con 0x7fb6600d3730 2023-07-11T00:30:44.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.044+0000 7fb665bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600cda30 con 0x7fb6600cfc60 2023-07-11T00:30:44.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.044+0000 7fb65f7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb6600b8430 0x7fb6600cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52286/0 (socket says 172.21.15.22:52286) 2023-07-11T00:30:44.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.044+0000 7fb65f7fe700 1 -- 172.21.15.22:0/3352900099 learned_addr learned my addr 172.21.15.22:0/3352900099 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:44.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.044+0000 7fb65ffff700 1 --2- 172.21.15.22:0/3352900099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6600cfc60 0x7fb660167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:44.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.044+0000 7fb65e7fc700 1 -- 172.21.15.22:0/3352900099 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647515108 0 0) 0x7fb6600d0b20 con 0x7fb6600b8430 2023-07-11T00:30:44.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.044+0000 7fb65e7fc700 1 -- 172.21.15.22:0/3352900099 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6480035b0 con 0x7fb6600b8430 2023-07-11T00:30:44.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.044+0000 7fb65e7fc700 1 -- 172.21.15.22:0/3352900099 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721516017 0 0) 0x7fb6600b4ee0 con 0x7fb6600d3730 2023-07-11T00:30:44.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.044+0000 7fb65e7fc700 1 -- 172.21.15.22:0/3352900099 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6600d0b20 con 0x7fb6600d3730 2023-07-11T00:30:44.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.044+0000 7fb65ffff700 1 -- 172.21.15.22:0/3352900099 >> v1:172.21.15.184:6789/0 conn(0x7fb6600d3730 legacy=0x7fb6600cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:44.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.044+0000 7fb65ffff700 1 -- 172.21.15.22:0/3352900099 >> v1:172.21.15.22:6789/0 conn(0x7fb6600b8430 legacy=0x7fb6600cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:44.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.044+0000 7fb65ffff700 1 -- 172.21.15.22:0/3352900099 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6600b51c0 con 0x7fb6600cfc60 2023-07-11T00:30:44.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.045+0000 7fb65ffff700 1 --2- 172.21.15.22:0/3352900099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6600cfc60 0x7fb660167010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb658009dc0 tx=0x7fb65800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee34060d7a266ee0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:44.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.045+0000 7fb65e7fc700 1 -- 172.21.15.22:0/3352900099 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65800e070 con 0x7fb6600cfc60 2023-07-11T00:30:44.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.045+0000 7fb65e7fc700 1 -- 172.21.15.22:0/3352900099 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65800bb20 con 0x7fb6600cfc60 2023-07-11T00:30:44.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.045+0000 7fb65e7fc700 1 -- 172.21.15.22:0/3352900099 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658012430 con 0x7fb6600cfc60 2023-07-11T00:30:44.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.046+0000 7fb665bff700 1 -- 172.21.15.22:0/3352900099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6600cfc60 msgr2=0x7fb660167010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:44.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.046+0000 7fb665bff700 1 --2- 172.21.15.22:0/3352900099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6600cfc60 0x7fb660167010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb658009dc0 tx=0x7fb65800b330 comp rx=0 tx=0).stop 2023-07-11T00:30:44.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.046+0000 7fb665bff700 1 -- 172.21.15.22:0/3352900099 shutdown_connections 2023-07-11T00:30:44.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.046+0000 7fb665bff700 1 --2- 172.21.15.22:0/3352900099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6600cfc60 0x7fb660167010 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.046+0000 7fb665bff700 1 -- 172.21.15.22:0/3352900099 >> 172.21.15.22:0/3352900099 conn(0x7fb66006b3f0 msgr2=0x7fb66006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:44.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.046+0000 7fb665bff700 1 -- 172.21.15.22:0/3352900099 shutdown_connections 2023-07-11T00:30:44.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.046+0000 7fb665bff700 1 -- 172.21.15.22:0/3352900099 wait complete. 2023-07-11T00:30:44.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.048+0000 7fb665bff700 1 Processor -- start 2023-07-11T00:30:44.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.048+0000 7fb665bff700 1 -- start start 2023-07-11T00:30:44.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.049+0000 7fb665bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6600b8430 0x7fb6600c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:44.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.049+0000 7fb665bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6600cfc60 0x7fb6600cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:44.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.049+0000 7fb665bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6600d3730 0x7fb6600b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:44.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.049+0000 7fb665bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600c8610 con 0x7fb6600cfc60 2023-07-11T00:30:44.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.049+0000 7fb665bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600cae00 con 0x7fb6600b8430 2023-07-11T00:30:44.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.049+0000 7fb665bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600cb0e0 con 0x7fb6600d3730 2023-07-11T00:30:44.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.049+0000 7fb65effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6600cfc60 0x7fb6600cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:44.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.049+0000 7fb65effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6600cfc60 0x7fb6600cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46558/0 (socket says 172.21.15.22:46558) 2023-07-11T00:30:44.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.049+0000 7fb65effd700 1 -- 172.21.15.22:0/699731431 learned_addr learned my addr 172.21.15.22:0/699731431 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:44.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.049+0000 7fb65f7fe700 1 --2- 172.21.15.22:0/699731431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6600b8430 0x7fb6600c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:44.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.049+0000 7fb65ffff700 1 --2- 172.21.15.22:0/699731431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6600d3730 0x7fb6600b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.049+0000 7fb65effd700 1 -- 172.21.15.22:0/699731431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6600d3730 msgr2=0x7fb6600b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.049+0000 7fb65effd700 1 --2- 172.21.15.22:0/699731431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6600d3730 0x7fb6600b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.049+0000 7fb65effd700 1 -- 172.21.15.22:0/699731431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6600b8430 msgr2=0x7fb6600c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.049+0000 7fb65effd700 1 --2- 172.21.15.22:0/699731431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6600b8430 0x7fb6600c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.049+0000 7fb65effd700 1 -- 172.21.15.22:0/699731431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb658009a70 con 0x7fb6600cfc60 2023-07-11T00:30:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.049+0000 7fb65ffff700 1 --2- 172.21.15.22:0/699731431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6600d3730 0x7fb6600b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.050+0000 7fb65effd700 1 --2- 172.21.15.22:0/699731431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6600cfc60 0x7fb6600cb8e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb65400c500 tx=0x7fb65400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:44.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.050+0000 7fb647fff700 1 -- 172.21.15.22:0/699731431 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6540052d0 con 0x7fb6600cfc60 2023-07-11T00:30:44.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.050+0000 7fb647fff700 1 -- 172.21.15.22:0/699731431 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb654005450 con 0x7fb6600cfc60 2023-07-11T00:30:44.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.050+0000 7fb647fff700 1 -- 172.21.15.22:0/699731431 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6540038c0 con 0x7fb6600cfc60 2023-07-11T00:30:44.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.050+0000 7fb665bff700 1 -- 172.21.15.22:0/699731431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6600cb3c0 con 0x7fb6600cfc60 2023-07-11T00:30:44.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.050+0000 7fb665bff700 1 -- 172.21.15.22:0/699731431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6600cbe20 con 0x7fb6600cfc60 2023-07-11T00:30:44.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.051+0000 7fb665bff700 1 -- 172.21.15.22:0/699731431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6600cac60 con 0x7fb6600cfc60 2023-07-11T00:30:44.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.052+0000 7fb647fff700 1 -- 172.21.15.22:0/699731431 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb654003a20 con 0x7fb6600cfc60 2023-07-11T00:30:44.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.054+0000 7fb647fff700 1 --2- 172.21.15.22:0/699731431 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb64c06ace0 0x7fb64c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:44.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.054+0000 7fb647fff700 1 -- 172.21.15.22:0/699731431 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb654088c70 con 0x7fb6600cfc60 2023-07-11T00:30:44.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.054+0000 7fb65f7fe700 1 --2- 172.21.15.22:0/699731431 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb64c06ace0 0x7fb64c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:44.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.054+0000 7fb65f7fe700 1 --2- 172.21.15.22:0/699731431 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb64c06ace0 0x7fb64c06d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb650007fd0 tx=0x7fb650007dc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:44.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.058+0000 7fb647fff700 1 -- 172.21.15.22:0/699731431 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb6600cac60 con 0x7fb6600cfc60 2023-07-11T00:30:44.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.268+0000 7fb665bff700 1 -- 172.21.15.22:0/699731431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6600cb600 con 0x7fb6600cfc60 2023-07-11T00:30:44.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.268+0000 7fb647fff700 1 -- 172.21.15.22:0/699731431 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb6600cb600 con 0x7fb6600cfc60 2023-07-11T00:30:44.271 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:30:44.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.271+0000 7fb665bff700 1 -- 172.21.15.22:0/699731431 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb64c06ace0 msgr2=0x7fb64c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:44.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.271+0000 7fb665bff700 1 --2- 172.21.15.22:0/699731431 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb64c06ace0 0x7fb64c06d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb650007fd0 tx=0x7fb650007dc0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.271+0000 7fb665bff700 1 -- 172.21.15.22:0/699731431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6600cfc60 msgr2=0x7fb6600cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:44.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.271+0000 7fb665bff700 1 --2- 172.21.15.22:0/699731431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6600cfc60 0x7fb6600cb8e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb65400c500 tx=0x7fb65400c810 comp rx=0 tx=0).stop 2023-07-11T00:30:44.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.271+0000 7fb665bff700 1 -- 172.21.15.22:0/699731431 shutdown_connections 2023-07-11T00:30:44.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.271+0000 7fb665bff700 1 --2- 172.21.15.22:0/699731431 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb64c06ace0 0x7fb64c06d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.271+0000 7fb665bff700 1 --2- 172.21.15.22:0/699731431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6600d3730 0x7fb6600b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.271+0000 7fb665bff700 1 --2- 172.21.15.22:0/699731431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6600b8430 0x7fb6600c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.271+0000 7fb665bff700 1 --2- 172.21.15.22:0/699731431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6600cfc60 0x7fb6600cb8e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.271+0000 7fb665bff700 1 -- 172.21.15.22:0/699731431 >> 172.21.15.22:0/699731431 conn(0x7fb66006b3f0 msgr2=0x7fb6600b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:44.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.271+0000 7fb665bff700 1 -- 172.21.15.22:0/699731431 shutdown_connections 2023-07-11T00:30:44.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.271+0000 7fb665bff700 1 -- 172.21.15.22:0/699731431 wait complete. 2023-07-11T00:30:44.291 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:30:44.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.494+0000 7f6c0a1ff700 1 Processor -- start 2023-07-11T00:30:44.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.494+0000 7f6c0a1ff700 1 -- start start 2023-07-11T00:30:44.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.495+0000 7f6c0a1ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6c040b8430 0x7f6c040cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:44.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.495+0000 7f6c0a1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6c040d3730 0x7f6c040cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:44.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.495+0000 7f6c0a1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c040d0b20 con 0x7f6c040cfa90 2023-07-11T00:30:44.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.495+0000 7f6c0a1ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c040b8800 con 0x7f6c040b8430 2023-07-11T00:30:44.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.495+0000 7f6c0a1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c040cfe90 con 0x7f6c040d3730 2023-07-11T00:30:44.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.495+0000 7f6c037fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6c040b8430 0x7f6c040cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:44.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.495+0000 7f6c037fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6c040b8430 0x7f6c040cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46570/0 (socket says 172.21.15.22:46570) 2023-07-11T00:30:44.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.495+0000 7f6c037fe700 1 -- 172.21.15.22:0/3245415245 learned_addr learned my addr 172.21.15.22:0/3245415245 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:44.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.496+0000 7f6c02ffd700 1 --2- 172.21.15.22:0/3245415245 >> v2:172.21.15.184:3300/0 conn(0x7f6c040d3730 0x7f6c040cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:44.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.496+0000 7f6c037fe700 1 -- 172.21.15.22:0/3245415245 >> v2:172.21.15.184:3300/0 conn(0x7f6c040d3730 msgr2=0x7f6c040cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:44.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.496+0000 7f6c037fe700 1 --2- 172.21.15.22:0/3245415245 >> v2:172.21.15.184:3300/0 conn(0x7f6c040d3730 0x7f6c040cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.496+0000 7f6c037fe700 1 -- 172.21.15.22:0/3245415245 >> v1:172.21.15.184:6789/0 conn(0x7f6c040cfa90 legacy=0x7f6c0415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:44.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.496+0000 7f6c037fe700 1 -- 172.21.15.22:0/3245415245 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c040b4ee0 con 0x7f6c040b8430 2023-07-11T00:30:44.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.496+0000 7f6c037fe700 1 --2- 172.21.15.22:0/3245415245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c040b8430 0x7f6c040cd320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c04160f50 tx=0x7f6bf4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3667739eabb921 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:44.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.496+0000 7f6c027fc700 1 -- 172.21.15.22:0/3245415245 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf400b870 con 0x7f6c040b8430 2023-07-11T00:30:44.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.496+0000 7f6c027fc700 1 -- 172.21.15.22:0/3245415245 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf400b9d0 con 0x7f6c040b8430 2023-07-11T00:30:44.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.496+0000 7f6c027fc700 1 -- 172.21.15.22:0/3245415245 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf400bd60 con 0x7f6c040b8430 2023-07-11T00:30:44.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.497+0000 7f6c0a1ff700 1 -- 172.21.15.22:0/3245415245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c040b8430 msgr2=0x7f6c040cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:44.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.497+0000 7f6c0a1ff700 1 --2- 172.21.15.22:0/3245415245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c040b8430 0x7f6c040cd320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c04160f50 tx=0x7f6bf4009bd0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.497+0000 7f6c0a1ff700 1 -- 172.21.15.22:0/3245415245 shutdown_connections 2023-07-11T00:30:44.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.497+0000 7f6c0a1ff700 1 --2- 172.21.15.22:0/3245415245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c040b8430 0x7f6c040cd320 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.497+0000 7f6c0a1ff700 1 --2- 172.21.15.22:0/3245415245 >> v2:172.21.15.184:3300/0 conn(0x7f6c040d3730 0x7f6c040cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.497+0000 7f6c0a1ff700 1 -- 172.21.15.22:0/3245415245 >> 172.21.15.22:0/3245415245 conn(0x7f6c0406b3f0 msgr2=0x7f6c0406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:44.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.497+0000 7f6c0a1ff700 1 -- 172.21.15.22:0/3245415245 shutdown_connections 2023-07-11T00:30:44.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.497+0000 7f6c0a1ff700 1 -- 172.21.15.22:0/3245415245 wait complete. 2023-07-11T00:30:44.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.499+0000 7f6c0a1ff700 1 Processor -- start 2023-07-11T00:30:44.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.499+0000 7f6c0a1ff700 1 -- start start 2023-07-11T00:30:44.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c0a1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c040b8430 0x7f6c040c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:44.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c0a1ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c040cfa90 0x7f6c041466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:44.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c0a1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c040d3730 0x7f6c04146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:44.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c0a1ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0415f880 con 0x7f6c040cfa90 2023-07-11T00:30:44.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c0a1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040c94b0 con 0x7f6c040d3730 2023-07-11T00:30:44.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c0a1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0415ec00 con 0x7f6c040b8430 2023-07-11T00:30:44.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c02ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c040cfa90 0x7f6c041466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c02ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c040cfa90 0x7f6c041466a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46580/0 (socket says 172.21.15.22:46580) 2023-07-11T00:30:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c02ffd700 1 -- 172.21.15.22:0/2161047080 learned_addr learned my addr 172.21.15.22:0/2161047080 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c037fe700 1 --2- 172.21.15.22:0/2161047080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c040b8430 0x7f6c040c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c03fff700 1 --2- 172.21.15.22:0/2161047080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c040d3730 0x7f6c04146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c02ffd700 1 -- 172.21.15.22:0/2161047080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c040b8430 msgr2=0x7f6c040c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c02ffd700 1 --2- 172.21.15.22:0/2161047080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c040b8430 0x7f6c040c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c02ffd700 1 -- 172.21.15.22:0/2161047080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c040d3730 msgr2=0x7f6c04146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c02ffd700 1 --2- 172.21.15.22:0/2161047080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c040d3730 0x7f6c04146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c02ffd700 1 -- 172.21.15.22:0/2161047080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf4009550 con 0x7f6c040cfa90 2023-07-11T00:30:44.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c037fe700 1 --2- 172.21.15.22:0/2161047080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c040b8430 0x7f6c040c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:44.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.500+0000 7f6c03fff700 1 --2- 172.21.15.22:0/2161047080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c040d3730 0x7f6c04146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:44.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.501+0000 7f6c02ffd700 1 --2- 172.21.15.22:0/2161047080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c040cfa90 0x7f6c041466a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800e810 tx=0x7f6bf800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:44.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.501+0000 7f6bebfff700 1 -- 172.21.15.22:0/2161047080 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8013610 con 0x7f6c040cfa90 2023-07-11T00:30:44.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.501+0000 7f6bebfff700 1 -- 172.21.15.22:0/2161047080 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf8013770 con 0x7f6c040cfa90 2023-07-11T00:30:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.501+0000 7f6bebfff700 1 -- 172.21.15.22:0/2161047080 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8013b20 con 0x7f6c040cfa90 2023-07-11T00:30:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.501+0000 7f6c0a1ff700 1 -- 172.21.15.22:0/2161047080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0415eee0 con 0x7f6c040cfa90 2023-07-11T00:30:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.501+0000 7f6c0a1ff700 1 -- 172.21.15.22:0/2161047080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0415f4a0 con 0x7f6c040cfa90 2023-07-11T00:30:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.502+0000 7f6c0a1ff700 1 -- 172.21.15.22:0/2161047080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0415f9c0 con 0x7f6c040cfa90 2023-07-11T00:30:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.503+0000 7f6bebfff700 1 -- 172.21.15.22:0/2161047080 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6bf8013c80 con 0x7f6c040cfa90 2023-07-11T00:30:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.504+0000 7f6bebfff700 1 --2- 172.21.15.22:0/2161047080 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6bf006ace0 0x7f6bf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.504+0000 7f6bebfff700 1 -- 172.21.15.22:0/2161047080 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6bf8089540 con 0x7f6c040cfa90 2023-07-11T00:30:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.505+0000 7f6c037fe700 1 --2- 172.21.15.22:0/2161047080 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6bf006ace0 0x7f6bf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:44.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.505+0000 7f6c037fe700 1 --2- 172.21.15.22:0/2161047080 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6bf006ace0 0x7f6bf006d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4014040 tx=0x7f6bf4008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:44.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.508+0000 7f6bebfff700 1 -- 172.21.15.22:0/2161047080 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6c0415f9c0 con 0x7f6c040cfa90 2023-07-11T00:30:44.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.712+0000 7f6c0a1ff700 1 -- 172.21.15.22:0/2161047080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6c0404ea60 con 0x7f6c040cfa90 2023-07-11T00:30:44.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.712+0000 7f6bebfff700 1 -- 172.21.15.22:0/2161047080 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6bf8057cf0 con 0x7f6c040cfa90 2023-07-11T00:30:44.716 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-07-11T00:30:44.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.714+0000 7f6c0a1ff700 1 -- 172.21.15.22:0/2161047080 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6bf006ace0 msgr2=0x7f6bf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:44.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.714+0000 7f6c0a1ff700 1 --2- 172.21.15.22:0/2161047080 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6bf006ace0 0x7f6bf006d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4014040 tx=0x7f6bf4008030 comp rx=0 tx=0).stop 2023-07-11T00:30:44.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.714+0000 7f6c0a1ff700 1 -- 172.21.15.22:0/2161047080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c040cfa90 msgr2=0x7f6c041466a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:44.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.714+0000 7f6c0a1ff700 1 --2- 172.21.15.22:0/2161047080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c040cfa90 0x7f6c041466a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800e810 tx=0x7f6bf800ebd0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.714+0000 7f6c0a1ff700 1 -- 172.21.15.22:0/2161047080 shutdown_connections 2023-07-11T00:30:44.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.714+0000 7f6c0a1ff700 1 --2- 172.21.15.22:0/2161047080 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6bf006ace0 0x7f6bf006d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.714+0000 7f6c0a1ff700 1 --2- 172.21.15.22:0/2161047080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c040b8430 0x7f6c040c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.714+0000 7f6c0a1ff700 1 --2- 172.21.15.22:0/2161047080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c040d3730 0x7f6c04146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.714+0000 7f6c0a1ff700 1 --2- 172.21.15.22:0/2161047080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c040cfa90 0x7f6c041466a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.714+0000 7f6c0a1ff700 1 -- 172.21.15.22:0/2161047080 >> 172.21.15.22:0/2161047080 conn(0x7f6c0406b3f0 msgr2=0x7f6c0415fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:44.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.714+0000 7f6c0a1ff700 1 -- 172.21.15.22:0/2161047080 shutdown_connections 2023-07-11T00:30:44.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.714+0000 7f6c0a1ff700 1 -- 172.21.15.22:0/2161047080 wait complete. 2023-07-11T00:30:44.735 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-11T00:30:44.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.938+0000 7f9dbdbff700 1 Processor -- start 2023-07-11T00:30:44.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.938+0000 7f9dbdbff700 1 -- start start 2023-07-11T00:30:44.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.939+0000 7f9dbdbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db80b8430 0x7f9db80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:44.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.939+0000 7f9dbdbff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9db80cfc60 0x7f9db80d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:44.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.939+0000 7f9dbdbff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db80d0b20 con 0x7f9db80d3730 2023-07-11T00:30:44.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.939+0000 7f9dbdbff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db80b8800 con 0x7f9db80cfc60 2023-07-11T00:30:44.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.939+0000 7f9dbdbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80b4ee0 con 0x7f9db80b8430 2023-07-11T00:30:44.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.939+0000 7f9db6ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9db80d3730 0x7f9db80cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52302/0 (socket says 172.21.15.22:52302) 2023-07-11T00:30:44.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.939+0000 7f9db6ffd700 1 -- 172.21.15.22:0/1394207036 learned_addr learned my addr 172.21.15.22:0/1394207036 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:44.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.939+0000 7f9db7fff700 1 --2- 172.21.15.22:0/1394207036 >> v2:172.21.15.22:3300/0 conn(0x7f9db80cfc60 0x7f9db80d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:44.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.940+0000 7f9db77fe700 1 --2- 172.21.15.22:0/1394207036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db80b8430 0x7f9db80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:44.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.940+0000 7f9db67fc700 1 -- 172.21.15.22:0/1394207036 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121068520 0 0) 0x7f9db80d0b20 con 0x7f9db80d3730 2023-07-11T00:30:44.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.940+0000 7f9db67fc700 1 -- 172.21.15.22:0/1394207036 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9da00035b0 con 0x7f9db80d3730 2023-07-11T00:30:44.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.940+0000 7f9db7fff700 1 -- 172.21.15.22:0/1394207036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db80b8430 msgr2=0x7f9db80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:44.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.940+0000 7f9db7fff700 1 --2- 172.21.15.22:0/1394207036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db80b8430 0x7f9db80cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.940+0000 7f9db7fff700 1 -- 172.21.15.22:0/1394207036 >> v1:172.21.15.22:6789/0 conn(0x7f9db80d3730 legacy=0x7f9db80cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:44.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.940+0000 7f9db7fff700 1 -- 172.21.15.22:0/1394207036 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db80b51c0 con 0x7f9db80cfc60 2023-07-11T00:30:44.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.940+0000 7f9db77fe700 1 --2- 172.21.15.22:0/1394207036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db80b8430 0x7f9db80cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:44.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.940+0000 7f9db7fff700 1 --2- 172.21.15.22:0/1394207036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9db80cfc60 0x7f9db80d0fb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009d90 tx=0x7f9db000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a84fdb9b86b87d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:44.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.940+0000 7f9db67fc700 1 -- 172.21.15.22:0/1394207036 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db000e070 con 0x7f9db80cfc60 2023-07-11T00:30:44.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.940+0000 7f9db67fc700 1 -- 172.21.15.22:0/1394207036 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db000bb20 con 0x7f9db80cfc60 2023-07-11T00:30:44.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.940+0000 7f9db67fc700 1 -- 172.21.15.22:0/1394207036 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0012430 con 0x7f9db80cfc60 2023-07-11T00:30:44.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.941+0000 7f9dbdbff700 1 -- 172.21.15.22:0/1394207036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9db80cfc60 msgr2=0x7f9db80d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:44.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.941+0000 7f9dbdbff700 1 --2- 172.21.15.22:0/1394207036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9db80cfc60 0x7f9db80d0fb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009d90 tx=0x7f9db000b330 comp rx=0 tx=0).stop 2023-07-11T00:30:44.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.941+0000 7f9dbdbff700 1 -- 172.21.15.22:0/1394207036 shutdown_connections 2023-07-11T00:30:44.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.941+0000 7f9dbdbff700 1 --2- 172.21.15.22:0/1394207036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9db80cfc60 0x7f9db80d0fb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.941+0000 7f9dbdbff700 1 --2- 172.21.15.22:0/1394207036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db80b8430 0x7f9db80cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.941+0000 7f9dbdbff700 1 -- 172.21.15.22:0/1394207036 >> 172.21.15.22:0/1394207036 conn(0x7f9db806b3f0 msgr2=0x7f9db806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:44.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.941+0000 7f9dbdbff700 1 -- 172.21.15.22:0/1394207036 shutdown_connections 2023-07-11T00:30:44.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.941+0000 7f9dbdbff700 1 -- 172.21.15.22:0/1394207036 wait complete. 2023-07-11T00:30:44.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.943+0000 7f9dbdbff700 1 Processor -- start 2023-07-11T00:30:44.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.943+0000 7f9dbdbff700 1 -- start start 2023-07-11T00:30:44.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.944+0000 7f9dbdbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db80b8430 0x7f9db8150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:44.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.944+0000 7f9dbdbff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9db80cfc60 0x7f9db80c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:44.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.944+0000 7f9dbdbff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9db80d3730 0x7f9db80c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:44.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.944+0000 7f9dbdbff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80cb000 con 0x7f9db80cfc60 2023-07-11T00:30:44.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.944+0000 7f9dbdbff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80cb2e0 con 0x7f9db80d3730 2023-07-11T00:30:44.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.944+0000 7f9dbdbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80cb5c0 con 0x7f9db80b8430 2023-07-11T00:30:44.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.944+0000 7f9db6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9db80cfc60 0x7f9db80c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:44.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.944+0000 7f9db6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9db80cfc60 0x7f9db80c7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46604/0 (socket says 172.21.15.22:46604) 2023-07-11T00:30:44.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.944+0000 7f9db6ffd700 1 -- 172.21.15.22:0/187494810 learned_addr learned my addr 172.21.15.22:0/187494810 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:44.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.944+0000 7f9db77fe700 1 --2- 172.21.15.22:0/187494810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db80b8430 0x7f9db8150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:44.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.944+0000 7f9db7fff700 1 --2- 172.21.15.22:0/187494810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9db80d3730 0x7f9db80c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:44.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.945+0000 7f9db6ffd700 1 -- 172.21.15.22:0/187494810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db80b8430 msgr2=0x7f9db8150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:44.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.945+0000 7f9db6ffd700 1 --2- 172.21.15.22:0/187494810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db80b8430 0x7f9db8150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.945+0000 7f9db6ffd700 1 -- 172.21.15.22:0/187494810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9db80d3730 msgr2=0x7f9db80c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:44.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.945+0000 7f9db6ffd700 1 --2- 172.21.15.22:0/187494810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9db80d3730 0x7f9db80c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:44.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.945+0000 7f9db6ffd700 1 -- 172.21.15.22:0/187494810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db0009a70 con 0x7f9db80cfc60 2023-07-11T00:30:44.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.945+0000 7f9db6ffd700 1 --2- 172.21.15.22:0/187494810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9db80cfc60 0x7f9db80c7350 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9dac001eb0 tx=0x7f9dac00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:44.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.945+0000 7f9d9ffff700 1 -- 172.21.15.22:0/187494810 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac005d70 con 0x7f9db80cfc60 2023-07-11T00:30:44.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.945+0000 7f9d9ffff700 1 -- 172.21.15.22:0/187494810 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac0070d0 con 0x7f9db80cfc60 2023-07-11T00:30:44.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.945+0000 7f9d9ffff700 1 -- 172.21.15.22:0/187494810 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac007460 con 0x7f9db80cfc60 2023-07-11T00:30:44.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.945+0000 7f9dbdbff700 1 -- 172.21.15.22:0/187494810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db80cb8a0 con 0x7f9db80cfc60 2023-07-11T00:30:44.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.945+0000 7f9dbdbff700 1 -- 172.21.15.22:0/187494810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db80cacd0 con 0x7f9db80cfc60 2023-07-11T00:30:44.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.946+0000 7f9dbdbff700 1 -- 172.21.15.22:0/187494810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db804ea60 con 0x7f9db80cfc60 2023-07-11T00:30:44.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.947+0000 7f9d9ffff700 1 -- 172.21.15.22:0/187494810 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9dac0075c0 con 0x7f9db80cfc60 2023-07-11T00:30:44.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.948+0000 7f9d9ffff700 1 --2- 172.21.15.22:0/187494810 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9da406ace0 0x7f9da406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:44.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.948+0000 7f9d9ffff700 1 -- 172.21.15.22:0/187494810 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9dac088cc0 con 0x7f9db80cfc60 2023-07-11T00:30:44.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.949+0000 7f9db77fe700 1 --2- 172.21.15.22:0/187494810 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9da406ace0 0x7f9da406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:44.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.950+0000 7f9db77fe700 1 --2- 172.21.15.22:0/187494810 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9da406ace0 0x7f9da406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9da8006f10 tx=0x7f9da8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:44.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:44.952+0000 7f9d9ffff700 1 -- 172.21.15.22:0/187494810 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9dac08f080 con 0x7f9db80cfc60 2023-07-11T00:30:45.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.161+0000 7f9dbdbff700 1 -- 172.21.15.22:0/187494810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9db8073980 con 0x7f9db80cfc60 2023-07-11T00:30:45.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.162+0000 7f9d9ffff700 1 -- 172.21.15.22:0/187494810 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9dac0539e0 con 0x7f9db80cfc60 2023-07-11T00:30:45.165 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:30:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.164+0000 7f9dbdbff700 1 -- 172.21.15.22:0/187494810 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9da406ace0 msgr2=0x7f9da406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.164+0000 7f9dbdbff700 1 --2- 172.21.15.22:0/187494810 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9da406ace0 0x7f9da406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9da8006f10 tx=0x7f9da8008040 comp rx=0 tx=0).stop 2023-07-11T00:30:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.164+0000 7f9dbdbff700 1 -- 172.21.15.22:0/187494810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9db80cfc60 msgr2=0x7f9db80c7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.164+0000 7f9dbdbff700 1 --2- 172.21.15.22:0/187494810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9db80cfc60 0x7f9db80c7350 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9dac001eb0 tx=0x7f9dac00c7b0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.164+0000 7f9dbdbff700 1 -- 172.21.15.22:0/187494810 shutdown_connections 2023-07-11T00:30:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.164+0000 7f9dbdbff700 1 --2- 172.21.15.22:0/187494810 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9da406ace0 0x7f9da406d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.164+0000 7f9dbdbff700 1 --2- 172.21.15.22:0/187494810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9db80b8430 0x7f9db8150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.164+0000 7f9dbdbff700 1 --2- 172.21.15.22:0/187494810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9db80d3730 0x7f9db80c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.164+0000 7f9dbdbff700 1 --2- 172.21.15.22:0/187494810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9db80cfc60 0x7f9db80c7350 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.164+0000 7f9dbdbff700 1 -- 172.21.15.22:0/187494810 >> 172.21.15.22:0/187494810 conn(0x7f9db806b3f0 msgr2=0x7f9db80b61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.164+0000 7f9dbdbff700 1 -- 172.21.15.22:0/187494810 shutdown_connections 2023-07-11T00:30:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.164+0000 7f9dbdbff700 1 -- 172.21.15.22:0/187494810 wait complete. 2023-07-11T00:30:45.186 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:30:45.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.386+0000 7fdb365ff700 1 Processor -- start 2023-07-11T00:30:45.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.386+0000 7fdb365ff700 1 -- start start 2023-07-11T00:30:45.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.387+0000 7fdb365ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdb3015c460 0x7fdb300b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:45.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.387+0000 7fdb365ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdb300d2640 0x7fdb300cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:45.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.388+0000 7fdb365ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb300d1790 con 0x7fdb300cf720 2023-07-11T00:30:45.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.388+0000 7fdb365ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb300cedd0 con 0x7fdb3015c460 2023-07-11T00:30:45.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.388+0000 7fdb365ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb300cd950 con 0x7fdb300d2640 2023-07-11T00:30:45.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.388+0000 7fdb2ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdb3015c460 0x7fdb300b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:45.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.388+0000 7fdb2ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdb3015c460 0x7fdb300b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46618/0 (socket says 172.21.15.22:46618) 2023-07-11T00:30:45.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.388+0000 7fdb2ffff700 1 -- 172.21.15.22:0/2161748205 learned_addr learned my addr 172.21.15.22:0/2161748205 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:45.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.388+0000 7fdb2f7fe700 1 --2- 172.21.15.22:0/2161748205 >> v2:172.21.15.184:3300/0 conn(0x7fdb300d2640 0x7fdb300cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:45.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.388+0000 7fdb2ffff700 1 -- 172.21.15.22:0/2161748205 >> v2:172.21.15.184:3300/0 conn(0x7fdb300d2640 msgr2=0x7fdb300cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:45.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.388+0000 7fdb2ffff700 1 --2- 172.21.15.22:0/2161748205 >> v2:172.21.15.184:3300/0 conn(0x7fdb300d2640 0x7fdb300cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.388+0000 7fdb2ffff700 1 -- 172.21.15.22:0/2161748205 >> v1:172.21.15.184:6789/0 conn(0x7fdb300cf720 legacy=0x7fdb300d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:45.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.388+0000 7fdb2ffff700 1 -- 172.21.15.22:0/2161748205 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb300d14b0 con 0x7fdb3015c460 2023-07-11T00:30:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.389+0000 7fdb2ffff700 1 --2- 172.21.15.22:0/2161748205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb3015c460 0x7fdb300b59d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdb3015fd80 tx=0x7fdb20009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a1bb524b9bc9b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.389+0000 7fdb2effd700 1 -- 172.21.15.22:0/2161748205 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20011830 con 0x7fdb3015c460 2023-07-11T00:30:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.389+0000 7fdb2effd700 1 -- 172.21.15.22:0/2161748205 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb20011990 con 0x7fdb3015c460 2023-07-11T00:30:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.389+0000 7fdb2effd700 1 -- 172.21.15.22:0/2161748205 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20011d20 con 0x7fdb3015c460 2023-07-11T00:30:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.389+0000 7fdb365ff700 1 -- 172.21.15.22:0/2161748205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb3015c460 msgr2=0x7fdb300b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:45.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.390+0000 7fdb365ff700 1 --2- 172.21.15.22:0/2161748205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb3015c460 0x7fdb300b59d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdb3015fd80 tx=0x7fdb20009bd0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.390+0000 7fdb365ff700 1 -- 172.21.15.22:0/2161748205 shutdown_connections 2023-07-11T00:30:45.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.390+0000 7fdb365ff700 1 --2- 172.21.15.22:0/2161748205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb3015c460 0x7fdb300b59d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.390+0000 7fdb365ff700 1 --2- 172.21.15.22:0/2161748205 >> v2:172.21.15.184:3300/0 conn(0x7fdb300d2640 0x7fdb300cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.390+0000 7fdb365ff700 1 -- 172.21.15.22:0/2161748205 >> 172.21.15.22:0/2161748205 conn(0x7fdb30071660 msgr2=0x7fdb30071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:45.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.390+0000 7fdb365ff700 1 -- 172.21.15.22:0/2161748205 shutdown_connections 2023-07-11T00:30:45.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.390+0000 7fdb365ff700 1 -- 172.21.15.22:0/2161748205 wait complete. 2023-07-11T00:30:45.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.391+0000 7fdb365ff700 1 Processor -- start 2023-07-11T00:30:45.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.392+0000 7fdb365ff700 1 -- start start 2023-07-11T00:30:45.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.392+0000 7fdb365ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb300cf720 0x7fdb30151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:45.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.392+0000 7fdb365ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb300d2640 0x7fdb3015a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:45.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.393+0000 7fdb365ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb3015c460 0x7fdb30159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:45.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.393+0000 7fdb365ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb300c66b0 con 0x7fdb300cf720 2023-07-11T00:30:45.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.393+0000 7fdb365ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb30152290 con 0x7fdb3015c460 2023-07-11T00:30:45.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.393+0000 7fdb365ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb300cb040 con 0x7fdb300d2640 2023-07-11T00:30:45.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.393+0000 7fdb2ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb300cf720 0x7fdb30151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:45.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.393+0000 7fdb2ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb300cf720 0x7fdb30151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46624/0 (socket says 172.21.15.22:46624) 2023-07-11T00:30:45.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.393+0000 7fdb2ffff700 1 -- 172.21.15.22:0/880313262 learned_addr learned my addr 172.21.15.22:0/880313262 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:45.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.393+0000 7fdb34b9c700 1 --2- 172.21.15.22:0/880313262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb3015c460 0x7fdb30159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:45.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.393+0000 7fdb2f7fe700 1 --2- 172.21.15.22:0/880313262 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb300d2640 0x7fdb3015a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:45.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.393+0000 7fdb2ffff700 1 -- 172.21.15.22:0/880313262 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb300d2640 msgr2=0x7fdb3015a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:45.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.393+0000 7fdb2ffff700 1 --2- 172.21.15.22:0/880313262 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb300d2640 0x7fdb3015a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.393+0000 7fdb2ffff700 1 -- 172.21.15.22:0/880313262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb3015c460 msgr2=0x7fdb30159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:45.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.393+0000 7fdb2ffff700 1 --2- 172.21.15.22:0/880313262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb3015c460 0x7fdb30159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.393+0000 7fdb2ffff700 1 -- 172.21.15.22:0/880313262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb20009550 con 0x7fdb300cf720 2023-07-11T00:30:45.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.393+0000 7fdb34b9c700 1 --2- 172.21.15.22:0/880313262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb3015c460 0x7fdb30159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:45.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.393+0000 7fdb2ffff700 1 --2- 172.21.15.22:0/880313262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb300cf720 0x7fdb30151d50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdb20000c00 tx=0x7fdb20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:45.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.394+0000 7fdb2cff9700 1 -- 172.21.15.22:0/880313262 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20004570 con 0x7fdb300cf720 2023-07-11T00:30:45.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.394+0000 7fdb2cff9700 1 -- 172.21.15.22:0/880313262 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2001f070 con 0x7fdb300cf720 2023-07-11T00:30:45.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.394+0000 7fdb365ff700 1 -- 172.21.15.22:0/880313262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb300cb320 con 0x7fdb300cf720 2023-07-11T00:30:45.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.394+0000 7fdb2cff9700 1 -- 172.21.15.22:0/880313262 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb200038e0 con 0x7fdb300cf720 2023-07-11T00:30:45.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.394+0000 7fdb365ff700 1 -- 172.21.15.22:0/880313262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb300c6900 con 0x7fdb300cf720 2023-07-11T00:30:45.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.395+0000 7fdb365ff700 1 -- 172.21.15.22:0/880313262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb3004ea60 con 0x7fdb300cf720 2023-07-11T00:30:45.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.396+0000 7fdb2cff9700 1 -- 172.21.15.22:0/880313262 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb20021030 con 0x7fdb300cf720 2023-07-11T00:30:45.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.397+0000 7fdb2cff9700 1 --2- 172.21.15.22:0/880313262 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdb1c06ace0 0x7fdb1c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:45.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.397+0000 7fdb2cff9700 1 -- 172.21.15.22:0/880313262 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdb2008ac10 con 0x7fdb300cf720 2023-07-11T00:30:45.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.398+0000 7fdb2f7fe700 1 --2- 172.21.15.22:0/880313262 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdb1c06ace0 0x7fdb1c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:45.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.398+0000 7fdb2f7fe700 1 --2- 172.21.15.22:0/880313262 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdb1c06ace0 0x7fdb1c06d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdb3015b820 tx=0x7fdb24008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:45.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.402+0000 7fdb2cff9700 1 -- 172.21.15.22:0/880313262 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fdb200559c0 con 0x7fdb300cf720 2023-07-11T00:30:45.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.656+0000 7fdb365ff700 1 -- 172.21.15.22:0/880313262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb301585e0 con 0x7fdb300cf720 2023-07-11T00:30:45.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.656+0000 7fdb2cff9700 1 -- 172.21.15.22:0/880313262 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fdb20015090 con 0x7fdb300cf720 2023-07-11T00:30:45.659 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:45.659 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3244868368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3244868368},{"type":"v1","addr":"172.21.15.22:6833","nonce":3244868368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/907204261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":907204261},{"type":"v1","addr":"172.21.15.184:6836","nonce":907204261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/1214375050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1214375050},{"type":"v1","addr":"172.21.15.22:6835","nonce":1214375050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:30:05.408970+0000","modified":"2023-07-11T00:30:33.631426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3376322541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3376322541},{"type":"v1","addr":"172.21.15.184:6837","nonce":3376322541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-11T00:30:45.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.659+0000 7fdb365ff700 1 -- 172.21.15.22:0/880313262 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdb1c06ace0 msgr2=0x7fdb1c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:45.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.659+0000 7fdb365ff700 1 --2- 172.21.15.22:0/880313262 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdb1c06ace0 0x7fdb1c06d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdb3015b820 tx=0x7fdb24008040 comp rx=0 tx=0).stop 2023-07-11T00:30:45.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.659+0000 7fdb365ff700 1 -- 172.21.15.22:0/880313262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb300cf720 msgr2=0x7fdb30151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:45.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.659+0000 7fdb365ff700 1 --2- 172.21.15.22:0/880313262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb300cf720 0x7fdb30151d50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdb20000c00 tx=0x7fdb20004750 comp rx=0 tx=0).stop 2023-07-11T00:30:45.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.659+0000 7fdb365ff700 1 -- 172.21.15.22:0/880313262 shutdown_connections 2023-07-11T00:30:45.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.659+0000 7fdb365ff700 1 --2- 172.21.15.22:0/880313262 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdb1c06ace0 0x7fdb1c06d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.659+0000 7fdb365ff700 1 --2- 172.21.15.22:0/880313262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb3015c460 0x7fdb30159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.659+0000 7fdb365ff700 1 --2- 172.21.15.22:0/880313262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb300cf720 0x7fdb30151d50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.659+0000 7fdb365ff700 1 --2- 172.21.15.22:0/880313262 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb300d2640 0x7fdb3015a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.659+0000 7fdb365ff700 1 -- 172.21.15.22:0/880313262 >> 172.21.15.22:0/880313262 conn(0x7fdb30071660 msgr2=0x7fdb30071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:45.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.659+0000 7fdb365ff700 1 -- 172.21.15.22:0/880313262 shutdown_connections 2023-07-11T00:30:45.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.659+0000 7fdb365ff700 1 -- 172.21.15.22:0/880313262 wait complete. 2023-07-11T00:30:45.664 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 9 2023-07-11T00:30:45.680 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:30:45.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.879+0000 7febbb7ff700 1 Processor -- start 2023-07-11T00:30:45.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.879+0000 7febbb7ff700 1 -- start start 2023-07-11T00:30:45.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.880+0000 7febbb7ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7febb415c460 0x7febb40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:45.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.880+0000 7febbb7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febb40d2640 0x7febb40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:45.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.880+0000 7febbb7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb40d1790 con 0x7febb40cf720 2023-07-11T00:30:45.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.880+0000 7febbb7ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb40cedd0 con 0x7febb415c460 2023-07-11T00:30:45.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.880+0000 7febbb7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb40cd950 con 0x7febb40d2640 2023-07-11T00:30:45.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.880+0000 7febb959b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7febb415c460 0x7febb40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:45.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.880+0000 7febb959b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7febb415c460 0x7febb40b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46632/0 (socket says 172.21.15.22:46632) 2023-07-11T00:30:45.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.880+0000 7febb959b700 1 -- 172.21.15.22:0/3891231754 learned_addr learned my addr 172.21.15.22:0/3891231754 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:45.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.881+0000 7febb8d9a700 1 --2- 172.21.15.22:0/3891231754 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febb40d2640 0x7febb40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:45.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.881+0000 7febb959b700 1 -- 172.21.15.22:0/3891231754 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febb40d2640 msgr2=0x7febb40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:45.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.881+0000 7febb959b700 1 --2- 172.21.15.22:0/3891231754 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febb40d2640 0x7febb40cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.881+0000 7febb959b700 1 -- 172.21.15.22:0/3891231754 >> v1:172.21.15.184:6789/0 conn(0x7febb40cf720 legacy=0x7febb40d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:45.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.881+0000 7febb959b700 1 -- 172.21.15.22:0/3891231754 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb40d14b0 con 0x7febb415c460 2023-07-11T00:30:45.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.881+0000 7febb959b700 1 --2- 172.21.15.22:0/3891231754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb415c460 0x7febb40b59d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7febb00098f0 tx=0x7febb0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c110c3ab630cd08 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:45.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.881+0000 7febabfff700 1 -- 172.21.15.22:0/3891231754 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0011830 con 0x7febb415c460 2023-07-11T00:30:45.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.881+0000 7febabfff700 1 -- 172.21.15.22:0/3891231754 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb0011990 con 0x7febb415c460 2023-07-11T00:30:45.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.881+0000 7febabfff700 1 -- 172.21.15.22:0/3891231754 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0011d20 con 0x7febb415c460 2023-07-11T00:30:45.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.882+0000 7febbb7ff700 1 -- 172.21.15.22:0/3891231754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb415c460 msgr2=0x7febb40b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:45.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.882+0000 7febbb7ff700 1 --2- 172.21.15.22:0/3891231754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb415c460 0x7febb40b59d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7febb00098f0 tx=0x7febb0009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:45.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.882+0000 7febbb7ff700 1 -- 172.21.15.22:0/3891231754 shutdown_connections 2023-07-11T00:30:45.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.882+0000 7febbb7ff700 1 --2- 172.21.15.22:0/3891231754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb415c460 0x7febb40b59d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.882+0000 7febbb7ff700 1 --2- 172.21.15.22:0/3891231754 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febb40d2640 0x7febb40cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.882+0000 7febbb7ff700 1 -- 172.21.15.22:0/3891231754 >> 172.21.15.22:0/3891231754 conn(0x7febb4071660 msgr2=0x7febb4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:45.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.882+0000 7febbb7ff700 1 -- 172.21.15.22:0/3891231754 shutdown_connections 2023-07-11T00:30:45.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.882+0000 7febbb7ff700 1 -- 172.21.15.22:0/3891231754 wait complete. 2023-07-11T00:30:45.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.884+0000 7febbb7ff700 1 Processor -- start 2023-07-11T00:30:45.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.884+0000 7febbb7ff700 1 -- start start 2023-07-11T00:30:45.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.885+0000 7febbb7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febb40cf720 0x7febb40cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:45.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.885+0000 7febbb7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febb40d2640 0x7febb4148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:45.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.885+0000 7febbb7ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb415c460 0x7febb415af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:45.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.885+0000 7febbb7ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb41f6a80 con 0x7febb415c460 2023-07-11T00:30:45.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.885+0000 7febbb7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb4149430 con 0x7febb40d2640 2023-07-11T00:30:45.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.885+0000 7febbb7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb41f5b20 con 0x7febb40cf720 2023-07-11T00:30:45.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.885+0000 7febb9d9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb415c460 0x7febb415af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:45.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.885+0000 7febb9d9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb415c460 0x7febb415af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46638/0 (socket says 172.21.15.22:46638) 2023-07-11T00:30:45.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.885+0000 7febb9d9c700 1 -- 172.21.15.22:0/4187374733 learned_addr learned my addr 172.21.15.22:0/4187374733 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:45.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.885+0000 7febb959b700 1 --2- 172.21.15.22:0/4187374733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febb40cf720 0x7febb40cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:45.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.885+0000 7febb8d9a700 1 --2- 172.21.15.22:0/4187374733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febb40d2640 0x7febb4148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:45.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.886+0000 7febb9d9c700 1 -- 172.21.15.22:0/4187374733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febb40cf720 msgr2=0x7febb40cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:45.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.886+0000 7febb9d9c700 1 --2- 172.21.15.22:0/4187374733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febb40cf720 0x7febb40cafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.886+0000 7febb9d9c700 1 -- 172.21.15.22:0/4187374733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febb40d2640 msgr2=0x7febb4148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:45.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.886+0000 7febb9d9c700 1 --2- 172.21.15.22:0/4187374733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febb40d2640 0x7febb4148ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:45.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.886+0000 7febb9d9c700 1 -- 172.21.15.22:0/4187374733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb0009550 con 0x7febb415c460 2023-07-11T00:30:45.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.886+0000 7febb959b700 1 --2- 172.21.15.22:0/4187374733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febb40cf720 0x7febb40cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:45.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.886+0000 7febb9d9c700 1 --2- 172.21.15.22:0/4187374733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb415c460 0x7febb415af60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7febac00cb50 tx=0x7febac00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:45.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.886+0000 7feba9ffb700 1 -- 172.21.15.22:0/4187374733 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac003c00 con 0x7febb415c460 2023-07-11T00:30:45.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.886+0000 7feba9ffb700 1 -- 172.21.15.22:0/4187374733 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac003d60 con 0x7febb415c460 2023-07-11T00:30:45.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.886+0000 7febbb7ff700 1 -- 172.21.15.22:0/4187374733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb41f5e00 con 0x7febb415c460 2023-07-11T00:30:45.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.886+0000 7feba9ffb700 1 -- 172.21.15.22:0/4187374733 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac00ab70 con 0x7febb415c460 2023-07-11T00:30:45.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.886+0000 7febbb7ff700 1 -- 172.21.15.22:0/4187374733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb41f63c0 con 0x7febb415c460 2023-07-11T00:30:45.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.887+0000 7febbb7ff700 1 -- 172.21.15.22:0/4187374733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb404ea60 con 0x7febb415c460 2023-07-11T00:30:45.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.888+0000 7feba9ffb700 1 -- 172.21.15.22:0/4187374733 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7febac00acd0 con 0x7febb415c460 2023-07-11T00:30:45.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.889+0000 7feba9ffb700 1 --2- 172.21.15.22:0/4187374733 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7feb9806ace0 0x7feb9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:45.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.889+0000 7feba9ffb700 1 -- 172.21.15.22:0/4187374733 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7febac089820 con 0x7febb415c460 2023-07-11T00:30:45.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.890+0000 7febb959b700 1 --2- 172.21.15.22:0/4187374733 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7feb9806ace0 0x7feb9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:45.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.890+0000 7febb959b700 1 --2- 172.21.15.22:0/4187374733 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7feb9806ace0 0x7feb9806d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7febb0000c00 tx=0x7febb0008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:45.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:45.893+0000 7feba9ffb700 1 -- 172.21.15.22:0/4187374733 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7febac0545d0 con 0x7febb415c460 2023-07-11T00:30:46.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.106+0000 7febbb7ff700 1 -- 172.21.15.22:0/4187374733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febb40b4fa0 con 0x7febb415c460 2023-07-11T00:30:46.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.107+0000 7feba9ffb700 1 -- 172.21.15.22:0/4187374733 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20062 (secure 0 0 0) 0x7febac057bf0 con 0x7febb415c460 2023-07-11T00:30:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:46.110 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:10.571866+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:30:46.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.109+0000 7febbb7ff700 1 -- 172.21.15.22:0/4187374733 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7feb9806ace0 msgr2=0x7feb9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:46.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.109+0000 7febbb7ff700 1 --2- 172.21.15.22:0/4187374733 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7feb9806ace0 0x7feb9806d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7febb0000c00 tx=0x7febb0008030 comp rx=0 tx=0).stop 2023-07-11T00:30:46.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.109+0000 7febbb7ff700 1 -- 172.21.15.22:0/4187374733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb415c460 msgr2=0x7febb415af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:46.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.109+0000 7febbb7ff700 1 --2- 172.21.15.22:0/4187374733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb415c460 0x7febb415af60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7febac00cb50 tx=0x7febac00cf10 comp rx=0 tx=0).stop 2023-07-11T00:30:46.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.109+0000 7febbb7ff700 1 -- 172.21.15.22:0/4187374733 shutdown_connections 2023-07-11T00:30:46.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.109+0000 7febbb7ff700 1 --2- 172.21.15.22:0/4187374733 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7feb9806ace0 0x7feb9806d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.109+0000 7febbb7ff700 1 --2- 172.21.15.22:0/4187374733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febb40cf720 0x7febb40cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.109+0000 7febbb7ff700 1 --2- 172.21.15.22:0/4187374733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb415c460 0x7febb415af60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.109+0000 7febbb7ff700 1 --2- 172.21.15.22:0/4187374733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febb40d2640 0x7febb4148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.109+0000 7febbb7ff700 1 -- 172.21.15.22:0/4187374733 >> 172.21.15.22:0/4187374733 conn(0x7febb4071660 msgr2=0x7febb415c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:46.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.109+0000 7febbb7ff700 1 -- 172.21.15.22:0/4187374733 shutdown_connections 2023-07-11T00:30:46.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.109+0000 7febbb7ff700 1 -- 172.21.15.22:0/4187374733 wait complete. 2023-07-11T00:30:46.131 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:29:57.631007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:29:58.547599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:30:03.826184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:30:04.383448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-11T00:30:08.075875+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-11T00:30:46.132 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:30:46.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.333+0000 7f44831ff700 1 Processor -- start 2023-07-11T00:30:46.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.333+0000 7f44831ff700 1 -- start start 2023-07-11T00:30:46.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.334+0000 7f44831ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f447c0b8430 0x7f447c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:46.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.334+0000 7f44831ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f447c0d0b20 con 0x7f447c0d3730 2023-07-11T00:30:46.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.334+0000 7f44831ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f447c0b4ee0 con 0x7f447c0cfc60 2023-07-11T00:30:46.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.334+0000 7f44831ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447c0b8800 con 0x7f447c0b8430 2023-07-11T00:30:46.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.334+0000 7f447bfff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f447c0d3730 0x7f447c0cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52318/0 (socket says 172.21.15.22:52318) 2023-07-11T00:30:46.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.334+0000 7f447bfff700 1 -- 172.21.15.22:0/3619078607 learned_addr learned my addr 172.21.15.22:0/3619078607 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:46.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.335+0000 7f4480f9b700 1 --2- 172.21.15.22:0/3619078607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f447c0b8430 0x7f447c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:46.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.335+0000 7f447b7fe700 1 -- 172.21.15.22:0/3619078607 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590752840 0 0) 0x7f447c0d0b20 con 0x7f447c0d3730 2023-07-11T00:30:46.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.335+0000 7f447b7fe700 1 -- 172.21.15.22:0/3619078607 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f446c0035b0 con 0x7f447c0d3730 2023-07-11T00:30:46.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.335+0000 7f447b7fe700 1 -- 172.21.15.22:0/3619078607 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512217276 0 0) 0x7f447c0b4ee0 con 0x7f447c0cfc60 2023-07-11T00:30:46.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.335+0000 7f447b7fe700 1 -- 172.21.15.22:0/3619078607 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f447c0d0b20 con 0x7f447c0cfc60 2023-07-11T00:30:46.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.335+0000 7f4480f9b700 1 -- 172.21.15.22:0/3619078607 >> v1:172.21.15.184:6789/0 conn(0x7f447c0cfc60 legacy=0x7f447c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:46.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.335+0000 7f4480f9b700 1 -- 172.21.15.22:0/3619078607 >> v1:172.21.15.22:6789/0 conn(0x7f447c0d3730 legacy=0x7f447c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:46.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.335+0000 7f4480f9b700 1 -- 172.21.15.22:0/3619078607 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c0b51c0 con 0x7f447c0b8430 2023-07-11T00:30:46.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.335+0000 7f4480f9b700 1 --2- 172.21.15.22:0/3619078607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f447c0b8430 0x7f447c0cd320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4470009870 tx=0x7f4470009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba4fe039bad74b11 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:46.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.336+0000 7f447b7fe700 1 -- 172.21.15.22:0/3619078607 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470011830 con 0x7f447c0b8430 2023-07-11T00:30:46.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.336+0000 7f447b7fe700 1 -- 172.21.15.22:0/3619078607 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4470011990 con 0x7f447c0b8430 2023-07-11T00:30:46.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.336+0000 7f447b7fe700 1 -- 172.21.15.22:0/3619078607 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470011d20 con 0x7f447c0b8430 2023-07-11T00:30:46.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.336+0000 7f44831ff700 1 -- 172.21.15.22:0/3619078607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f447c0b8430 msgr2=0x7f447c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:46.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.336+0000 7f44831ff700 1 --2- 172.21.15.22:0/3619078607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f447c0b8430 0x7f447c0cd320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4470009870 tx=0x7f4470009b80 comp rx=0 tx=0).stop 2023-07-11T00:30:46.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.336+0000 7f44831ff700 1 -- 172.21.15.22:0/3619078607 shutdown_connections 2023-07-11T00:30:46.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.336+0000 7f44831ff700 1 --2- 172.21.15.22:0/3619078607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f447c0b8430 0x7f447c0cd320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.336+0000 7f44831ff700 1 -- 172.21.15.22:0/3619078607 >> 172.21.15.22:0/3619078607 conn(0x7f447c06b3f0 msgr2=0x7f447c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:46.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.336+0000 7f44831ff700 1 -- 172.21.15.22:0/3619078607 shutdown_connections 2023-07-11T00:30:46.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.337+0000 7f44831ff700 1 -- 172.21.15.22:0/3619078607 wait complete. 2023-07-11T00:30:46.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.338+0000 7f44831ff700 1 Processor -- start 2023-07-11T00:30:46.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.338+0000 7f44831ff700 1 -- start start 2023-07-11T00:30:46.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.339+0000 7f44831ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f447c0b8430 0x7f447c0cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:46.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.339+0000 7f44831ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f447c0cfc60 0x7f447c0c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:46.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.339+0000 7f44831ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f447c0d3730 0x7f447c1f1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:46.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.339+0000 7f44831ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c156830 con 0x7f447c0cfc60 2023-07-11T00:30:46.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.339+0000 7f44831ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c0c6bb0 con 0x7f447c0d3730 2023-07-11T00:30:46.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.339+0000 7f44831ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447c1f19b0 con 0x7f447c0b8430 2023-07-11T00:30:46.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.340+0000 7f447bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f447c0cfc60 0x7f447c0c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:46.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.340+0000 7f447bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f447c0cfc60 0x7f447c0c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46654/0 (socket says 172.21.15.22:46654) 2023-07-11T00:30:46.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.340+0000 7f447bfff700 1 -- 172.21.15.22:0/768273243 learned_addr learned my addr 172.21.15.22:0/768273243 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:46.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.340+0000 7f4480f9b700 1 --2- 172.21.15.22:0/768273243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f447c0b8430 0x7f447c0cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:46.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.340+0000 7f448179c700 1 --2- 172.21.15.22:0/768273243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f447c0d3730 0x7f447c1f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:46.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.340+0000 7f447bfff700 1 -- 172.21.15.22:0/768273243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f447c0b8430 msgr2=0x7f447c0cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:46.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.340+0000 7f447bfff700 1 --2- 172.21.15.22:0/768273243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f447c0b8430 0x7f447c0cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.340+0000 7f447bfff700 1 -- 172.21.15.22:0/768273243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f447c0d3730 msgr2=0x7f447c1f1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:46.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.340+0000 7f447bfff700 1 --2- 172.21.15.22:0/768273243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f447c0d3730 0x7f447c1f1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.340+0000 7f447bfff700 1 -- 172.21.15.22:0/768273243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44700094a0 con 0x7f447c0cfc60 2023-07-11T00:30:46.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.340+0000 7f4480f9b700 1 --2- 172.21.15.22:0/768273243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f447c0b8430 0x7f447c0cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:46.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.340+0000 7f447bfff700 1 --2- 172.21.15.22:0/768273243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f447c0cfc60 0x7f447c0c6670 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4468001eb0 tx=0x7f446800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:46.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.341+0000 7f44797fa700 1 -- 172.21.15.22:0/768273243 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468005d70 con 0x7f447c0cfc60 2023-07-11T00:30:46.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.341+0000 7f44797fa700 1 -- 172.21.15.22:0/768273243 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44680070d0 con 0x7f447c0cfc60 2023-07-11T00:30:46.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.341+0000 7f44797fa700 1 -- 172.21.15.22:0/768273243 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468007460 con 0x7f447c0cfc60 2023-07-11T00:30:46.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.341+0000 7f44831ff700 1 -- 172.21.15.22:0/768273243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447c0c76d0 con 0x7f447c0cfc60 2023-07-11T00:30:46.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.341+0000 7f44831ff700 1 -- 172.21.15.22:0/768273243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447c0c7110 con 0x7f447c0cfc60 2023-07-11T00:30:46.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.342+0000 7f44831ff700 1 -- 172.21.15.22:0/768273243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447c156600 con 0x7f447c0cfc60 2023-07-11T00:30:46.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.343+0000 7f44797fa700 1 -- 172.21.15.22:0/768273243 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f44680075c0 con 0x7f447c0cfc60 2023-07-11T00:30:46.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.344+0000 7f44797fa700 1 --2- 172.21.15.22:0/768273243 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f446006ace0 0x7f446006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:46.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.344+0000 7f44797fa700 1 -- 172.21.15.22:0/768273243 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4468088db0 con 0x7f447c0cfc60 2023-07-11T00:30:46.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.344+0000 7f4480f9b700 1 --2- 172.21.15.22:0/768273243 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f446006ace0 0x7f446006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:46.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.345+0000 7f4480f9b700 1 --2- 172.21.15.22:0/768273243 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f446006ace0 0x7f446006d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f44700097c0 tx=0x7f447001c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:46.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.348+0000 7f44797fa700 1 -- 172.21.15.22:0/768273243 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f447c156600 con 0x7f447c0cfc60 2023-07-11T00:30:46.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.555+0000 7f44831ff700 1 -- 172.21.15.22:0/768273243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f447c156600 con 0x7f447c0cfc60 2023-07-11T00:30:46.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.556+0000 7f44797fa700 1 -- 172.21.15.22:0/768273243 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f447c156600 con 0x7f447c0cfc60 2023-07-11T00:30:46.558 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2023-07-11T00:30:46.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.558+0000 7f44831ff700 1 -- 172.21.15.22:0/768273243 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f446006ace0 msgr2=0x7f446006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:46.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.558+0000 7f44831ff700 1 --2- 172.21.15.22:0/768273243 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f446006ace0 0x7f446006d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f44700097c0 tx=0x7f447001c040 comp rx=0 tx=0).stop 2023-07-11T00:30:46.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.558+0000 7f44831ff700 1 -- 172.21.15.22:0/768273243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f447c0cfc60 msgr2=0x7f447c0c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:46.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.558+0000 7f44831ff700 1 --2- 172.21.15.22:0/768273243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f447c0cfc60 0x7f447c0c6670 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4468001eb0 tx=0x7f446800c860 comp rx=0 tx=0).stop 2023-07-11T00:30:46.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.558+0000 7f44831ff700 1 -- 172.21.15.22:0/768273243 shutdown_connections 2023-07-11T00:30:46.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.558+0000 7f44831ff700 1 --2- 172.21.15.22:0/768273243 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f446006ace0 0x7f446006d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.558+0000 7f44831ff700 1 --2- 172.21.15.22:0/768273243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f447c0b8430 0x7f447c0cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.558+0000 7f44831ff700 1 --2- 172.21.15.22:0/768273243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f447c0d3730 0x7f447c1f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.558+0000 7f44831ff700 1 --2- 172.21.15.22:0/768273243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f447c0cfc60 0x7f447c0c6670 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.558+0000 7f44831ff700 1 -- 172.21.15.22:0/768273243 >> 172.21.15.22:0/768273243 conn(0x7f447c06b3f0 msgr2=0x7f447c0cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:46.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.558+0000 7f44831ff700 1 -- 172.21.15.22:0/768273243 shutdown_connections 2023-07-11T00:30:46.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.558+0000 7f44831ff700 1 -- 172.21.15.22:0/768273243 wait complete. 2023-07-11T00:30:46.578 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:30:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.780+0000 7f6ab6fff700 1 Processor -- start 2023-07-11T00:30:46.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.780+0000 7f6ab6fff700 1 -- start start 2023-07-11T00:30:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.781+0000 7f6ab6fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6ab00b8430 0x7f6ab00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.781+0000 7f6ab6fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ab00d3730 0x7f6ab00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.781+0000 7f6ab6fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ab00cfa90 0x7f6ab015feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.781+0000 7f6ab6fff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab00b8800 con 0x7f6ab00cfa90 2023-07-11T00:30:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.781+0000 7f6ab6fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab00d0b20 con 0x7f6ab00b8430 2023-07-11T00:30:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.781+0000 7f6ab6fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00cfeb0 con 0x7f6ab00d3730 2023-07-11T00:30:46.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.782+0000 7f6ab559c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ab00cfa90 0x7f6ab015feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:46.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.782+0000 7f6ab559c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ab00cfa90 0x7f6ab015feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46664/0 (socket says 172.21.15.22:46664) 2023-07-11T00:30:46.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.782+0000 7f6ab559c700 1 -- 172.21.15.22:0/723457139 learned_addr learned my addr 172.21.15.22:0/723457139 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:46.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.782+0000 7f6ab4d9b700 1 --2- 172.21.15.22:0/723457139 >> v2:172.21.15.184:3300/0 conn(0x7f6ab00b8430 0x7f6ab00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:46.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.782+0000 7f6aaffff700 1 --2- 172.21.15.22:0/723457139 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ab00d3730 0x7f6ab00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:46.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.782+0000 7f6ab559c700 1 -- 172.21.15.22:0/723457139 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ab00d3730 msgr2=0x7f6ab00cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:46.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.782+0000 7f6ab559c700 1 --2- 172.21.15.22:0/723457139 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ab00d3730 0x7f6ab00cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.782+0000 7f6ab559c700 1 -- 172.21.15.22:0/723457139 >> v2:172.21.15.184:3300/0 conn(0x7f6ab00b8430 msgr2=0x7f6ab00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:46.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.782+0000 7f6ab559c700 1 --2- 172.21.15.22:0/723457139 >> v2:172.21.15.184:3300/0 conn(0x7f6ab00b8430 0x7f6ab00cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.782+0000 7f6ab559c700 1 -- 172.21.15.22:0/723457139 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00b4ee0 con 0x7f6ab00cfa90 2023-07-11T00:30:46.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.782+0000 7f6ab559c700 1 --2- 172.21.15.22:0/723457139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00cfa90 0x7f6ab015feb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00cf520 tx=0x7f6aa800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e981570eaef35758 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:46.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.783+0000 7f6aaf7fe700 1 -- 172.21.15.22:0/723457139 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa800e070 con 0x7f6ab00cfa90 2023-07-11T00:30:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.783+0000 7f6aaf7fe700 1 -- 172.21.15.22:0/723457139 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa800b9c0 con 0x7f6ab00cfa90 2023-07-11T00:30:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.783+0000 7f6aaf7fe700 1 -- 172.21.15.22:0/723457139 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa800bd70 con 0x7f6ab00cfa90 2023-07-11T00:30:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.783+0000 7f6ab6fff700 1 -- 172.21.15.22:0/723457139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00cfa90 msgr2=0x7f6ab015feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.783+0000 7f6ab6fff700 1 --2- 172.21.15.22:0/723457139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00cfa90 0x7f6ab015feb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00cf520 tx=0x7f6aa800b330 comp rx=0 tx=0).stop 2023-07-11T00:30:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.783+0000 7f6ab6fff700 1 -- 172.21.15.22:0/723457139 shutdown_connections 2023-07-11T00:30:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.783+0000 7f6ab6fff700 1 --2- 172.21.15.22:0/723457139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00cfa90 0x7f6ab015feb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.783+0000 7f6ab6fff700 1 --2- 172.21.15.22:0/723457139 >> v2:172.21.15.184:3300/0 conn(0x7f6ab00b8430 0x7f6ab00cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.783+0000 7f6ab6fff700 1 --2- 172.21.15.22:0/723457139 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ab00d3730 0x7f6ab00cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.783+0000 7f6ab6fff700 1 -- 172.21.15.22:0/723457139 >> 172.21.15.22:0/723457139 conn(0x7f6ab006b3f0 msgr2=0x7f6ab006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:46.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.783+0000 7f6ab6fff700 1 -- 172.21.15.22:0/723457139 shutdown_connections 2023-07-11T00:30:46.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.783+0000 7f6ab6fff700 1 -- 172.21.15.22:0/723457139 wait complete. 2023-07-11T00:30:46.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.785+0000 7f6ab6fff700 1 Processor -- start 2023-07-11T00:30:46.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.785+0000 7f6ab6fff700 1 -- start start 2023-07-11T00:30:46.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.786+0000 7f6ab6fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ab00b8430 0x7f6ab01f1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:46.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.786+0000 7f6ab6fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ab00cfa90 0x7f6ab015d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:46.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.786+0000 7f6ab6fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00d3730 0x7f6ab00c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:46.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.786+0000 7f6ab6fff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab015e140 con 0x7f6ab00d3730 2023-07-11T00:30:46.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.786+0000 7f6ab6fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00c9cb0 con 0x7f6ab00cfa90 2023-07-11T00:30:46.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.786+0000 7f6ab6fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00c9f90 con 0x7f6ab00b8430 2023-07-11T00:30:46.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.786+0000 7f6ab559c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00d3730 0x7f6ab00c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.786+0000 7f6ab559c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00d3730 0x7f6ab00c7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46666/0 (socket says 172.21.15.22:46666) 2023-07-11T00:30:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.786+0000 7f6ab559c700 1 -- 172.21.15.22:0/733528828 learned_addr learned my addr 172.21.15.22:0/733528828 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.787+0000 7f6ab4d9b700 1 --2- 172.21.15.22:0/733528828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ab00b8430 0x7f6ab01f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.787+0000 7f6aaffff700 1 --2- 172.21.15.22:0/733528828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ab00cfa90 0x7f6ab015d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.787+0000 7f6ab559c700 1 -- 172.21.15.22:0/733528828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ab00b8430 msgr2=0x7f6ab01f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.787+0000 7f6ab559c700 1 --2- 172.21.15.22:0/733528828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ab00b8430 0x7f6ab01f1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.787+0000 7f6ab559c700 1 -- 172.21.15.22:0/733528828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ab00cfa90 msgr2=0x7f6ab015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.787+0000 7f6ab559c700 1 --2- 172.21.15.22:0/733528828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ab00cfa90 0x7f6ab015d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:46.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.787+0000 7f6ab559c700 1 -- 172.21.15.22:0/733528828 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa8009b30 con 0x7f6ab00d3730 2023-07-11T00:30:46.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.787+0000 7f6ab559c700 1 --2- 172.21.15.22:0/733528828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00d3730 0x7f6ab00c7b40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6ab006c780 tx=0x7f6aa8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:46.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.787+0000 7f6aad7fa700 1 -- 172.21.15.22:0/733528828 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa80099b0 con 0x7f6ab00d3730 2023-07-11T00:30:46.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.787+0000 7f6aad7fa700 1 -- 172.21.15.22:0/733528828 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa8004250 con 0x7f6ab00d3730 2023-07-11T00:30:46.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.787+0000 7f6aad7fa700 1 -- 172.21.15.22:0/733528828 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8004600 con 0x7f6ab00d3730 2023-07-11T00:30:46.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.788+0000 7f6ab6fff700 1 -- 172.21.15.22:0/733528828 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab00ca270 con 0x7f6ab00d3730 2023-07-11T00:30:46.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.788+0000 7f6ab6fff700 1 -- 172.21.15.22:0/733528828 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab015b670 con 0x7f6ab00d3730 2023-07-11T00:30:46.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.789+0000 7f6ab6fff700 1 -- 172.21.15.22:0/733528828 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab00ca790 con 0x7f6ab00d3730 2023-07-11T00:30:46.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.789+0000 7f6aad7fa700 1 -- 172.21.15.22:0/733528828 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6aa8004760 con 0x7f6ab00d3730 2023-07-11T00:30:46.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.791+0000 7f6aad7fa700 1 --2- 172.21.15.22:0/733528828 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6a9406ace0 0x7f6a9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:46.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.792+0000 7f6aad7fa700 1 -- 172.21.15.22:0/733528828 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6aa808a830 con 0x7f6ab00d3730 2023-07-11T00:30:46.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.792+0000 7f6ab4d9b700 1 --2- 172.21.15.22:0/733528828 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6a9406ace0 0x7f6a9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:46.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.792+0000 7f6ab4d9b700 1 --2- 172.21.15.22:0/733528828 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6a9406ace0 0x7f6a9406d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4006b20 tx=0x7f6aa4008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:46.796+0000 7f6aad7fa700 1 -- 172.21.15.22:0/733528828 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6ab00ca790 con 0x7f6ab00d3730 2023-07-11T00:30:47.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.006+0000 7f6ab6fff700 1 -- 172.21.15.22:0/733528828 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ab00ca790 con 0x7f6ab00d3730 2023-07-11T00:30:47.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.007+0000 7f6aad7fa700 1 -- 172.21.15.22:0/733528828 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ab00ca790 con 0x7f6ab00d3730 2023-07-11T00:30:47.010 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-07-11T00:30:47.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.009+0000 7f6ab6fff700 1 -- 172.21.15.22:0/733528828 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6a9406ace0 msgr2=0x7f6a9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:47.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.009+0000 7f6ab6fff700 1 --2- 172.21.15.22:0/733528828 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6a9406ace0 0x7f6a9406d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4006b20 tx=0x7f6aa4008040 comp rx=0 tx=0).stop 2023-07-11T00:30:47.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.009+0000 7f6ab6fff700 1 -- 172.21.15.22:0/733528828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00d3730 msgr2=0x7f6ab00c7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:47.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.009+0000 7f6ab6fff700 1 --2- 172.21.15.22:0/733528828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00d3730 0x7f6ab00c7b40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6ab006c780 tx=0x7f6aa8004ad0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.009+0000 7f6ab6fff700 1 -- 172.21.15.22:0/733528828 shutdown_connections 2023-07-11T00:30:47.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.009+0000 7f6ab6fff700 1 --2- 172.21.15.22:0/733528828 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6a9406ace0 0x7f6a9406d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.009+0000 7f6ab6fff700 1 --2- 172.21.15.22:0/733528828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ab00b8430 0x7f6ab01f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.009+0000 7f6ab6fff700 1 --2- 172.21.15.22:0/733528828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00d3730 0x7f6ab00c7b40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.009+0000 7f6ab6fff700 1 --2- 172.21.15.22:0/733528828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ab00cfa90 0x7f6ab015d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.009+0000 7f6ab6fff700 1 -- 172.21.15.22:0/733528828 >> 172.21.15.22:0/733528828 conn(0x7f6ab006b3f0 msgr2=0x7f6ab00b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.009+0000 7f6ab6fff700 1 -- 172.21.15.22:0/733528828 shutdown_connections 2023-07-11T00:30:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.010+0000 7f6ab6fff700 1 -- 172.21.15.22:0/733528828 wait complete. 2023-07-11T00:30:47.030 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:30:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.233+0000 7fd98f5ff700 1 Processor -- start 2023-07-11T00:30:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.233+0000 7fd98f5ff700 1 -- start start 2023-07-11T00:30:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.234+0000 7fd98f5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd9880b4590 0x7fd9880b4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.234+0000 7fd98f5ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9880b4ea0 con 0x7fd98806bda0 2023-07-11T00:30:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.234+0000 7fd98f5ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd98815d3d0 con 0x7fd98806c210 2023-07-11T00:30:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.234+0000 7fd98f5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98806b390 con 0x7fd9880b4590 2023-07-11T00:30:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.234+0000 7fd98cb9a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd98806bda0 0x7fd9880d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52324/0 (socket says 172.21.15.22:52324) 2023-07-11T00:30:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.234+0000 7fd98cb9a700 1 -- 172.21.15.22:0/4291710275 learned_addr learned my addr 172.21.15.22:0/4291710275 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.235+0000 7fd98d39b700 1 --2- 172.21.15.22:0/4291710275 >> v2:172.21.15.184:3300/0 conn(0x7fd9880b4590 0x7fd9880b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.235+0000 7fd97ffff700 1 -- 172.21.15.22:0/4291710275 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618058002 0 0) 0x7fd9880b4ea0 con 0x7fd98806bda0 2023-07-11T00:30:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.235+0000 7fd97ffff700 1 -- 172.21.15.22:0/4291710275 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9740035b0 con 0x7fd98806bda0 2023-07-11T00:30:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.235+0000 7fd97ffff700 1 -- 172.21.15.22:0/4291710275 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557946725 0 0) 0x7fd98815d3d0 con 0x7fd98806c210 2023-07-11T00:30:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.235+0000 7fd97ffff700 1 -- 172.21.15.22:0/4291710275 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9880b4ea0 con 0x7fd98806c210 2023-07-11T00:30:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.235+0000 7fd98d39b700 1 -- 172.21.15.22:0/4291710275 >> v1:172.21.15.184:6789/0 conn(0x7fd98806c210 legacy=0x7fd98815c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.235+0000 7fd98d39b700 1 -- 172.21.15.22:0/4291710275 >> v1:172.21.15.22:6789/0 conn(0x7fd98806bda0 legacy=0x7fd9880d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.235+0000 7fd98d39b700 1 -- 172.21.15.22:0/4291710275 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98815d6b0 con 0x7fd9880b4590 2023-07-11T00:30:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.235+0000 7fd98d39b700 1 --2- 172.21.15.22:0/4291710275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9880b4590 0x7fd9880b4960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd984009840 tx=0x7fd984009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd813c5fa9440773 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.236+0000 7fd97ffff700 1 -- 172.21.15.22:0/4291710275 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984011830 con 0x7fd9880b4590 2023-07-11T00:30:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.236+0000 7fd97ffff700 1 -- 172.21.15.22:0/4291710275 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd984011990 con 0x7fd9880b4590 2023-07-11T00:30:47.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.236+0000 7fd97ffff700 1 -- 172.21.15.22:0/4291710275 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984011d20 con 0x7fd9880b4590 2023-07-11T00:30:47.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.236+0000 7fd98f5ff700 1 -- 172.21.15.22:0/4291710275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9880b4590 msgr2=0x7fd9880b4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:47.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.236+0000 7fd98f5ff700 1 --2- 172.21.15.22:0/4291710275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9880b4590 0x7fd9880b4960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd984009840 tx=0x7fd984009b50 comp rx=0 tx=0).stop 2023-07-11T00:30:47.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.236+0000 7fd98f5ff700 1 -- 172.21.15.22:0/4291710275 shutdown_connections 2023-07-11T00:30:47.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.236+0000 7fd98f5ff700 1 --2- 172.21.15.22:0/4291710275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9880b4590 0x7fd9880b4960 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.236+0000 7fd98f5ff700 1 -- 172.21.15.22:0/4291710275 >> 172.21.15.22:0/4291710275 conn(0x7fd9880cf590 msgr2=0x7fd9880cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:47.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.236+0000 7fd98f5ff700 1 -- 172.21.15.22:0/4291710275 shutdown_connections 2023-07-11T00:30:47.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.236+0000 7fd98f5ff700 1 -- 172.21.15.22:0/4291710275 wait complete. 2023-07-11T00:30:47.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.238+0000 7fd98f5ff700 1 Processor -- start 2023-07-11T00:30:47.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.238+0000 7fd98f5ff700 1 -- start start 2023-07-11T00:30:47.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.239+0000 7fd98f5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd98806bda0 0x7fd9880cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:47.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.239+0000 7fd98f5ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd98806c210 0x7fd988158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:47.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.239+0000 7fd98f5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9880b4590 0x7fd988156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:47.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.239+0000 7fd98f5ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9880ccd80 con 0x7fd98806c210 2023-07-11T00:30:47.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.239+0000 7fd98f5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9880cb9b0 con 0x7fd9880b4590 2023-07-11T00:30:47.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.239+0000 7fd98f5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9880cbc90 con 0x7fd98806bda0 2023-07-11T00:30:47.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.239+0000 7fd98cb9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd98806c210 0x7fd988158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:47.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.239+0000 7fd98cb9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd98806c210 0x7fd988158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46676/0 (socket says 172.21.15.22:46676) 2023-07-11T00:30:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.239+0000 7fd98cb9a700 1 -- 172.21.15.22:0/3137248686 learned_addr learned my addr 172.21.15.22:0/3137248686 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.240+0000 7fd98db9c700 1 --2- 172.21.15.22:0/3137248686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9880b4590 0x7fd988156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.240+0000 7fd98d39b700 1 --2- 172.21.15.22:0/3137248686 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd98806bda0 0x7fd9880cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.240+0000 7fd98cb9a700 1 -- 172.21.15.22:0/3137248686 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd98806bda0 msgr2=0x7fd9880cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:47.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.240+0000 7fd98cb9a700 1 --2- 172.21.15.22:0/3137248686 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd98806bda0 0x7fd9880cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.240+0000 7fd98cb9a700 1 -- 172.21.15.22:0/3137248686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9880b4590 msgr2=0x7fd988156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:47.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.240+0000 7fd98cb9a700 1 --2- 172.21.15.22:0/3137248686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9880b4590 0x7fd988156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.240+0000 7fd98cb9a700 1 -- 172.21.15.22:0/3137248686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9840094a0 con 0x7fd98806c210 2023-07-11T00:30:47.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.240+0000 7fd98db9c700 1 --2- 172.21.15.22:0/3137248686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9880b4590 0x7fd988156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:47.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.240+0000 7fd98cb9a700 1 --2- 172.21.15.22:0/3137248686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd98806c210 0x7fd988158890 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd978001eb0 tx=0x7fd97800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:47.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.240+0000 7fd97dffb700 1 -- 172.21.15.22:0/3137248686 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd978005d70 con 0x7fd98806c210 2023-07-11T00:30:47.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.240+0000 7fd97dffb700 1 -- 172.21.15.22:0/3137248686 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9780070d0 con 0x7fd98806c210 2023-07-11T00:30:47.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.240+0000 7fd98f5ff700 1 -- 172.21.15.22:0/3137248686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9880cbf70 con 0x7fd98806c210 2023-07-11T00:30:47.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.240+0000 7fd97dffb700 1 -- 172.21.15.22:0/3137248686 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd978007460 con 0x7fd98806c210 2023-07-11T00:30:47.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.240+0000 7fd98f5ff700 1 -- 172.21.15.22:0/3137248686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9881e3430 con 0x7fd98806c210 2023-07-11T00:30:47.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.241+0000 7fd98f5ff700 1 -- 172.21.15.22:0/3137248686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9881e3650 con 0x7fd98806c210 2023-07-11T00:30:47.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.242+0000 7fd97dffb700 1 -- 172.21.15.22:0/3137248686 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd9780075c0 con 0x7fd98806c210 2023-07-11T00:30:47.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.243+0000 7fd97dffb700 1 --2- 172.21.15.22:0/3137248686 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd96c06ace0 0x7fd96c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:47.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.244+0000 7fd97dffb700 1 -- 172.21.15.22:0/3137248686 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd978088d10 con 0x7fd98806c210 2023-07-11T00:30:47.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.244+0000 7fd98d39b700 1 --2- 172.21.15.22:0/3137248686 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd96c06ace0 0x7fd96c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:47.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.245+0000 7fd98d39b700 1 --2- 172.21.15.22:0/3137248686 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd96c06ace0 0x7fd96c06d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd984009fd0 tx=0x7fd98401c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:47.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.248+0000 7fd97dffb700 1 -- 172.21.15.22:0/3137248686 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd978053ad0 con 0x7fd98806c210 2023-07-11T00:30:47.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.454+0000 7fd98f5ff700 1 -- 172.21.15.22:0/3137248686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd98804ea60 con 0x7fd98806c210 2023-07-11T00:30:47.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.454+0000 7fd97dffb700 1 -- 172.21.15.22:0/3137248686 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd9780570f0 con 0x7fd98806c210 2023-07-11T00:30:47.460 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:30:47.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.457+0000 7fd98f5ff700 1 -- 172.21.15.22:0/3137248686 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd96c06ace0 msgr2=0x7fd96c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:47.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.457+0000 7fd98f5ff700 1 --2- 172.21.15.22:0/3137248686 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd96c06ace0 0x7fd96c06d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd984009fd0 tx=0x7fd98401c040 comp rx=0 tx=0).stop 2023-07-11T00:30:47.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.457+0000 7fd98f5ff700 1 -- 172.21.15.22:0/3137248686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd98806c210 msgr2=0x7fd988158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:47.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.457+0000 7fd98f5ff700 1 --2- 172.21.15.22:0/3137248686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd98806c210 0x7fd988158890 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd978001eb0 tx=0x7fd97800c860 comp rx=0 tx=0).stop 2023-07-11T00:30:47.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.457+0000 7fd98f5ff700 1 -- 172.21.15.22:0/3137248686 shutdown_connections 2023-07-11T00:30:47.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.457+0000 7fd98f5ff700 1 --2- 172.21.15.22:0/3137248686 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd96c06ace0 0x7fd96c06d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.457+0000 7fd98f5ff700 1 --2- 172.21.15.22:0/3137248686 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd98806bda0 0x7fd9880cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.457+0000 7fd98f5ff700 1 --2- 172.21.15.22:0/3137248686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9880b4590 0x7fd988156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.457+0000 7fd98f5ff700 1 --2- 172.21.15.22:0/3137248686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd98806c210 0x7fd988158890 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.457+0000 7fd98f5ff700 1 -- 172.21.15.22:0/3137248686 >> 172.21.15.22:0/3137248686 conn(0x7fd9880cf590 msgr2=0x7fd9880b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:47.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.457+0000 7fd98f5ff700 1 -- 172.21.15.22:0/3137248686 shutdown_connections 2023-07-11T00:30:47.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.457+0000 7fd98f5ff700 1 -- 172.21.15.22:0/3137248686 wait complete. 2023-07-11T00:30:47.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:30:47.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.681+0000 7f9756dff700 1 Processor -- start 2023-07-11T00:30:47.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.681+0000 7f9756dff700 1 -- start start 2023-07-11T00:30:47.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.682+0000 7f9756dff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f97500b8430 0x7f97500cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:47.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.682+0000 7f9756dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97500d3730 0x7f97500cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:47.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.682+0000 7f9756dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f97500cfa90 0x7f975015feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:47.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.682+0000 7f9756dff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97500b8800 con 0x7f97500b8430 2023-07-11T00:30:47.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.682+0000 7f9756dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97500d0b20 con 0x7f97500cfa90 2023-07-11T00:30:47.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.682+0000 7f9756dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97500cfeb0 con 0x7f97500d3730 2023-07-11T00:30:47.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.682+0000 7f9754b9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f97500b8430 0x7f97500cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:47.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.683+0000 7f974ffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97500d3730 0x7f97500cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:47.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.683+0000 7f974ffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97500d3730 0x7f97500cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:59566/0 (socket says 172.21.15.22:59566) 2023-07-11T00:30:47.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.683+0000 7f9754b9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f97500b8430 0x7f97500cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46690/0 (socket says 172.21.15.22:46690) 2023-07-11T00:30:47.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.683+0000 7f974ffff700 1 -- 172.21.15.22:0/4043244932 learned_addr learned my addr 172.21.15.22:0/4043244932 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:47.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.683+0000 7f975539c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f97500cfa90 0x7f975015feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:47.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.683+0000 7f9754b9b700 1 -- 172.21.15.22:0/4043244932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97500d3730 msgr2=0x7f97500cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:47.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.683+0000 7f9754b9b700 1 --2- 172.21.15.22:0/4043244932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97500d3730 0x7f97500cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.683+0000 7f9754b9b700 1 -- 172.21.15.22:0/4043244932 >> v2:172.21.15.184:3300/0 conn(0x7f97500cfa90 msgr2=0x7f975015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:47.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.683+0000 7f9754b9b700 1 --2- 172.21.15.22:0/4043244932 >> v2:172.21.15.184:3300/0 conn(0x7f97500cfa90 0x7f975015feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.683+0000 7f9754b9b700 1 -- 172.21.15.22:0/4043244932 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97500b4ee0 con 0x7f97500b8430 2023-07-11T00:30:47.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.683+0000 7f9754b9b700 1 --2- 172.21.15.22:0/4043244932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97500b8430 0x7f97500cd320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f975006c570 tx=0x7f9744009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d48ddb500857e13 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:47.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.684+0000 7f974f7fe700 1 -- 172.21.15.22:0/4043244932 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9744011830 con 0x7f97500b8430 2023-07-11T00:30:47.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.684+0000 7f974f7fe700 1 -- 172.21.15.22:0/4043244932 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9744011990 con 0x7f97500b8430 2023-07-11T00:30:47.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.684+0000 7f974f7fe700 1 -- 172.21.15.22:0/4043244932 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9744011d20 con 0x7f97500b8430 2023-07-11T00:30:47.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.684+0000 7f9756dff700 1 -- 172.21.15.22:0/4043244932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97500b8430 msgr2=0x7f97500cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:47.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.684+0000 7f9756dff700 1 --2- 172.21.15.22:0/4043244932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97500b8430 0x7f97500cd320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f975006c570 tx=0x7f9744009b20 comp rx=0 tx=0).stop 2023-07-11T00:30:47.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.684+0000 7f9756dff700 1 -- 172.21.15.22:0/4043244932 shutdown_connections 2023-07-11T00:30:47.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.684+0000 7f9756dff700 1 --2- 172.21.15.22:0/4043244932 >> v2:172.21.15.184:3300/0 conn(0x7f97500cfa90 0x7f975015feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.684+0000 7f9756dff700 1 --2- 172.21.15.22:0/4043244932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97500b8430 0x7f97500cd320 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.684+0000 7f9756dff700 1 --2- 172.21.15.22:0/4043244932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97500d3730 0x7f97500cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.684+0000 7f9756dff700 1 -- 172.21.15.22:0/4043244932 >> 172.21.15.22:0/4043244932 conn(0x7f975006b3f0 msgr2=0x7f975006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:47.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.684+0000 7f9756dff700 1 -- 172.21.15.22:0/4043244932 shutdown_connections 2023-07-11T00:30:47.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.684+0000 7f9756dff700 1 -- 172.21.15.22:0/4043244932 wait complete. 2023-07-11T00:30:47.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.686+0000 7f9756dff700 1 Processor -- start 2023-07-11T00:30:47.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.686+0000 7f9756dff700 1 -- start start 2023-07-11T00:30:47.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.687+0000 7f9756dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97500b8430 0x7f97501498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:47.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.687+0000 7f9756dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97500cfa90 0x7f975015d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:47.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.687+0000 7f9756dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97500d3730 0x7f975015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:47.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.687+0000 7f9756dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97501f2c60 con 0x7f97500b8430 2023-07-11T00:30:47.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.687+0000 7f9756dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97501f1d20 con 0x7f97500d3730 2023-07-11T00:30:47.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.687+0000 7f9756dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97501f1fe0 con 0x7f97500cfa90 2023-07-11T00:30:47.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.687+0000 7f9754b9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97500b8430 0x7f97501498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:47.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.687+0000 7f9754b9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97500b8430 0x7f97501498d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46692/0 (socket says 172.21.15.22:46692) 2023-07-11T00:30:47.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.687+0000 7f9754b9b700 1 -- 172.21.15.22:0/4022286992 learned_addr learned my addr 172.21.15.22:0/4022286992 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:47.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.687+0000 7f975539c700 1 --2- 172.21.15.22:0/4022286992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97500d3730 0x7f975015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:47.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.687+0000 7f974ffff700 1 --2- 172.21.15.22:0/4022286992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97500cfa90 0x7f975015d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:47.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.688+0000 7f9754b9b700 1 -- 172.21.15.22:0/4022286992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97500cfa90 msgr2=0x7f975015d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:47.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.688+0000 7f9754b9b700 1 --2- 172.21.15.22:0/4022286992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97500cfa90 0x7f975015d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.688+0000 7f9754b9b700 1 -- 172.21.15.22:0/4022286992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97500d3730 msgr2=0x7f975015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:47.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.688+0000 7f9754b9b700 1 --2- 172.21.15.22:0/4022286992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97500d3730 0x7f975015eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.688+0000 7f9754b9b700 1 -- 172.21.15.22:0/4022286992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97440094a0 con 0x7f97500b8430 2023-07-11T00:30:47.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.688+0000 7f974ffff700 1 --2- 172.21.15.22:0/4022286992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97500cfa90 0x7f975015d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:47.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.688+0000 7f9754b9b700 1 --2- 172.21.15.22:0/4022286992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97500b8430 0x7f97501498d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9744000c00 tx=0x7f9744004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:47.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.688+0000 7f974d7fa700 1 -- 172.21.15.22:0/4022286992 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9744004510 con 0x7f97500b8430 2023-07-11T00:30:47.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.688+0000 7f974d7fa700 1 -- 172.21.15.22:0/4022286992 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974401e070 con 0x7f97500b8430 2023-07-11T00:30:47.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.688+0000 7f974d7fa700 1 -- 172.21.15.22:0/4022286992 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97440038e0 con 0x7f97500b8430 2023-07-11T00:30:47.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.688+0000 7f9756dff700 1 -- 172.21.15.22:0/4022286992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97501f22c0 con 0x7f97500b8430 2023-07-11T00:30:47.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.688+0000 7f9756dff700 1 -- 172.21.15.22:0/4022286992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97501f2880 con 0x7f97500b8430 2023-07-11T00:30:47.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.689+0000 7f9756dff700 1 -- 172.21.15.22:0/4022286992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975004ea60 con 0x7f97500b8430 2023-07-11T00:30:47.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.690+0000 7f974d7fa700 1 -- 172.21.15.22:0/4022286992 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9744003a40 con 0x7f97500b8430 2023-07-11T00:30:47.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.691+0000 7f974d7fa700 1 --2- 172.21.15.22:0/4022286992 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f973406ace0 0x7f973406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:47.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.691+0000 7f974d7fa700 1 -- 172.21.15.22:0/4022286992 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f974408a460 con 0x7f97500b8430 2023-07-11T00:30:47.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.692+0000 7f974ffff700 1 --2- 172.21.15.22:0/4022286992 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f973406ace0 0x7f973406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:47.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.693+0000 7f974ffff700 1 --2- 172.21.15.22:0/4022286992 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f973406ace0 0x7f973406d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f973c009ba0 tx=0x7f973c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:47.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.695+0000 7f974d7fa700 1 -- 172.21.15.22:0/4022286992 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9744055210 con 0x7f97500b8430 2023-07-11T00:30:47.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.907+0000 7f9756dff700 1 -- 172.21.15.22:0/4022286992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f975015b5d0 con 0x7f97500b8430 2023-07-11T00:30:47.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.908+0000 7f974d7fa700 1 -- 172.21.15.22:0/4022286992 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9744058830 con 0x7f97500b8430 2023-07-11T00:30:47.911 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-07-11T00:30:47.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.910+0000 7f9756dff700 1 -- 172.21.15.22:0/4022286992 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f973406ace0 msgr2=0x7f973406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:47.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.910+0000 7f9756dff700 1 --2- 172.21.15.22:0/4022286992 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f973406ace0 0x7f973406d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f973c009ba0 tx=0x7f973c008040 comp rx=0 tx=0).stop 2023-07-11T00:30:47.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.910+0000 7f9756dff700 1 -- 172.21.15.22:0/4022286992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97500b8430 msgr2=0x7f97501498d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.910+0000 7f9756dff700 1 --2- 172.21.15.22:0/4022286992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97500b8430 0x7f97501498d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9744000c00 tx=0x7f9744004750 comp rx=0 tx=0).stop 2023-07-11T00:30:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.910+0000 7f9756dff700 1 -- 172.21.15.22:0/4022286992 shutdown_connections 2023-07-11T00:30:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.910+0000 7f9756dff700 1 --2- 172.21.15.22:0/4022286992 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f973406ace0 0x7f973406d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.910+0000 7f9756dff700 1 --2- 172.21.15.22:0/4022286992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97500d3730 0x7f975015eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.910+0000 7f9756dff700 1 --2- 172.21.15.22:0/4022286992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97500b8430 0x7f97501498d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.910+0000 7f9756dff700 1 --2- 172.21.15.22:0/4022286992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97500cfa90 0x7f975015d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:47.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.910+0000 7f9756dff700 1 -- 172.21.15.22:0/4022286992 >> 172.21.15.22:0/4022286992 conn(0x7f975006b3f0 msgr2=0x7f97500b62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.910+0000 7f9756dff700 1 -- 172.21.15.22:0/4022286992 shutdown_connections 2023-07-11T00:30:47.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:47.910+0000 7f9756dff700 1 -- 172.21.15.22:0/4022286992 wait complete. 2023-07-11T00:30:47.930 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-11T00:30:48.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.132+0000 7f48819ff700 1 Processor -- start 2023-07-11T00:30:48.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.132+0000 7f48819ff700 1 -- start start 2023-07-11T00:30:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.133+0000 7f48819ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f487c0b8430 0x7f487c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.133+0000 7f48819ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f487c0d3730 0x7f487c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.133+0000 7f48819ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c0d0b20 con 0x7f487c0cfa90 2023-07-11T00:30:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.133+0000 7f48819ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487c0b8800 con 0x7f487c0d3730 2023-07-11T00:30:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.133+0000 7f48819ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0cfeb0 con 0x7f487c0b8430 2023-07-11T00:30:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.134+0000 7f487affd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f487c0b8430 0x7f487c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.134+0000 7f487affd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f487c0b8430 0x7f487c0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:59584/0 (socket says 172.21.15.22:59584) 2023-07-11T00:30:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.134+0000 7f487affd700 1 -- 172.21.15.22:0/1543532433 learned_addr learned my addr 172.21.15.22:0/1543532433 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.134+0000 7f487a7fc700 1 --2- 172.21.15.22:0/1543532433 >> v2:172.21.15.184:3300/0 conn(0x7f487c0d3730 0x7f487c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:48.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.134+0000 7f487affd700 1 -- 172.21.15.22:0/1543532433 >> v2:172.21.15.184:3300/0 conn(0x7f487c0d3730 msgr2=0x7f487c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:48.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.134+0000 7f487affd700 1 --2- 172.21.15.22:0/1543532433 >> v2:172.21.15.184:3300/0 conn(0x7f487c0d3730 0x7f487c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.134+0000 7f487affd700 1 -- 172.21.15.22:0/1543532433 >> v1:172.21.15.184:6789/0 conn(0x7f487c0cfa90 legacy=0x7f487c15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:48.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.134+0000 7f487affd700 1 -- 172.21.15.22:0/1543532433 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c0b4ee0 con 0x7f487c0b8430 2023-07-11T00:30:48.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.135+0000 7f487affd700 1 --2- 172.21.15.22:0/1543532433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f487c0b8430 0x7f487c0cd320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f486c0098f0 tx=0x7f486c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af85fd124d3e6015 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:48.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.135+0000 7f4879ffb700 1 -- 172.21.15.22:0/1543532433 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c011830 con 0x7f487c0b8430 2023-07-11T00:30:48.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.135+0000 7f4879ffb700 1 -- 172.21.15.22:0/1543532433 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c011990 con 0x7f487c0b8430 2023-07-11T00:30:48.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.135+0000 7f4879ffb700 1 -- 172.21.15.22:0/1543532433 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c011d20 con 0x7f487c0b8430 2023-07-11T00:30:48.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.135+0000 7f48819ff700 1 -- 172.21.15.22:0/1543532433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f487c0b8430 msgr2=0x7f487c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:48.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.135+0000 7f48819ff700 1 --2- 172.21.15.22:0/1543532433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f487c0b8430 0x7f487c0cd320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f486c0098f0 tx=0x7f486c009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.135+0000 7f48819ff700 1 -- 172.21.15.22:0/1543532433 shutdown_connections 2023-07-11T00:30:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.135+0000 7f48819ff700 1 --2- 172.21.15.22:0/1543532433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f487c0b8430 0x7f487c0cd320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.135+0000 7f48819ff700 1 --2- 172.21.15.22:0/1543532433 >> v2:172.21.15.184:3300/0 conn(0x7f487c0d3730 0x7f487c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.135+0000 7f48819ff700 1 -- 172.21.15.22:0/1543532433 >> 172.21.15.22:0/1543532433 conn(0x7f487c06b3f0 msgr2=0x7f487c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.136+0000 7f48819ff700 1 -- 172.21.15.22:0/1543532433 shutdown_connections 2023-07-11T00:30:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.136+0000 7f48819ff700 1 -- 172.21.15.22:0/1543532433 wait complete. 2023-07-11T00:30:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.137+0000 7f48819ff700 1 Processor -- start 2023-07-11T00:30:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.137+0000 7f48819ff700 1 -- start start 2023-07-11T00:30:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.138+0000 7f48819ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f487c0b8430 0x7f487c1f1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.138+0000 7f48819ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f487c0cfa90 0x7f487c15f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.138+0000 7f48819ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f487c0d3730 0x7f487c14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.138+0000 7f48819ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c1f20c0 con 0x7f487c0b8430 2023-07-11T00:30:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.138+0000 7f48819ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c1f23a0 con 0x7f487c0d3730 2023-07-11T00:30:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.138+0000 7f48819ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c1f2680 con 0x7f487c0cfa90 2023-07-11T00:30:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.139+0000 7f487affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f487c0b8430 0x7f487c1f1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.139+0000 7f487affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f487c0b8430 0x7f487c1f1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46700/0 (socket says 172.21.15.22:46700) 2023-07-11T00:30:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.139+0000 7f487affd700 1 -- 172.21.15.22:0/142187660 learned_addr learned my addr 172.21.15.22:0/142187660 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.139+0000 7f487a7fc700 1 --2- 172.21.15.22:0/142187660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f487c0cfa90 0x7f487c15f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.139+0000 7f487b7fe700 1 --2- 172.21.15.22:0/142187660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f487c0d3730 0x7f487c14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.139+0000 7f487affd700 1 -- 172.21.15.22:0/142187660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f487c0cfa90 msgr2=0x7f487c15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.139+0000 7f487affd700 1 --2- 172.21.15.22:0/142187660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f487c0cfa90 0x7f487c15f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.139+0000 7f487affd700 1 -- 172.21.15.22:0/142187660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f487c0d3730 msgr2=0x7f487c14ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.139+0000 7f487affd700 1 --2- 172.21.15.22:0/142187660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f487c0d3730 0x7f487c14ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.139+0000 7f487affd700 1 -- 172.21.15.22:0/142187660 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486c009550 con 0x7f487c0b8430 2023-07-11T00:30:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.139+0000 7f487b7fe700 1 --2- 172.21.15.22:0/142187660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f487c0d3730 0x7f487c14ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:30:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.139+0000 7f487affd700 1 --2- 172.21.15.22:0/142187660 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f487c0b8430 0x7f487c1f1a90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f486c009c40 tx=0x7f486c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.139+0000 7f4863fff700 1 -- 172.21.15.22:0/142187660 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c0036a0 con 0x7f487c0b8430 2023-07-11T00:30:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.140+0000 7f4863fff700 1 -- 172.21.15.22:0/142187660 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c01e070 con 0x7f487c0b8430 2023-07-11T00:30:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.140+0000 7f48819ff700 1 -- 172.21.15.22:0/142187660 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487c0c7fc0 con 0x7f487c0b8430 2023-07-11T00:30:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.140+0000 7f4863fff700 1 -- 172.21.15.22:0/142187660 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c003a60 con 0x7f487c0b8430 2023-07-11T00:30:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.140+0000 7f48819ff700 1 -- 172.21.15.22:0/142187660 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c15fb70 con 0x7f487c0b8430 2023-07-11T00:30:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.141+0000 7f48819ff700 1 -- 172.21.15.22:0/142187660 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c0c81d0 con 0x7f487c0b8430 2023-07-11T00:30:48.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.142+0000 7f4863fff700 1 -- 172.21.15.22:0/142187660 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f486c003bc0 con 0x7f487c0b8430 2023-07-11T00:30:48.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.143+0000 7f4863fff700 1 --2- 172.21.15.22:0/142187660 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f486806ace0 0x7f486806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.143+0000 7f4863fff700 1 -- 172.21.15.22:0/142187660 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f486c08a760 con 0x7f487c0b8430 2023-07-11T00:30:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.143+0000 7f487a7fc700 1 --2- 172.21.15.22:0/142187660 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f486806ace0 0x7f486806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.144+0000 7f487a7fc700 1 --2- 172.21.15.22:0/142187660 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f486806ace0 0x7f486806d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f487c15b700 tx=0x7f4870008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:48.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.148+0000 7f4863fff700 1 -- 172.21.15.22:0/142187660 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f486c055510 con 0x7f487c0b8430 2023-07-11T00:30:48.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.355+0000 7f48819ff700 1 -- 172.21.15.22:0/142187660 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f487c04ea60 con 0x7f487c0b8430 2023-07-11T00:30:48.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.356+0000 7f4863fff700 1 -- 172.21.15.22:0/142187660 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f486c058b30 con 0x7f487c0b8430 2023-07-11T00:30:48.358 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:30:48.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.358+0000 7f48819ff700 1 -- 172.21.15.22:0/142187660 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f486806ace0 msgr2=0x7f486806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:48.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.358+0000 7f48819ff700 1 --2- 172.21.15.22:0/142187660 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f486806ace0 0x7f486806d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f487c15b700 tx=0x7f4870008040 comp rx=0 tx=0).stop 2023-07-11T00:30:48.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.358+0000 7f48819ff700 1 -- 172.21.15.22:0/142187660 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f487c0b8430 msgr2=0x7f487c1f1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.358+0000 7f48819ff700 1 --2- 172.21.15.22:0/142187660 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f487c0b8430 0x7f487c1f1a90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f486c009c40 tx=0x7f486c004750 comp rx=0 tx=0).stop 2023-07-11T00:30:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.358+0000 7f48819ff700 1 -- 172.21.15.22:0/142187660 shutdown_connections 2023-07-11T00:30:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.358+0000 7f48819ff700 1 --2- 172.21.15.22:0/142187660 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f486806ace0 0x7f486806d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.358+0000 7f48819ff700 1 --2- 172.21.15.22:0/142187660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f487c0d3730 0x7f487c14ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.358+0000 7f48819ff700 1 --2- 172.21.15.22:0/142187660 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f487c0b8430 0x7f487c1f1a90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.358+0000 7f48819ff700 1 --2- 172.21.15.22:0/142187660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f487c0cfa90 0x7f487c15f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.358+0000 7f48819ff700 1 -- 172.21.15.22:0/142187660 >> 172.21.15.22:0/142187660 conn(0x7f487c06b3f0 msgr2=0x7f487c0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.358+0000 7f48819ff700 1 -- 172.21.15.22:0/142187660 shutdown_connections 2023-07-11T00:30:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.358+0000 7f48819ff700 1 -- 172.21.15.22:0/142187660 wait complete. 2023-07-11T00:30:48.379 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:30:48.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.583+0000 7f9ec6fff700 1 Processor -- start 2023-07-11T00:30:48.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.583+0000 7f9ec6fff700 1 -- start start 2023-07-11T00:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.584+0000 7f9ec6fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ec00d2640 0x7f9ec00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.584+0000 7f9ec6fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9ec00cf8f0 0x7f9ec015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.584+0000 7f9ec6fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec00d1790 con 0x7f9ec015c460 2023-07-11T00:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.584+0000 7f9ec6fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec00cedd0 con 0x7f9ec00cf8f0 2023-07-11T00:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.584+0000 7f9ec6fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00cd950 con 0x7f9ec00d2640 2023-07-11T00:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.585+0000 7f9ebffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ec00d2640 0x7f9ec00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.585+0000 7f9ebffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ec00d2640 0x7f9ec00b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:59608/0 (socket says 172.21.15.22:59608) 2023-07-11T00:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.585+0000 7f9ec4d9b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f9ec015c460 0x7f9ec00cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:54894/0 (socket says 172.21.15.22:54894) 2023-07-11T00:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.585+0000 7f9ebffff700 1 -- 172.21.15.22:0/3175738634 learned_addr learned my addr 172.21.15.22:0/3175738634 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.585+0000 7f9ec559c700 1 --2- 172.21.15.22:0/3175738634 >> v2:172.21.15.184:3300/0 conn(0x7f9ec00cf8f0 0x7f9ec015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.585+0000 7f9ebf7fe700 1 -- 172.21.15.22:0/3175738634 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459501909 0 0) 0x7f9ec00d1790 con 0x7f9ec015c460 2023-07-11T00:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.586+0000 7f9ebf7fe700 1 -- 172.21.15.22:0/3175738634 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eb00035b0 con 0x7f9ec015c460 2023-07-11T00:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.586+0000 7f9ebffff700 1 -- 172.21.15.22:0/3175738634 >> v2:172.21.15.184:3300/0 conn(0x7f9ec00cf8f0 msgr2=0x7f9ec015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:48.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.586+0000 7f9ebffff700 1 --2- 172.21.15.22:0/3175738634 >> v2:172.21.15.184:3300/0 conn(0x7f9ec00cf8f0 0x7f9ec015fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.586+0000 7f9ebffff700 1 -- 172.21.15.22:0/3175738634 >> v1:172.21.15.184:6789/0 conn(0x7f9ec015c460 legacy=0x7f9ec00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:48.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.586+0000 7f9ebffff700 1 -- 172.21.15.22:0/3175738634 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec00d14b0 con 0x7f9ec00d2640 2023-07-11T00:30:48.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.586+0000 7f9ebffff700 1 --2- 172.21.15.22:0/3175738634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ec00d2640 0x7f9ec00b59d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0098f0 tx=0x7f9eac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27f644c69262212b server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:48.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.586+0000 7f9ebf7fe700 1 -- 172.21.15.22:0/3175738634 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac011830 con 0x7f9ec00d2640 2023-07-11T00:30:48.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.586+0000 7f9ebf7fe700 1 -- 172.21.15.22:0/3175738634 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eac011990 con 0x7f9ec00d2640 2023-07-11T00:30:48.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.586+0000 7f9ebf7fe700 1 -- 172.21.15.22:0/3175738634 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac011d20 con 0x7f9ec00d2640 2023-07-11T00:30:48.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.587+0000 7f9ec6fff700 1 -- 172.21.15.22:0/3175738634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ec00d2640 msgr2=0x7f9ec00b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:48.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.587+0000 7f9ec6fff700 1 --2- 172.21.15.22:0/3175738634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ec00d2640 0x7f9ec00b59d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0098f0 tx=0x7f9eac009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:48.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.587+0000 7f9ec6fff700 1 -- 172.21.15.22:0/3175738634 shutdown_connections 2023-07-11T00:30:48.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.587+0000 7f9ec6fff700 1 --2- 172.21.15.22:0/3175738634 >> v2:172.21.15.184:3300/0 conn(0x7f9ec00cf8f0 0x7f9ec015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.587+0000 7f9ec6fff700 1 --2- 172.21.15.22:0/3175738634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ec00d2640 0x7f9ec00b59d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.587+0000 7f9ec6fff700 1 -- 172.21.15.22:0/3175738634 >> 172.21.15.22:0/3175738634 conn(0x7f9ec0071660 msgr2=0x7f9ec0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:48.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.587+0000 7f9ec6fff700 1 -- 172.21.15.22:0/3175738634 shutdown_connections 2023-07-11T00:30:48.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.587+0000 7f9ec6fff700 1 -- 172.21.15.22:0/3175738634 wait complete. 2023-07-11T00:30:48.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.589+0000 7f9ec6fff700 1 Processor -- start 2023-07-11T00:30:48.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.589+0000 7f9ec6fff700 1 -- start start 2023-07-11T00:30:48.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.590+0000 7f9ec6fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ec00cf8f0 0x7f9ec00c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:48.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.590+0000 7f9ec6fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ec00d2640 0x7f9ec00c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:48.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.590+0000 7f9ec6fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ec015c460 0x7f9ec01e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:48.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.590+0000 7f9ec6fff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00c6bf0 con 0x7f9ec00d2640 2023-07-11T00:30:48.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.590+0000 7f9ec6fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00c94e0 con 0x7f9ec015c460 2023-07-11T00:30:48.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.590+0000 7f9ec6fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec015f5c0 con 0x7f9ec00cf8f0 2023-07-11T00:30:48.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.590+0000 7f9ebffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ec00d2640 0x7f9ec00c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:48.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.590+0000 7f9ebffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ec00d2640 0x7f9ec00c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46710/0 (socket says 172.21.15.22:46710) 2023-07-11T00:30:48.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.590+0000 7f9ebffff700 1 -- 172.21.15.22:0/3663482830 learned_addr learned my addr 172.21.15.22:0/3663482830 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:48.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.590+0000 7f9ec4d9b700 1 --2- 172.21.15.22:0/3663482830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ec00cf8f0 0x7f9ec00c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:48.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.590+0000 7f9ec559c700 1 --2- 172.21.15.22:0/3663482830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ec015c460 0x7f9ec01e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:48.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.590+0000 7f9ebffff700 1 -- 172.21.15.22:0/3663482830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ec00cf8f0 msgr2=0x7f9ec00c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:48.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.590+0000 7f9ebffff700 1 --2- 172.21.15.22:0/3663482830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ec00cf8f0 0x7f9ec00c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.590+0000 7f9ebffff700 1 -- 172.21.15.22:0/3663482830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ec015c460 msgr2=0x7f9ec01e6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:48.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.590+0000 7f9ebffff700 1 --2- 172.21.15.22:0/3663482830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ec015c460 0x7f9ec01e6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.590+0000 7f9ebffff700 1 -- 172.21.15.22:0/3663482830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac009550 con 0x7f9ec00d2640 2023-07-11T00:30:48.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.591+0000 7f9ebffff700 1 --2- 172.21.15.22:0/3663482830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ec00d2640 0x7f9ec00c8380 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9eac014040 tx=0x7f9eac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:48.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.591+0000 7f9ebd7fa700 1 -- 172.21.15.22:0/3663482830 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac004510 con 0x7f9ec00d2640 2023-07-11T00:30:48.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.591+0000 7f9ebd7fa700 1 -- 172.21.15.22:0/3663482830 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eac01e070 con 0x7f9ec00d2640 2023-07-11T00:30:48.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.591+0000 7f9ec6fff700 1 -- 172.21.15.22:0/3663482830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec00c8e90 con 0x7f9ec00d2640 2023-07-11T00:30:48.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.591+0000 7f9ebd7fa700 1 -- 172.21.15.22:0/3663482830 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac0038e0 con 0x7f9ec00d2640 2023-07-11T00:30:48.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.591+0000 7f9ec6fff700 1 -- 172.21.15.22:0/3663482830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec015f290 con 0x7f9ec00d2640 2023-07-11T00:30:48.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.592+0000 7f9ec6fff700 1 -- 172.21.15.22:0/3663482830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec00c9650 con 0x7f9ec00d2640 2023-07-11T00:30:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.593+0000 7f9ebd7fa700 1 -- 172.21.15.22:0/3663482830 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9eac003a40 con 0x7f9ec00d2640 2023-07-11T00:30:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.594+0000 7f9ebd7fa700 1 --2- 172.21.15.22:0/3663482830 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9ea406ace0 0x7f9ea406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.594+0000 7f9ebd7fa700 1 -- 172.21.15.22:0/3663482830 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9eac020070 con 0x7f9ec00d2640 2023-07-11T00:30:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.595+0000 7f9ec4d9b700 1 --2- 172.21.15.22:0/3663482830 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9ea406ace0 0x7f9ea406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.596+0000 7f9ec4d9b700 1 --2- 172.21.15.22:0/3663482830 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9ea406ace0 0x7f9ea406d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4007fd0 tx=0x7f9eb4007dc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:48.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.599+0000 7f9ebd7fa700 1 -- 172.21.15.22:0/3663482830 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9eac055880 con 0x7f9ec00d2640 2023-07-11T00:30:48.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.850+0000 7f9ec6fff700 1 -- 172.21.15.22:0/3663482830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ec004ea60 con 0x7f9ec00d2640 2023-07-11T00:30:48.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.851+0000 7f9ebd7fa700 1 -- 172.21.15.22:0/3663482830 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f9eac058ea0 con 0x7f9ec00d2640 2023-07-11T00:30:48.854 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:48.854 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3244868368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3244868368},{"type":"v1","addr":"172.21.15.22:6833","nonce":3244868368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/907204261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":907204261},{"type":"v1","addr":"172.21.15.184:6836","nonce":907204261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/1214375050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1214375050},{"type":"v1","addr":"172.21.15.22:6835","nonce":1214375050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:30:05.408970+0000","modified":"2023-07-11T00:30:33.631426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3376322541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3376322541},{"type":"v1","addr":"172.21.15.184:6837","nonce":3376322541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-11T00:30:48.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.853+0000 7f9ec6fff700 1 -- 172.21.15.22:0/3663482830 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9ea406ace0 msgr2=0x7f9ea406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:48.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.853+0000 7f9ec6fff700 1 --2- 172.21.15.22:0/3663482830 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9ea406ace0 0x7f9ea406d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4007fd0 tx=0x7f9eb4007dc0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.853+0000 7f9ec6fff700 1 -- 172.21.15.22:0/3663482830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ec00d2640 msgr2=0x7f9ec00c8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:48.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.853+0000 7f9ec6fff700 1 --2- 172.21.15.22:0/3663482830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ec00d2640 0x7f9ec00c8380 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9eac014040 tx=0x7f9eac004750 comp rx=0 tx=0).stop 2023-07-11T00:30:48.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.853+0000 7f9ec6fff700 1 -- 172.21.15.22:0/3663482830 shutdown_connections 2023-07-11T00:30:48.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.853+0000 7f9ec6fff700 1 --2- 172.21.15.22:0/3663482830 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9ea406ace0 0x7f9ea406d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.853+0000 7f9ec6fff700 1 --2- 172.21.15.22:0/3663482830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ec00cf8f0 0x7f9ec00c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.853+0000 7f9ec6fff700 1 --2- 172.21.15.22:0/3663482830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ec015c460 0x7f9ec01e6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.853+0000 7f9ec6fff700 1 --2- 172.21.15.22:0/3663482830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ec00d2640 0x7f9ec00c8380 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:48.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.853+0000 7f9ec6fff700 1 -- 172.21.15.22:0/3663482830 >> 172.21.15.22:0/3663482830 conn(0x7f9ec0071660 msgr2=0x7f9ec00b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:48.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.853+0000 7f9ec6fff700 1 -- 172.21.15.22:0/3663482830 shutdown_connections 2023-07-11T00:30:48.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:48.853+0000 7f9ec6fff700 1 -- 172.21.15.22:0/3663482830 wait complete. 2023-07-11T00:30:48.859 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 9 2023-07-11T00:30:48.874 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:30:49.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.073+0000 7f3c7efff700 1 Processor -- start 2023-07-11T00:30:49.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.073+0000 7f3c7efff700 1 -- start start 2023-07-11T00:30:49.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.075+0000 7f3c7efff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3c7815fe00 0x7f3c780cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:49.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.075+0000 7f3c7efff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3c781601d0 0x7f3c78160620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:49.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.075+0000 7f3c7efff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c780d29b0 0x7f3c780d2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:49.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.075+0000 7f3c7efff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c780cd930 con 0x7f3c7815fe00 2023-07-11T00:30:49.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.075+0000 7f3c7efff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c780d06a0 con 0x7f3c781601d0 2023-07-11T00:30:49.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.075+0000 7f3c7efff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780cd120 con 0x7f3c780d29b0 2023-07-11T00:30:49.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.075+0000 7f3c7cd9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3c7815fe00 0x7f3c780cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:49.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.075+0000 7f3c7cd9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3c7815fe00 0x7f3c780cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46726/0 (socket says 172.21.15.22:46726) 2023-07-11T00:30:49.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.075+0000 7f3c7cd9b700 1 -- 172.21.15.22:0/269819572 learned_addr learned my addr 172.21.15.22:0/269819572 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.075+0000 7f3c77fff700 1 --2- 172.21.15.22:0/269819572 >> v2:172.21.15.184:3300/0 conn(0x7f3c781601d0 0x7f3c78160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.075+0000 7f3c7d59c700 1 --2- 172.21.15.22:0/269819572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c780d29b0 0x7f3c780d2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.075+0000 7f3c7cd9b700 1 -- 172.21.15.22:0/269819572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c780d29b0 msgr2=0x7f3c780d2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.076+0000 7f3c7cd9b700 1 --2- 172.21.15.22:0/269819572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c780d29b0 0x7f3c780d2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.076+0000 7f3c7cd9b700 1 -- 172.21.15.22:0/269819572 >> v2:172.21.15.184:3300/0 conn(0x7f3c781601d0 msgr2=0x7f3c78160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.076+0000 7f3c7cd9b700 1 --2- 172.21.15.22:0/269819572 >> v2:172.21.15.184:3300/0 conn(0x7f3c781601d0 0x7f3c78160620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.076+0000 7f3c7cd9b700 1 -- 172.21.15.22:0/269819572 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c780d0940 con 0x7f3c7815fe00 2023-07-11T00:30:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.076+0000 7f3c7cd9b700 1 --2- 172.21.15.22:0/269819572 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c7815fe00 0x7f3c780cf810 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3c780d0650 tx=0x7f3c6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5eb149281b4e48 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.076+0000 7f3c777fe700 1 -- 172.21.15.22:0/269819572 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c00b870 con 0x7f3c7815fe00 2023-07-11T00:30:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.076+0000 7f3c777fe700 1 -- 172.21.15.22:0/269819572 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c00b9d0 con 0x7f3c7815fe00 2023-07-11T00:30:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.076+0000 7f3c777fe700 1 -- 172.21.15.22:0/269819572 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c00bd60 con 0x7f3c7815fe00 2023-07-11T00:30:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.077+0000 7f3c7efff700 1 -- 172.21.15.22:0/269819572 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c7815fe00 msgr2=0x7f3c780cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.077+0000 7f3c7efff700 1 --2- 172.21.15.22:0/269819572 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c7815fe00 0x7f3c780cf810 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3c780d0650 tx=0x7f3c6c009bd0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.077+0000 7f3c7efff700 1 -- 172.21.15.22:0/269819572 shutdown_connections 2023-07-11T00:30:49.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.077+0000 7f3c7efff700 1 --2- 172.21.15.22:0/269819572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c780d29b0 0x7f3c780d2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.077+0000 7f3c7efff700 1 --2- 172.21.15.22:0/269819572 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c7815fe00 0x7f3c780cf810 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.077+0000 7f3c7efff700 1 --2- 172.21.15.22:0/269819572 >> v2:172.21.15.184:3300/0 conn(0x7f3c781601d0 0x7f3c78160620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.077+0000 7f3c7efff700 1 -- 172.21.15.22:0/269819572 >> 172.21.15.22:0/269819572 conn(0x7f3c78071660 msgr2=0x7f3c78071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:49.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.077+0000 7f3c7efff700 1 -- 172.21.15.22:0/269819572 shutdown_connections 2023-07-11T00:30:49.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.077+0000 7f3c7efff700 1 -- 172.21.15.22:0/269819572 wait complete. 2023-07-11T00:30:49.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.079+0000 7f3c7efff700 1 Processor -- start 2023-07-11T00:30:49.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.079+0000 7f3c7efff700 1 -- start start 2023-07-11T00:30:49.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.080+0000 7f3c7efff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c780d29b0 0x7f3c78150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.080+0000 7f3c7efff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c7815fe00 0x7f3c78151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.080+0000 7f3c7efff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c781601d0 0x7f3c781f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.080+0000 7f3c7efff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780cc890 con 0x7f3c7815fe00 2023-07-11T00:30:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.080+0000 7f3c7efff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780c9ba0 con 0x7f3c781601d0 2023-07-11T00:30:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.080+0000 7f3c7efff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780ca0b0 con 0x7f3c780d29b0 2023-07-11T00:30:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.080+0000 7f3c77fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c7815fe00 0x7f3c78151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.080+0000 7f3c77fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c7815fe00 0x7f3c78151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46736/0 (socket says 172.21.15.22:46736) 2023-07-11T00:30:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.080+0000 7f3c77fff700 1 -- 172.21.15.22:0/2366428279 learned_addr learned my addr 172.21.15.22:0/2366428279 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.080+0000 7f3c7cd9b700 1 --2- 172.21.15.22:0/2366428279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c780d29b0 0x7f3c78150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.080+0000 7f3c7d59c700 1 --2- 172.21.15.22:0/2366428279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c781601d0 0x7f3c781f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.080+0000 7f3c77fff700 1 -- 172.21.15.22:0/2366428279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c780d29b0 msgr2=0x7f3c78150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.080+0000 7f3c77fff700 1 --2- 172.21.15.22:0/2366428279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c780d29b0 0x7f3c78150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.080+0000 7f3c77fff700 1 -- 172.21.15.22:0/2366428279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c781601d0 msgr2=0x7f3c781f5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:49.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.080+0000 7f3c77fff700 1 --2- 172.21.15.22:0/2366428279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c781601d0 0x7f3c781f5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.080+0000 7f3c77fff700 1 -- 172.21.15.22:0/2366428279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c009550 con 0x7f3c7815fe00 2023-07-11T00:30:49.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.081+0000 7f3c77fff700 1 --2- 172.21.15.22:0/2366428279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c7815fe00 0x7f3c78151190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400d800 tx=0x7f3c6400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:49.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.081+0000 7f3c757fa700 1 -- 172.21.15.22:0/2366428279 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c640125f0 con 0x7f3c7815fe00 2023-07-11T00:30:49.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.081+0000 7f3c757fa700 1 -- 172.21.15.22:0/2366428279 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c64012750 con 0x7f3c7815fe00 2023-07-11T00:30:49.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.081+0000 7f3c7efff700 1 -- 172.21.15.22:0/2366428279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c781516d0 con 0x7f3c7815fe00 2023-07-11T00:30:49.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.081+0000 7f3c757fa700 1 -- 172.21.15.22:0/2366428279 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64012b00 con 0x7f3c7815fe00 2023-07-11T00:30:49.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.081+0000 7f3c7efff700 1 -- 172.21.15.22:0/2366428279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c780cc1d0 con 0x7f3c7815fe00 2023-07-11T00:30:49.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.082+0000 7f3c7efff700 1 -- 172.21.15.22:0/2366428279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c7804ea60 con 0x7f3c7815fe00 2023-07-11T00:30:49.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.083+0000 7f3c757fa700 1 -- 172.21.15.22:0/2366428279 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c64012c60 con 0x7f3c7815fe00 2023-07-11T00:30:49.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.084+0000 7f3c757fa700 1 --2- 172.21.15.22:0/2366428279 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3c5c06ace0 0x7f3c5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:49.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.085+0000 7f3c757fa700 1 -- 172.21.15.22:0/2366428279 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3c64089ac0 con 0x7f3c7815fe00 2023-07-11T00:30:49.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.085+0000 7f3c7cd9b700 1 --2- 172.21.15.22:0/2366428279 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3c5c06ace0 0x7f3c5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:49.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.085+0000 7f3c7cd9b700 1 --2- 172.21.15.22:0/2366428279 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3c5c06ace0 0x7f3c5c06d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c014040 tx=0x7f3c6c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:49.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.088+0000 7f3c757fa700 1 -- 172.21.15.22:0/2366428279 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3c64054910 con 0x7f3c7815fe00 2023-07-11T00:30:49.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.300+0000 7f3c7efff700 1 -- 172.21.15.22:0/2366428279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c780b4f10 con 0x7f3c7815fe00 2023-07-11T00:30:49.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.301+0000 7f3c757fa700 1 -- 172.21.15.22:0/2366428279 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f3c64057f30 con 0x7f3c7815fe00 2023-07-11T00:30:49.305 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:49.305 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:10.571866+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:30:49.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.303+0000 7f3c7efff700 1 -- 172.21.15.22:0/2366428279 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3c5c06ace0 msgr2=0x7f3c5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:49.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.303+0000 7f3c7efff700 1 --2- 172.21.15.22:0/2366428279 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3c5c06ace0 0x7f3c5c06d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c014040 tx=0x7f3c6c008030 comp rx=0 tx=0).stop 2023-07-11T00:30:49.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.303+0000 7f3c7efff700 1 -- 172.21.15.22:0/2366428279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c7815fe00 msgr2=0x7f3c78151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:49.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.303+0000 7f3c7efff700 1 --2- 172.21.15.22:0/2366428279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c7815fe00 0x7f3c78151190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400d800 tx=0x7f3c6400dbc0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.303+0000 7f3c7efff700 1 -- 172.21.15.22:0/2366428279 shutdown_connections 2023-07-11T00:30:49.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.303+0000 7f3c7efff700 1 --2- 172.21.15.22:0/2366428279 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3c5c06ace0 0x7f3c5c06d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.303+0000 7f3c7efff700 1 --2- 172.21.15.22:0/2366428279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c780d29b0 0x7f3c78150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.303+0000 7f3c7efff700 1 --2- 172.21.15.22:0/2366428279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c781601d0 0x7f3c781f5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.303+0000 7f3c7efff700 1 --2- 172.21.15.22:0/2366428279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c7815fe00 0x7f3c78151190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.303+0000 7f3c7efff700 1 -- 172.21.15.22:0/2366428279 >> 172.21.15.22:0/2366428279 conn(0x7f3c78071660 msgr2=0x7f3c780b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:49.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.304+0000 7f3c7efff700 1 -- 172.21.15.22:0/2366428279 shutdown_connections 2023-07-11T00:30:49.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.304+0000 7f3c7efff700 1 -- 172.21.15.22:0/2366428279 wait complete. 2023-07-11T00:30:49.325 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:30:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.525+0000 7f01917ff700 1 Processor -- start 2023-07-11T00:30:49.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.525+0000 7f01917ff700 1 -- start start 2023-07-11T00:30:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.526+0000 7f01917ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f018c15c460 0x7f018c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.526+0000 7f01917ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f018c0d2640 0x7f018c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.526+0000 7f01917ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f018c0d1790 con 0x7f018c0cf720 2023-07-11T00:30:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.526+0000 7f01917ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f018c0cedd0 con 0x7f018c15c460 2023-07-11T00:30:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.526+0000 7f01917ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018c0cd950 con 0x7f018c0d2640 2023-07-11T00:30:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.527+0000 7f018affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f018c15c460 0x7f018c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.527+0000 7f018affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f018c15c460 0x7f018c0b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46740/0 (socket says 172.21.15.22:46740) 2023-07-11T00:30:49.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.527+0000 7f018affd700 1 -- 172.21.15.22:0/3130644243 learned_addr learned my addr 172.21.15.22:0/3130644243 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.527+0000 7f018a7fc700 1 --2- 172.21.15.22:0/3130644243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f018c0d2640 0x7f018c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.527+0000 7f018affd700 1 -- 172.21.15.22:0/3130644243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f018c0d2640 msgr2=0x7f018c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.527+0000 7f018affd700 1 --2- 172.21.15.22:0/3130644243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f018c0d2640 0x7f018c0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.527+0000 7f018affd700 1 -- 172.21.15.22:0/3130644243 >> v1:172.21.15.184:6789/0 conn(0x7f018c0cf720 legacy=0x7f018c0d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.527+0000 7f018affd700 1 -- 172.21.15.22:0/3130644243 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c0d14b0 con 0x7f018c15c460 2023-07-11T00:30:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.527+0000 7f018affd700 1 --2- 172.21.15.22:0/3130644243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f018c15c460 0x7f018c0b59d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f017c0098f0 tx=0x7f017c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e41f3311e8625c server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.527+0000 7f0189ffb700 1 -- 172.21.15.22:0/3130644243 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c00b8a0 con 0x7f018c15c460 2023-07-11T00:30:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.528+0000 7f0189ffb700 1 -- 172.21.15.22:0/3130644243 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c00ba00 con 0x7f018c15c460 2023-07-11T00:30:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.528+0000 7f0189ffb700 1 -- 172.21.15.22:0/3130644243 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c00bd90 con 0x7f018c15c460 2023-07-11T00:30:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.528+0000 7f01917ff700 1 -- 172.21.15.22:0/3130644243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f018c15c460 msgr2=0x7f018c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.528+0000 7f01917ff700 1 --2- 172.21.15.22:0/3130644243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f018c15c460 0x7f018c0b59d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f017c0098f0 tx=0x7f017c009c00 comp rx=0 tx=0).stop 2023-07-11T00:30:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.528+0000 7f01917ff700 1 -- 172.21.15.22:0/3130644243 shutdown_connections 2023-07-11T00:30:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.528+0000 7f01917ff700 1 --2- 172.21.15.22:0/3130644243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f018c15c460 0x7f018c0b59d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.528+0000 7f01917ff700 1 --2- 172.21.15.22:0/3130644243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f018c0d2640 0x7f018c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.528+0000 7f01917ff700 1 -- 172.21.15.22:0/3130644243 >> 172.21.15.22:0/3130644243 conn(0x7f018c071660 msgr2=0x7f018c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.528+0000 7f01917ff700 1 -- 172.21.15.22:0/3130644243 shutdown_connections 2023-07-11T00:30:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.528+0000 7f01917ff700 1 -- 172.21.15.22:0/3130644243 wait complete. 2023-07-11T00:30:49.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.530+0000 7f01917ff700 1 Processor -- start 2023-07-11T00:30:49.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.530+0000 7f01917ff700 1 -- start start 2023-07-11T00:30:49.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.531+0000 7f01917ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f018c0cf720 0x7f018c1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:49.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.531+0000 7f01917ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f018c0d2640 0x7f018c15a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:49.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.531+0000 7f01917ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f018c15c460 0x7f018c15a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:49.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.531+0000 7f01917ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018c156f00 con 0x7f018c0d2640 2023-07-11T00:30:49.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.531+0000 7f01917ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018c1f59a0 con 0x7f018c15c460 2023-07-11T00:30:49.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.531+0000 7f01917ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018c1f5c80 con 0x7f018c0cf720 2023-07-11T00:30:49.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.531+0000 7f018a7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f018c0d2640 0x7f018c15a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:49.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.532+0000 7f018a7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f018c0d2640 0x7f018c15a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46748/0 (socket says 172.21.15.22:46748) 2023-07-11T00:30:49.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.532+0000 7f018a7fc700 1 -- 172.21.15.22:0/808332106 learned_addr learned my addr 172.21.15.22:0/808332106 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:49.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.532+0000 7f018affd700 1 --2- 172.21.15.22:0/808332106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f018c0cf720 0x7f018c1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:49.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.532+0000 7f018b7fe700 1 --2- 172.21.15.22:0/808332106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f018c15c460 0x7f018c15a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:49.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.532+0000 7f018a7fc700 1 -- 172.21.15.22:0/808332106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f018c0cf720 msgr2=0x7f018c1569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:49.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.532+0000 7f018a7fc700 1 --2- 172.21.15.22:0/808332106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f018c0cf720 0x7f018c1569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.532+0000 7f018a7fc700 1 -- 172.21.15.22:0/808332106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f018c15c460 msgr2=0x7f018c15a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:49.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.532+0000 7f018a7fc700 1 --2- 172.21.15.22:0/808332106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f018c15c460 0x7f018c15a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.532+0000 7f018a7fc700 1 -- 172.21.15.22:0/808332106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017c009550 con 0x7f018c0d2640 2023-07-11T00:30:49.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.532+0000 7f018a7fc700 1 --2- 172.21.15.22:0/808332106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f018c0d2640 0x7f018c15a080 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f018000d800 tx=0x7f018000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:49.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.532+0000 7f01737fe700 1 -- 172.21.15.22:0/808332106 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01800126b0 con 0x7f018c0d2640 2023-07-11T00:30:49.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.532+0000 7f01737fe700 1 -- 172.21.15.22:0/808332106 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0180012810 con 0x7f018c0d2640 2023-07-11T00:30:49.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.532+0000 7f01737fe700 1 -- 172.21.15.22:0/808332106 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180012bc0 con 0x7f018c0d2640 2023-07-11T00:30:49.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.533+0000 7f01917ff700 1 -- 172.21.15.22:0/808332106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f018c1f5f60 con 0x7f018c0d2640 2023-07-11T00:30:49.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.533+0000 7f01917ff700 1 -- 172.21.15.22:0/808332106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018c1f6760 con 0x7f018c0d2640 2023-07-11T00:30:49.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.534+0000 7f01917ff700 1 -- 172.21.15.22:0/808332106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f018c04ea60 con 0x7f018c0d2640 2023-07-11T00:30:49.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.535+0000 7f01737fe700 1 -- 172.21.15.22:0/808332106 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0180012d20 con 0x7f018c0d2640 2023-07-11T00:30:49.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.536+0000 7f01737fe700 1 --2- 172.21.15.22:0/808332106 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f017806ace0 0x7f017806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:49.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.536+0000 7f01737fe700 1 -- 172.21.15.22:0/808332106 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f01800898e0 con 0x7f018c0d2640 2023-07-11T00:30:49.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.536+0000 7f018affd700 1 --2- 172.21.15.22:0/808332106 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f017806ace0 0x7f017806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:49.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.537+0000 7f018affd700 1 --2- 172.21.15.22:0/808332106 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f017806ace0 0x7f017806d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f017c000c00 tx=0x7f017c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:49.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.540+0000 7f01737fe700 1 -- 172.21.15.22:0/808332106 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0180058120 con 0x7f018c0d2640 2023-07-11T00:30:49.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.791+0000 7f01917ff700 1 -- 172.21.15.22:0/808332106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f018c158670 con 0x7f018c0d2640 2023-07-11T00:30:49.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.792+0000 7f01737fe700 1 -- 172.21.15.22:0/808332106 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f0180057cb0 con 0x7f018c0d2640 2023-07-11T00:30:49.794 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:30:49.794 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3244868368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3244868368},{"type":"v1","addr":"172.21.15.22:6833","nonce":3244868368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/907204261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":907204261},{"type":"v1","addr":"172.21.15.184:6836","nonce":907204261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/1214375050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1214375050},{"type":"v1","addr":"172.21.15.22:6835","nonce":1214375050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:30:05.408970+0000","modified":"2023-07-11T00:30:33.631426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3376322541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3376322541},{"type":"v1","addr":"172.21.15.184:6837","nonce":3376322541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-11T00:30:49.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.794+0000 7f01917ff700 1 -- 172.21.15.22:0/808332106 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f017806ace0 msgr2=0x7f017806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:49.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.794+0000 7f01917ff700 1 --2- 172.21.15.22:0/808332106 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f017806ace0 0x7f017806d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f017c000c00 tx=0x7f017c008030 comp rx=0 tx=0).stop 2023-07-11T00:30:49.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.794+0000 7f01917ff700 1 -- 172.21.15.22:0/808332106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f018c0d2640 msgr2=0x7f018c15a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:49.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.794+0000 7f01917ff700 1 --2- 172.21.15.22:0/808332106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f018c0d2640 0x7f018c15a080 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f018000d800 tx=0x7f018000db10 comp rx=0 tx=0).stop 2023-07-11T00:30:49.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.794+0000 7f01917ff700 1 -- 172.21.15.22:0/808332106 shutdown_connections 2023-07-11T00:30:49.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.794+0000 7f01917ff700 1 --2- 172.21.15.22:0/808332106 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f017806ace0 0x7f017806d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.794+0000 7f01917ff700 1 --2- 172.21.15.22:0/808332106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f018c0cf720 0x7f018c1569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.794+0000 7f01917ff700 1 --2- 172.21.15.22:0/808332106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f018c15c460 0x7f018c15a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.794+0000 7f01917ff700 1 --2- 172.21.15.22:0/808332106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f018c0d2640 0x7f018c15a080 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:49.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.794+0000 7f01917ff700 1 -- 172.21.15.22:0/808332106 >> 172.21.15.22:0/808332106 conn(0x7f018c071660 msgr2=0x7f018c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:49.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.794+0000 7f01917ff700 1 -- 172.21.15.22:0/808332106 shutdown_connections 2023-07-11T00:30:49.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:49.794+0000 7f01917ff700 1 -- 172.21.15.22:0/808332106 wait complete. 2023-07-11T00:30:49.798 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 9 2023-07-11T00:30:50.218 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-11T00:30:05.408970+0000', 'modified': '2023-07-11T00:30:33.631426+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6837/3376322541', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6835', 'nonce': 3376322541}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 3376322541}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-11T00:30:50.219 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-11T00:30:50.219 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-11T00:30:50.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.421+0000 7fbaf9dff700 1 Processor -- start 2023-07-11T00:30:50.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.421+0000 7fbaf9dff700 1 -- start start 2023-07-11T00:30:50.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.422+0000 7fbaf9dff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbaf415c460 0x7fbaf40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.422+0000 7fbaf9dff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf40d1790 con 0x7fbaf40d2640 2023-07-11T00:30:50.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.422+0000 7fbaf9dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf40cd950 con 0x7fbaf40cf8f0 2023-07-11T00:30:50.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.422+0000 7fbaf9dff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf40cedd0 con 0x7fbaf415c460 2023-07-11T00:30:50.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.422+0000 7fbaf2ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbaf40d2640 0x7fbaf40cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37042/0 (socket says 172.21.15.22:37042) 2023-07-11T00:30:50.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.422+0000 7fbaf2ffd700 1 -- 172.21.15.22:0/3498766608 learned_addr learned my addr 172.21.15.22:0/3498766608 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:50.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.422+0000 7fbaf37fe700 1 --2- 172.21.15.22:0/3498766608 >> v2:172.21.15.22:3300/0 conn(0x7fbaf415c460 0x7fbaf40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.423+0000 7fbaf27fc700 1 -- 172.21.15.22:0/3498766608 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648194291 0 0) 0x7fbaf40d1790 con 0x7fbaf40d2640 2023-07-11T00:30:50.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.423+0000 7fbaf37fe700 1 -- 172.21.15.22:0/3498766608 >> v1:172.21.15.184:6789/0 conn(0x7fbaf40cf8f0 legacy=0x7fbaf415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:50.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.423+0000 7fbaf37fe700 1 -- 172.21.15.22:0/3498766608 >> v1:172.21.15.22:6789/0 conn(0x7fbaf40d2640 legacy=0x7fbaf40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:50.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.423+0000 7fbaf37fe700 1 -- 172.21.15.22:0/3498766608 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf40d14b0 con 0x7fbaf415c460 2023-07-11T00:30:50.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.423+0000 7fbaf37fe700 1 --2- 172.21.15.22:0/3498766608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaf415c460 0x7fbaf40b59d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009840 tx=0x7fbae4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1cbebb5be940ec5 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:50.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.423+0000 7fbaf27fc700 1 -- 172.21.15.22:0/3498766608 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4011830 con 0x7fbaf415c460 2023-07-11T00:30:50.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.423+0000 7fbaf27fc700 1 -- 172.21.15.22:0/3498766608 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae4011990 con 0x7fbaf415c460 2023-07-11T00:30:50.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.423+0000 7fbaf27fc700 1 -- 172.21.15.22:0/3498766608 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4011d20 con 0x7fbaf415c460 2023-07-11T00:30:50.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.424+0000 7fbaf9dff700 1 -- 172.21.15.22:0/3498766608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaf415c460 msgr2=0x7fbaf40b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:50.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.424+0000 7fbaf9dff700 1 --2- 172.21.15.22:0/3498766608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaf415c460 0x7fbaf40b59d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009840 tx=0x7fbae4009b50 comp rx=0 tx=0).stop 2023-07-11T00:30:50.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.424+0000 7fbaf9dff700 1 -- 172.21.15.22:0/3498766608 shutdown_connections 2023-07-11T00:30:50.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.424+0000 7fbaf9dff700 1 --2- 172.21.15.22:0/3498766608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaf415c460 0x7fbaf40b59d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.424+0000 7fbaf9dff700 1 -- 172.21.15.22:0/3498766608 >> 172.21.15.22:0/3498766608 conn(0x7fbaf4071660 msgr2=0x7fbaf4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:50.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.424+0000 7fbaf9dff700 1 -- 172.21.15.22:0/3498766608 shutdown_connections 2023-07-11T00:30:50.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.424+0000 7fbaf9dff700 1 -- 172.21.15.22:0/3498766608 wait complete. 2023-07-11T00:30:50.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.426+0000 7fbaf9dff700 1 Processor -- start 2023-07-11T00:30:50.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.426+0000 7fbaf9dff700 1 -- start start 2023-07-11T00:30:50.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.427+0000 7fbaf9dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbaf40cf8f0 0x7fbaf415df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.427+0000 7fbaf9dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaf40d2640 0x7fbaf4155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.427+0000 7fbaf9dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaf415c460 0x7fbaf415c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.427+0000 7fbaf9dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf415dab0 con 0x7fbaf40d2640 2023-07-11T00:30:50.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.427+0000 7fbaf9dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf415cea0 con 0x7fbaf415c460 2023-07-11T00:30:50.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.427+0000 7fbaf9dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf415d180 con 0x7fbaf40cf8f0 2023-07-11T00:30:50.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.427+0000 7fbaf2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaf40d2640 0x7fbaf4155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.427+0000 7fbaf2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaf40d2640 0x7fbaf4155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36474/0 (socket says 172.21.15.22:36474) 2023-07-11T00:30:50.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.427+0000 7fbaf2ffd700 1 -- 172.21.15.22:0/1790628276 learned_addr learned my addr 172.21.15.22:0/1790628276 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:50.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.427+0000 7fbaf37fe700 1 --2- 172.21.15.22:0/1790628276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbaf40cf8f0 0x7fbaf415df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.427+0000 7fbaf3fff700 1 --2- 172.21.15.22:0/1790628276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaf415c460 0x7fbaf415c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.428+0000 7fbaf2ffd700 1 -- 172.21.15.22:0/1790628276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbaf40cf8f0 msgr2=0x7fbaf415df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:50.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.428+0000 7fbaf2ffd700 1 --2- 172.21.15.22:0/1790628276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbaf40cf8f0 0x7fbaf415df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.428+0000 7fbaf2ffd700 1 -- 172.21.15.22:0/1790628276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaf415c460 msgr2=0x7fbaf415c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:50.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.428+0000 7fbaf2ffd700 1 --2- 172.21.15.22:0/1790628276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaf415c460 0x7fbaf415c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.428+0000 7fbaf2ffd700 1 -- 172.21.15.22:0/1790628276 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae40094a0 con 0x7fbaf40d2640 2023-07-11T00:30:50.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.428+0000 7fbaf2ffd700 1 --2- 172.21.15.22:0/1790628276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaf40d2640 0x7fbaf4155d00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbae800c520 tx=0x7fbae800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:50.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.428+0000 7fbadbfff700 1 -- 172.21.15.22:0/1790628276 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae8004c80 con 0x7fbaf40d2640 2023-07-11T00:30:50.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.428+0000 7fbadbfff700 1 -- 172.21.15.22:0/1790628276 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae8004e00 con 0x7fbaf40d2640 2023-07-11T00:30:50.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.428+0000 7fbadbfff700 1 -- 172.21.15.22:0/1790628276 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae8007310 con 0x7fbaf40d2640 2023-07-11T00:30:50.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.428+0000 7fbaf9dff700 1 -- 172.21.15.22:0/1790628276 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf415d460 con 0x7fbaf40d2640 2023-07-11T00:30:50.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.428+0000 7fbaf9dff700 1 -- 172.21.15.22:0/1790628276 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf4156530 con 0x7fbaf40d2640 2023-07-11T00:30:50.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.430+0000 7fbadbfff700 1 -- 172.21.15.22:0/1790628276 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbae8007470 con 0x7fbaf40d2640 2023-07-11T00:30:50.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.431+0000 7fbadbfff700 1 --2- 172.21.15.22:0/1790628276 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbae006ace0 0x7fbae006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.431+0000 7fbadbfff700 1 -- 172.21.15.22:0/1790628276 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbae80893f0 con 0x7fbaf40d2640 2023-07-11T00:30:50.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.432+0000 7fbaf37fe700 1 --2- 172.21.15.22:0/1790628276 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbae006ace0 0x7fbae006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.433+0000 7fbaf37fe700 1 --2- 172.21.15.22:0/1790628276 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbae006ace0 0x7fbae006d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbae40090b0 tx=0x7fbae401c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:50.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.434+0000 7fbb0d722b80 1 Processor -- start 2023-07-11T00:30:50.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.434+0000 7fbb0d722b80 1 -- start start 2023-07-11T00:30:50.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.435+0000 7fbb0d722b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f6037130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.435+0000 7fbb0d722b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f603c1a0 0x5640f605aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.435+0000 7fbb0d722b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f6011b60 0x5640f6014120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.435+0000 7fbb0d722b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f5f88ea0 con 0x5640f6036d60 2023-07-11T00:30:50.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.435+0000 7fbb0d722b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f5efc600 con 0x5640f6011b60 2023-07-11T00:30:50.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.435+0000 7fbb0d722b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640f5f6b910 con 0x5640f603c1a0 2023-07-11T00:30:50.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.435+0000 7fbaf37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f6037130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.435+0000 7fbaf37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f6037130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36486/0 (socket says 172.21.15.22:36486) 2023-07-11T00:30:50.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.435+0000 7fbaf37fe700 1 -- 172.21.15.22:0/2958309409 learned_addr learned my addr 172.21.15.22:0/2958309409 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:50.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.436+0000 7fbaf3fff700 1 --2- 172.21.15.22:0/2958309409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f6011b60 0x5640f6014120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.436+0000 7fbaf2ffd700 1 --2- 172.21.15.22:0/2958309409 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f603c1a0 0x5640f605aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.436+0000 7fbaf37fe700 1 -- 172.21.15.22:0/2958309409 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f603c1a0 msgr2=0x5640f605aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:50.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.436+0000 7fbaf37fe700 1 --2- 172.21.15.22:0/2958309409 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f603c1a0 0x5640f605aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.436+0000 7fbaf37fe700 1 -- 172.21.15.22:0/2958309409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f6011b60 msgr2=0x5640f6014120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:50.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.436+0000 7fbaf37fe700 1 --2- 172.21.15.22:0/2958309409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f6011b60 0x5640f6014120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.436+0000 7fbaf37fe700 1 -- 172.21.15.22:0/2958309409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640f5d58790 con 0x5640f6036d60 2023-07-11T00:30:50.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.436+0000 7fbaf2ffd700 1 --2- 172.21.15.22:0/2958309409 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f603c1a0 0x5640f605aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:30:50.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.436+0000 7fbaf37fe700 1 --2- 172.21.15.22:0/2958309409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f6037130 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009b90 tx=0x7fbae4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=612249f21fc1e1d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:50.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.436+0000 7fbad97fa700 1 -- 172.21.15.22:0/2958309409 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae40259d0 con 0x5640f6036d60 2023-07-11T00:30:50.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.436+0000 7fbad97fa700 1 -- 172.21.15.22:0/2958309409 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae402b040 con 0x5640f6036d60 2023-07-11T00:30:50.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.436+0000 7fbad97fa700 1 -- 172.21.15.22:0/2958309409 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4025d50 con 0x5640f6036d60 2023-07-11T00:30:50.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.437+0000 7fbb0d722b80 1 -- 172.21.15.22:0/2958309409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 msgr2=0x5640f6037130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:50.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.437+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/2958309409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f6037130 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009b90 tx=0x7fbae4010000 comp rx=0 tx=0).stop 2023-07-11T00:30:50.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.437+0000 7fbb0d722b80 1 -- 172.21.15.22:0/2958309409 shutdown_connections 2023-07-11T00:30:50.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.437+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/2958309409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f6011b60 0x5640f6014120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.437+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/2958309409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f6037130 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.437+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/2958309409 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f603c1a0 0x5640f605aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.437+0000 7fbb0d722b80 1 -- 172.21.15.22:0/2958309409 >> 172.21.15.22:0/2958309409 conn(0x5640f6009320 msgr2=0x5640f60595c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:50.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.437+0000 7fbb0d722b80 1 -- 172.21.15.22:0/2958309409 shutdown_connections 2023-07-11T00:30:50.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.437+0000 7fbb0d722b80 1 -- 172.21.15.22:0/2958309409 wait complete. 2023-07-11T00:30:50.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.438+0000 7fbb0d722b80 1 -- start start 2023-07-11T00:30:50.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.438+0000 7fbb0d722b80 1 Processor -- start 2023-07-11T00:30:50.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.440+0000 7fbb0d722b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f6011b60 0x5640f6053180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.440+0000 7fbb0d722b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f602bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.440+0000 7fbb0d722b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f603c1a0 0x5640f6030300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.440+0000 7fbb0d722b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f5f64be0 con 0x5640f6036d60 2023-07-11T00:30:50.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.440+0000 7fbb0d722b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f5f225b0 con 0x5640f6011b60 2023-07-11T00:30:50.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.440+0000 7fbb0d722b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640f5f08910 con 0x5640f603c1a0 2023-07-11T00:30:50.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.440+0000 7fbb0d722b80 10 client.0 _ll_register_callbacks cb 0x5640f5f20b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-11T00:30:50.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.440+0000 7fbaf2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f602bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.440+0000 7fbaf2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f602bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36492/0 (socket says 172.21.15.22:36492) 2023-07-11T00:30:50.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.440+0000 7fbaf2ffd700 1 -- 172.21.15.22:0/1254109211 learned_addr learned my addr 172.21.15.22:0/1254109211 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:50.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.441+0000 7fbaf37fe700 1 --2- 172.21.15.22:0/1254109211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f6011b60 0x5640f6053180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.441+0000 7fbaf3fff700 1 --2- 172.21.15.22:0/1254109211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f603c1a0 0x5640f6030300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.441+0000 7fbaf2ffd700 1 -- 172.21.15.22:0/1254109211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f603c1a0 msgr2=0x5640f6030300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:50.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.441+0000 7fbaf2ffd700 1 --2- 172.21.15.22:0/1254109211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f603c1a0 0x5640f6030300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.441+0000 7fbaf2ffd700 1 -- 172.21.15.22:0/1254109211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f6011b60 msgr2=0x5640f6053180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:50.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.441+0000 7fbaf2ffd700 1 --2- 172.21.15.22:0/1254109211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f6011b60 0x5640f6053180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.441+0000 7fbaf2ffd700 1 -- 172.21.15.22:0/1254109211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf40d14b0 con 0x5640f6036d60 2023-07-11T00:30:50.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.441+0000 7fbaf2ffd700 1 --2- 172.21.15.22:0/1254109211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f602bda0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbae8057ad0 tx=0x7fbae805bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3896ca2785096343 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:50.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.441+0000 7fbad27fc700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-07-11T00:30:50.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.441+0000 7fbad27fc700 1 -- 172.21.15.22:0/1254109211 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae8086070 con 0x5640f6036d60 2023-07-11T00:30:50.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.441+0000 7fbb0d722b80 1 -- 172.21.15.22:0/1254109211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640f6006930 con 0x5640f6036d60 2023-07-11T00:30:50.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.441+0000 7fbad27fc700 1 -- 172.21.15.22:0/1254109211 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbae80572c0 con 0x5640f6036d60 2023-07-11T00:30:50.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.442+0000 7fbad27fc700 1 -- 172.21.15.22:0/1254109211 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbae8057480 con 0x5640f6036d60 2023-07-11T00:30:50.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.442+0000 7fbb0d722b80 10 client.4818 fetch_fsmap learned FSMap version 9 2023-07-11T00:30:50.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.442+0000 7fbb0d722b80 1 -- 172.21.15.22:0/1254109211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5640f5e450a0 con 0x5640f6036d60 2023-07-11T00:30:50.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.442+0000 7fbad27fc700 1 -- 172.21.15.22:0/1254109211 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5640f6006930 con 0x5640f6036d60 2023-07-11T00:30:50.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.442+0000 7fbad27fc700 1 -- 172.21.15.22:0/1254109211 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fbae805fc90 con 0x5640f6036d60 2023-07-11T00:30:50.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.442+0000 7fbb0d722b80 10 client.4818 fetch_fsmap finished waiting for FSMap version 9 2023-07-11T00:30:50.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.442+0000 7fbb0d722b80 10 client.4818 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-11T00:30:50.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.442+0000 7fbb0d722b80 20 client.4818 populate_metadata read hostname 'smithi022' 2023-07-11T00:30:50.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.442+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/1254109211 >> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] conn(0x5640f60311c0 0x5640f6031590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.442+0000 7fbb0d722b80 4 client.4818 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-11T00:30:50.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.442+0000 7fbb0d722b80 1 -- 172.21.15.22:0/1254109211 --> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5640f5fe30e0 con 0x5640f60311c0 2023-07-11T00:30:50.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.442+0000 7fbaf37fe700 1 --2- 172.21.15.22:0/1254109211 >> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] conn(0x5640f60311c0 0x5640f6031590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.443+0000 7fbaf37fe700 1 --2- 172.21.15.22:0/1254109211 >> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] conn(0x5640f60311c0 0x5640f6031590 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4c3afce4389f1be server_cookie=8baa1b3b6b1dac81 in_seq=0 out_seq=0 2023-07-11T00:30:50.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.443+0000 7fbad27fc700 10 client.4818 ms_handle_connect on v2:172.21.15.184:6835/3376322541 2023-07-11T00:30:50.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.444+0000 7fbad27fc700 1 -- 172.21.15.22:0/1254109211 <== mds.0 v2:172.21.15.184:6835/3376322541 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5640f5fe30e0 con 0x5640f60311c0 2023-07-11T00:30:50.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.444+0000 7fbad27fc700 10 client.4818 handle_command_reply: tid=0 2023-07-11T00:30:50.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.444+0000 7fbb0d722b80 1 client.4818 shutdown 2023-07-11T00:30:50.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.444+0000 7fbb0d722b80 1 -- 172.21.15.22:0/1254109211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 msgr2=0x5640f602bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:50.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.444+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/1254109211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f602bda0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbae8057ad0 tx=0x7fbae805bd90 comp rx=0 tx=0).stop 2023-07-11T00:30:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.444+0000 7fbb0d722b80 1 -- 172.21.15.22:0/1254109211 shutdown_connections 2023-07-11T00:30:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.444+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/1254109211 >> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] conn(0x5640f60311c0 0x5640f6031590 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.444+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/1254109211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f603c1a0 0x5640f6030300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.444+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/1254109211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f6011b60 0x5640f6053180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.444+0000 7fbad27fc700 0 client.4818 ms_handle_reset on v2:172.21.15.184:6835/3376322541 2023-07-11T00:30:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.444+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/1254109211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f602bda0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.444+0000 7fbb0d722b80 1 -- 172.21.15.22:0/1254109211 >> 172.21.15.22:0/1254109211 conn(0x5640f6009320 msgr2=0x5640f600dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:50.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.444+0000 7fbb0d722b80 1 -- 172.21.15.22:0/1254109211 shutdown_connections 2023-07-11T00:30:50.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.444+0000 7fbb0d722b80 1 -- 172.21.15.22:0/1254109211 wait complete. 2023-07-11T00:30:50.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.445+0000 7fbb0d722b80 20 client.4818 trim_cache size 0 max 16384 2023-07-11T00:30:50.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.463+0000 7fbb0d722b80 1 Processor -- start 2023-07-11T00:30:50.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.463+0000 7fbb0d722b80 1 -- start start 2023-07-11T00:30:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.464+0000 7fbb0d722b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f6011b60 0x5640f6014130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.464+0000 7fbb0d722b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f6036d60 0x5640f602f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.464+0000 7fbb0d722b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f603c1a0 0x5640f602f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.464+0000 7fbb0d722b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f5d59390 con 0x5640f603c1a0 2023-07-11T00:30:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.464+0000 7fbb0d722b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f600ae20 con 0x5640f6011b60 2023-07-11T00:30:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.464+0000 7fbb0d722b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640f603bca0 con 0x5640f6036d60 2023-07-11T00:30:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.464+0000 7fbaf3fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f603c1a0 0x5640f602f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.464+0000 7fbaf3fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f603c1a0 0x5640f602f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36500/0 (socket says 172.21.15.22:36500) 2023-07-11T00:30:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.465+0000 7fbaf3fff700 1 -- 172.21.15.22:0/4105520544 learned_addr learned my addr 172.21.15.22:0/4105520544 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.465+0000 7fbaf37fe700 1 --2- 172.21.15.22:0/4105520544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f6011b60 0x5640f6014130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.465+0000 7fbaf2ffd700 1 --2- 172.21.15.22:0/4105520544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f6036d60 0x5640f602f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.465+0000 7fbaf3fff700 1 -- 172.21.15.22:0/4105520544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f6036d60 msgr2=0x5640f602f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.465+0000 7fbaf3fff700 1 --2- 172.21.15.22:0/4105520544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f6036d60 0x5640f602f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.465+0000 7fbaf3fff700 1 -- 172.21.15.22:0/4105520544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f6011b60 msgr2=0x5640f6014130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.465+0000 7fbaf3fff700 1 --2- 172.21.15.22:0/4105520544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f6011b60 0x5640f6014130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.465+0000 7fbaf3fff700 1 -- 172.21.15.22:0/4105520544 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640f5f2ab10 con 0x5640f603c1a0 2023-07-11T00:30:50.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.465+0000 7fbaf3fff700 1 --2- 172.21.15.22:0/4105520544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f603c1a0 0x5640f602f6a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbaec015490 tx=0x7fbaec001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2df95d0be4fa07 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:50.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.465+0000 7fbad9ffb700 1 -- 172.21.15.22:0/4105520544 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec015ee0 con 0x5640f603c1a0 2023-07-11T00:30:50.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.465+0000 7fbad9ffb700 1 -- 172.21.15.22:0/4105520544 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaec003a00 con 0x5640f603c1a0 2023-07-11T00:30:50.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.465+0000 7fbad9ffb700 1 -- 172.21.15.22:0/4105520544 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec003d90 con 0x5640f603c1a0 2023-07-11T00:30:50.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.466+0000 7fbb0d722b80 1 -- 172.21.15.22:0/4105520544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f603c1a0 msgr2=0x5640f602f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:50.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.466+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/4105520544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f603c1a0 0x5640f602f6a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbaec015490 tx=0x7fbaec001a70 comp rx=0 tx=0).stop 2023-07-11T00:30:50.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.466+0000 7fbb0d722b80 1 -- 172.21.15.22:0/4105520544 shutdown_connections 2023-07-11T00:30:50.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.466+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/4105520544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f603c1a0 0x5640f602f6a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.466+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/4105520544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f6011b60 0x5640f6014130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.466+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/4105520544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f6036d60 0x5640f602f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.466+0000 7fbb0d722b80 1 -- 172.21.15.22:0/4105520544 >> 172.21.15.22:0/4105520544 conn(0x5640f6009320 msgr2=0x5640f60152e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:50.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.466+0000 7fbb0d722b80 1 -- 172.21.15.22:0/4105520544 shutdown_connections 2023-07-11T00:30:50.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.466+0000 7fbb0d722b80 1 -- 172.21.15.22:0/4105520544 wait complete. 2023-07-11T00:30:50.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.467+0000 7fbb0d722b80 1 -- start start 2023-07-11T00:30:50.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.467+0000 7fbb0d722b80 1 Processor -- start 2023-07-11T00:30:50.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.468+0000 7fbb0d722b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f6011b60 0x5640f60a7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.468+0000 7fbb0d722b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f604ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.468+0000 7fbb0d722b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f603c1a0 0x5640f604f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.468+0000 7fbb0d722b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f60c1d00 con 0x5640f6036d60 2023-07-11T00:30:50.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.468+0000 7fbb0d722b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f60c2280 con 0x5640f603c1a0 2023-07-11T00:30:50.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.468+0000 7fbb0d722b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640f600ab90 con 0x5640f6011b60 2023-07-11T00:30:50.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.468+0000 7fbb0d722b80 10 client.0 _ll_register_callbacks cb 0x5640f5f20b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-11T00:30:50.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.468+0000 7fbaf2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f604ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.468+0000 7fbaf2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f604ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36508/0 (socket says 172.21.15.22:36508) 2023-07-11T00:30:50.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.468+0000 7fbaf2ffd700 1 -- 172.21.15.22:0/200506818 learned_addr learned my addr 172.21.15.22:0/200506818 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:50.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.468+0000 7fbaf37fe700 1 --2- 172.21.15.22:0/200506818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f6011b60 0x5640f60a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.468+0000 7fbaf3fff700 1 --2- 172.21.15.22:0/200506818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f603c1a0 0x5640f604f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.469+0000 7fbaf2ffd700 1 -- 172.21.15.22:0/200506818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f6011b60 msgr2=0x5640f60a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:50.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.469+0000 7fbaf2ffd700 1 --2- 172.21.15.22:0/200506818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f6011b60 0x5640f60a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.469+0000 7fbaf2ffd700 1 -- 172.21.15.22:0/200506818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f603c1a0 msgr2=0x5640f604f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:50.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.469+0000 7fbaf2ffd700 1 --2- 172.21.15.22:0/200506818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f603c1a0 0x5640f604f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.469+0000 7fbaf2ffd700 1 -- 172.21.15.22:0/200506818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf40cd950 con 0x5640f6036d60 2023-07-11T00:30:50.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.469+0000 7fbaf2ffd700 1 --2- 172.21.15.22:0/200506818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f604ef50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbae8057d60 tx=0x7fbae8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73ecac9d9ef69ab server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:50.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.469+0000 7fbad27fc700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-07-11T00:30:50.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.469+0000 7fbad27fc700 1 -- 172.21.15.22:0/200506818 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae8086070 con 0x5640f6036d60 2023-07-11T00:30:50.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.469+0000 7fbb0d722b80 1 -- 172.21.15.22:0/200506818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbae402b040 con 0x5640f6036d60 2023-07-11T00:30:50.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.469+0000 7fbad27fc700 1 -- 172.21.15.22:0/200506818 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbae80572c0 con 0x5640f6036d60 2023-07-11T00:30:50.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.469+0000 7fbad27fc700 1 -- 172.21.15.22:0/200506818 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbae8057480 con 0x5640f6036d60 2023-07-11T00:30:50.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.469+0000 7fbb0d722b80 10 client.4824 fetch_fsmap learned FSMap version 9 2023-07-11T00:30:50.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.469+0000 7fbb0d722b80 1 -- 172.21.15.22:0/200506818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5640f5db91d0 con 0x5640f6036d60 2023-07-11T00:30:50.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.469+0000 7fbad27fc700 1 -- 172.21.15.22:0/200506818 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae807e020 con 0x5640f6036d60 2023-07-11T00:30:50.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.470+0000 7fbad27fc700 1 -- 172.21.15.22:0/200506818 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fbae8076af0 con 0x5640f6036d60 2023-07-11T00:30:50.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.470+0000 7fbb0d722b80 10 client.4824 fetch_fsmap finished waiting for FSMap version 9 2023-07-11T00:30:50.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.470+0000 7fbb0d722b80 10 client.4824 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-11T00:30:50.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.470+0000 7fbb0d722b80 20 client.4824 populate_metadata read hostname 'smithi022' 2023-07-11T00:30:50.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.470+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/200506818 >> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] conn(0x5640f602efa0 0x5640f602f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:50.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.470+0000 7fbb0d722b80 4 client.4824 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-07-11T00:30:50.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.470+0000 7fbb0d722b80 1 -- 172.21.15.22:0/200506818 --> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5640f5f5dd20 con 0x5640f602efa0 2023-07-11T00:30:50.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.470+0000 7fbaf37fe700 1 --2- 172.21.15.22:0/200506818 >> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] conn(0x5640f602efa0 0x5640f602f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:50.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.471+0000 7fbaf37fe700 1 --2- 172.21.15.22:0/200506818 >> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] conn(0x5640f602efa0 0x5640f602f370 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acc11468bd441e19 server_cookie=71106aa015506e78 in_seq=0 out_seq=0 2023-07-11T00:30:50.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.471+0000 7fbad27fc700 10 client.4824 ms_handle_connect on v2:172.21.15.184:6835/3376322541 2023-07-11T00:30:50.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.471+0000 7fbad27fc700 1 -- 172.21.15.22:0/200506818 <== mds.0 v2:172.21.15.184:6835/3376322541 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5640f5f5dd20 con 0x5640f602efa0 2023-07-11T00:30:50.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.471+0000 7fbad27fc700 10 client.4824 handle_command_reply: tid=0 2023-07-11T00:30:50.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.471+0000 7fbb0d722b80 1 client.4824 shutdown 2023-07-11T00:30:50.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.471+0000 7fbb0d722b80 1 -- 172.21.15.22:0/200506818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 msgr2=0x5640f604ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:50.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.471+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/200506818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f604ef50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbae8057d60 tx=0x7fbae8009040 comp rx=0 tx=0).stop 2023-07-11T00:30:50.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.471+0000 7fbb0d722b80 1 -- 172.21.15.22:0/200506818 shutdown_connections 2023-07-11T00:30:50.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.471+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/200506818 >> [v2:172.21.15.184:6835/3376322541,v1:172.21.15.184:6837/3376322541] conn(0x5640f602efa0 0x5640f602f370 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.471+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/200506818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5640f6011b60 0x5640f60a7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.471+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/200506818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5640f603c1a0 0x5640f604f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.471+0000 7fbad27fc700 0 client.4824 ms_handle_reset on v2:172.21.15.184:6835/3376322541 2023-07-11T00:30:50.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.471+0000 7fbb0d722b80 1 --2- 172.21.15.22:0/200506818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640f6036d60 0x5640f604ef50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.471+0000 7fbb0d722b80 1 -- 172.21.15.22:0/200506818 >> 172.21.15.22:0/200506818 conn(0x5640f6009320 msgr2=0x5640f602d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:50.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.471+0000 7fbb0d722b80 1 -- 172.21.15.22:0/200506818 shutdown_connections 2023-07-11T00:30:50.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.471+0000 7fbb0d722b80 1 -- 172.21.15.22:0/200506818 wait complete. 2023-07-11T00:30:50.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.471+0000 7fbb0d722b80 20 client.4824 trim_cache size 0 max 16384 2023-07-11T00:30:50.485 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-07-11T00:30:50.485 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "c306ab0a-3faf-4f52-9dba-c4f0807b892e", 2023-07-11T00:30:50.485 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-07-11T00:30:50.486 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4291, 2023-07-11T00:30:50.486 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-07-11T00:30:50.486 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-07-11T00:30:50.486 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-07-11T00:30:50.487 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 44.449534606, 2023-07-11T00:30:50.487 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 9, 2023-07-11T00:30:50.487 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 24, 2023-07-11T00:30:50.488 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 24, 2023-07-11T00:30:50.488 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 50.671926044000003 2023-07-11T00:30:50.488 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-07-11T00:30:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.472+0000 7fbaf9dff700 1 -- 172.21.15.22:0/1790628276 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbae006ace0 msgr2=0x7fbae006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:50.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.472+0000 7fbaf9dff700 1 --2- 172.21.15.22:0/1790628276 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbae006ace0 0x7fbae006d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbae40090b0 tx=0x7fbae401c040 comp rx=0 tx=0).stop 2023-07-11T00:30:50.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.472+0000 7fbaf9dff700 1 -- 172.21.15.22:0/1790628276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaf40d2640 msgr2=0x7fbaf4155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:50.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.472+0000 7fbaf9dff700 1 --2- 172.21.15.22:0/1790628276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaf40d2640 0x7fbaf4155d00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbae800c520 tx=0x7fbae800c830 comp rx=0 tx=0).stop 2023-07-11T00:30:50.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.472+0000 7fbaf9dff700 1 -- 172.21.15.22:0/1790628276 shutdown_connections 2023-07-11T00:30:50.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.472+0000 7fbaf9dff700 1 --2- 172.21.15.22:0/1790628276 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbae006ace0 0x7fbae006d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.472+0000 7fbaf9dff700 1 --2- 172.21.15.22:0/1790628276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbaf40cf8f0 0x7fbaf415df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.472+0000 7fbaf9dff700 1 --2- 172.21.15.22:0/1790628276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaf415c460 0x7fbaf415c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.472+0000 7fbaf9dff700 1 --2- 172.21.15.22:0/1790628276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaf40d2640 0x7fbaf4155d00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:50.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.472+0000 7fbaf9dff700 1 -- 172.21.15.22:0/1790628276 >> 172.21.15.22:0/1790628276 conn(0x7fbaf4071660 msgr2=0x7fbaf40cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:50.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.472+0000 7fbaf9dff700 1 -- 172.21.15.22:0/1790628276 shutdown_connections 2023-07-11T00:30:50.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:50.472+0000 7fbaf9dff700 1 -- 172.21.15.22:0/1790628276 wait complete. 2023-07-11T00:30:50.494 INFO:teuthology.run_tasks:Running task kclient... 2023-07-11T00:30:50.508 INFO:tasks.kclient:Mounting kernel clients... 2023-07-11T00:30:50.508 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-11T00:30:50.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:50.509 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-07-11T00:30:50.556 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-07-11T00:30:50.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:50.558 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-11T00:30:50.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:50.633 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2023-07-11T00:30:50.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:50.751 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-07-11T00:30:50.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:50.802 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2023-07-11T00:30:50.877 INFO:teuthology.orchestra.run.smithi022.stderr:Cannot find device "ceph-brx" 2023-07-11T00:30:50.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-11T00:30:50.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:50.881 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-07-11T00:30:50.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:50.933 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-07-11T00:30:51.010 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-07-11T00:30:51.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-11T00:30:51.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:51.014 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-07-11T00:30:51.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:51.063 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-07-11T00:30:51.135 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-07-11T00:30:51.138 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-11T00:30:51.138 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-07-11T00:30:51.139 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-11T00:30:51.139 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-11T00:30:51.140 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-11T00:30:51.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.343+0000 7fc9dadff700 1 Processor -- start 2023-07-11T00:30:51.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.343+0000 7fc9dadff700 1 -- start start 2023-07-11T00:30:51.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.345+0000 7fc9dadff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc9d40d2640 0x7fc9d40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:51.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.345+0000 7fc9dadff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc9d40cf8f0 0x7fc9d415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:51.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.345+0000 7fc9dadff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d40d1790 con 0x7fc9d415c460 2023-07-11T00:30:51.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.345+0000 7fc9dadff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d40cedd0 con 0x7fc9d40d2640 2023-07-11T00:30:51.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.345+0000 7fc9dadff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d40cd950 con 0x7fc9d40cf8f0 2023-07-11T00:30:51.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.345+0000 7fc9d8b9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc9d415c460 0x7fc9d40cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37046/0 (socket says 172.21.15.22:37046) 2023-07-11T00:30:51.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.345+0000 7fc9d8b9b700 1 -- 172.21.15.22:0/1532240774 learned_addr learned my addr 172.21.15.22:0/1532240774 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:30:51.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.345+0000 7fc9d3fff700 1 --2- 172.21.15.22:0/1532240774 >> v2:172.21.15.22:3300/0 conn(0x7fc9d40d2640 0x7fc9d40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:51.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.346+0000 7fc9d939c700 1 --2- 172.21.15.22:0/1532240774 >> v2:172.21.15.184:3300/0 conn(0x7fc9d40cf8f0 0x7fc9d415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:51.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.346+0000 7fc9d37fe700 1 -- 172.21.15.22:0/1532240774 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153690642 0 0) 0x7fc9d40d1790 con 0x7fc9d415c460 2023-07-11T00:30:51.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.346+0000 7fc9d37fe700 1 -- 172.21.15.22:0/1532240774 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9c40035b0 con 0x7fc9d415c460 2023-07-11T00:30:51.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.346+0000 7fc9d3fff700 1 -- 172.21.15.22:0/1532240774 >> v2:172.21.15.184:3300/0 conn(0x7fc9d40cf8f0 msgr2=0x7fc9d415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:51.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.346+0000 7fc9d3fff700 1 --2- 172.21.15.22:0/1532240774 >> v2:172.21.15.184:3300/0 conn(0x7fc9d40cf8f0 0x7fc9d415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:51.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.346+0000 7fc9d3fff700 1 -- 172.21.15.22:0/1532240774 >> v1:172.21.15.22:6789/0 conn(0x7fc9d415c460 legacy=0x7fc9d40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:51.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.346+0000 7fc9d3fff700 1 -- 172.21.15.22:0/1532240774 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d40d14b0 con 0x7fc9d40d2640 2023-07-11T00:30:51.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.346+0000 7fc9d3fff700 1 --2- 172.21.15.22:0/1532240774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d40d2640 0x7fc9d40b59d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4072140 tx=0x7fc9c0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e746571558e8aa6f server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:51.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.346+0000 7fc9d37fe700 1 -- 172.21.15.22:0/1532240774 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0011830 con 0x7fc9d40d2640 2023-07-11T00:30:51.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.347+0000 7fc9d37fe700 1 -- 172.21.15.22:0/1532240774 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c0011990 con 0x7fc9d40d2640 2023-07-11T00:30:51.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.347+0000 7fc9d37fe700 1 -- 172.21.15.22:0/1532240774 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0011d20 con 0x7fc9d40d2640 2023-07-11T00:30:51.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.347+0000 7fc9dadff700 1 -- 172.21.15.22:0/1532240774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d40d2640 msgr2=0x7fc9d40b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:51.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.347+0000 7fc9dadff700 1 --2- 172.21.15.22:0/1532240774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d40d2640 0x7fc9d40b59d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4072140 tx=0x7fc9c0009b20 comp rx=0 tx=0).stop 2023-07-11T00:30:51.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.347+0000 7fc9dadff700 1 -- 172.21.15.22:0/1532240774 shutdown_connections 2023-07-11T00:30:51.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.347+0000 7fc9dadff700 1 --2- 172.21.15.22:0/1532240774 >> v2:172.21.15.184:3300/0 conn(0x7fc9d40cf8f0 0x7fc9d415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:51.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.347+0000 7fc9dadff700 1 --2- 172.21.15.22:0/1532240774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d40d2640 0x7fc9d40b59d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:51.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.347+0000 7fc9dadff700 1 -- 172.21.15.22:0/1532240774 >> 172.21.15.22:0/1532240774 conn(0x7fc9d4071660 msgr2=0x7fc9d4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:51.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.347+0000 7fc9dadff700 1 -- 172.21.15.22:0/1532240774 shutdown_connections 2023-07-11T00:30:51.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.347+0000 7fc9dadff700 1 -- 172.21.15.22:0/1532240774 wait complete. 2023-07-11T00:30:51.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.349+0000 7fc9dadff700 1 Processor -- start 2023-07-11T00:30:51.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.349+0000 7fc9dadff700 1 -- start start 2023-07-11T00:30:51.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.350+0000 7fc9dadff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9d40cf8f0 0x7fc9d415f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:51.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.350+0000 7fc9dadff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9d40d2640 0x7fc9d40cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:51.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.350+0000 7fc9dadff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d415c460 0x7fc9d40c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:51.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.350+0000 7fc9dadff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d415f850 con 0x7fc9d415c460 2023-07-11T00:30:51.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.350+0000 7fc9dadff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d40cc4f0 con 0x7fc9d40cf8f0 2023-07-11T00:30:51.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.350+0000 7fc9dadff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d40ca280 con 0x7fc9d40d2640 2023-07-11T00:30:51.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.351+0000 7fc9d3fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9d40d2640 0x7fc9d40cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:51.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.351+0000 7fc9d939c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d415c460 0x7fc9d40c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:51.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.351+0000 7fc9d8b9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9d40cf8f0 0x7fc9d415f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:51.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.351+0000 7fc9d3fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9d40d2640 0x7fc9d40cba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:37144/0 (socket says 172.21.15.22:37144) 2023-07-11T00:30:51.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.351+0000 7fc9d3fff700 1 -- 172.21.15.22:0/2544779214 learned_addr learned my addr 172.21.15.22:0/2544779214 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:51.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.351+0000 7fc9d939c700 1 -- 172.21.15.22:0/2544779214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9d40d2640 msgr2=0x7fc9d40cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:51.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.351+0000 7fc9d939c700 1 --2- 172.21.15.22:0/2544779214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9d40d2640 0x7fc9d40cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:51.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.351+0000 7fc9d939c700 1 -- 172.21.15.22:0/2544779214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9d40cf8f0 msgr2=0x7fc9d415f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.351+0000 7fc9d939c700 1 --2- 172.21.15.22:0/2544779214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9d40cf8f0 0x7fc9d415f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.351+0000 7fc9d939c700 1 -- 172.21.15.22:0/2544779214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c00094a0 con 0x7fc9d415c460 2023-07-11T00:30:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.351+0000 7fc9d3fff700 1 --2- 172.21.15.22:0/2544779214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9d40d2640 0x7fc9d40cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:30:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.351+0000 7fc9d939c700 1 --2- 172.21.15.22:0/2544779214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d415c460 0x7fc9d40c7830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00eba0 tx=0x7fc9cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.352+0000 7fc9d17fa700 1 -- 172.21.15.22:0/2544779214 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc009a80 con 0x7fc9d415c460 2023-07-11T00:30:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.352+0000 7fc9d17fa700 1 -- 172.21.15.22:0/2544779214 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9cc00f040 con 0x7fc9d415c460 2023-07-11T00:30:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.352+0000 7fc9dadff700 1 -- 172.21.15.22:0/2544779214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d40c9fa0 con 0x7fc9d415c460 2023-07-11T00:30:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.352+0000 7fc9d17fa700 1 -- 172.21.15.22:0/2544779214 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc00cc40 con 0x7fc9d415c460 2023-07-11T00:30:51.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.352+0000 7fc9dadff700 1 -- 172.21.15.22:0/2544779214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d40cca70 con 0x7fc9d415c460 2023-07-11T00:30:51.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.353+0000 7fc9dadff700 1 -- 172.21.15.22:0/2544779214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d40ccc90 con 0x7fc9d415c460 2023-07-11T00:30:51.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.354+0000 7fc9d17fa700 1 -- 172.21.15.22:0/2544779214 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc9cc014480 con 0x7fc9d415c460 2023-07-11T00:30:51.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.356+0000 7fc9d17fa700 1 --2- 172.21.15.22:0/2544779214 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc9b806ace0 0x7fc9b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:51.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.356+0000 7fc9d17fa700 1 -- 172.21.15.22:0/2544779214 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc9cc08a1c0 con 0x7fc9d415c460 2023-07-11T00:30:51.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.356+0000 7fc9d8b9b700 1 --2- 172.21.15.22:0/2544779214 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc9b806ace0 0x7fc9b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:51.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.357+0000 7fc9d8b9b700 1 --2- 172.21.15.22:0/2544779214 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc9b806ace0 0x7fc9b806d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8007fd0 tx=0x7fc9c8007dc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:51.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.361+0000 7fc9d17fa700 1 -- 172.21.15.22:0/2544779214 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc9cc058970 con 0x7fc9d415c460 2023-07-11T00:30:51.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.618+0000 7fc9dadff700 1 -- 172.21.15.22:0/2544779214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc9d404ea60 con 0x7fc9d415c460 2023-07-11T00:30:51.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.618+0000 7fc9d17fa700 1 -- 172.21.15.22:0/2544779214 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc9cc058500 con 0x7fc9d415c460 2023-07-11T00:30:51.621 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-11T00:30:51.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.621+0000 7fc9dadff700 1 -- 172.21.15.22:0/2544779214 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc9b806ace0 msgr2=0x7fc9b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:51.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.621+0000 7fc9dadff700 1 --2- 172.21.15.22:0/2544779214 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc9b806ace0 0x7fc9b806d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8007fd0 tx=0x7fc9c8007dc0 comp rx=0 tx=0).stop 2023-07-11T00:30:51.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.621+0000 7fc9dadff700 1 -- 172.21.15.22:0/2544779214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d415c460 msgr2=0x7fc9d40c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:51.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.621+0000 7fc9dadff700 1 --2- 172.21.15.22:0/2544779214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d415c460 0x7fc9d40c7830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00eba0 tx=0x7fc9cc00eeb0 comp rx=0 tx=0).stop 2023-07-11T00:30:51.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.621+0000 7fc9dadff700 1 -- 172.21.15.22:0/2544779214 shutdown_connections 2023-07-11T00:30:51.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.621+0000 7fc9dadff700 1 --2- 172.21.15.22:0/2544779214 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc9b806ace0 0x7fc9b806d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:51.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.621+0000 7fc9dadff700 1 --2- 172.21.15.22:0/2544779214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d415c460 0x7fc9d40c7830 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:51.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.621+0000 7fc9dadff700 1 --2- 172.21.15.22:0/2544779214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9d40cf8f0 0x7fc9d415f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:51.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.621+0000 7fc9dadff700 1 --2- 172.21.15.22:0/2544779214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9d40d2640 0x7fc9d40cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:51.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.621+0000 7fc9dadff700 1 -- 172.21.15.22:0/2544779214 >> 172.21.15.22:0/2544779214 conn(0x7fc9d4071660 msgr2=0x7fc9d406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:51.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.621+0000 7fc9dadff700 1 -- 172.21.15.22:0/2544779214 shutdown_connections 2023-07-11T00:30:51.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:51.621+0000 7fc9dadff700 1 -- 172.21.15.22:0/2544779214 wait complete. 2023-07-11T00:30:51.641 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-11T00:30:51.642 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-11T00:30:51.642 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-07-11T00:30:51.642 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-11T00:30:51.642 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-11T00:30:51.642 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-11T00:30:51.643 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-11T00:30:51.643 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-11T00:30:51.643 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-11T00:30:51.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:51.644 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-07-11T00:30:51.690 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-11T00:30:51.690 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-11T00:30:51.690 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-07-11T00:30:51.691 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:51.691 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-07-11T00:30:51.691 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:51.691 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:30:51.691 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-07-11T00:30:51.691 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-07-11T00:30:51.691 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:30:51.691 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-07-11T00:30:51.692 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-07-11T00:30:51.692 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-11T00:30:51.692 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:30:51.692 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-07-11T00:30:51.692 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-11T00:30:51.692 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42287sec preferred_lft 42287sec 2023-07-11T00:30:51.692 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-07-11T00:30:51.693 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:51.693 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:30:51.693 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:30:51.693 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-07-11T00:30:51.694 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-11T00:30:51.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:51.695 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-07-11T00:30:51.695 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-07-11T00:30:51.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add name ceph-brx type bridge 2023-07-11T00:30:51.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr flush dev ceph-brx 2023-07-11T00:30:51.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set ceph-brx up 2023-07-11T00:30:51.696 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-11T00:30:51.696 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-07-11T00:30:51.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:51.894 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-11T00:30:51.964 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-07-11T00:30:51.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:51.967 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-07-11T00:30:52.015 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-07-11T00:30:52.016 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-11T00:30:52.016 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-11T00:30:52.016 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-11T00:30:52.016 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-11T00:30:52.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:52.017 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-07-11T00:30:52.018 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-07-11T00:30:52.018 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-11T00:30:52.018 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-11T00:30:52.018 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-11T00:30:52.019 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-07-11T00:30:52.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:52.189 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-07-11T00:30:52.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:52.237 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list-id 2023-07-11T00:30:52.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:52.324 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-07-11T00:30:52.324 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-07-11T00:30:52.325 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-11T00:30:52.325 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-11T00:30:52.325 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-07-11T00:30:52.508 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-11T00:30:52.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:52.510 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-07-11T00:30:52.510 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-07-11T00:30:52.511 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-11T00:30:52.512 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-11T00:30:52.512 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-11T00:30:52.513 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-11T00:30:52.514 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-11T00:30:52.515 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-07-11T00:30:52.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:52.764 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-07-11T00:30:52.764 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-07-11T00:30:52.765 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-07-11T00:30:52.765 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set dev brx.0 master ceph-brx 2023-07-11T00:30:52.765 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-07-11T00:30:52.945 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-11T00:30:52.946 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-11T00:30:52.993 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-11T00:30:52.994 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-11T00:30:52.994 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-11T00:30:53.078 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-11T00:30:53.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:53.079 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-11T00:30:53.230 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-11T00:30:53.230 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-11T00:30:53.230 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2023-07-11T00:30:53.657 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-11T00:30:53.658 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-11T00:30:53.658 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2023-07-11T00:30:53.658 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-11T00:30:53.658 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-11T00:30:53.682 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-11T00:30:53.683 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-11T00:30:53.683 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2023-07-11T00:30:53.683 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-11T00:30:53.683 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-11T00:30:53.684 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-07-11T00:30:53.684 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-07-11T00:30:53.684 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c306ab0a-3faf-4f52-9dba-c4f0807b892e" will pass to kernel 2023-07-11T00:30:53.688 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-11T00:30:53.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:53.689 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-11T00:30:53.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:53.764 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-11T00:30:53.857 INFO:teuthology.orchestra.run.smithi022.stdout:client4909 2023-07-11T00:30:53.858 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:30:53.858 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:30:53.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:53.904 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-11T00:30:54.033 INFO:teuthology.orchestra.run.smithi022.stdout:client4909 2023-07-11T00:30:54.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:54.034 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-11T00:30:54.122 INFO:teuthology.orchestra.run.smithi022.stdout:client4909 2023-07-11T00:30:54.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:54.123 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c306ab0a-3faf-4f52-9dba-c4f0807b892e.client4909/status') 2023-07-11T00:30:54.235 INFO:teuthology.orchestra.run.smithi022.stdout:instance: client.4909 (3)172.21.15.22:0/3962783699 2023-07-11T00:30:54.235 INFO:teuthology.orchestra.run.smithi022.stdout:blocklisted: false 2023-07-11T00:30:54.236 INFO:teuthology.orchestra.run.smithi022.stderr:0+1 records in 2023-07-11T00:30:54.236 INFO:teuthology.orchestra.run.smithi022.stderr:0+1 records out 2023-07-11T00:30:54.236 INFO:teuthology.orchestra.run.smithi022.stderr:70 bytes copied, 6.2009e-05 s, 1.1 MB/s 2023-07-11T00:30:54.238 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-07-11T00:30:54.238 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-11T00:30:54.238 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-11T00:30:54.239 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-11T00:30:54.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.438+0000 7fae9e5ff700 1 Processor -- start 2023-07-11T00:30:54.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.438+0000 7fae9e5ff700 1 -- start start 2023-07-11T00:30:54.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.439+0000 7fae9e5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae98156be0 0x7fae980cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:54.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.439+0000 7fae9e5ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fae980cd600 0x7fae980cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:54.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.439+0000 7fae9e5ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae980cda70 con 0x7fae980cb4f0 2023-07-11T00:30:54.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.439+0000 7fae9e5ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae98156fb0 con 0x7fae980cd600 2023-07-11T00:30:54.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.439+0000 7fae9e5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9815da40 con 0x7fae98156be0 2023-07-11T00:30:54.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.440+0000 7fae977fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fae980cd600 0x7fae980cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:54.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.440+0000 7fae977fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fae980cd600 0x7fae980cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36544/0 (socket says 172.21.15.22:36544) 2023-07-11T00:30:54.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.440+0000 7fae977fe700 1 -- 172.21.15.22:0/422546272 learned_addr learned my addr 172.21.15.22:0/422546272 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:54.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.440+0000 7fae97fff700 1 --2- 172.21.15.22:0/422546272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae98156be0 0x7fae980cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:54.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.440+0000 7fae977fe700 1 -- 172.21.15.22:0/422546272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae98156be0 msgr2=0x7fae980cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:54.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.440+0000 7fae977fe700 1 --2- 172.21.15.22:0/422546272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae98156be0 0x7fae980cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:54.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.440+0000 7fae977fe700 1 -- 172.21.15.22:0/422546272 >> v1:172.21.15.184:6789/0 conn(0x7fae980cb4f0 legacy=0x7fae98070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:54.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.440+0000 7fae977fe700 1 -- 172.21.15.22:0/422546272 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae980cbc00 con 0x7fae980cd600 2023-07-11T00:30:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.440+0000 7fae977fe700 1 --2- 172.21.15.22:0/422546272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae980cd600 0x7fae980cafb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fae8c009920 tx=0x7fae8c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e211afca663b1e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.440+0000 7fae96ffd700 1 -- 172.21.15.22:0/422546272 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c00ba20 con 0x7fae980cd600 2023-07-11T00:30:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.441+0000 7fae96ffd700 1 -- 172.21.15.22:0/422546272 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c00bb80 con 0x7fae980cd600 2023-07-11T00:30:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.441+0000 7fae96ffd700 1 -- 172.21.15.22:0/422546272 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c009e70 con 0x7fae980cd600 2023-07-11T00:30:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.441+0000 7fae9e5ff700 1 -- 172.21.15.22:0/422546272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae980cd600 msgr2=0x7fae980cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.441+0000 7fae9e5ff700 1 --2- 172.21.15.22:0/422546272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae980cd600 0x7fae980cafb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fae8c009920 tx=0x7fae8c009c30 comp rx=0 tx=0).stop 2023-07-11T00:30:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.441+0000 7fae9e5ff700 1 -- 172.21.15.22:0/422546272 shutdown_connections 2023-07-11T00:30:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.441+0000 7fae9e5ff700 1 --2- 172.21.15.22:0/422546272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae98156be0 0x7fae980cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.441+0000 7fae9e5ff700 1 --2- 172.21.15.22:0/422546272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae980cd600 0x7fae980cafb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.441+0000 7fae9e5ff700 1 -- 172.21.15.22:0/422546272 >> 172.21.15.22:0/422546272 conn(0x7fae980b0390 msgr2=0x7fae980b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.441+0000 7fae9e5ff700 1 -- 172.21.15.22:0/422546272 shutdown_connections 2023-07-11T00:30:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.441+0000 7fae9e5ff700 1 -- 172.21.15.22:0/422546272 wait complete. 2023-07-11T00:30:54.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.444+0000 7fae9e5ff700 1 Processor -- start 2023-07-11T00:30:54.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.444+0000 7fae9e5ff700 1 -- start start 2023-07-11T00:30:54.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.445+0000 7fae9e5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae980cb4f0 0x7fae981570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:54.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.445+0000 7fae9e5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae980cd600 0x7fae980c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:54.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.445+0000 7fae9e5ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae98156be0 0x7fae980c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:54.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.445+0000 7fae9e5ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae980b2780 con 0x7fae98156be0 2023-07-11T00:30:54.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.445+0000 7fae9e5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae980b24a0 con 0x7fae980cb4f0 2023-07-11T00:30:54.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.445+0000 7fae9e5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae980b3ec0 con 0x7fae980cd600 2023-07-11T00:30:54.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.445+0000 7fae9cb9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae98156be0 0x7fae980c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:54.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.445+0000 7fae9cb9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae98156be0 0x7fae980c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36558/0 (socket says 172.21.15.22:36558) 2023-07-11T00:30:54.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.445+0000 7fae9cb9c700 1 -- 172.21.15.22:0/946647153 learned_addr learned my addr 172.21.15.22:0/946647153 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:54.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.446+0000 7fae977fe700 1 --2- 172.21.15.22:0/946647153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae980cd600 0x7fae980c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:54.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.446+0000 7fae97fff700 1 --2- 172.21.15.22:0/946647153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae980cb4f0 0x7fae981570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:54.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.446+0000 7fae9cb9c700 1 -- 172.21.15.22:0/946647153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae980cd600 msgr2=0x7fae980c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:54.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.446+0000 7fae9cb9c700 1 --2- 172.21.15.22:0/946647153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae980cd600 0x7fae980c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:54.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.446+0000 7fae9cb9c700 1 -- 172.21.15.22:0/946647153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae980cb4f0 msgr2=0x7fae981570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:54.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.446+0000 7fae9cb9c700 1 --2- 172.21.15.22:0/946647153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae980cb4f0 0x7fae981570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:54.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.446+0000 7fae9cb9c700 1 -- 172.21.15.22:0/946647153 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c009550 con 0x7fae98156be0 2023-07-11T00:30:54.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.446+0000 7fae9cb9c700 1 --2- 172.21.15.22:0/946647153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae98156be0 0x7fae980c8140 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fae9000cc50 tx=0x7fae9000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:54.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.446+0000 7fae94ff9700 1 -- 172.21.15.22:0/946647153 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90003c00 con 0x7fae98156be0 2023-07-11T00:30:54.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.446+0000 7fae94ff9700 1 -- 172.21.15.22:0/946647153 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae90003d60 con 0x7fae98156be0 2023-07-11T00:30:54.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.446+0000 7fae94ff9700 1 -- 172.21.15.22:0/946647153 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9000aab0 con 0x7fae98156be0 2023-07-11T00:30:54.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.446+0000 7fae9e5ff700 1 -- 172.21.15.22:0/946647153 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae980b41a0 con 0x7fae98156be0 2023-07-11T00:30:54.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.447+0000 7fae9e5ff700 1 -- 172.21.15.22:0/946647153 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae98154a40 con 0x7fae98156be0 2023-07-11T00:30:54.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.448+0000 7fae9e5ff700 1 -- 172.21.15.22:0/946647153 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae981e3330 con 0x7fae98156be0 2023-07-11T00:30:54.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.449+0000 7fae94ff9700 1 -- 172.21.15.22:0/946647153 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fae9000ac10 con 0x7fae98156be0 2023-07-11T00:30:54.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.449+0000 7fae94ff9700 1 --2- 172.21.15.22:0/946647153 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fae8406ace0 0x7fae8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:54.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.450+0000 7fae94ff9700 1 -- 172.21.15.22:0/946647153 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fae90089560 con 0x7fae98156be0 2023-07-11T00:30:54.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.450+0000 7fae97fff700 1 --2- 172.21.15.22:0/946647153 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fae8406ace0 0x7fae8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:54.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.451+0000 7fae97fff700 1 --2- 172.21.15.22:0/946647153 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fae8406ace0 0x7fae8406d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fae88006b20 tx=0x7fae88008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:54.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.454+0000 7fae94ff9700 1 -- 172.21.15.22:0/946647153 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fae981e3330 con 0x7fae98156be0 2023-07-11T00:30:54.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.708+0000 7fae9e5ff700 1 -- 172.21.15.22:0/946647153 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fae980cda70 con 0x7fae98156be0 2023-07-11T00:30:54.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.709+0000 7fae94ff9700 1 -- 172.21.15.22:0/946647153 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fae980cda70 con 0x7fae98156be0 2023-07-11T00:30:54.712 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-11T00:30:54.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.711+0000 7fae9e5ff700 1 -- 172.21.15.22:0/946647153 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fae8406ace0 msgr2=0x7fae8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:54.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.711+0000 7fae9e5ff700 1 --2- 172.21.15.22:0/946647153 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fae8406ace0 0x7fae8406d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fae88006b20 tx=0x7fae88008040 comp rx=0 tx=0).stop 2023-07-11T00:30:54.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.711+0000 7fae9e5ff700 1 -- 172.21.15.22:0/946647153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae98156be0 msgr2=0x7fae980c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:54.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.711+0000 7fae9e5ff700 1 --2- 172.21.15.22:0/946647153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae98156be0 0x7fae980c8140 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fae9000cc50 tx=0x7fae9000cf60 comp rx=0 tx=0).stop 2023-07-11T00:30:54.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.711+0000 7fae9e5ff700 1 -- 172.21.15.22:0/946647153 shutdown_connections 2023-07-11T00:30:54.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.711+0000 7fae9e5ff700 1 --2- 172.21.15.22:0/946647153 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fae8406ace0 0x7fae8406d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:54.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.711+0000 7fae9e5ff700 1 --2- 172.21.15.22:0/946647153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae98156be0 0x7fae980c8140 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:54.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.711+0000 7fae9e5ff700 1 --2- 172.21.15.22:0/946647153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae980cb4f0 0x7fae981570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:54.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.711+0000 7fae9e5ff700 1 --2- 172.21.15.22:0/946647153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae980cd600 0x7fae980c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:54.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.711+0000 7fae9e5ff700 1 -- 172.21.15.22:0/946647153 >> 172.21.15.22:0/946647153 conn(0x7fae980b0390 msgr2=0x7fae9806c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:54.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.711+0000 7fae9e5ff700 1 -- 172.21.15.22:0/946647153 shutdown_connections 2023-07-11T00:30:54.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:54.711+0000 7fae9e5ff700 1 -- 172.21.15.22:0/946647153 wait complete. 2023-07-11T00:30:54.732 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-11T00:30:54.732 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-11T00:30:54.732 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-07-11T00:30:54.733 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-11T00:30:54.733 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-11T00:30:54.733 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-11T00:30:54.733 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-11T00:30:54.734 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-11T00:30:54.734 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-11T00:30:54.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:54.735 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-07-11T00:30:54.782 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-11T00:30:54.782 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-11T00:30:54.782 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-07-11T00:30:54.783 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:54.783 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-07-11T00:30:54.783 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:54.783 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:30:54.783 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-07-11T00:30:54.783 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-07-11T00:30:54.784 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:30:54.784 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-07-11T00:30:54.784 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-07-11T00:30:54.784 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-11T00:30:54.784 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:30:54.784 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-07-11T00:30:54.785 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-11T00:30:54.785 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42284sec preferred_lft 42284sec 2023-07-11T00:30:54.785 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-07-11T00:30:54.785 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:54.785 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:30:54.785 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:30:54.785 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-07-11T00:30:54.786 INFO:teuthology.orchestra.run.smithi022.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-11T00:30:54.786 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:8e:86:c3:8d:07 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:30:54.786 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-11T00:30:54.786 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:54.786 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::c4a2:20ff:fe26:3621/64 scope link 2023-07-11T00:30:54.786 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:54.786 INFO:teuthology.orchestra.run.smithi022.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-11T00:30:54.786 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:8e:86:c3:8d:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-11T00:30:54.787 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec8e:86ff:fec3:8d07/64 scope link 2023-07-11T00:30:54.787 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:54.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:54.787 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-11T00:30:54.855 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-07-11T00:30:54.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:54.858 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-07-11T00:30:54.906 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-07-11T00:30:54.907 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-11T00:30:54.907 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-11T00:30:54.907 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-11T00:30:54.907 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-11T00:30:54.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:54.908 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-07-11T00:30:54.909 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-07-11T00:30:54.909 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-11T00:30:54.909 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-11T00:30:54.909 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-11T00:30:54.910 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-07-11T00:30:55.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:55.081 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-07-11T00:30:55.127 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-11T00:30:55.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:55.129 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list-id 2023-07-11T00:30:55.176 INFO:teuthology.orchestra.run.smithi022.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-11T00:30:55.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:55.178 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-07-11T00:30:55.178 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-07-11T00:30:55.178 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-11T00:30:55.178 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-11T00:30:55.178 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-07-11T00:30:55.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:55.363 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-11T00:30:55.434 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-11T00:30:55.435 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-11T00:30:55.435 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-07-11T00:30:55.435 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:55.435 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-07-11T00:30:55.435 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:55.436 INFO:teuthology.orchestra.run.smithi022.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-11T00:30:55.436 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 46:ee:79:87:1d:45 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-11T00:30:55.436 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-11T00:30:55.436 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:55.436 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::44ee:79ff:fe87:1d45/64 scope link 2023-07-11T00:30:55.436 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:55.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:55.438 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-11T00:30:55.509 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-11T00:30:55.510 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-11T00:30:55.510 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-07-11T00:30:55.510 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:55.510 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-07-11T00:30:55.510 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:55.511 INFO:teuthology.orchestra.run.smithi022.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-11T00:30:55.511 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 46:ee:79:87:1d:45 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-11T00:30:55.511 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-11T00:30:55.511 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:55.512 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::44ee:79ff:fe87:1d45/64 scope link 2023-07-11T00:30:55.512 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:55.513 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-11T00:30:55.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:55.515 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-07-11T00:30:55.515 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-07-11T00:30:55.515 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-11T00:30:55.515 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-11T00:30:55.516 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-11T00:30:55.516 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-11T00:30:55.517 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-11T00:30:55.517 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-07-11T00:30:55.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:55.775 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-07-11T00:30:55.775 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-07-11T00:30:55.775 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.1 up 2023-07-11T00:30:55.775 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set dev brx.1 master ceph-brx 2023-07-11T00:30:55.776 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-07-11T00:30:55.955 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-11T00:30:55.956 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-11T00:30:56.002 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-11T00:30:56.002 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-11T00:30:56.003 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-11T00:30:56.087 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-11T00:30:56.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:56.088 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-11T00:30:56.233 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-11T00:30:56.234 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-11T00:30:56.234 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2023-07-11T00:30:56.249 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-11T00:30:56.249 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-11T00:30:56.250 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2023-07-11T00:30:56.250 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-11T00:30:56.250 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-11T00:30:56.271 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-11T00:30:56.271 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-11T00:30:56.272 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2023-07-11T00:30:56.272 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-11T00:30:56.272 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-11T00:30:56.272 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-07-11T00:30:56.273 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-07-11T00:30:56.273 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=c306ab0a-3faf-4f52-9dba-c4f0807b892e" will pass to kernel 2023-07-11T00:30:56.277 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-11T00:30:56.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:56.278 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-11T00:30:56.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:56.348 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-11T00:30:56.437 INFO:teuthology.orchestra.run.smithi022.stdout:client4842 2023-07-11T00:30:56.438 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:30:56.438 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:30:56.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:56.484 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-11T00:30:56.613 INFO:teuthology.orchestra.run.smithi022.stdout:client4842 2023-07-11T00:30:56.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:56.614 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-11T00:30:56.702 INFO:teuthology.orchestra.run.smithi022.stdout:client4842 2023-07-11T00:30:56.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:56.703 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c306ab0a-3faf-4f52-9dba-c4f0807b892e.client4842/status') 2023-07-11T00:30:56.812 INFO:teuthology.orchestra.run.smithi022.stdout:instance: client.4842 (3)192.168.0.2:0/1426303903 2023-07-11T00:30:56.812 INFO:teuthology.orchestra.run.smithi022.stdout:blocklisted: false 2023-07-11T00:30:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:0+1 records in 2023-07-11T00:30:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:0+1 records out 2023-07-11T00:30:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:69 bytes copied, 5.4359e-05 s, 1.3 MB/s 2023-07-11T00:30:56.815 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-07-11T00:30:56.815 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-11T00:30:56.815 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-11T00:30:56.816 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-11T00:30:57.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.015+0000 7ff6663ff700 1 Processor -- start 2023-07-11T00:30:57.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.016+0000 7ff6663ff700 1 -- start start 2023-07-11T00:30:57.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.017+0000 7ff6663ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff660157f10 0x7ff66006a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:57.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.017+0000 7ff6663ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff660070340 0x7ff66015e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:57.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.017+0000 7ff6663ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66015e210 con 0x7ff660070a50 2023-07-11T00:30:57.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.017+0000 7ff6663ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66006d900 con 0x7ff660157f10 2023-07-11T00:30:57.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.017+0000 7ff6663ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66015dee0 con 0x7ff660070340 2023-07-11T00:30:57.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.017+0000 7ff65ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff660157f10 0x7ff66006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:57.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.017+0000 7ff65ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff660157f10 0x7ff66006a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36574/0 (socket says 172.21.15.22:36574) 2023-07-11T00:30:57.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.017+0000 7ff65ffff700 1 -- 172.21.15.22:0/1445040509 learned_addr learned my addr 172.21.15.22:0/1445040509 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:57.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.017+0000 7ff66499c700 1 --1- 172.21.15.22:0/1445040509 >> v1:172.21.15.22:6789/0 conn(0x7ff660070a50 0x7ff660070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37052/0 (socket says 172.21.15.22:37052) 2023-07-11T00:30:57.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.017+0000 7ff65f7fe700 1 --2- 172.21.15.22:0/1445040509 >> v2:172.21.15.184:3300/0 conn(0x7ff660070340 0x7ff66015e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:57.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.018+0000 7ff65ffff700 1 -- 172.21.15.22:0/1445040509 >> v2:172.21.15.184:3300/0 conn(0x7ff660070340 msgr2=0x7ff66015e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:30:57.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.018+0000 7ff65ffff700 1 --2- 172.21.15.22:0/1445040509 >> v2:172.21.15.184:3300/0 conn(0x7ff660070340 0x7ff66015e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:57.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.018+0000 7ff65ffff700 1 -- 172.21.15.22:0/1445040509 >> v1:172.21.15.22:6789/0 conn(0x7ff660070a50 legacy=0x7ff660070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:57.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.018+0000 7ff65ffff700 1 -- 172.21.15.22:0/1445040509 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6600c8f40 con 0x7ff660157f10 2023-07-11T00:30:57.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.018+0000 7ff65ffff700 1 --2- 172.21.15.22:0/1445040509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff660157f10 0x7ff66006a940 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff6600cc000 tx=0x7ff650009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c783c65c9a9c0961 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:57.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.018+0000 7ff65effd700 1 -- 172.21.15.22:0/1445040509 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65000b870 con 0x7ff660157f10 2023-07-11T00:30:57.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.018+0000 7ff65effd700 1 -- 172.21.15.22:0/1445040509 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65000b9d0 con 0x7ff660157f10 2023-07-11T00:30:57.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.018+0000 7ff65effd700 1 -- 172.21.15.22:0/1445040509 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65000bd60 con 0x7ff660157f10 2023-07-11T00:30:57.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.019+0000 7ff6663ff700 1 -- 172.21.15.22:0/1445040509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff660157f10 msgr2=0x7ff66006a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:57.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.019+0000 7ff6663ff700 1 --2- 172.21.15.22:0/1445040509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff660157f10 0x7ff66006a940 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff6600cc000 tx=0x7ff650009bd0 comp rx=0 tx=0).stop 2023-07-11T00:30:57.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.019+0000 7ff6663ff700 1 -- 172.21.15.22:0/1445040509 shutdown_connections 2023-07-11T00:30:57.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.019+0000 7ff6663ff700 1 --2- 172.21.15.22:0/1445040509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff660157f10 0x7ff66006a940 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:57.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.019+0000 7ff6663ff700 1 --2- 172.21.15.22:0/1445040509 >> v2:172.21.15.184:3300/0 conn(0x7ff660070340 0x7ff66015e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:57.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.019+0000 7ff6663ff700 1 -- 172.21.15.22:0/1445040509 >> 172.21.15.22:0/1445040509 conn(0x7ff6600b0390 msgr2=0x7ff6600b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:57.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.019+0000 7ff6663ff700 1 -- 172.21.15.22:0/1445040509 shutdown_connections 2023-07-11T00:30:57.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.019+0000 7ff6663ff700 1 -- 172.21.15.22:0/1445040509 wait complete. 2023-07-11T00:30:57.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.020+0000 7ff6663ff700 1 Processor -- start 2023-07-11T00:30:57.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.021+0000 7ff6663ff700 1 -- start start 2023-07-11T00:30:57.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.022+0000 7ff6663ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff660070340 0x7ff66014ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:57.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.022+0000 7ff6663ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff660070a50 0x7ff6600cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:57.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.022+0000 7ff6663ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff660157f10 0x7ff660154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:57.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.022+0000 7ff6663ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6601520e0 con 0x7ff660070a50 2023-07-11T00:30:57.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.022+0000 7ff6663ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66014b1d0 con 0x7ff660157f10 2023-07-11T00:30:57.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.022+0000 7ff6663ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6601f64f0 con 0x7ff660070340 2023-07-11T00:30:57.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.022+0000 7ff65f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff660070a50 0x7ff6600cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:57.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.022+0000 7ff65f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff660070a50 0x7ff6600cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36582/0 (socket says 172.21.15.22:36582) 2023-07-11T00:30:57.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.022+0000 7ff65f7fe700 1 -- 172.21.15.22:0/1009024249 learned_addr learned my addr 172.21.15.22:0/1009024249 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:30:57.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.022+0000 7ff65ffff700 1 --2- 172.21.15.22:0/1009024249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff660070340 0x7ff66014ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:57.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.022+0000 7ff66499c700 1 --2- 172.21.15.22:0/1009024249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff660157f10 0x7ff660154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:57.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.022+0000 7ff65f7fe700 1 -- 172.21.15.22:0/1009024249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff660070340 msgr2=0x7ff66014ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:57.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.022+0000 7ff65f7fe700 1 --2- 172.21.15.22:0/1009024249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff660070340 0x7ff66014ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:57.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.022+0000 7ff65f7fe700 1 -- 172.21.15.22:0/1009024249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff660157f10 msgr2=0x7ff660154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:57.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.022+0000 7ff65f7fe700 1 --2- 172.21.15.22:0/1009024249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff660157f10 0x7ff660154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:57.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.022+0000 7ff65f7fe700 1 -- 172.21.15.22:0/1009024249 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650009550 con 0x7ff660070a50 2023-07-11T00:30:57.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.022+0000 7ff65f7fe700 1 --2- 172.21.15.22:0/1009024249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff660070a50 0x7ff6600cb1a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff65400e810 tx=0x7ff65400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:57.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.023+0000 7ff65cff9700 1 -- 172.21.15.22:0/1009024249 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65400c070 con 0x7ff660070a50 2023-07-11T00:30:57.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.023+0000 7ff65cff9700 1 -- 172.21.15.22:0/1009024249 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff654013610 con 0x7ff660070a50 2023-07-11T00:30:57.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.023+0000 7ff65cff9700 1 -- 172.21.15.22:0/1009024249 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540139c0 con 0x7ff660070a50 2023-07-11T00:30:57.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.023+0000 7ff6663ff700 1 -- 172.21.15.22:0/1009024249 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6601522f0 con 0x7ff660070a50 2023-07-11T00:30:57.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.023+0000 7ff6663ff700 1 -- 172.21.15.22:0/1009024249 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6601528b0 con 0x7ff660070a50 2023-07-11T00:30:57.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.024+0000 7ff6663ff700 1 -- 172.21.15.22:0/1009024249 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66004ea60 con 0x7ff660070a50 2023-07-11T00:30:57.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.025+0000 7ff65cff9700 1 -- 172.21.15.22:0/1009024249 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff654013b20 con 0x7ff660070a50 2023-07-11T00:30:57.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.026+0000 7ff65cff9700 1 --2- 172.21.15.22:0/1009024249 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff64c06ace0 0x7ff64c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:30:57.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.026+0000 7ff65cff9700 1 -- 172.21.15.22:0/1009024249 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff654089570 con 0x7ff660070a50 2023-07-11T00:30:57.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.026+0000 7ff65ffff700 1 --2- 172.21.15.22:0/1009024249 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff64c06ace0 0x7ff64c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:30:57.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.027+0000 7ff65ffff700 1 --2- 172.21.15.22:0/1009024249 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff64c06ace0 0x7ff64c06d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff650014040 tx=0x7ff650008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:30:57.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.030+0000 7ff65cff9700 1 -- 172.21.15.22:0/1009024249 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff654054260 con 0x7ff660070a50 2023-07-11T00:30:57.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.288+0000 7ff6663ff700 1 -- 172.21.15.22:0/1009024249 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff6600c20d0 con 0x7ff660070a50 2023-07-11T00:30:57.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.288+0000 7ff65cff9700 1 -- 172.21.15.22:0/1009024249 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff654057880 con 0x7ff660070a50 2023-07-11T00:30:57.291 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-11T00:30:57.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.290+0000 7ff6663ff700 1 -- 172.21.15.22:0/1009024249 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff64c06ace0 msgr2=0x7ff64c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:57.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.290+0000 7ff6663ff700 1 --2- 172.21.15.22:0/1009024249 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff64c06ace0 0x7ff64c06d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff650014040 tx=0x7ff650008030 comp rx=0 tx=0).stop 2023-07-11T00:30:57.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.290+0000 7ff6663ff700 1 -- 172.21.15.22:0/1009024249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff660070a50 msgr2=0x7ff6600cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:30:57.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.290+0000 7ff6663ff700 1 --2- 172.21.15.22:0/1009024249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff660070a50 0x7ff6600cb1a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff65400e810 tx=0x7ff65400eb20 comp rx=0 tx=0).stop 2023-07-11T00:30:57.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.290+0000 7ff6663ff700 1 -- 172.21.15.22:0/1009024249 shutdown_connections 2023-07-11T00:30:57.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.290+0000 7ff6663ff700 1 --2- 172.21.15.22:0/1009024249 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff64c06ace0 0x7ff64c06d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:57.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.290+0000 7ff6663ff700 1 --2- 172.21.15.22:0/1009024249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff660070340 0x7ff66014ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:57.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.290+0000 7ff6663ff700 1 --2- 172.21.15.22:0/1009024249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff660157f10 0x7ff660154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:57.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.290+0000 7ff6663ff700 1 --2- 172.21.15.22:0/1009024249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff660070a50 0x7ff6600cb1a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:30:57.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.290+0000 7ff6663ff700 1 -- 172.21.15.22:0/1009024249 >> 172.21.15.22:0/1009024249 conn(0x7ff6600b0390 msgr2=0x7ff660155930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:30:57.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.291+0000 7ff6663ff700 1 -- 172.21.15.22:0/1009024249 shutdown_connections 2023-07-11T00:30:57.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:30:57.291+0000 7ff6663ff700 1 -- 172.21.15.22:0/1009024249 wait complete. 2023-07-11T00:30:57.310 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-11T00:30:57.311 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-11T00:30:57.311 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-07-11T00:30:57.311 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-11T00:30:57.312 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-11T00:30:57.312 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-11T00:30:57.312 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-11T00:30:57.312 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-11T00:30:57.313 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-11T00:30:57.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:57.313 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-07-11T00:30:57.366 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-11T00:30:57.366 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-11T00:30:57.366 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-07-11T00:30:57.366 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:57.367 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-07-11T00:30:57.367 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:57.367 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:30:57.367 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:30:57.367 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-07-11T00:30:57.367 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:30:57.368 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:30:57.368 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-07-11T00:30:57.368 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:30:57.368 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-07-11T00:30:57.368 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-11T00:30:57.368 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-07-11T00:30:57.369 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-11T00:30:57.369 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42300sec preferred_lft 42300sec 2023-07-11T00:30:57.369 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-07-11T00:30:57.369 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:30:57.370 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-11T00:30:57.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:57.372 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-11T00:30:57.372 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-11T00:30:57.372 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add name ceph-brx type bridge 2023-07-11T00:30:57.372 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr flush dev ceph-brx 2023-07-11T00:30:57.373 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set ceph-brx up 2023-07-11T00:30:57.373 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-11T00:30:57.373 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-11T00:30:57.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:57.886 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-11T00:30:57.956 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-07-11T00:30:57.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:57.959 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-07-11T00:30:58.025 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-07-11T00:30:58.026 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-11T00:30:58.026 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-11T00:30:58.026 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-11T00:30:58.026 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-11T00:30:58.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:58.027 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-11T00:30:58.027 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-11T00:30:58.027 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-11T00:30:58.028 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-11T00:30:58.028 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-11T00:30:58.028 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-11T00:30:58.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:58.704 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-07-11T00:30:58.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:58.751 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2023-07-11T00:30:58.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:58.798 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-11T00:30:58.799 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-11T00:30:58.799 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-11T00:30:58.800 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-11T00:30:58.800 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-11T00:30:58.942 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-11T00:30:58.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:58.943 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-11T00:30:58.943 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-11T00:30:58.943 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-11T00:30:58.943 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-11T00:30:58.944 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-11T00:30:58.944 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-11T00:30:58.944 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-11T00:30:58.944 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-11T00:30:59.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:59.242 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-11T00:30:59.243 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-11T00:30:59.243 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-07-11T00:30:59.243 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.0 master ceph-brx 2023-07-11T00:30:59.243 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-11T00:30:59.421 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-11T00:30:59.422 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-11T00:30:59.469 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-11T00:30:59.470 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-11T00:30:59.470 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-11T00:30:59.554 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-11T00:30:59.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:30:59.555 DEBUG:teuthology.orchestra.run.smithi184:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-11T00:30:59.699 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-11T00:30:59.699 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-11T00:30:59.699 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-11T00:31:00.113 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-11T00:31:00.114 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-11T00:31:00.114 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-11T00:31:00.114 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-11T00:31:00.114 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-11T00:31:00.138 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-11T00:31:00.138 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-11T00:31:00.138 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-11T00:31:00.138 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-11T00:31:00.138 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-11T00:31:00.138 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-07-11T00:31:00.139 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-07-11T00:31:00.139 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c306ab0a-3faf-4f52-9dba-c4f0807b892e" will pass to kernel 2023-07-11T00:31:00.143 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-11T00:31:00.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:00.144 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-11T00:31:00.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:00.212 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-11T00:31:00.304 INFO:teuthology.orchestra.run.smithi184.stdout:client4679 2023-07-11T00:31:00.305 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:31:00.305 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:31:00.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:00.351 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-11T00:31:00.476 INFO:teuthology.orchestra.run.smithi184.stdout:client4679 2023-07-11T00:31:00.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:00.477 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-11T00:31:00.567 INFO:teuthology.orchestra.run.smithi184.stdout:client4679 2023-07-11T00:31:00.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:00.568 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c306ab0a-3faf-4f52-9dba-c4f0807b892e.client4679/status') 2023-07-11T00:31:00.676 INFO:teuthology.orchestra.run.smithi184.stdout:instance: client.4679 (3)192.168.0.1:0/2681528037 2023-07-11T00:31:00.676 INFO:teuthology.orchestra.run.smithi184.stdout:blocklisted: false 2023-07-11T00:31:00.678 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records in 2023-07-11T00:31:00.678 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records out 2023-07-11T00:31:00.678 INFO:teuthology.orchestra.run.smithi184.stderr:69 bytes copied, 5.6184e-05 s, 1.2 MB/s 2023-07-11T00:31:00.679 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-07-11T00:31:00.679 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-11T00:31:00.679 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-11T00:31:00.679 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-11T00:31:00.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.887+0000 7f0223bff700 1 Processor -- start 2023-07-11T00:31:00.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.888+0000 7f0223bff700 1 -- start start 2023-07-11T00:31:00.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.889+0000 7f0223bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f021c15c460 0x7f021c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:00.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.889+0000 7f0223bff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f021c0d2640 0x7f021c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:00.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.889+0000 7f0223bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c0d1790 con 0x7f021c0cf720 2023-07-11T00:31:00.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.889+0000 7f0223bff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c0cedd0 con 0x7f021c0d2640 2023-07-11T00:31:00.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.889+0000 7f0223bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0cd950 con 0x7f021c15c460 2023-07-11T00:31:00.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.889+0000 7f022119a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f021c0d2640 0x7f021c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:00.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.889+0000 7f022119a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f021c0d2640 0x7f021c0cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55246/0 (socket says 172.21.15.22:55246) 2023-07-11T00:31:00.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.889+0000 7f022119a700 1 -- 172.21.15.22:0/928522356 learned_addr learned my addr 172.21.15.22:0/928522356 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:00.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.889+0000 7f022199b700 1 --2- 172.21.15.22:0/928522356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f021c15c460 0x7f021c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:00.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.890+0000 7f022119a700 1 -- 172.21.15.22:0/928522356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f021c15c460 msgr2=0x7f021c0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:00.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.890+0000 7f022119a700 1 --2- 172.21.15.22:0/928522356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f021c15c460 0x7f021c0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:00.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.890+0000 7f022119a700 1 -- 172.21.15.22:0/928522356 >> v1:172.21.15.184:6789/0 conn(0x7f021c0cf720 legacy=0x7f021c0d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:00.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.890+0000 7f022119a700 1 -- 172.21.15.22:0/928522356 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0d14b0 con 0x7f021c0d2640 2023-07-11T00:31:00.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.890+0000 7f022199b700 1 --2- 172.21.15.22:0/928522356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f021c15c460 0x7f021c0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:00.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.890+0000 7f022119a700 1 --2- 172.21.15.22:0/928522356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f021c0d2640 0x7f021c0cf1e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f020c0098f0 tx=0x7f020c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743e45cf77bb1bf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:00.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.890+0000 7f0220999700 1 -- 172.21.15.22:0/928522356 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c00b8a0 con 0x7f021c0d2640 2023-07-11T00:31:00.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.890+0000 7f0220999700 1 -- 172.21.15.22:0/928522356 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c00ba00 con 0x7f021c0d2640 2023-07-11T00:31:00.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.890+0000 7f0220999700 1 -- 172.21.15.22:0/928522356 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c00bd90 con 0x7f021c0d2640 2023-07-11T00:31:00.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.891+0000 7f0223bff700 1 -- 172.21.15.22:0/928522356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f021c0d2640 msgr2=0x7f021c0cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:00.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.891+0000 7f0223bff700 1 --2- 172.21.15.22:0/928522356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f021c0d2640 0x7f021c0cf1e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f020c0098f0 tx=0x7f020c009c00 comp rx=0 tx=0).stop 2023-07-11T00:31:00.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.891+0000 7f0223bff700 1 -- 172.21.15.22:0/928522356 shutdown_connections 2023-07-11T00:31:00.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.891+0000 7f0223bff700 1 --2- 172.21.15.22:0/928522356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f021c15c460 0x7f021c0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:00.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.891+0000 7f0223bff700 1 --2- 172.21.15.22:0/928522356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f021c0d2640 0x7f021c0cf1e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:00.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.891+0000 7f0223bff700 1 -- 172.21.15.22:0/928522356 >> 172.21.15.22:0/928522356 conn(0x7f021c071660 msgr2=0x7f021c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:00.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.891+0000 7f0223bff700 1 -- 172.21.15.22:0/928522356 shutdown_connections 2023-07-11T00:31:00.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.891+0000 7f0223bff700 1 -- 172.21.15.22:0/928522356 wait complete. 2023-07-11T00:31:00.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.893+0000 7f0223bff700 1 Processor -- start 2023-07-11T00:31:00.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.893+0000 7f0223bff700 1 -- start start 2023-07-11T00:31:00.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.894+0000 7f0223bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f021c0cf720 0x7f021c14dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:00.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.894+0000 7f0223bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f021c0d2640 0x7f021c0c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:00.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.894+0000 7f0223bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f021c15c460 0x7f021c0ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:00.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.894+0000 7f0223bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c151180 con 0x7f021c0cf720 2023-07-11T00:31:00.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.894+0000 7f0223bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0c7ec0 con 0x7f021c0d2640 2023-07-11T00:31:00.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.894+0000 7f0223bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c1519c0 con 0x7f021c15c460 2023-07-11T00:31:00.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.894+0000 7f022199b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f021c0cf720 0x7f021c14dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:00.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.894+0000 7f022199b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f021c0cf720 0x7f021c14dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55262/0 (socket says 172.21.15.22:55262) 2023-07-11T00:31:00.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.894+0000 7f022199b700 1 -- 172.21.15.22:0/3086018645 learned_addr learned my addr 172.21.15.22:0/3086018645 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:00.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.894+0000 7f022199b700 1 -- 172.21.15.22:0/3086018645 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f021c15c460 msgr2=0x7f021c0ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:00.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.894+0000 7f022199b700 1 --2- 172.21.15.22:0/3086018645 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f021c15c460 0x7f021c0ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:00.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.894+0000 7f022119a700 1 --2- 172.21.15.22:0/3086018645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f021c0d2640 0x7f021c0c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:00.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.894+0000 7f022199b700 1 -- 172.21.15.22:0/3086018645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f021c0d2640 msgr2=0x7f021c0c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:00.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.894+0000 7f022199b700 1 --2- 172.21.15.22:0/3086018645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f021c0d2640 0x7f021c0c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:00.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.894+0000 7f022199b700 1 -- 172.21.15.22:0/3086018645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c009550 con 0x7f021c0cf720 2023-07-11T00:31:00.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.894+0000 7f022119a700 1 --2- 172.21.15.22:0/3086018645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f021c0d2640 0x7f021c0c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:00.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.895+0000 7f022199b700 1 --2- 172.21.15.22:0/3086018645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f021c0cf720 0x7f021c14dc10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f021800e810 tx=0x7f021800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:00.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.895+0000 7f02127fc700 1 -- 172.21.15.22:0/3086018645 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218004230 con 0x7f021c0cf720 2023-07-11T00:31:00.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.895+0000 7f02127fc700 1 -- 172.21.15.22:0/3086018645 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0218004390 con 0x7f021c0cf720 2023-07-11T00:31:00.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.895+0000 7f0223bff700 1 -- 172.21.15.22:0/3086018645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c0c7be0 con 0x7f021c0cf720 2023-07-11T00:31:00.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.895+0000 7f02127fc700 1 -- 172.21.15.22:0/3086018645 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02180036a0 con 0x7f021c0cf720 2023-07-11T00:31:00.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.895+0000 7f0223bff700 1 -- 172.21.15.22:0/3086018645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c151650 con 0x7f021c0cf720 2023-07-11T00:31:00.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.896+0000 7f0223bff700 1 -- 172.21.15.22:0/3086018645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c04ea60 con 0x7f021c0cf720 2023-07-11T00:31:00.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.897+0000 7f02127fc700 1 -- 172.21.15.22:0/3086018645 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0218003800 con 0x7f021c0cf720 2023-07-11T00:31:00.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.898+0000 7f02127fc700 1 --2- 172.21.15.22:0/3086018645 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f020006ace0 0x7f020006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:00.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.898+0000 7f02127fc700 1 -- 172.21.15.22:0/3086018645 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0218089280 con 0x7f021c0cf720 2023-07-11T00:31:00.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.898+0000 7f022119a700 1 --2- 172.21.15.22:0/3086018645 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f020006ace0 0x7f020006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:00.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.899+0000 7f022119a700 1 --2- 172.21.15.22:0/3086018645 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f020006ace0 0x7f020006d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f021c1f56f0 tx=0x7f020c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:00.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:00.903+0000 7f02127fc700 1 -- 172.21.15.22:0/3086018645 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0218053ff0 con 0x7f021c0cf720 2023-07-11T00:31:01.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:01.158+0000 7f0223bff700 1 -- 172.21.15.22:0/3086018645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f021c0ccf40 con 0x7f021c0cf720 2023-07-11T00:31:01.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:01.158+0000 7f02127fc700 1 -- 172.21.15.22:0/3086018645 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0218057610 con 0x7f021c0cf720 2023-07-11T00:31:01.161 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-11T00:31:01.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:01.160+0000 7f0223bff700 1 -- 172.21.15.22:0/3086018645 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f020006ace0 msgr2=0x7f020006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:01.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:01.160+0000 7f0223bff700 1 --2- 172.21.15.22:0/3086018645 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f020006ace0 0x7f020006d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f021c1f56f0 tx=0x7f020c008030 comp rx=0 tx=0).stop 2023-07-11T00:31:01.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:01.160+0000 7f0223bff700 1 -- 172.21.15.22:0/3086018645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f021c0cf720 msgr2=0x7f021c14dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:01.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:01.160+0000 7f0223bff700 1 --2- 172.21.15.22:0/3086018645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f021c0cf720 0x7f021c14dc10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f021800e810 tx=0x7f021800ebd0 comp rx=0 tx=0).stop 2023-07-11T00:31:01.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:01.161+0000 7f0223bff700 1 -- 172.21.15.22:0/3086018645 shutdown_connections 2023-07-11T00:31:01.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:01.161+0000 7f0223bff700 1 --2- 172.21.15.22:0/3086018645 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f020006ace0 0x7f020006d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:01.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:01.161+0000 7f0223bff700 1 --2- 172.21.15.22:0/3086018645 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f021c15c460 0x7f021c0ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:01.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:01.161+0000 7f0223bff700 1 --2- 172.21.15.22:0/3086018645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f021c0cf720 0x7f021c14dc10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:01.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:01.161+0000 7f0223bff700 1 --2- 172.21.15.22:0/3086018645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f021c0d2640 0x7f021c0c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:01.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:01.161+0000 7f0223bff700 1 -- 172.21.15.22:0/3086018645 >> 172.21.15.22:0/3086018645 conn(0x7f021c071660 msgr2=0x7f021c15c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:01.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:01.161+0000 7f0223bff700 1 -- 172.21.15.22:0/3086018645 shutdown_connections 2023-07-11T00:31:01.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:01.161+0000 7f0223bff700 1 -- 172.21.15.22:0/3086018645 wait complete. 2023-07-11T00:31:01.181 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-11T00:31:01.182 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-11T00:31:01.182 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-07-11T00:31:01.182 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-11T00:31:01.182 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-11T00:31:01.182 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-11T00:31:01.183 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-11T00:31:01.183 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-11T00:31:01.183 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-11T00:31:01.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:01.184 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-07-11T00:31:01.233 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-11T00:31:01.233 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-11T00:31:01.234 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-07-11T00:31:01.235 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:31:01.235 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-07-11T00:31:01.235 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:31:01.236 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:31:01.236 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:31:01.236 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-07-11T00:31:01.236 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:31:01.237 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:31:01.237 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-07-11T00:31:01.238 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:31:01.238 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-07-11T00:31:01.238 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-11T00:31:01.238 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-07-11T00:31:01.239 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-11T00:31:01.239 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42296sec preferred_lft 42296sec 2023-07-11T00:31:01.239 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-07-11T00:31:01.239 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:31:01.239 INFO:teuthology.orchestra.run.smithi184.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-11T00:31:01.239 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 06:bf:56:b9:87:2b brd ff:ff:ff:ff:ff:ff 2023-07-11T00:31:01.239 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-11T00:31:01.240 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:31:01.240 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::e4bc:a2ff:fe01:4b85/64 scope link 2023-07-11T00:31:01.240 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:31:01.240 INFO:teuthology.orchestra.run.smithi184.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-11T00:31:01.240 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 06:bf:56:b9:87:2b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-11T00:31:01.240 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::4bf:56ff:feb9:872b/64 scope link 2023-07-11T00:31:01.240 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:31:01.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:01.241 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-11T00:31:01.308 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-07-11T00:31:01.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:01.313 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-07-11T00:31:01.363 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-07-11T00:31:01.363 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-11T00:31:01.363 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-11T00:31:01.364 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-11T00:31:01.364 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-11T00:31:01.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:01.365 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-11T00:31:01.365 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-11T00:31:01.366 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-11T00:31:01.366 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-11T00:31:01.366 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-11T00:31:01.366 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-11T00:31:01.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:01.533 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-07-11T00:31:01.579 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-11T00:31:01.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:01.582 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2023-07-11T00:31:01.666 INFO:teuthology.orchestra.run.smithi184.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-11T00:31:01.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:01.668 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-11T00:31:01.668 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-11T00:31:01.669 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-11T00:31:01.669 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-11T00:31:01.669 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-11T00:31:01.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:01.846 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-11T00:31:01.918 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-11T00:31:01.919 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-11T00:31:01.919 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-07-11T00:31:01.919 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:31:01.919 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-07-11T00:31:01.920 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:31:01.920 INFO:teuthology.orchestra.run.smithi184.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-11T00:31:01.920 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether e2:bd:b8:cb:d6:69 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-11T00:31:01.920 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-11T00:31:01.920 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:31:01.921 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::e0bd:b8ff:fecb:d669/64 scope link 2023-07-11T00:31:01.921 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:31:01.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:01.923 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-11T00:31:01.994 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-11T00:31:01.994 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-11T00:31:01.994 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-07-11T00:31:01.995 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:31:01.995 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-07-11T00:31:01.995 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:31:01.995 INFO:teuthology.orchestra.run.smithi184.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-11T00:31:01.995 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether e2:bd:b8:cb:d6:69 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-11T00:31:01.995 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-11T00:31:01.995 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:31:01.996 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::e0bd:b8ff:fecb:d669/64 scope link 2023-07-11T00:31:01.996 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:31:01.997 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-11T00:31:01.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:01.998 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-11T00:31:01.998 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-11T00:31:01.998 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-11T00:31:01.999 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-11T00:31:01.999 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-11T00:31:01.999 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-11T00:31:02.000 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-11T00:31:02.000 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-11T00:31:02.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:02.251 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-07-11T00:31:02.251 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-07-11T00:31:02.251 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.1 up 2023-07-11T00:31:02.252 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.1 master ceph-brx 2023-07-11T00:31:02.252 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-07-11T00:31:02.430 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-11T00:31:02.431 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-11T00:31:02.476 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-11T00:31:02.477 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-11T00:31:02.478 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-11T00:31:02.562 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-11T00:31:02.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:02.562 DEBUG:teuthology.orchestra.run.smithi184:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-11T00:31:02.707 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-11T00:31:02.707 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-11T00:31:02.707 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-11T00:31:02.722 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-11T00:31:02.723 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-11T00:31:02.723 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-11T00:31:02.723 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-11T00:31:02.723 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-11T00:31:02.744 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-11T00:31:02.744 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-11T00:31:02.744 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-07-11T00:31:02.745 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-11T00:31:02.745 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-11T00:31:02.745 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-07-11T00:31:02.745 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-07-11T00:31:02.746 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=c306ab0a-3faf-4f52-9dba-c4f0807b892e" will pass to kernel 2023-07-11T00:31:02.750 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-11T00:31:02.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:02.751 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-11T00:31:02.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:02.821 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-11T00:31:02.907 INFO:teuthology.orchestra.run.smithi184.stdout:client4927 2023-07-11T00:31:02.909 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:31:02.910 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:31:02.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:02.956 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-11T00:31:03.083 INFO:teuthology.orchestra.run.smithi184.stdout:client4927 2023-07-11T00:31:03.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:03.084 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-11T00:31:03.170 INFO:teuthology.orchestra.run.smithi184.stdout:client4927 2023-07-11T00:31:03.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:03.172 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c306ab0a-3faf-4f52-9dba-c4f0807b892e.client4927/status') 2023-07-11T00:31:03.279 INFO:teuthology.orchestra.run.smithi184.stdout:instance: client.4927 (3)192.168.0.2:0/2153840748 2023-07-11T00:31:03.279 INFO:teuthology.orchestra.run.smithi184.stdout:blocklisted: false 2023-07-11T00:31:03.279 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records in 2023-07-11T00:31:03.279 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records out 2023-07-11T00:31:03.280 INFO:teuthology.orchestra.run.smithi184.stderr:69 bytes copied, 5.5035e-05 s, 1.3 MB/s 2023-07-11T00:31:03.281 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-11T00:31:03.299 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:31:03.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.510+0000 7f7b249ff700 1 Processor -- start 2023-07-11T00:31:03.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.510+0000 7f7b249ff700 1 -- start start 2023-07-11T00:31:03.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.511+0000 7f7b249ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7b20070340 0x7f7b2006a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:03.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.511+0000 7f7b249ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7b20070a50 0x7f7b20070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:03.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.511+0000 7f7b249ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2015e210 con 0x7f7b20157f10 2023-07-11T00:31:03.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.511+0000 7f7b249ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2006d900 con 0x7f7b20070340 2023-07-11T00:31:03.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.511+0000 7f7b249ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b200713b0 con 0x7f7b20070a50 2023-07-11T00:31:03.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.512+0000 7f7b1dd9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7b20070340 0x7f7b2006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:03.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.512+0000 7f7b1e59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7b20157f10 0x7f7b2015e6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47644/0 (socket says 172.21.15.22:47644) 2023-07-11T00:31:03.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.512+0000 7f7b1e59c700 1 -- 172.21.15.22:0/1704930263 learned_addr learned my addr 172.21.15.22:0/1704930263 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:03.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.512+0000 7f7b1ed9d700 1 --2- 172.21.15.22:0/1704930263 >> v2:172.21.15.184:3300/0 conn(0x7f7b20070a50 0x7f7b20070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:03.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.512+0000 7f7b1d59a700 1 -- 172.21.15.22:0/1704930263 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053566048 0 0) 0x7f7b2015e210 con 0x7f7b20157f10 2023-07-11T00:31:03.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.512+0000 7f7b1d59a700 1 -- 172.21.15.22:0/1704930263 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b080035b0 con 0x7f7b20157f10 2023-07-11T00:31:03.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.512+0000 7f7b1dd9b700 1 -- 172.21.15.22:0/1704930263 >> v2:172.21.15.184:3300/0 conn(0x7f7b20070a50 msgr2=0x7f7b20070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:03.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.512+0000 7f7b1dd9b700 1 --2- 172.21.15.22:0/1704930263 >> v2:172.21.15.184:3300/0 conn(0x7f7b20070a50 0x7f7b20070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:03.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.512+0000 7f7b1dd9b700 1 -- 172.21.15.22:0/1704930263 >> v1:172.21.15.22:6789/0 conn(0x7f7b20157f10 legacy=0x7f7b2015e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:03.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.512+0000 7f7b1dd9b700 1 -- 172.21.15.22:0/1704930263 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2015dee0 con 0x7f7b20070340 2023-07-11T00:31:03.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.513+0000 7f7b1dd9b700 1 --2- 172.21.15.22:0/1704930263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b20070340 0x7f7b2006a940 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7b200add00 tx=0x7f7b14009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4697c1f6138721 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:03.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.513+0000 7f7b1d59a700 1 -- 172.21.15.22:0/1704930263 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14011830 con 0x7f7b20070340 2023-07-11T00:31:03.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.513+0000 7f7b1d59a700 1 -- 172.21.15.22:0/1704930263 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b14011990 con 0x7f7b20070340 2023-07-11T00:31:03.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.513+0000 7f7b1d59a700 1 -- 172.21.15.22:0/1704930263 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14011d00 con 0x7f7b20070340 2023-07-11T00:31:03.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.513+0000 7f7b249ff700 1 -- 172.21.15.22:0/1704930263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b20070340 msgr2=0x7f7b2006a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:03.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.513+0000 7f7b249ff700 1 --2- 172.21.15.22:0/1704930263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b20070340 0x7f7b2006a940 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7b200add00 tx=0x7f7b14009b20 comp rx=0 tx=0).stop 2023-07-11T00:31:03.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.513+0000 7f7b249ff700 1 -- 172.21.15.22:0/1704930263 shutdown_connections 2023-07-11T00:31:03.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.513+0000 7f7b249ff700 1 --2- 172.21.15.22:0/1704930263 >> v2:172.21.15.184:3300/0 conn(0x7f7b20070a50 0x7f7b20070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:03.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.513+0000 7f7b249ff700 1 --2- 172.21.15.22:0/1704930263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b20070340 0x7f7b2006a940 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:03.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.513+0000 7f7b249ff700 1 -- 172.21.15.22:0/1704930263 >> 172.21.15.22:0/1704930263 conn(0x7f7b200b0390 msgr2=0x7f7b200b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:03.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.514+0000 7f7b249ff700 1 -- 172.21.15.22:0/1704930263 shutdown_connections 2023-07-11T00:31:03.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.514+0000 7f7b249ff700 1 -- 172.21.15.22:0/1704930263 wait complete. 2023-07-11T00:31:03.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.516+0000 7f7b249ff700 1 Processor -- start 2023-07-11T00:31:03.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.516+0000 7f7b249ff700 1 -- start start 2023-07-11T00:31:03.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.517+0000 7f7b249ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b20070340 0x7f7b200cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:03.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.517+0000 7f7b249ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b20070a50 0x7f7b200c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:03.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.518+0000 7f7b249ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b20157f10 0x7f7b200c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:03.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.518+0000 7f7b249ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2014b720 con 0x7f7b20157f10 2023-07-11T00:31:03.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.518+0000 7f7b249ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b201f5910 con 0x7f7b20070a50 2023-07-11T00:31:03.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.518+0000 7f7b249ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b201f4d20 con 0x7f7b20070340 2023-07-11T00:31:03.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.518+0000 7f7b1ed9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b20157f10 0x7f7b200c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:03.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.518+0000 7f7b1ed9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b20157f10 0x7f7b200c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55280/0 (socket says 172.21.15.22:55280) 2023-07-11T00:31:03.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.518+0000 7f7b1ed9d700 1 -- 172.21.15.22:0/2395954448 learned_addr learned my addr 172.21.15.22:0/2395954448 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:03.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.518+0000 7f7b1e59c700 1 --2- 172.21.15.22:0/2395954448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b20070340 0x7f7b200cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:03.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.518+0000 7f7b1dd9b700 1 --2- 172.21.15.22:0/2395954448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b20070a50 0x7f7b200c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:03.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.518+0000 7f7b1ed9d700 1 -- 172.21.15.22:0/2395954448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b20070340 msgr2=0x7f7b200cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:03.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.518+0000 7f7b1ed9d700 1 --2- 172.21.15.22:0/2395954448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b20070340 0x7f7b200cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:03.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.518+0000 7f7b1ed9d700 1 -- 172.21.15.22:0/2395954448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b20070a50 msgr2=0x7f7b200c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:03.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.518+0000 7f7b1ed9d700 1 --2- 172.21.15.22:0/2395954448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b20070a50 0x7f7b200c6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:03.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.518+0000 7f7b1ed9d700 1 -- 172.21.15.22:0/2395954448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b140094a0 con 0x7f7b20157f10 2023-07-11T00:31:03.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.518+0000 7f7b1ed9d700 1 --2- 172.21.15.22:0/2395954448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b20157f10 0x7f7b200c7ea0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800efc0 tx=0x7f7b1800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:03.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.519+0000 7f7b0effd700 1 -- 172.21.15.22:0/2395954448 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1800cad0 con 0x7f7b20157f10 2023-07-11T00:31:03.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.519+0000 7f7b0effd700 1 -- 172.21.15.22:0/2395954448 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1800f040 con 0x7f7b20157f10 2023-07-11T00:31:03.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.519+0000 7f7b249ff700 1 -- 172.21.15.22:0/2395954448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b201f4fe0 con 0x7f7b20157f10 2023-07-11T00:31:03.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.519+0000 7f7b0effd700 1 -- 172.21.15.22:0/2395954448 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1800ce70 con 0x7f7b20157f10 2023-07-11T00:31:03.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.519+0000 7f7b249ff700 1 -- 172.21.15.22:0/2395954448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b201f55a0 con 0x7f7b20157f10 2023-07-11T00:31:03.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.520+0000 7f7b249ff700 1 -- 172.21.15.22:0/2395954448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b20066ac0 con 0x7f7b20157f10 2023-07-11T00:31:03.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.521+0000 7f7b0effd700 1 -- 172.21.15.22:0/2395954448 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b18014480 con 0x7f7b20157f10 2023-07-11T00:31:03.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.522+0000 7f7b0effd700 1 --2- 172.21.15.22:0/2395954448 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7b0006ace0 0x7f7b0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:03.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.522+0000 7f7b0effd700 1 -- 172.21.15.22:0/2395954448 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7b18089f40 con 0x7f7b20157f10 2023-07-11T00:31:03.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.522+0000 7f7b1e59c700 1 --2- 172.21.15.22:0/2395954448 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7b0006ace0 0x7f7b0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:03.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.523+0000 7f7b1e59c700 1 --2- 172.21.15.22:0/2395954448 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7b0006ace0 0x7f7b0006d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7b10007fd0 tx=0x7f7b10009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:03.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.526+0000 7f7b0effd700 1 -- 172.21.15.22:0/2395954448 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7b20066ac0 con 0x7f7b20157f10 2023-07-11T00:31:03.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.733+0000 7f7b249ff700 1 -- 172.21.15.22:0/2395954448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b20066ac0 con 0x7f7b20157f10 2023-07-11T00:31:03.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.734+0000 7f7b0effd700 1 -- 172.21.15.22:0/2395954448 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f7b20066ac0 con 0x7f7b20157f10 2023-07-11T00:31:03.738 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:03.738 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:54.208536+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:31:03.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.737+0000 7f7b249ff700 1 -- 172.21.15.22:0/2395954448 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7b0006ace0 msgr2=0x7f7b0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:03.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.737+0000 7f7b249ff700 1 --2- 172.21.15.22:0/2395954448 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7b0006ace0 0x7f7b0006d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7b10007fd0 tx=0x7f7b10009040 comp rx=0 tx=0).stop 2023-07-11T00:31:03.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.737+0000 7f7b249ff700 1 -- 172.21.15.22:0/2395954448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b20157f10 msgr2=0x7f7b200c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:03.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.737+0000 7f7b249ff700 1 --2- 172.21.15.22:0/2395954448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b20157f10 0x7f7b200c7ea0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800efc0 tx=0x7f7b1800c0c0 comp rx=0 tx=0).stop 2023-07-11T00:31:03.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.737+0000 7f7b249ff700 1 -- 172.21.15.22:0/2395954448 shutdown_connections 2023-07-11T00:31:03.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.737+0000 7f7b249ff700 1 --2- 172.21.15.22:0/2395954448 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7b0006ace0 0x7f7b0006d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:03.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.737+0000 7f7b249ff700 1 --2- 172.21.15.22:0/2395954448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b20070340 0x7f7b200cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:03.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.737+0000 7f7b249ff700 1 --2- 172.21.15.22:0/2395954448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b20157f10 0x7f7b200c7ea0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:03.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.737+0000 7f7b249ff700 1 --2- 172.21.15.22:0/2395954448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b20070a50 0x7f7b200c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:03.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.737+0000 7f7b249ff700 1 -- 172.21.15.22:0/2395954448 >> 172.21.15.22:0/2395954448 conn(0x7f7b200b0390 msgr2=0x7f7b200ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:03.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.737+0000 7f7b249ff700 1 -- 172.21.15.22:0/2395954448 shutdown_connections 2023-07-11T00:31:03.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.737+0000 7f7b249ff700 1 -- 172.21.15.22:0/2395954448 wait complete. 2023-07-11T00:31:03.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:29:57.631007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:29:58.547599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:30:03.826184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:30:04.383448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-11T00:30:08.075875+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-11T00:31:03.759 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:31:03.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.960+0000 7f80407ff700 1 Processor -- start 2023-07-11T00:31:03.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.961+0000 7f80407ff700 1 -- start start 2023-07-11T00:31:03.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.962+0000 7f80407ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80380d3730 0x7f80380cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:03.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.962+0000 7f80407ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80380d0b20 con 0x7f80380b8430 2023-07-11T00:31:03.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.962+0000 7f80407ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80380cfe90 con 0x7f80380cfa90 2023-07-11T00:31:03.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.962+0000 7f80407ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80380cda30 con 0x7f80380d3730 2023-07-11T00:31:03.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.962+0000 7f803dd9a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80380d3730 0x7f80380cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:03.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.962+0000 7f803e59b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f80380b8430 0x7f80380cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47650/0 (socket says 172.21.15.22:47650) 2023-07-11T00:31:03.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.962+0000 7f803e59b700 1 -- 172.21.15.22:0/3734025584 learned_addr learned my addr 172.21.15.22:0/3734025584 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:03.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.963+0000 7f803dd9a700 1 -- 172.21.15.22:0/3734025584 >> v1:172.21.15.184:6789/0 conn(0x7f80380cfa90 legacy=0x7f80380d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:03.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.963+0000 7f803dd9a700 1 -- 172.21.15.22:0/3734025584 >> v1:172.21.15.22:6789/0 conn(0x7f80380b8430 legacy=0x7f80380cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:03.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.963+0000 7f803dd9a700 1 -- 172.21.15.22:0/3734025584 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80380b4ee0 con 0x7f80380d3730 2023-07-11T00:31:03.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.963+0000 7f803dd9a700 1 --2- 172.21.15.22:0/3734025584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80380d3730 0x7f80380cf550 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8028009840 tx=0x7f8028009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80f1f2e31598bf server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:03.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.963+0000 7f803d599700 1 -- 172.21.15.22:0/3734025584 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028011830 con 0x7f80380d3730 2023-07-11T00:31:03.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.963+0000 7f803d599700 1 -- 172.21.15.22:0/3734025584 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8028011990 con 0x7f80380d3730 2023-07-11T00:31:03.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.963+0000 7f803d599700 1 -- 172.21.15.22:0/3734025584 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028011d20 con 0x7f80380d3730 2023-07-11T00:31:03.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.964+0000 7f80407ff700 1 -- 172.21.15.22:0/3734025584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80380d3730 msgr2=0x7f80380cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:03.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.964+0000 7f80407ff700 1 --2- 172.21.15.22:0/3734025584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80380d3730 0x7f80380cf550 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8028009840 tx=0x7f8028009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:03.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.964+0000 7f80407ff700 1 -- 172.21.15.22:0/3734025584 shutdown_connections 2023-07-11T00:31:03.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.964+0000 7f80407ff700 1 --2- 172.21.15.22:0/3734025584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80380d3730 0x7f80380cf550 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.964+0000 7f80407ff700 1 -- 172.21.15.22:0/3734025584 >> 172.21.15.22:0/3734025584 conn(0x7f803806b3f0 msgr2=0x7f803806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.964+0000 7f80407ff700 1 -- 172.21.15.22:0/3734025584 shutdown_connections 2023-07-11T00:31:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.964+0000 7f80407ff700 1 -- 172.21.15.22:0/3734025584 wait complete. 2023-07-11T00:31:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.966+0000 7f80407ff700 1 Processor -- start 2023-07-11T00:31:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.966+0000 7f80407ff700 1 -- start start 2023-07-11T00:31:03.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.968+0000 7f80407ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80380b8430 0x7f80380c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:03.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.968+0000 7f80407ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80380cfa90 0x7f803814cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:03.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.968+0000 7f80407ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80380d3730 0x7f80380c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:03.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.968+0000 7f80407ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80380c9560 con 0x7f80380cfa90 2023-07-11T00:31:03.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.968+0000 7f80407ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80380c7f80 con 0x7f80380b8430 2023-07-11T00:31:03.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.968+0000 7f80407ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80380c8260 con 0x7f80380d3730 2023-07-11T00:31:03.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.968+0000 7f803dd9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80380cfa90 0x7f803814cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:03.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.968+0000 7f803dd9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80380cfa90 0x7f803814cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55288/0 (socket says 172.21.15.22:55288) 2023-07-11T00:31:03.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.968+0000 7f803dd9a700 1 -- 172.21.15.22:0/2563193230 learned_addr learned my addr 172.21.15.22:0/2563193230 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:03.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.968+0000 7f803e59b700 1 --2- 172.21.15.22:0/2563193230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80380b8430 0x7f80380c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:03.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.968+0000 7f803ed9c700 1 --2- 172.21.15.22:0/2563193230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80380d3730 0x7f80380c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:03.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.968+0000 7f803dd9a700 1 -- 172.21.15.22:0/2563193230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80380d3730 msgr2=0x7f80380c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:03.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.968+0000 7f803dd9a700 1 --2- 172.21.15.22:0/2563193230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80380d3730 0x7f80380c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:03.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.968+0000 7f803dd9a700 1 -- 172.21.15.22:0/2563193230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80380b8430 msgr2=0x7f80380c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:03.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.968+0000 7f803dd9a700 1 --2- 172.21.15.22:0/2563193230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80380b8430 0x7f80380c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:03.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.968+0000 7f803dd9a700 1 -- 172.21.15.22:0/2563193230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80280094a0 con 0x7f80380cfa90 2023-07-11T00:31:03.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.968+0000 7f803e59b700 1 --2- 172.21.15.22:0/2563193230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80380b8430 0x7f80380c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:03.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.969+0000 7f803dd9a700 1 --2- 172.21.15.22:0/2563193230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80380cfa90 0x7f803814cf10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8028000c00 tx=0x7f8028004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:03.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.969+0000 7f802effd700 1 -- 172.21.15.22:0/2563193230 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80280038a0 con 0x7f80380cfa90 2023-07-11T00:31:03.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.969+0000 7f802effd700 1 -- 172.21.15.22:0/2563193230 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802801e070 con 0x7f80380cfa90 2023-07-11T00:31:03.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.969+0000 7f80407ff700 1 -- 172.21.15.22:0/2563193230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80380c8540 con 0x7f80380cfa90 2023-07-11T00:31:03.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.969+0000 7f802effd700 1 -- 172.21.15.22:0/2563193230 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028003c60 con 0x7f80380cfa90 2023-07-11T00:31:03.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.969+0000 7f80407ff700 1 -- 172.21.15.22:0/2563193230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80380c8b00 con 0x7f80380cfa90 2023-07-11T00:31:03.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.970+0000 7f80407ff700 1 -- 172.21.15.22:0/2563193230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80380c8cf0 con 0x7f80380cfa90 2023-07-11T00:31:03.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.971+0000 7f802effd700 1 -- 172.21.15.22:0/2563193230 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f802802d450 con 0x7f80380cfa90 2023-07-11T00:31:03.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.972+0000 7f802effd700 1 --2- 172.21.15.22:0/2563193230 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f801c06ace0 0x7f801c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:03.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.972+0000 7f802effd700 1 -- 172.21.15.22:0/2563193230 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f802808a900 con 0x7f80380cfa90 2023-07-11T00:31:03.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.973+0000 7f803e59b700 1 --2- 172.21.15.22:0/2563193230 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f801c06ace0 0x7f801c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:03.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.973+0000 7f803e59b700 1 --2- 172.21.15.22:0/2563193230 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f801c06ace0 0x7f801c06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8034007fd0 tx=0x7f8034009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:03.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:03.977+0000 7f802effd700 1 -- 172.21.15.22:0/2563193230 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8028055670 con 0x7f80380cfa90 2023-07-11T00:31:04.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.185+0000 7f80407ff700 1 -- 172.21.15.22:0/2563193230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f803804ea60 con 0x7f80380cfa90 2023-07-11T00:31:04.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.185+0000 7f802effd700 1 -- 172.21.15.22:0/2563193230 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8028058c90 con 0x7f80380cfa90 2023-07-11T00:31:04.188 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2023-07-11T00:31:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.188+0000 7f80407ff700 1 -- 172.21.15.22:0/2563193230 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f801c06ace0 msgr2=0x7f801c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.188+0000 7f80407ff700 1 --2- 172.21.15.22:0/2563193230 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f801c06ace0 0x7f801c06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8034007fd0 tx=0x7f8034009040 comp rx=0 tx=0).stop 2023-07-11T00:31:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.188+0000 7f80407ff700 1 -- 172.21.15.22:0/2563193230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80380cfa90 msgr2=0x7f803814cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.188+0000 7f80407ff700 1 --2- 172.21.15.22:0/2563193230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80380cfa90 0x7f803814cf10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8028000c00 tx=0x7f8028004750 comp rx=0 tx=0).stop 2023-07-11T00:31:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.188+0000 7f80407ff700 1 -- 172.21.15.22:0/2563193230 shutdown_connections 2023-07-11T00:31:04.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.188+0000 7f80407ff700 1 --2- 172.21.15.22:0/2563193230 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f801c06ace0 0x7f801c06d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.188+0000 7f80407ff700 1 --2- 172.21.15.22:0/2563193230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80380d3730 0x7f80380c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.188+0000 7f80407ff700 1 --2- 172.21.15.22:0/2563193230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80380b8430 0x7f80380c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.188+0000 7f80407ff700 1 --2- 172.21.15.22:0/2563193230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80380cfa90 0x7f803814cf10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.188+0000 7f80407ff700 1 -- 172.21.15.22:0/2563193230 >> 172.21.15.22:0/2563193230 conn(0x7f803806b3f0 msgr2=0x7f803806b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.188+0000 7f80407ff700 1 -- 172.21.15.22:0/2563193230 shutdown_connections 2023-07-11T00:31:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.188+0000 7f80407ff700 1 -- 172.21.15.22:0/2563193230 wait complete. 2023-07-11T00:31:04.208 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:31:04.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.412+0000 7f1ef8bff700 1 Processor -- start 2023-07-11T00:31:04.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.412+0000 7f1ef8bff700 1 -- start start 2023-07-11T00:31:04.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.413+0000 7f1ef8bff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1ef40b8430 0x7f1ef40cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:04.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.413+0000 7f1ef8bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ef40cfc60 0x7f1ef40d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:04.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.413+0000 7f1ef8bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef40d0b20 con 0x7f1ef40d3730 2023-07-11T00:31:04.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.413+0000 7f1ef8bff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef40b8800 con 0x7f1ef40b8430 2023-07-11T00:31:04.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.413+0000 7f1ef8bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef40b4ee0 con 0x7f1ef40cfc60 2023-07-11T00:31:04.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.414+0000 7f1ef259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1ef40b8430 0x7f1ef40cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:04.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.414+0000 7f1ef259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1ef40b8430 0x7f1ef40cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55304/0 (socket says 172.21.15.22:55304) 2023-07-11T00:31:04.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.414+0000 7f1ef259c700 1 -- 172.21.15.22:0/1406912304 learned_addr learned my addr 172.21.15.22:0/1406912304 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:04.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.414+0000 7f1ef2d9d700 1 --2- 172.21.15.22:0/1406912304 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ef40cfc60 0x7f1ef40d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:04.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.414+0000 7f1ef259c700 1 -- 172.21.15.22:0/1406912304 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ef40cfc60 msgr2=0x7f1ef40d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:04.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.414+0000 7f1ef259c700 1 --2- 172.21.15.22:0/1406912304 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ef40cfc60 0x7f1ef40d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.414+0000 7f1ef259c700 1 -- 172.21.15.22:0/1406912304 >> v1:172.21.15.184:6789/0 conn(0x7f1ef40d3730 legacy=0x7f1ef40cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:04.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.414+0000 7f1ef259c700 1 -- 172.21.15.22:0/1406912304 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef40b51c0 con 0x7f1ef40b8430 2023-07-11T00:31:04.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.414+0000 7f1ef259c700 1 --2- 172.21.15.22:0/1406912304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef40b8430 0x7f1ef40cd320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40098f0 tx=0x7f1ee4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94494df660181067 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:04.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.415+0000 7f1ef159a700 1 -- 172.21.15.22:0/1406912304 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee400b8a0 con 0x7f1ef40b8430 2023-07-11T00:31:04.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.415+0000 7f1ef159a700 1 -- 172.21.15.22:0/1406912304 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee400ba00 con 0x7f1ef40b8430 2023-07-11T00:31:04.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.415+0000 7f1ef159a700 1 -- 172.21.15.22:0/1406912304 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee400bd90 con 0x7f1ef40b8430 2023-07-11T00:31:04.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.415+0000 7f1ef8bff700 1 -- 172.21.15.22:0/1406912304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef40b8430 msgr2=0x7f1ef40cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:04.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.415+0000 7f1ef8bff700 1 --2- 172.21.15.22:0/1406912304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef40b8430 0x7f1ef40cd320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40098f0 tx=0x7f1ee4009c00 comp rx=0 tx=0).stop 2023-07-11T00:31:04.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.415+0000 7f1ef8bff700 1 -- 172.21.15.22:0/1406912304 shutdown_connections 2023-07-11T00:31:04.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.415+0000 7f1ef8bff700 1 --2- 172.21.15.22:0/1406912304 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ef40cfc60 0x7f1ef40d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.415+0000 7f1ef8bff700 1 --2- 172.21.15.22:0/1406912304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef40b8430 0x7f1ef40cd320 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.415+0000 7f1ef8bff700 1 -- 172.21.15.22:0/1406912304 >> 172.21.15.22:0/1406912304 conn(0x7f1ef406b3f0 msgr2=0x7f1ef406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:04.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.415+0000 7f1ef8bff700 1 -- 172.21.15.22:0/1406912304 shutdown_connections 2023-07-11T00:31:04.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.415+0000 7f1ef8bff700 1 -- 172.21.15.22:0/1406912304 wait complete. 2023-07-11T00:31:04.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.418+0000 7f1ef8bff700 1 Processor -- start 2023-07-11T00:31:04.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.418+0000 7f1ef8bff700 1 -- start start 2023-07-11T00:31:04.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.419+0000 7f1ef8bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ef40b8430 0x7f1ef414be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:04.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.419+0000 7f1ef8bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef40cfc60 0x7f1ef415d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:04.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.419+0000 7f1ef8bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ef40d3730 0x7f1ef40c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:04.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.419+0000 7f1ef8bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef40cb040 con 0x7f1ef40cfc60 2023-07-11T00:31:04.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.419+0000 7f1ef8bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef40cb8e0 con 0x7f1ef40b8430 2023-07-11T00:31:04.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.419+0000 7f1ef8bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef415db20 con 0x7f1ef40d3730 2023-07-11T00:31:04.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.419+0000 7f1ef1d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef40cfc60 0x7f1ef415d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:04.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.420+0000 7f1ef1d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef40cfc60 0x7f1ef415d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55306/0 (socket says 172.21.15.22:55306) 2023-07-11T00:31:04.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.420+0000 7f1ef1d9b700 1 -- 172.21.15.22:0/615611788 learned_addr learned my addr 172.21.15.22:0/615611788 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:04.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.420+0000 7f1ef259c700 1 --2- 172.21.15.22:0/615611788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ef40b8430 0x7f1ef414be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:04.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.420+0000 7f1ef2d9d700 1 --2- 172.21.15.22:0/615611788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ef40d3730 0x7f1ef40c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:04.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.420+0000 7f1ef1d9b700 1 -- 172.21.15.22:0/615611788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ef40d3730 msgr2=0x7f1ef40c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:04.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.420+0000 7f1ef1d9b700 1 --2- 172.21.15.22:0/615611788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ef40d3730 0x7f1ef40c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.420+0000 7f1ef1d9b700 1 -- 172.21.15.22:0/615611788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ef40b8430 msgr2=0x7f1ef414be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:04.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.420+0000 7f1ef1d9b700 1 --2- 172.21.15.22:0/615611788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ef40b8430 0x7f1ef414be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.420+0000 7f1ef1d9b700 1 -- 172.21.15.22:0/615611788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee4009550 con 0x7f1ef40cfc60 2023-07-11T00:31:04.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.420+0000 7f1ef1d9b700 1 --2- 172.21.15.22:0/615611788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef40cfc60 0x7f1ef415d110 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800c4e0 tx=0x7f1ee800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:04.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.420+0000 7f1ee2ffd700 1 -- 172.21.15.22:0/615611788 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80052d0 con 0x7f1ef40cfc60 2023-07-11T00:31:04.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.420+0000 7f1ee2ffd700 1 -- 172.21.15.22:0/615611788 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee8005430 con 0x7f1ef40cfc60 2023-07-11T00:31:04.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.420+0000 7f1ee2ffd700 1 -- 172.21.15.22:0/615611788 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80038c0 con 0x7f1ef40cfc60 2023-07-11T00:31:04.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.420+0000 7f1ef8bff700 1 -- 172.21.15.22:0/615611788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef40cb290 con 0x7f1ef40cfc60 2023-07-11T00:31:04.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.421+0000 7f1ef8bff700 1 -- 172.21.15.22:0/615611788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef414c3b0 con 0x7f1ef40cfc60 2023-07-11T00:31:04.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.422+0000 7f1ef8bff700 1 -- 172.21.15.22:0/615611788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef414c570 con 0x7f1ef40cfc60 2023-07-11T00:31:04.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.422+0000 7f1ee2ffd700 1 -- 172.21.15.22:0/615611788 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ee8003a20 con 0x7f1ef40cfc60 2023-07-11T00:31:04.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.423+0000 7f1ee2ffd700 1 --2- 172.21.15.22:0/615611788 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1ed406ace0 0x7f1ed406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:04.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.423+0000 7f1ee2ffd700 1 -- 172.21.15.22:0/615611788 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1ee8088b20 con 0x7f1ef40cfc60 2023-07-11T00:31:04.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.424+0000 7f1ef259c700 1 --2- 172.21.15.22:0/615611788 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1ed406ace0 0x7f1ed406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:04.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.425+0000 7f1ef259c700 1 --2- 172.21.15.22:0/615611788 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1ed406ace0 0x7f1ed406d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4014040 tx=0x7f1ee4008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:04.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.427+0000 7f1ee2ffd700 1 -- 172.21.15.22:0/615611788 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1ee8053890 con 0x7f1ef40cfc60 2023-07-11T00:31:04.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.633+0000 7f1ef8bff700 1 -- 172.21.15.22:0/615611788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1ef40cba50 con 0x7f1ef40cfc60 2023-07-11T00:31:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.633+0000 7f1ee2ffd700 1 -- 172.21.15.22:0/615611788 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1ee8056eb0 con 0x7f1ef40cfc60 2023-07-11T00:31:04.636 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-07-11T00:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.635+0000 7f1ef8bff700 1 -- 172.21.15.22:0/615611788 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1ed406ace0 msgr2=0x7f1ed406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.635+0000 7f1ef8bff700 1 --2- 172.21.15.22:0/615611788 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1ed406ace0 0x7f1ed406d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4014040 tx=0x7f1ee4008030 comp rx=0 tx=0).stop 2023-07-11T00:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.635+0000 7f1ef8bff700 1 -- 172.21.15.22:0/615611788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef40cfc60 msgr2=0x7f1ef415d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.635+0000 7f1ef8bff700 1 --2- 172.21.15.22:0/615611788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef40cfc60 0x7f1ef415d110 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800c4e0 tx=0x7f1ee800c7f0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.636+0000 7f1ef8bff700 1 -- 172.21.15.22:0/615611788 shutdown_connections 2023-07-11T00:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.636+0000 7f1ef8bff700 1 --2- 172.21.15.22:0/615611788 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1ed406ace0 0x7f1ed406d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.636+0000 7f1ef8bff700 1 --2- 172.21.15.22:0/615611788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ef40d3730 0x7f1ef40c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.636+0000 7f1ef8bff700 1 --2- 172.21.15.22:0/615611788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ef40b8430 0x7f1ef414be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.636+0000 7f1ef8bff700 1 --2- 172.21.15.22:0/615611788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef40cfc60 0x7f1ef415d110 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.636+0000 7f1ef8bff700 1 -- 172.21.15.22:0/615611788 >> 172.21.15.22:0/615611788 conn(0x7f1ef406b3f0 msgr2=0x7f1ef40b7850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.636+0000 7f1ef8bff700 1 -- 172.21.15.22:0/615611788 shutdown_connections 2023-07-11T00:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.636+0000 7f1ef8bff700 1 -- 172.21.15.22:0/615611788 wait complete. 2023-07-11T00:31:04.656 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:31:04.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.857+0000 7fa0d23ff700 1 Processor -- start 2023-07-11T00:31:04.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.857+0000 7fa0d23ff700 1 -- start start 2023-07-11T00:31:04.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.858+0000 7fa0d23ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa0cc0b8430 0x7fa0cc0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:04.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.858+0000 7fa0d23ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0cc0d3730 0x7fa0cc0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:04.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.858+0000 7fa0d23ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0cc0d0b20 con 0x7fa0cc0cfa90 2023-07-11T00:31:04.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.858+0000 7fa0d23ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0cc0b8800 con 0x7fa0cc0b8430 2023-07-11T00:31:04.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.858+0000 7fa0d23ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc0cfeb0 con 0x7fa0cc0d3730 2023-07-11T00:31:04.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.859+0000 7fa0d099c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa0cc0cfa90 0x7fa0cc15feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47660/0 (socket says 172.21.15.22:47660) 2023-07-11T00:31:04.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.859+0000 7fa0d099c700 1 -- 172.21.15.22:0/1309454307 learned_addr learned my addr 172.21.15.22:0/1309454307 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:04.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.859+0000 7fa0cbfff700 1 --2- 172.21.15.22:0/1309454307 >> v2:172.21.15.184:3300/0 conn(0x7fa0cc0b8430 0x7fa0cc0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:04.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.859+0000 7fa0cb7fe700 1 --2- 172.21.15.22:0/1309454307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0cc0d3730 0x7fa0cc0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:04.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.859+0000 7fa0caffd700 1 -- 172.21.15.22:0/1309454307 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2323191492 0 0) 0x7fa0cc0d0b20 con 0x7fa0cc0cfa90 2023-07-11T00:31:04.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.859+0000 7fa0caffd700 1 -- 172.21.15.22:0/1309454307 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0b40035b0 con 0x7fa0cc0cfa90 2023-07-11T00:31:04.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.859+0000 7fa0cbfff700 1 -- 172.21.15.22:0/1309454307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0cc0d3730 msgr2=0x7fa0cc0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:04.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.859+0000 7fa0cbfff700 1 --2- 172.21.15.22:0/1309454307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0cc0d3730 0x7fa0cc0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.859+0000 7fa0cbfff700 1 -- 172.21.15.22:0/1309454307 >> v1:172.21.15.22:6789/0 conn(0x7fa0cc0cfa90 legacy=0x7fa0cc15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:04.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.859+0000 7fa0cbfff700 1 -- 172.21.15.22:0/1309454307 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc0b4ee0 con 0x7fa0cc0b8430 2023-07-11T00:31:04.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.859+0000 7fa0cb7fe700 1 --2- 172.21.15.22:0/1309454307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0cc0d3730 0x7fa0cc0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:04.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.860+0000 7fa0cbfff700 1 --2- 172.21.15.22:0/1309454307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0cc0b8430 0x7fa0cc0cd320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc009840 tx=0x7fa0bc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed9e169495475e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:04.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.860+0000 7fa0caffd700 1 -- 172.21.15.22:0/1309454307 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc011830 con 0x7fa0cc0b8430 2023-07-11T00:31:04.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.860+0000 7fa0caffd700 1 -- 172.21.15.22:0/1309454307 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc011990 con 0x7fa0cc0b8430 2023-07-11T00:31:04.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.860+0000 7fa0caffd700 1 -- 172.21.15.22:0/1309454307 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc011d20 con 0x7fa0cc0b8430 2023-07-11T00:31:04.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.860+0000 7fa0d23ff700 1 -- 172.21.15.22:0/1309454307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0cc0b8430 msgr2=0x7fa0cc0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:04.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.860+0000 7fa0d23ff700 1 --2- 172.21.15.22:0/1309454307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0cc0b8430 0x7fa0cc0cd320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc009840 tx=0x7fa0bc009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:04.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.860+0000 7fa0d23ff700 1 -- 172.21.15.22:0/1309454307 shutdown_connections 2023-07-11T00:31:04.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.860+0000 7fa0d23ff700 1 --2- 172.21.15.22:0/1309454307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0cc0b8430 0x7fa0cc0cd320 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.860+0000 7fa0d23ff700 1 --2- 172.21.15.22:0/1309454307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0cc0d3730 0x7fa0cc0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.860+0000 7fa0d23ff700 1 -- 172.21.15.22:0/1309454307 >> 172.21.15.22:0/1309454307 conn(0x7fa0cc06b3f0 msgr2=0x7fa0cc06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:04.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.861+0000 7fa0d23ff700 1 -- 172.21.15.22:0/1309454307 shutdown_connections 2023-07-11T00:31:04.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.861+0000 7fa0d23ff700 1 -- 172.21.15.22:0/1309454307 wait complete. 2023-07-11T00:31:04.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.862+0000 7fa0d23ff700 1 Processor -- start 2023-07-11T00:31:04.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.862+0000 7fa0d23ff700 1 -- start start 2023-07-11T00:31:04.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.863+0000 7fa0d23ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0cc0b8430 0x7fa0cc1540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:04.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.863+0000 7fa0d23ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0cc0cfa90 0x7fa0cc0c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:04.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.863+0000 7fa0d23ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0cc0d3730 0x7fa0cc0cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:04.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.863+0000 7fa0d23ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc154610 con 0x7fa0cc0cfa90 2023-07-11T00:31:04.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.863+0000 7fa0d23ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc0c7050 con 0x7fa0cc0b8430 2023-07-11T00:31:04.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.863+0000 7fa0d23ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc0c7330 con 0x7fa0cc0d3730 2023-07-11T00:31:04.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.864+0000 7fa0cb7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0cc0cfa90 0x7fa0cc0c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:04.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.864+0000 7fa0cb7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0cc0cfa90 0x7fa0cc0c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55316/0 (socket says 172.21.15.22:55316) 2023-07-11T00:31:04.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.864+0000 7fa0cb7fe700 1 -- 172.21.15.22:0/2590572062 learned_addr learned my addr 172.21.15.22:0/2590572062 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:04.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.864+0000 7fa0cbfff700 1 --2- 172.21.15.22:0/2590572062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0cc0b8430 0x7fa0cc1540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:04.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.864+0000 7fa0d099c700 1 --2- 172.21.15.22:0/2590572062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0cc0d3730 0x7fa0cc0cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:04.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.864+0000 7fa0cb7fe700 1 -- 172.21.15.22:0/2590572062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0cc0d3730 msgr2=0x7fa0cc0cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:04.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.864+0000 7fa0cb7fe700 1 --2- 172.21.15.22:0/2590572062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0cc0d3730 0x7fa0cc0cab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.864+0000 7fa0cb7fe700 1 -- 172.21.15.22:0/2590572062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0cc0b8430 msgr2=0x7fa0cc1540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.864+0000 7fa0cb7fe700 1 --2- 172.21.15.22:0/2590572062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0cc0b8430 0x7fa0cc1540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.864+0000 7fa0cb7fe700 1 -- 172.21.15.22:0/2590572062 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c00094a0 con 0x7fa0cc0cfa90 2023-07-11T00:31:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.864+0000 7fa0cb7fe700 1 --2- 172.21.15.22:0/2590572062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0cc0cfa90 0x7fa0cc0c6670 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000ebe0 tx=0x7fa0c000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.865+0000 7fa0c8ff9700 1 -- 172.21.15.22:0/2590572062 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c000c850 con 0x7fa0cc0cfa90 2023-07-11T00:31:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.865+0000 7fa0c8ff9700 1 -- 172.21.15.22:0/2590572062 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c000c9b0 con 0x7fa0cc0cfa90 2023-07-11T00:31:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.865+0000 7fa0d23ff700 1 -- 172.21.15.22:0/2590572062 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0bc0094a0 con 0x7fa0cc0cfa90 2023-07-11T00:31:04.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.865+0000 7fa0c8ff9700 1 -- 172.21.15.22:0/2590572062 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c000cd40 con 0x7fa0cc0cfa90 2023-07-11T00:31:04.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.865+0000 7fa0d23ff700 1 -- 172.21.15.22:0/2590572062 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0cc0ca660 con 0x7fa0cc0cfa90 2023-07-11T00:31:04.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.866+0000 7fa0d23ff700 1 -- 172.21.15.22:0/2590572062 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0cc04ea60 con 0x7fa0cc0cfa90 2023-07-11T00:31:04.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.867+0000 7fa0c8ff9700 1 -- 172.21.15.22:0/2590572062 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa0c0013470 con 0x7fa0cc0cfa90 2023-07-11T00:31:04.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.868+0000 7fa0c8ff9700 1 --2- 172.21.15.22:0/2590572062 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa0b806ace0 0x7fa0b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:04.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.868+0000 7fa0c8ff9700 1 -- 172.21.15.22:0/2590572062 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa0c0089900 con 0x7fa0cc0cfa90 2023-07-11T00:31:04.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.868+0000 7fa0cbfff700 1 --2- 172.21.15.22:0/2590572062 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa0b806ace0 0x7fa0b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:04.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.869+0000 7fa0cbfff700 1 --2- 172.21.15.22:0/2590572062 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa0b806ace0 0x7fa0b806d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc000c00 tx=0x7fa0bc01c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:04.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:04.872+0000 7fa0c8ff9700 1 -- 172.21.15.22:0/2590572062 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa0c00545e0 con 0x7fa0cc0cfa90 2023-07-11T00:31:05.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.079+0000 7fa0d23ff700 1 -- 172.21.15.22:0/2590572062 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0cc15af70 con 0x7fa0cc0cfa90 2023-07-11T00:31:05.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.079+0000 7fa0c8ff9700 1 -- 172.21.15.22:0/2590572062 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa0c000cea0 con 0x7fa0cc0cfa90 2023-07-11T00:31:05.083 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:05.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.082+0000 7fa0d23ff700 1 -- 172.21.15.22:0/2590572062 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa0b806ace0 msgr2=0x7fa0b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:05.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.082+0000 7fa0d23ff700 1 --2- 172.21.15.22:0/2590572062 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa0b806ace0 0x7fa0b806d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc000c00 tx=0x7fa0bc01c040 comp rx=0 tx=0).stop 2023-07-11T00:31:05.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.082+0000 7fa0d23ff700 1 -- 172.21.15.22:0/2590572062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0cc0cfa90 msgr2=0x7fa0cc0c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:05.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.082+0000 7fa0d23ff700 1 --2- 172.21.15.22:0/2590572062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0cc0cfa90 0x7fa0cc0c6670 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000ebe0 tx=0x7fa0c000eef0 comp rx=0 tx=0).stop 2023-07-11T00:31:05.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.082+0000 7fa0d23ff700 1 -- 172.21.15.22:0/2590572062 shutdown_connections 2023-07-11T00:31:05.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.082+0000 7fa0d23ff700 1 --2- 172.21.15.22:0/2590572062 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa0b806ace0 0x7fa0b806d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:05.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.082+0000 7fa0d23ff700 1 --2- 172.21.15.22:0/2590572062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0cc0d3730 0x7fa0cc0cab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:05.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.082+0000 7fa0d23ff700 1 --2- 172.21.15.22:0/2590572062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0cc0b8430 0x7fa0cc1540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:05.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.082+0000 7fa0d23ff700 1 --2- 172.21.15.22:0/2590572062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0cc0cfa90 0x7fa0cc0c6670 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:05.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.082+0000 7fa0d23ff700 1 -- 172.21.15.22:0/2590572062 >> 172.21.15.22:0/2590572062 conn(0x7fa0cc06b3f0 msgr2=0x7fa0cc0b7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:05.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.082+0000 7fa0d23ff700 1 -- 172.21.15.22:0/2590572062 shutdown_connections 2023-07-11T00:31:05.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.082+0000 7fa0d23ff700 1 -- 172.21.15.22:0/2590572062 wait complete. 2023-07-11T00:31:05.102 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:31:05.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.305+0000 7f18dfbff700 1 Processor -- start 2023-07-11T00:31:05.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.305+0000 7f18dfbff700 1 -- start start 2023-07-11T00:31:05.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.306+0000 7f18dfbff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f18d806e130 0x7f18d80cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:05.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.306+0000 7f18dfbff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f18d806a640 0x7f18d81573f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:05.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.307+0000 7f18dfbff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d80cb000 con 0x7f18d80b3ec0 2023-07-11T00:31:05.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.307+0000 7f18dfbff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d80ca8d0 con 0x7f18d806a640 2023-07-11T00:31:05.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.307+0000 7f18dfbff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d815b6c0 con 0x7f18d806e130 2023-07-11T00:31:05.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.307+0000 7f18de19c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f18d806a640 0x7f18d81573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:05.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.307+0000 7f18de19c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f18d806a640 0x7f18d81573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55318/0 (socket says 172.21.15.22:55318) 2023-07-11T00:31:05.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.307+0000 7f18de19c700 1 -- 172.21.15.22:0/384764856 learned_addr learned my addr 172.21.15.22:0/384764856 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:05.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.307+0000 7f18de19c700 1 -- 172.21.15.22:0/384764856 >> v2:172.21.15.184:3300/0 conn(0x7f18d806e130 msgr2=0x7f18d80cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:05.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.307+0000 7f18de19c700 1 --2- 172.21.15.22:0/384764856 >> v2:172.21.15.184:3300/0 conn(0x7f18d806e130 0x7f18d80cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:05.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.307+0000 7f18de19c700 1 -- 172.21.15.22:0/384764856 >> v1:172.21.15.184:6789/0 conn(0x7f18d80b3ec0 legacy=0x7f18d8069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:05.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.307+0000 7f18de19c700 1 -- 172.21.15.22:0/384764856 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d80c9460 con 0x7f18d806a640 2023-07-11T00:31:05.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.307+0000 7f18de19c700 1 --2- 172.21.15.22:0/384764856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d806a640 0x7f18d81573f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f18d80ca360 tx=0x7f18d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6e7e18b877fe7d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:05.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.308+0000 7f18dc999700 1 -- 172.21.15.22:0/384764856 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d000e070 con 0x7f18d806a640 2023-07-11T00:31:05.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.308+0000 7f18dc999700 1 -- 172.21.15.22:0/384764856 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d0003a20 con 0x7f18d806a640 2023-07-11T00:31:05.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.308+0000 7f18dc999700 1 -- 172.21.15.22:0/384764856 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0003dd0 con 0x7f18d806a640 2023-07-11T00:31:05.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.308+0000 7f18dfbff700 1 -- 172.21.15.22:0/384764856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d806a640 msgr2=0x7f18d81573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:05.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.308+0000 7f18dfbff700 1 --2- 172.21.15.22:0/384764856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d806a640 0x7f18d81573f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f18d80ca360 tx=0x7f18d000b330 comp rx=0 tx=0).stop 2023-07-11T00:31:05.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.308+0000 7f18dfbff700 1 -- 172.21.15.22:0/384764856 shutdown_connections 2023-07-11T00:31:05.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.308+0000 7f18dfbff700 1 --2- 172.21.15.22:0/384764856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d806a640 0x7f18d81573f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:05.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.308+0000 7f18dfbff700 1 --2- 172.21.15.22:0/384764856 >> v2:172.21.15.184:3300/0 conn(0x7f18d806e130 0x7f18d80cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:05.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.308+0000 7f18dfbff700 1 -- 172.21.15.22:0/384764856 >> 172.21.15.22:0/384764856 conn(0x7f18d80b0fd0 msgr2=0x7f18d80ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:05.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.308+0000 7f18dfbff700 1 -- 172.21.15.22:0/384764856 shutdown_connections 2023-07-11T00:31:05.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.308+0000 7f18dfbff700 1 -- 172.21.15.22:0/384764856 wait complete. 2023-07-11T00:31:05.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.310+0000 7f18dfbff700 1 Processor -- start 2023-07-11T00:31:05.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.310+0000 7f18dfbff700 1 -- start start 2023-07-11T00:31:05.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.311+0000 7f18dfbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18d806a640 0x7f18d80c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:05.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.311+0000 7f18dfbff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d806e130 0x7f18d81466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:05.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.311+0000 7f18dfbff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18d80b3ec0 0x7f18d80cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:05.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.311+0000 7f18dfbff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d8146c30 con 0x7f18d806e130 2023-07-11T00:31:05.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.311+0000 7f18dfbff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80c78b0 con 0x7f18d80b3ec0 2023-07-11T00:31:05.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.311+0000 7f18dfbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80c6440 con 0x7f18d806a640 2023-07-11T00:31:05.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.311+0000 7f18dd19a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d806e130 0x7f18d81466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:05.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.312+0000 7f18dd19a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d806e130 0x7f18d81466f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55320/0 (socket says 172.21.15.22:55320) 2023-07-11T00:31:05.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.312+0000 7f18dd19a700 1 -- 172.21.15.22:0/3121525604 learned_addr learned my addr 172.21.15.22:0/3121525604 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:05.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.312+0000 7f18dd99b700 1 --2- 172.21.15.22:0/3121525604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18d806a640 0x7f18d80c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:05.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.312+0000 7f18de19c700 1 --2- 172.21.15.22:0/3121525604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18d80b3ec0 0x7f18d80cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:05.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.312+0000 7f18dd19a700 1 -- 172.21.15.22:0/3121525604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18d806a640 msgr2=0x7f18d80c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:05.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.312+0000 7f18dd19a700 1 --2- 172.21.15.22:0/3121525604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18d806a640 0x7f18d80c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:05.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.312+0000 7f18dd19a700 1 -- 172.21.15.22:0/3121525604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18d80b3ec0 msgr2=0x7f18d80cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:05.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.312+0000 7f18dd19a700 1 --2- 172.21.15.22:0/3121525604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18d80b3ec0 0x7f18d80cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:05.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.312+0000 7f18dd19a700 1 -- 172.21.15.22:0/3121525604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d0009b30 con 0x7f18d806e130 2023-07-11T00:31:05.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.312+0000 7f18dd19a700 1 --2- 172.21.15.22:0/3121525604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d806e130 0x7f18d81466f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f18c800b530 tx=0x7f18c800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:05.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.312+0000 7f18ce7fc700 1 -- 172.21.15.22:0/3121525604 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8011830 con 0x7f18d806e130 2023-07-11T00:31:05.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.313+0000 7f18ce7fc700 1 -- 172.21.15.22:0/3121525604 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c8011990 con 0x7f18d806e130 2023-07-11T00:31:05.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.313+0000 7f18dfbff700 1 -- 172.21.15.22:0/3121525604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d80c7b30 con 0x7f18d806e130 2023-07-11T00:31:05.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.313+0000 7f18ce7fc700 1 -- 172.21.15.22:0/3121525604 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8011d40 con 0x7f18d806e130 2023-07-11T00:31:05.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.313+0000 7f18dfbff700 1 -- 172.21.15.22:0/3121525604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d80c7df0 con 0x7f18d806e130 2023-07-11T00:31:05.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.314+0000 7f18dfbff700 1 -- 172.21.15.22:0/3121525604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d8066a70 con 0x7f18d806e130 2023-07-11T00:31:05.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.315+0000 7f18ce7fc700 1 -- 172.21.15.22:0/3121525604 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f18c801a400 con 0x7f18d806e130 2023-07-11T00:31:05.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.316+0000 7f18ce7fc700 1 --2- 172.21.15.22:0/3121525604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f18bc06ace0 0x7f18bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:05.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.316+0000 7f18ce7fc700 1 -- 172.21.15.22:0/3121525604 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f18c8089790 con 0x7f18d806e130 2023-07-11T00:31:05.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.316+0000 7f18dd99b700 1 --2- 172.21.15.22:0/3121525604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f18bc06ace0 0x7f18bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:05.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.317+0000 7f18dd99b700 1 --2- 172.21.15.22:0/3121525604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f18bc06ace0 0x7f18bc06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f18d4007fd0 tx=0x7f18d4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:05.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.320+0000 7f18ce7fc700 1 -- 172.21.15.22:0/3121525604 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f18c8054530 con 0x7f18d806e130 2023-07-11T00:31:05.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.528+0000 7f18dfbff700 1 -- 172.21.15.22:0/3121525604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18d804ea60 con 0x7f18d806e130 2023-07-11T00:31:05.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.528+0000 7f18ce7fc700 1 -- 172.21.15.22:0/3121525604 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f18c8057b50 con 0x7f18d806e130 2023-07-11T00:31:05.532 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-07-11T00:31:05.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.531+0000 7f18dfbff700 1 -- 172.21.15.22:0/3121525604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f18bc06ace0 msgr2=0x7f18bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:05.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.531+0000 7f18dfbff700 1 --2- 172.21.15.22:0/3121525604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f18bc06ace0 0x7f18bc06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f18d4007fd0 tx=0x7f18d4009040 comp rx=0 tx=0).stop 2023-07-11T00:31:05.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.531+0000 7f18dfbff700 1 -- 172.21.15.22:0/3121525604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d806e130 msgr2=0x7f18d81466f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:05.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.531+0000 7f18dfbff700 1 --2- 172.21.15.22:0/3121525604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d806e130 0x7f18d81466f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f18c800b530 tx=0x7f18c800b840 comp rx=0 tx=0).stop 2023-07-11T00:31:05.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.531+0000 7f18dfbff700 1 -- 172.21.15.22:0/3121525604 shutdown_connections 2023-07-11T00:31:05.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.531+0000 7f18dfbff700 1 --2- 172.21.15.22:0/3121525604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f18bc06ace0 0x7f18bc06d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:05.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.531+0000 7f18dfbff700 1 --2- 172.21.15.22:0/3121525604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18d806a640 0x7f18d80c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:05.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.531+0000 7f18dfbff700 1 --2- 172.21.15.22:0/3121525604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18d80b3ec0 0x7f18d80cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:05.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.531+0000 7f18dfbff700 1 --2- 172.21.15.22:0/3121525604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18d806e130 0x7f18d81466f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:05.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.531+0000 7f18dfbff700 1 -- 172.21.15.22:0/3121525604 >> 172.21.15.22:0/3121525604 conn(0x7f18d80b0fd0 msgr2=0x7f18d80705c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:05.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.531+0000 7f18dfbff700 1 -- 172.21.15.22:0/3121525604 shutdown_connections 2023-07-11T00:31:05.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.531+0000 7f18dfbff700 1 -- 172.21.15.22:0/3121525604 wait complete. 2023-07-11T00:31:05.552 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-11T00:31:05.564 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:31:05.604 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:31:05.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.766+0000 7fdfb9bff700 1 Processor -- start 2023-07-11T00:31:05.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.766+0000 7fdfb9bff700 1 -- start start 2023-07-11T00:31:05.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.767+0000 7fdfb9bff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdfb40d3730 0x7fdfb40cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:05.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.767+0000 7fdfb9bff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb40d0b20 con 0x7fdfb40b8430 2023-07-11T00:31:05.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.767+0000 7fdfb9bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb40cfe90 con 0x7fdfb40cfa90 2023-07-11T00:31:05.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.767+0000 7fdfb9bff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb40cda30 con 0x7fdfb40d3730 2023-07-11T00:31:05.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.768+0000 7fdfb2ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdfb40d3730 0x7fdfb40cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:05.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.768+0000 7fdfb37fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdfb40b8430 0x7fdfb40cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47674/0 (socket says 172.21.15.22:47674) 2023-07-11T00:31:05.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.768+0000 7fdfb37fe700 1 -- 172.21.15.22:0/2059222208 learned_addr learned my addr 172.21.15.22:0/2059222208 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:05.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.768+0000 7fdfb2ffd700 1 -- 172.21.15.22:0/2059222208 >> v1:172.21.15.184:6789/0 conn(0x7fdfb40cfa90 legacy=0x7fdfb40d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:05.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.768+0000 7fdfb2ffd700 1 -- 172.21.15.22:0/2059222208 >> v1:172.21.15.22:6789/0 conn(0x7fdfb40b8430 legacy=0x7fdfb40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:05.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.768+0000 7fdfb2ffd700 1 -- 172.21.15.22:0/2059222208 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb40b4ee0 con 0x7fdfb40d3730 2023-07-11T00:31:05.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.768+0000 7fdfb27fc700 1 -- 172.21.15.22:0/2059222208 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3896141658 0 0) 0x7fdfb40d0b20 con 0x7fdfb40b8430 2023-07-11T00:31:05.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.768+0000 7fdfb2ffd700 1 --2- 172.21.15.22:0/2059222208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfb40d3730 0x7fdfb40cf550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009840 tx=0x7fdfa8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d521f581fc75e8b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:05.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.769+0000 7fdfb27fc700 1 -- 172.21.15.22:0/2059222208 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8011830 con 0x7fdfb40d3730 2023-07-11T00:31:05.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.769+0000 7fdfb27fc700 1 -- 172.21.15.22:0/2059222208 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa8011990 con 0x7fdfb40d3730 2023-07-11T00:31:05.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.769+0000 7fdfb27fc700 1 -- 172.21.15.22:0/2059222208 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8011d20 con 0x7fdfb40d3730 2023-07-11T00:31:05.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.769+0000 7fdfb9bff700 1 -- 172.21.15.22:0/2059222208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfb40d3730 msgr2=0x7fdfb40cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:05.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.769+0000 7fdfb9bff700 1 --2- 172.21.15.22:0/2059222208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfb40d3730 0x7fdfb40cf550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009840 tx=0x7fdfa8009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:05.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.769+0000 7fdfb9bff700 1 -- 172.21.15.22:0/2059222208 shutdown_connections 2023-07-11T00:31:05.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.769+0000 7fdfb9bff700 1 --2- 172.21.15.22:0/2059222208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfb40d3730 0x7fdfb40cf550 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:05.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.769+0000 7fdfb9bff700 1 -- 172.21.15.22:0/2059222208 >> 172.21.15.22:0/2059222208 conn(0x7fdfb406b3f0 msgr2=0x7fdfb406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:05.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.769+0000 7fdfb9bff700 1 -- 172.21.15.22:0/2059222208 shutdown_connections 2023-07-11T00:31:05.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.769+0000 7fdfb9bff700 1 -- 172.21.15.22:0/2059222208 wait complete. 2023-07-11T00:31:05.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.771+0000 7fdfb9bff700 1 Processor -- start 2023-07-11T00:31:05.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.771+0000 7fdfb9bff700 1 -- start start 2023-07-11T00:31:05.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.772+0000 7fdfb9bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfb40b8430 0x7fdfb40c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:05.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.772+0000 7fdfb9bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfb40cfa90 0x7fdfb40cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:05.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.772+0000 7fdfb9bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb40d3730 0x7fdfb40d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:05.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.772+0000 7fdfb9bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb415e2c0 con 0x7fdfb40b8430 2023-07-11T00:31:05.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.772+0000 7fdfb9bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40cb250 con 0x7fdfb40d3730 2023-07-11T00:31:05.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.772+0000 7fdfb9bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40ccf20 con 0x7fdfb40cfa90 2023-07-11T00:31:05.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.772+0000 7fdfb37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfb40b8430 0x7fdfb40c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:05.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.772+0000 7fdfb37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfb40b8430 0x7fdfb40c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55338/0 (socket says 172.21.15.22:55338) 2023-07-11T00:31:05.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.772+0000 7fdfb37fe700 1 -- 172.21.15.22:0/2938902720 learned_addr learned my addr 172.21.15.22:0/2938902720 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:05.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.772+0000 7fdfb3fff700 1 --2- 172.21.15.22:0/2938902720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb40d3730 0x7fdfb40d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:05.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.773+0000 7fdfb2ffd700 1 --2- 172.21.15.22:0/2938902720 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfb40cfa90 0x7fdfb40cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:05.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.773+0000 7fdfb37fe700 1 -- 172.21.15.22:0/2938902720 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfb40cfa90 msgr2=0x7fdfb40cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:05.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.773+0000 7fdfb37fe700 1 --2- 172.21.15.22:0/2938902720 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfb40cfa90 0x7fdfb40cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:05.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.773+0000 7fdfb37fe700 1 -- 172.21.15.22:0/2938902720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb40d3730 msgr2=0x7fdfb40d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:05.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.773+0000 7fdfb37fe700 1 --2- 172.21.15.22:0/2938902720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb40d3730 0x7fdfb40d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:05.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.773+0000 7fdfb37fe700 1 -- 172.21.15.22:0/2938902720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa80094a0 con 0x7fdfb40b8430 2023-07-11T00:31:05.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.773+0000 7fdfb2ffd700 1 --2- 172.21.15.22:0/2938902720 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfb40cfa90 0x7fdfb40cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:05.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.773+0000 7fdfb37fe700 1 --2- 172.21.15.22:0/2938902720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfb40b8430 0x7fdfb40c9c10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400c550 tx=0x7fdfa400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:05.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.773+0000 7fdf9bfff700 1 -- 172.21.15.22:0/2938902720 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4004c80 con 0x7fdfb40b8430 2023-07-11T00:31:05.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.773+0000 7fdf9bfff700 1 -- 172.21.15.22:0/2938902720 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa4004e00 con 0x7fdfb40b8430 2023-07-11T00:31:05.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.773+0000 7fdfb9bff700 1 -- 172.21.15.22:0/2938902720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb40ccc40 con 0x7fdfb40b8430 2023-07-11T00:31:05.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.773+0000 7fdf9bfff700 1 -- 172.21.15.22:0/2938902720 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4007310 con 0x7fdfb40b8430 2023-07-11T00:31:05.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.773+0000 7fdfb9bff700 1 -- 172.21.15.22:0/2938902720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb415dee0 con 0x7fdfb40b8430 2023-07-11T00:31:05.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.774+0000 7fdfb9bff700 1 -- 172.21.15.22:0/2938902720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb415e400 con 0x7fdfb40b8430 2023-07-11T00:31:05.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.775+0000 7fdf9bfff700 1 -- 172.21.15.22:0/2938902720 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdfa4007470 con 0x7fdfb40b8430 2023-07-11T00:31:05.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.777+0000 7fdf9bfff700 1 --2- 172.21.15.22:0/2938902720 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdfa006ace0 0x7fdfa006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:05.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.777+0000 7fdf9bfff700 1 -- 172.21.15.22:0/2938902720 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdfa4089430 con 0x7fdfb40b8430 2023-07-11T00:31:05.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.777+0000 7fdfb2ffd700 1 --2- 172.21.15.22:0/2938902720 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdfa006ace0 0x7fdfa006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:05.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.778+0000 7fdfb2ffd700 1 --2- 172.21.15.22:0/2938902720 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdfa006ace0 0x7fdfa006d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40ca150 tx=0x7fdfa801c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:05.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.781+0000 7fdf9bfff700 1 -- 172.21.15.22:0/2938902720 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fdfb415e400 con 0x7fdfb40b8430 2023-07-11T00:31:06.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.998+0000 7fdfb9bff700 1 -- 172.21.15.22:0/2938902720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdfb4066e80 con 0x7fdfb40b8430 2023-07-11T00:31:06.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:05.998+0000 7fdf9bfff700 1 -- 172.21.15.22:0/2938902720 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdfa40541a0 con 0x7fdfb40b8430 2023-07-11T00:31:06.002 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:06.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.001+0000 7fdfb9bff700 1 -- 172.21.15.22:0/2938902720 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdfa006ace0 msgr2=0x7fdfa006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:06.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.001+0000 7fdfb9bff700 1 --2- 172.21.15.22:0/2938902720 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdfa006ace0 0x7fdfa006d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40ca150 tx=0x7fdfa801c040 comp rx=0 tx=0).stop 2023-07-11T00:31:06.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.001+0000 7fdfb9bff700 1 -- 172.21.15.22:0/2938902720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfb40b8430 msgr2=0x7fdfb40c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:06.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.001+0000 7fdfb9bff700 1 --2- 172.21.15.22:0/2938902720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfb40b8430 0x7fdfb40c9c10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400c550 tx=0x7fdfa400c860 comp rx=0 tx=0).stop 2023-07-11T00:31:06.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.001+0000 7fdfb9bff700 1 -- 172.21.15.22:0/2938902720 shutdown_connections 2023-07-11T00:31:06.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.001+0000 7fdfb9bff700 1 --2- 172.21.15.22:0/2938902720 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdfa006ace0 0x7fdfa006d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.001+0000 7fdfb9bff700 1 --2- 172.21.15.22:0/2938902720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb40d3730 0x7fdfb40d29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.001+0000 7fdfb9bff700 1 --2- 172.21.15.22:0/2938902720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfb40b8430 0x7fdfb40c9c10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.001+0000 7fdfb9bff700 1 --2- 172.21.15.22:0/2938902720 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfb40cfa90 0x7fdfb40cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.001+0000 7fdfb9bff700 1 -- 172.21.15.22:0/2938902720 >> 172.21.15.22:0/2938902720 conn(0x7fdfb406b3f0 msgr2=0x7fdfb40d1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:06.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.001+0000 7fdfb9bff700 1 -- 172.21.15.22:0/2938902720 shutdown_connections 2023-07-11T00:31:06.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.001+0000 7fdfb9bff700 1 -- 172.21.15.22:0/2938902720 wait complete. 2023-07-11T00:31:06.021 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:31:06.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.224+0000 7f83e07ff700 1 Processor -- start 2023-07-11T00:31:06.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.224+0000 7f83e07ff700 1 -- start start 2023-07-11T00:31:06.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.225+0000 7f83e07ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f83d815c460 0x7f83d80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:06.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.225+0000 7f83e07ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f83d80cf8f0 0x7f83d815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:06.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.225+0000 7f83e07ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d80d1790 con 0x7f83d80d2640 2023-07-11T00:31:06.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.225+0000 7f83e07ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d80cedd0 con 0x7f83d80cf8f0 2023-07-11T00:31:06.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.225+0000 7f83e07ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d80cd950 con 0x7f83d815c460 2023-07-11T00:31:06.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.225+0000 7f83ded9c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f83d80cf8f0 0x7f83d815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:06.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.226+0000 7f83ded9c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f83d80cf8f0 0x7f83d815fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55348/0 (socket says 172.21.15.22:55348) 2023-07-11T00:31:06.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.226+0000 7f83ded9c700 1 -- 172.21.15.22:0/1533044141 learned_addr learned my addr 172.21.15.22:0/1533044141 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:06.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.226+0000 7f83de59b700 1 --2- 172.21.15.22:0/1533044141 >> v2:172.21.15.184:3300/0 conn(0x7f83d815c460 0x7f83d80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:06.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.226+0000 7f83ded9c700 1 -- 172.21.15.22:0/1533044141 >> v2:172.21.15.184:3300/0 conn(0x7f83d815c460 msgr2=0x7f83d80b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:06.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.226+0000 7f83ded9c700 1 --2- 172.21.15.22:0/1533044141 >> v2:172.21.15.184:3300/0 conn(0x7f83d815c460 0x7f83d80b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.226+0000 7f83ded9c700 1 -- 172.21.15.22:0/1533044141 >> v1:172.21.15.184:6789/0 conn(0x7f83d80d2640 legacy=0x7f83d80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:06.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.226+0000 7f83ded9c700 1 -- 172.21.15.22:0/1533044141 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d80d14b0 con 0x7f83d80cf8f0 2023-07-11T00:31:06.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.226+0000 7f83ded9c700 1 --2- 172.21.15.22:0/1533044141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d80cf8f0 0x7f83d815fe20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f83d80b4f00 tx=0x7f83d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f285acee822f0eb server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:06.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.226+0000 7f83dd599700 1 -- 172.21.15.22:0/1533044141 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d000e070 con 0x7f83d80cf8f0 2023-07-11T00:31:06.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.227+0000 7f83dd599700 1 -- 172.21.15.22:0/1533044141 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d000b9c0 con 0x7f83d80cf8f0 2023-07-11T00:31:06.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.227+0000 7f83dd599700 1 -- 172.21.15.22:0/1533044141 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d000bd70 con 0x7f83d80cf8f0 2023-07-11T00:31:06.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.227+0000 7f83e07ff700 1 -- 172.21.15.22:0/1533044141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d80cf8f0 msgr2=0x7f83d815fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:06.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.227+0000 7f83e07ff700 1 --2- 172.21.15.22:0/1533044141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d80cf8f0 0x7f83d815fe20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f83d80b4f00 tx=0x7f83d000b330 comp rx=0 tx=0).stop 2023-07-11T00:31:06.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.227+0000 7f83e07ff700 1 -- 172.21.15.22:0/1533044141 shutdown_connections 2023-07-11T00:31:06.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.227+0000 7f83e07ff700 1 --2- 172.21.15.22:0/1533044141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d80cf8f0 0x7f83d815fe20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.227+0000 7f83e07ff700 1 --2- 172.21.15.22:0/1533044141 >> v2:172.21.15.184:3300/0 conn(0x7f83d815c460 0x7f83d80b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.227+0000 7f83e07ff700 1 -- 172.21.15.22:0/1533044141 >> 172.21.15.22:0/1533044141 conn(0x7f83d8071660 msgr2=0x7f83d8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:06.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.227+0000 7f83e07ff700 1 -- 172.21.15.22:0/1533044141 shutdown_connections 2023-07-11T00:31:06.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.227+0000 7f83e07ff700 1 -- 172.21.15.22:0/1533044141 wait complete. 2023-07-11T00:31:06.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.230+0000 7f83e07ff700 1 Processor -- start 2023-07-11T00:31:06.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.230+0000 7f83e07ff700 1 -- start start 2023-07-11T00:31:06.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.231+0000 7f83e07ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d80cf8f0 0x7f83d814e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:06.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.231+0000 7f83e07ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83d80d2640 0x7f83d80b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:06.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.231+0000 7f83e07ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83d815c460 0x7f83d80b6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:06.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.231+0000 7f83e07ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d815c830 con 0x7f83d80cf8f0 2023-07-11T00:31:06.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.231+0000 7f83e07ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80c8aa0 con 0x7f83d80d2640 2023-07-11T00:31:06.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.231+0000 7f83e07ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80c8d80 con 0x7f83d815c460 2023-07-11T00:31:06.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.231+0000 7f83de59b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d80cf8f0 0x7f83d814e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:06.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.231+0000 7f83de59b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d80cf8f0 0x7f83d814e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55360/0 (socket says 172.21.15.22:55360) 2023-07-11T00:31:06.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.231+0000 7f83de59b700 1 -- 172.21.15.22:0/2886019653 learned_addr learned my addr 172.21.15.22:0/2886019653 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:06.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.232+0000 7f83ded9c700 1 --2- 172.21.15.22:0/2886019653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83d815c460 0x7f83d80b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:06.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.232+0000 7f83ddd9a700 1 --2- 172.21.15.22:0/2886019653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83d80d2640 0x7f83d80b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:06.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.232+0000 7f83de59b700 1 -- 172.21.15.22:0/2886019653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83d815c460 msgr2=0x7f83d80b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:06.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.232+0000 7f83de59b700 1 --2- 172.21.15.22:0/2886019653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83d815c460 0x7f83d80b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.232+0000 7f83de59b700 1 -- 172.21.15.22:0/2886019653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83d80d2640 msgr2=0x7f83d80b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:06.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.232+0000 7f83de59b700 1 --2- 172.21.15.22:0/2886019653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83d80d2640 0x7f83d80b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.232+0000 7f83de59b700 1 -- 172.21.15.22:0/2886019653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d0009b30 con 0x7f83d80cf8f0 2023-07-11T00:31:06.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.232+0000 7f83de59b700 1 --2- 172.21.15.22:0/2886019653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d80cf8f0 0x7f83d814e260 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f83d400e810 tx=0x7f83d400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:06.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.232+0000 7f83ceffd700 1 -- 172.21.15.22:0/2886019653 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4013610 con 0x7f83d80cf8f0 2023-07-11T00:31:06.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.232+0000 7f83ceffd700 1 -- 172.21.15.22:0/2886019653 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d4013770 con 0x7f83d80cf8f0 2023-07-11T00:31:06.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.232+0000 7f83ceffd700 1 -- 172.21.15.22:0/2886019653 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4013b20 con 0x7f83d80cf8f0 2023-07-11T00:31:06.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.233+0000 7f83e07ff700 1 -- 172.21.15.22:0/2886019653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d80c9060 con 0x7f83d80cf8f0 2023-07-11T00:31:06.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.233+0000 7f83e07ff700 1 -- 172.21.15.22:0/2886019653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d814e7a0 con 0x7f83d80cf8f0 2023-07-11T00:31:06.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.234+0000 7f83e07ff700 1 -- 172.21.15.22:0/2886019653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d8066e80 con 0x7f83d80cf8f0 2023-07-11T00:31:06.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.235+0000 7f83ceffd700 1 -- 172.21.15.22:0/2886019653 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83d4013c80 con 0x7f83d80cf8f0 2023-07-11T00:31:06.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.236+0000 7f83ceffd700 1 --2- 172.21.15.22:0/2886019653 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f83bc06ace0 0x7f83bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:06.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.236+0000 7f83ceffd700 1 -- 172.21.15.22:0/2886019653 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f83d4089580 con 0x7f83d80cf8f0 2023-07-11T00:31:06.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.236+0000 7f83ddd9a700 1 --2- 172.21.15.22:0/2886019653 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f83bc06ace0 0x7f83bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:06.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.237+0000 7f83ddd9a700 1 --2- 172.21.15.22:0/2886019653 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f83bc06ace0 0x7f83bc06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f83d8160ce0 tx=0x7f83c8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:06.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.239+0000 7f83ceffd700 1 -- 172.21.15.22:0/2886019653 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f83d4054270 con 0x7f83d80cf8f0 2023-07-11T00:31:06.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.446+0000 7f83e07ff700 1 -- 172.21.15.22:0/2886019653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83d804ea60 con 0x7f83d80cf8f0 2023-07-11T00:31:06.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.447+0000 7f83ceffd700 1 -- 172.21.15.22:0/2886019653 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f83d4057890 con 0x7f83d80cf8f0 2023-07-11T00:31:06.450 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:06.450 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:54.208536+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:31:06.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.450+0000 7f83e07ff700 1 -- 172.21.15.22:0/2886019653 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f83bc06ace0 msgr2=0x7f83bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:06.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.450+0000 7f83e07ff700 1 --2- 172.21.15.22:0/2886019653 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f83bc06ace0 0x7f83bc06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f83d8160ce0 tx=0x7f83c8009040 comp rx=0 tx=0).stop 2023-07-11T00:31:06.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.450+0000 7f83e07ff700 1 -- 172.21.15.22:0/2886019653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d80cf8f0 msgr2=0x7f83d814e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:06.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.450+0000 7f83e07ff700 1 --2- 172.21.15.22:0/2886019653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d80cf8f0 0x7f83d814e260 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f83d400e810 tx=0x7f83d400ebd0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.450+0000 7f83e07ff700 1 -- 172.21.15.22:0/2886019653 shutdown_connections 2023-07-11T00:31:06.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.450+0000 7f83e07ff700 1 --2- 172.21.15.22:0/2886019653 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f83bc06ace0 0x7f83bc06d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.450+0000 7f83e07ff700 1 --2- 172.21.15.22:0/2886019653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83d815c460 0x7f83d80b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.450+0000 7f83e07ff700 1 --2- 172.21.15.22:0/2886019653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d80cf8f0 0x7f83d814e260 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.450+0000 7f83e07ff700 1 --2- 172.21.15.22:0/2886019653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83d80d2640 0x7f83d80b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.450+0000 7f83e07ff700 1 -- 172.21.15.22:0/2886019653 >> 172.21.15.22:0/2886019653 conn(0x7f83d8071660 msgr2=0x7f83d80b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:06.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.450+0000 7f83e07ff700 1 -- 172.21.15.22:0/2886019653 shutdown_connections 2023-07-11T00:31:06.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.450+0000 7f83e07ff700 1 -- 172.21.15.22:0/2886019653 wait complete. 2023-07-11T00:31:06.471 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:29:57.631007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:29:58.547599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:30:03.826184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:30:04.383448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-11T00:30:08.075875+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-11T00:31:06.472 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:31:06.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.674+0000 7f880c5ff700 1 Processor -- start 2023-07-11T00:31:06.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.674+0000 7f880c5ff700 1 -- start start 2023-07-11T00:31:06.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.675+0000 7f880c5ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f88040b8430 0x7f88040cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:06.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.675+0000 7f880c5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f88040cfc60 0x7f88040d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:06.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.675+0000 7f880c5ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88040d0b20 con 0x7f88040d3730 2023-07-11T00:31:06.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.675+0000 7f880c5ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88040b8800 con 0x7f88040b8430 2023-07-11T00:31:06.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.675+0000 7f880c5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88040b4ee0 con 0x7f88040cfc60 2023-07-11T00:31:06.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.675+0000 7f880a39b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f88040b8430 0x7f88040cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:06.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.676+0000 7f880a39b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f88040b8430 0x7f88040cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55376/0 (socket says 172.21.15.22:55376) 2023-07-11T00:31:06.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.676+0000 7f880a39b700 1 -- 172.21.15.22:0/3840387280 learned_addr learned my addr 172.21.15.22:0/3840387280 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:06.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.676+0000 7f880ab9c700 1 --2- 172.21.15.22:0/3840387280 >> v2:172.21.15.184:3300/0 conn(0x7f88040cfc60 0x7f88040d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:06.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.676+0000 7f880a39b700 1 -- 172.21.15.22:0/3840387280 >> v2:172.21.15.184:3300/0 conn(0x7f88040cfc60 msgr2=0x7f88040d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:06.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.676+0000 7f880a39b700 1 --2- 172.21.15.22:0/3840387280 >> v2:172.21.15.184:3300/0 conn(0x7f88040cfc60 0x7f88040d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.676+0000 7f880a39b700 1 -- 172.21.15.22:0/3840387280 >> v1:172.21.15.22:6789/0 conn(0x7f88040d3730 legacy=0x7f88040cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:06.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.676+0000 7f880a39b700 1 -- 172.21.15.22:0/3840387280 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88040b51c0 con 0x7f88040b8430 2023-07-11T00:31:06.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.676+0000 7f8809399700 1 -- 172.21.15.22:0/3840387280 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317592165 0 0) 0x7f88040d0b20 con 0x7f88040d3730 2023-07-11T00:31:06.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.676+0000 7f880a39b700 1 --2- 172.21.15.22:0/3840387280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88040b8430 0x7f88040cd320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f88040b2100 tx=0x7f8800009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d60379aba44c397 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:06.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.677+0000 7f8809399700 1 -- 172.21.15.22:0/3840387280 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880000b870 con 0x7f88040b8430 2023-07-11T00:31:06.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.677+0000 7f8809399700 1 -- 172.21.15.22:0/3840387280 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880000b9d0 con 0x7f88040b8430 2023-07-11T00:31:06.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.677+0000 7f8809399700 1 -- 172.21.15.22:0/3840387280 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880000bd60 con 0x7f88040b8430 2023-07-11T00:31:06.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.677+0000 7f880c5ff700 1 -- 172.21.15.22:0/3840387280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88040b8430 msgr2=0x7f88040cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:06.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.677+0000 7f880c5ff700 1 --2- 172.21.15.22:0/3840387280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88040b8430 0x7f88040cd320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f88040b2100 tx=0x7f8800009bd0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.677+0000 7f880c5ff700 1 -- 172.21.15.22:0/3840387280 shutdown_connections 2023-07-11T00:31:06.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.677+0000 7f880c5ff700 1 --2- 172.21.15.22:0/3840387280 >> v2:172.21.15.184:3300/0 conn(0x7f88040cfc60 0x7f88040d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.677+0000 7f880c5ff700 1 --2- 172.21.15.22:0/3840387280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88040b8430 0x7f88040cd320 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.677+0000 7f880c5ff700 1 -- 172.21.15.22:0/3840387280 >> 172.21.15.22:0/3840387280 conn(0x7f880406b3f0 msgr2=0x7f880406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:06.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.677+0000 7f880c5ff700 1 -- 172.21.15.22:0/3840387280 shutdown_connections 2023-07-11T00:31:06.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.677+0000 7f880c5ff700 1 -- 172.21.15.22:0/3840387280 wait complete. 2023-07-11T00:31:06.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.679+0000 7f880c5ff700 1 Processor -- start 2023-07-11T00:31:06.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.679+0000 7f880c5ff700 1 -- start start 2023-07-11T00:31:06.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.680+0000 7f880c5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88040b8430 0x7f88040b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:06.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.680+0000 7f880c5ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88040cfc60 0x7f88040c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:06.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.680+0000 7f880c5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040d3730 0x7f88041f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:06.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.680+0000 7f880c5ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88040c83e0 con 0x7f88040cfc60 2023-07-11T00:31:06.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.680+0000 7f880c5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88040c80d0 con 0x7f88040b8430 2023-07-11T00:31:06.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.680+0000 7f880c5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88040b0bb0 con 0x7f88040d3730 2023-07-11T00:31:06.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.680+0000 7f8809b9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88040cfc60 0x7f88040c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:06.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.680+0000 7f8809b9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88040cfc60 0x7f88040c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55390/0 (socket says 172.21.15.22:55390) 2023-07-11T00:31:06.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.680+0000 7f8809b9a700 1 -- 172.21.15.22:0/4275303692 learned_addr learned my addr 172.21.15.22:0/4275303692 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:06.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.680+0000 7f880a39b700 1 --2- 172.21.15.22:0/4275303692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88040b8430 0x7f88040b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:06.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.680+0000 7f880ab9c700 1 --2- 172.21.15.22:0/4275303692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040d3730 0x7f88041f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:06.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.681+0000 7f8809b9a700 1 -- 172.21.15.22:0/4275303692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040d3730 msgr2=0x7f88041f18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:06.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.681+0000 7f8809b9a700 1 --2- 172.21.15.22:0/4275303692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040d3730 0x7f88041f18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.681+0000 7f8809b9a700 1 -- 172.21.15.22:0/4275303692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88040b8430 msgr2=0x7f88040b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:06.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.681+0000 7f8809b9a700 1 --2- 172.21.15.22:0/4275303692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88040b8430 0x7f88040b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.681+0000 7f8809b9a700 1 -- 172.21.15.22:0/4275303692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8800009550 con 0x7f88040cfc60 2023-07-11T00:31:06.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.681+0000 7f8809b9a700 1 --2- 172.21.15.22:0/4275303692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88040cfc60 0x7f88040c8800 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f87f400c550 tx=0x7f87f400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:06.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.681+0000 7f87faffd700 1 -- 172.21.15.22:0/4275303692 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f40054e0 con 0x7f88040cfc60 2023-07-11T00:31:06.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.681+0000 7f87faffd700 1 -- 172.21.15.22:0/4275303692 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f4003680 con 0x7f88040cfc60 2023-07-11T00:31:06.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.681+0000 7f87faffd700 1 -- 172.21.15.22:0/4275303692 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4003a30 con 0x7f88040cfc60 2023-07-11T00:31:06.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.681+0000 7f880c5ff700 1 -- 172.21.15.22:0/4275303692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88040b0e90 con 0x7f88040cfc60 2023-07-11T00:31:06.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.681+0000 7f880c5ff700 1 -- 172.21.15.22:0/4275303692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88040b1860 con 0x7f88040cfc60 2023-07-11T00:31:06.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.682+0000 7f880c5ff700 1 -- 172.21.15.22:0/4275303692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88040c8520 con 0x7f88040cfc60 2023-07-11T00:31:06.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.684+0000 7f87faffd700 1 -- 172.21.15.22:0/4275303692 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f87f4003b90 con 0x7f88040cfc60 2023-07-11T00:31:06.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.684+0000 7f87faffd700 1 --2- 172.21.15.22:0/4275303692 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87e806ace0 0x7f87e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:06.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.685+0000 7f87faffd700 1 -- 172.21.15.22:0/4275303692 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f87f4088b00 con 0x7f88040cfc60 2023-07-11T00:31:06.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.685+0000 7f880a39b700 1 --2- 172.21.15.22:0/4275303692 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87e806ace0 0x7f87e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:06.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.686+0000 7f880a39b700 1 --2- 172.21.15.22:0/4275303692 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87e806ace0 0x7f87e806d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8800009c10 tx=0x7f8800008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:06.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.689+0000 7f87faffd700 1 -- 172.21.15.22:0/4275303692 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f88040c8520 con 0x7f88040cfc60 2023-07-11T00:31:06.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.898+0000 7f880c5ff700 1 -- 172.21.15.22:0/4275303692 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f88040c8520 con 0x7f88040cfc60 2023-07-11T00:31:06.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.898+0000 7f87faffd700 1 -- 172.21.15.22:0/4275303692 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f88040c8520 con 0x7f88040cfc60 2023-07-11T00:31:06.901 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2023-07-11T00:31:06.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.901+0000 7f880c5ff700 1 -- 172.21.15.22:0/4275303692 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87e806ace0 msgr2=0x7f87e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:06.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.901+0000 7f880c5ff700 1 --2- 172.21.15.22:0/4275303692 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87e806ace0 0x7f87e806d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8800009c10 tx=0x7f8800008030 comp rx=0 tx=0).stop 2023-07-11T00:31:06.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.901+0000 7f880c5ff700 1 -- 172.21.15.22:0/4275303692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88040cfc60 msgr2=0x7f88040c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:06.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.901+0000 7f880c5ff700 1 --2- 172.21.15.22:0/4275303692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88040cfc60 0x7f88040c8800 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f87f400c550 tx=0x7f87f400c860 comp rx=0 tx=0).stop 2023-07-11T00:31:06.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.901+0000 7f880c5ff700 1 -- 172.21.15.22:0/4275303692 shutdown_connections 2023-07-11T00:31:06.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.901+0000 7f880c5ff700 1 --2- 172.21.15.22:0/4275303692 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87e806ace0 0x7f87e806d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.901+0000 7f880c5ff700 1 --2- 172.21.15.22:0/4275303692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040d3730 0x7f88041f18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.901+0000 7f880c5ff700 1 --2- 172.21.15.22:0/4275303692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88040b8430 0x7f88040b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.901+0000 7f880c5ff700 1 --2- 172.21.15.22:0/4275303692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88040cfc60 0x7f88040c8800 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:06.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.901+0000 7f880c5ff700 1 -- 172.21.15.22:0/4275303692 >> 172.21.15.22:0/4275303692 conn(0x7f880406b3f0 msgr2=0x7f88040b6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:06.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.901+0000 7f880c5ff700 1 -- 172.21.15.22:0/4275303692 shutdown_connections 2023-07-11T00:31:06.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:06.901+0000 7f880c5ff700 1 -- 172.21.15.22:0/4275303692 wait complete. 2023-07-11T00:31:06.921 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:31:07.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.125+0000 7ff6bbdff700 1 Processor -- start 2023-07-11T00:31:07.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.125+0000 7ff6bbdff700 1 -- start start 2023-07-11T00:31:07.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.127+0000 7ff6bbdff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff6b40cfc60 0x7ff6b4167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:07.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.127+0000 7ff6bbdff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b40d0b20 con 0x7ff6b40d3730 2023-07-11T00:31:07.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.127+0000 7ff6bbdff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b40b4ee0 con 0x7ff6b40b8430 2023-07-11T00:31:07.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.127+0000 7ff6bbdff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b40cda30 con 0x7ff6b40cfc60 2023-07-11T00:31:07.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.127+0000 7ff6b939a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff6b40d3730 0x7ff6b40cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47692/0 (socket says 172.21.15.22:47692) 2023-07-11T00:31:07.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.127+0000 7ff6b939a700 1 -- 172.21.15.22:0/3061693701 learned_addr learned my addr 172.21.15.22:0/3061693701 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:07.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.127+0000 7ff6ba39c700 1 --2- 172.21.15.22:0/3061693701 >> v2:172.21.15.184:3300/0 conn(0x7ff6b40cfc60 0x7ff6b4167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:07.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.127+0000 7ff6b8b99700 1 -- 172.21.15.22:0/3061693701 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964002100 0 0) 0x7ff6b40d0b20 con 0x7ff6b40d3730 2023-07-11T00:31:07.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.127+0000 7ff6b8b99700 1 -- 172.21.15.22:0/3061693701 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6a00035b0 con 0x7ff6b40d3730 2023-07-11T00:31:07.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6b8b99700 1 -- 172.21.15.22:0/3061693701 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2395219171 0 0) 0x7ff6a00035b0 con 0x7ff6b40d3730 2023-07-11T00:31:07.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6b8b99700 1 -- 172.21.15.22:0/3061693701 >> v2:172.21.15.184:3300/0 conn(0x7ff6b40cfc60 msgr2=0x7ff6b4167010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:07.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6b8b99700 1 --2- 172.21.15.22:0/3061693701 >> v2:172.21.15.184:3300/0 conn(0x7ff6b40cfc60 0x7ff6b4167010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6b8b99700 1 -- 172.21.15.22:0/3061693701 >> v1:172.21.15.184:6789/0 conn(0x7ff6b40b8430 legacy=0x7ff6b40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:07.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6b8b99700 1 -- 172.21.15.22:0/3061693701 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b40b51c0 con 0x7ff6b40d3730 2023-07-11T00:31:07.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6b8b99700 1 -- 172.21.15.22:0/3061693701 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7ff6a4001670 con 0x7ff6b40d3730 2023-07-11T00:31:07.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6b8b99700 1 -- 172.21.15.22:0/3061693701 >> v1:172.21.15.22:6789/0 conn(0x7ff6b40d3730 legacy=0x7ff6b40cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:07.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6b8b99700 1 --2- 172.21.15.22:0/3061693701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a0003a00 0x7ff6a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:07.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6b8b99700 1 --2- 172.21.15.22:0/3061693701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6a0004850 0x7ff6a0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:07.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6b8b99700 1 --2- 172.21.15.22:0/3061693701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6a0005200 0x7ff6a000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:07.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6b8b99700 1 -- 172.21.15.22:0/3061693701 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a000c030 con 0x7ff6a0005200 2023-07-11T00:31:07.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6b8b99700 1 -- 172.21.15.22:0/3061693701 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a000c1a0 con 0x7ff6a0003a00 2023-07-11T00:31:07.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6b8b99700 1 -- 172.21.15.22:0/3061693701 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a000c360 con 0x7ff6a0004850 2023-07-11T00:31:07.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6ba39c700 1 --2- 172.21.15.22:0/3061693701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6a0005200 0x7ff6a000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:07.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6b9b9b700 1 --2- 172.21.15.22:0/3061693701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a0003a00 0x7ff6a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:07.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6b939a700 1 --2- 172.21.15.22:0/3061693701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6a0004850 0x7ff6a0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:07.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6ba39c700 1 -- 172.21.15.22:0/3061693701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6a0004850 msgr2=0x7ff6a0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:07.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6ba39c700 1 --2- 172.21.15.22:0/3061693701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6a0004850 0x7ff6a0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6ba39c700 1 -- 172.21.15.22:0/3061693701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a0003a00 msgr2=0x7ff6a0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6ba39c700 1 --2- 172.21.15.22:0/3061693701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a0003a00 0x7ff6a0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.128+0000 7ff6ba39c700 1 -- 172.21.15.22:0/3061693701 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a00035b0 con 0x7ff6a0005200 2023-07-11T00:31:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.129+0000 7ff6ba39c700 1 -- 172.21.15.22:0/3061693701 reap_dead start 2023-07-11T00:31:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.129+0000 7ff6ba39c700 1 --2- 172.21.15.22:0/3061693701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6a0005200 0x7ff6a000ba10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac009fc0 tx=0x7ff6a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd42a3f38f2cb3fb server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.129+0000 7ff6b8b99700 1 -- 172.21.15.22:0/3061693701 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac003a20 con 0x7ff6a0005200 2023-07-11T00:31:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.129+0000 7ff6b8b99700 1 -- 172.21.15.22:0/3061693701 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac00f040 con 0x7ff6a0005200 2023-07-11T00:31:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.129+0000 7ff6b8b99700 1 -- 172.21.15.22:0/3061693701 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac003de0 con 0x7ff6a0005200 2023-07-11T00:31:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.129+0000 7ff6bbdff700 1 -- 172.21.15.22:0/3061693701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6a0005200 msgr2=0x7ff6a000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.129+0000 7ff6bbdff700 1 --2- 172.21.15.22:0/3061693701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6a0005200 0x7ff6a000ba10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac009fc0 tx=0x7ff6a0005880 comp rx=0 tx=0).stop 2023-07-11T00:31:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.130+0000 7ff6bbdff700 1 -- 172.21.15.22:0/3061693701 shutdown_connections 2023-07-11T00:31:07.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.130+0000 7ff6bbdff700 1 --2- 172.21.15.22:0/3061693701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6a0005200 0x7ff6a000ba10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.130+0000 7ff6bbdff700 1 -- 172.21.15.22:0/3061693701 >> 172.21.15.22:0/3061693701 conn(0x7ff6b406b3f0 msgr2=0x7ff6b406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:07.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.130+0000 7ff6bbdff700 1 -- 172.21.15.22:0/3061693701 shutdown_connections 2023-07-11T00:31:07.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.130+0000 7ff6bbdff700 1 -- 172.21.15.22:0/3061693701 wait complete. 2023-07-11T00:31:07.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.131+0000 7ff6bbdff700 1 Processor -- start 2023-07-11T00:31:07.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.132+0000 7ff6bbdff700 1 -- start start 2023-07-11T00:31:07.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.132+0000 7ff6bbdff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a0005200 0x7ff6b40ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:07.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.132+0000 7ff6bbdff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6b41f29a0 0x7ff6b415f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:07.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.132+0000 7ff6bbdff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6b40c91c0 0x7ff6b41f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:07.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.132+0000 7ff6bbdff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40b1f70 con 0x7ff6b40c91c0 2023-07-11T00:31:07.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.132+0000 7ff6bbdff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b415cf50 con 0x7ff6a0005200 2023-07-11T00:31:07.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.132+0000 7ff6bbdff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b415c990 con 0x7ff6b41f29a0 2023-07-11T00:31:07.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.133+0000 7ff6ba39c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6b40c91c0 0x7ff6b41f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:07.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.133+0000 7ff6ba39c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6b40c91c0 0x7ff6b41f41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55402/0 (socket says 172.21.15.22:55402) 2023-07-11T00:31:07.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.133+0000 7ff6ba39c700 1 -- 172.21.15.22:0/2876221193 learned_addr learned my addr 172.21.15.22:0/2876221193 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:07.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.133+0000 7ff6b9b9b700 1 --2- 172.21.15.22:0/2876221193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a0005200 0x7ff6b40ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:07.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.133+0000 7ff6b939a700 1 --2- 172.21.15.22:0/2876221193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6b41f29a0 0x7ff6b415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:07.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.133+0000 7ff6ba39c700 1 -- 172.21.15.22:0/2876221193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6b41f29a0 msgr2=0x7ff6b415f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:07.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.133+0000 7ff6ba39c700 1 --2- 172.21.15.22:0/2876221193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6b41f29a0 0x7ff6b415f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.133+0000 7ff6ba39c700 1 -- 172.21.15.22:0/2876221193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a0005200 msgr2=0x7ff6b40ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:07.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.133+0000 7ff6ba39c700 1 --2- 172.21.15.22:0/2876221193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a0005200 0x7ff6b40ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.133+0000 7ff6ba39c700 1 -- 172.21.15.22:0/2876221193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b415cc70 con 0x7ff6b40c91c0 2023-07-11T00:31:07.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.133+0000 7ff6b9b9b700 1 --2- 172.21.15.22:0/2876221193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a0005200 0x7ff6b40ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:07.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.133+0000 7ff6b939a700 1 --2- 172.21.15.22:0/2876221193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6b41f29a0 0x7ff6b415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:07.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.133+0000 7ff6ba39c700 1 --2- 172.21.15.22:0/2876221193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6b40c91c0 0x7ff6b41f41e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff6b415fe10 tx=0x7ff6ac009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:07.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.134+0000 7ff6aa7fc700 1 -- 172.21.15.22:0/2876221193 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac004230 con 0x7ff6b40c91c0 2023-07-11T00:31:07.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.134+0000 7ff6aa7fc700 1 -- 172.21.15.22:0/2876221193 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac004390 con 0x7ff6b40c91c0 2023-07-11T00:31:07.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.134+0000 7ff6aa7fc700 1 -- 172.21.15.22:0/2876221193 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac004740 con 0x7ff6b40c91c0 2023-07-11T00:31:07.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.134+0000 7ff6bbdff700 1 -- 172.21.15.22:0/2876221193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b415d3a0 con 0x7ff6b40c91c0 2023-07-11T00:31:07.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.134+0000 7ff6bbdff700 1 -- 172.21.15.22:0/2876221193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b415f790 con 0x7ff6b40c91c0 2023-07-11T00:31:07.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.135+0000 7ff6bbdff700 1 -- 172.21.15.22:0/2876221193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b415d8c0 con 0x7ff6b40c91c0 2023-07-11T00:31:07.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.136+0000 7ff6aa7fc700 1 -- 172.21.15.22:0/2876221193 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6ac014480 con 0x7ff6b40c91c0 2023-07-11T00:31:07.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.137+0000 7ff6aa7fc700 1 --2- 172.21.15.22:0/2876221193 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff69806ace0 0x7ff69806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:07.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.137+0000 7ff6aa7fc700 1 -- 172.21.15.22:0/2876221193 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff6ac08ae60 con 0x7ff6b40c91c0 2023-07-11T00:31:07.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.137+0000 7ff6b9b9b700 1 --2- 172.21.15.22:0/2876221193 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff69806ace0 0x7ff69806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:07.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.138+0000 7ff6b9b9b700 1 --2- 172.21.15.22:0/2876221193 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff69806ace0 0x7ff69806d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4158750 tx=0x7ff6b0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:07.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.141+0000 7ff6aa7fc700 1 -- 172.21.15.22:0/2876221193 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff6b415d8c0 con 0x7ff6b40c91c0 2023-07-11T00:31:07.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.347+0000 7ff6bbdff700 1 -- 172.21.15.22:0/2876221193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6b415d8c0 con 0x7ff6b40c91c0 2023-07-11T00:31:07.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.347+0000 7ff6aa7fc700 1 -- 172.21.15.22:0/2876221193 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6b415d8c0 con 0x7ff6b40c91c0 2023-07-11T00:31:07.350 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-07-11T00:31:07.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.350+0000 7ff6bbdff700 1 -- 172.21.15.22:0/2876221193 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff69806ace0 msgr2=0x7ff69806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:07.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.350+0000 7ff6bbdff700 1 --2- 172.21.15.22:0/2876221193 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff69806ace0 0x7ff69806d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4158750 tx=0x7ff6b0009040 comp rx=0 tx=0).stop 2023-07-11T00:31:07.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.350+0000 7ff6bbdff700 1 -- 172.21.15.22:0/2876221193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6b40c91c0 msgr2=0x7ff6b41f41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:07.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.350+0000 7ff6bbdff700 1 --2- 172.21.15.22:0/2876221193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6b40c91c0 0x7ff6b41f41e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff6b415fe10 tx=0x7ff6ac009750 comp rx=0 tx=0).stop 2023-07-11T00:31:07.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.350+0000 7ff6bbdff700 1 -- 172.21.15.22:0/2876221193 shutdown_connections 2023-07-11T00:31:07.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.350+0000 7ff6bbdff700 1 --2- 172.21.15.22:0/2876221193 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff69806ace0 0x7ff69806d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.350+0000 7ff6bbdff700 1 --2- 172.21.15.22:0/2876221193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6b40c91c0 0x7ff6b41f41e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.350+0000 7ff6bbdff700 1 --2- 172.21.15.22:0/2876221193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a0005200 0x7ff6b40ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.350+0000 7ff6bbdff700 1 --2- 172.21.15.22:0/2876221193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6b41f29a0 0x7ff6b415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.350+0000 7ff6bbdff700 1 -- 172.21.15.22:0/2876221193 >> 172.21.15.22:0/2876221193 conn(0x7ff6b406b3f0 msgr2=0x7ff6b40b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:07.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.350+0000 7ff6bbdff700 1 -- 172.21.15.22:0/2876221193 shutdown_connections 2023-07-11T00:31:07.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.350+0000 7ff6bbdff700 1 -- 172.21.15.22:0/2876221193 wait complete. 2023-07-11T00:31:07.370 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:31:07.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.573+0000 7f3d64bff700 1 Processor -- start 2023-07-11T00:31:07.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.573+0000 7f3d64bff700 1 -- start start 2023-07-11T00:31:07.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.574+0000 7f3d64bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3d600d3730 0x7f3d600cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:07.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.574+0000 7f3d64bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d600cfa90 0x7f3d600d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:07.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.575+0000 7f3d64bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d600d0b20 con 0x7f3d600b8430 2023-07-11T00:31:07.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.575+0000 7f3d64bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d600cda30 con 0x7f3d600d3730 2023-07-11T00:31:07.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.575+0000 7f3d64bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600b8800 con 0x7f3d600cfa90 2023-07-11T00:31:07.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.575+0000 7f3d5ed9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d600cfa90 0x7f3d600d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:07.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.575+0000 7f3d5ed9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d600cfa90 0x7f3d600d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:56166/0 (socket says 172.21.15.22:56166) 2023-07-11T00:31:07.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.575+0000 7f3d5ed9d700 1 -- 172.21.15.22:0/1284830936 learned_addr learned my addr 172.21.15.22:0/1284830936 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:07.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.575+0000 7f3d5e59c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f3d600b8430 0x7f3d600cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:51038/0 (socket says 172.21.15.22:51038) 2023-07-11T00:31:07.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.575+0000 7f3d57fff700 1 --2- 172.21.15.22:0/1284830936 >> v2:172.21.15.184:3300/0 conn(0x7f3d600d3730 0x7f3d600cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:07.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.576+0000 7f3d5ed9d700 1 -- 172.21.15.22:0/1284830936 >> v2:172.21.15.184:3300/0 conn(0x7f3d600d3730 msgr2=0x7f3d600cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:07.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.576+0000 7f3d5ed9d700 1 --2- 172.21.15.22:0/1284830936 >> v2:172.21.15.184:3300/0 conn(0x7f3d600d3730 0x7f3d600cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.576+0000 7f3d5dd9b700 1 -- 172.21.15.22:0/1284830936 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481042759 0 0) 0x7f3d600d0b20 con 0x7f3d600b8430 2023-07-11T00:31:07.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.576+0000 7f3d5ed9d700 1 -- 172.21.15.22:0/1284830936 >> v1:172.21.15.184:6789/0 conn(0x7f3d600b8430 legacy=0x7f3d600cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:07.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.576+0000 7f3d5ed9d700 1 -- 172.21.15.22:0/1284830936 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d600cfeb0 con 0x7f3d600cfa90 2023-07-11T00:31:07.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.576+0000 7f3d5ed9d700 1 --2- 172.21.15.22:0/1284830936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d600cfa90 0x7f3d600d0fb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009e50 tx=0x7f3d5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef1909e26d4f8a5d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:07.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.576+0000 7f3d5dd9b700 1 -- 172.21.15.22:0/1284830936 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5800e070 con 0x7f3d600cfa90 2023-07-11T00:31:07.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.576+0000 7f3d5dd9b700 1 -- 172.21.15.22:0/1284830936 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5800b910 con 0x7f3d600cfa90 2023-07-11T00:31:07.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.576+0000 7f3d5dd9b700 1 -- 172.21.15.22:0/1284830936 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5800bcc0 con 0x7f3d600cfa90 2023-07-11T00:31:07.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.577+0000 7f3d64bff700 1 -- 172.21.15.22:0/1284830936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d600cfa90 msgr2=0x7f3d600d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:07.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.577+0000 7f3d64bff700 1 --2- 172.21.15.22:0/1284830936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d600cfa90 0x7f3d600d0fb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009e50 tx=0x7f3d5800b330 comp rx=0 tx=0).stop 2023-07-11T00:31:07.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.577+0000 7f3d64bff700 1 -- 172.21.15.22:0/1284830936 shutdown_connections 2023-07-11T00:31:07.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.577+0000 7f3d64bff700 1 --2- 172.21.15.22:0/1284830936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d600cfa90 0x7f3d600d0fb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.577+0000 7f3d64bff700 1 --2- 172.21.15.22:0/1284830936 >> v2:172.21.15.184:3300/0 conn(0x7f3d600d3730 0x7f3d600cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.577+0000 7f3d64bff700 1 -- 172.21.15.22:0/1284830936 >> 172.21.15.22:0/1284830936 conn(0x7f3d6006b3f0 msgr2=0x7f3d6006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:07.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.577+0000 7f3d64bff700 1 -- 172.21.15.22:0/1284830936 shutdown_connections 2023-07-11T00:31:07.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.577+0000 7f3d64bff700 1 -- 172.21.15.22:0/1284830936 wait complete. 2023-07-11T00:31:07.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.579+0000 7f3d64bff700 1 Processor -- start 2023-07-11T00:31:07.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.579+0000 7f3d64bff700 1 -- start start 2023-07-11T00:31:07.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.580+0000 7f3d64bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d600b8430 0x7f3d6015e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:07.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.580+0000 7f3d64bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d600cfa90 0x7f3d600cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:07.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.580+0000 7f3d64bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d600d3730 0x7f3d601f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:07.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.580+0000 7f3d64bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6015e3c0 con 0x7f3d600b8430 2023-07-11T00:31:07.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.580+0000 7f3d64bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6015d840 con 0x7f3d600cfa90 2023-07-11T00:31:07.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.580+0000 7f3d64bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6015db20 con 0x7f3d600d3730 2023-07-11T00:31:07.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.580+0000 7f3d5e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d600b8430 0x7f3d6015e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:07.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.580+0000 7f3d5e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d600b8430 0x7f3d6015e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55416/0 (socket says 172.21.15.22:55416) 2023-07-11T00:31:07.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.580+0000 7f3d5e59c700 1 -- 172.21.15.22:0/2681943214 learned_addr learned my addr 172.21.15.22:0/2681943214 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:07.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.580+0000 7f3d57fff700 1 --2- 172.21.15.22:0/2681943214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d600cfa90 0x7f3d600cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:07.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.580+0000 7f3d5ed9d700 1 --2- 172.21.15.22:0/2681943214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d600d3730 0x7f3d601f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:07.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.581+0000 7f3d5e59c700 1 -- 172.21.15.22:0/2681943214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d600d3730 msgr2=0x7f3d601f50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:07.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.581+0000 7f3d5e59c700 1 --2- 172.21.15.22:0/2681943214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d600d3730 0x7f3d601f50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.581+0000 7f3d5e59c700 1 -- 172.21.15.22:0/2681943214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d600cfa90 msgr2=0x7f3d600cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:07.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.581+0000 7f3d5e59c700 1 --2- 172.21.15.22:0/2681943214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d600cfa90 0x7f3d600cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.581+0000 7f3d5e59c700 1 -- 172.21.15.22:0/2681943214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d58009b30 con 0x7f3d600b8430 2023-07-11T00:31:07.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.581+0000 7f3d57fff700 1 --2- 172.21.15.22:0/2681943214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d600cfa90 0x7f3d600cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.581+0000 7f3d5e59c700 1 --2- 172.21.15.22:0/2681943214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d600b8430 0x7f3d6015e7c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3d500011e0 tx=0x7f3d5000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.581+0000 7f3d56ffd700 1 -- 172.21.15.22:0/2681943214 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50004c80 con 0x7f3d600b8430 2023-07-11T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.581+0000 7f3d56ffd700 1 -- 172.21.15.22:0/2681943214 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d50004e00 con 0x7f3d600b8430 2023-07-11T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.581+0000 7f3d56ffd700 1 -- 172.21.15.22:0/2681943214 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50007310 con 0x7f3d600b8430 2023-07-11T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.581+0000 7f3d64bff700 1 -- 172.21.15.22:0/2681943214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6015de00 con 0x7f3d600b8430 2023-07-11T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.581+0000 7f3d64bff700 1 -- 172.21.15.22:0/2681943214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6015ed00 con 0x7f3d600b8430 2023-07-11T00:31:07.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.583+0000 7f3d64bff700 1 -- 172.21.15.22:0/2681943214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d600cde60 con 0x7f3d600b8430 2023-07-11T00:31:07.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.583+0000 7f3d56ffd700 1 -- 172.21.15.22:0/2681943214 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d50007470 con 0x7f3d600b8430 2023-07-11T00:31:07.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.584+0000 7f3d56ffd700 1 --2- 172.21.15.22:0/2681943214 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3d4006ace0 0x7f3d4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:07.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.584+0000 7f3d56ffd700 1 -- 172.21.15.22:0/2681943214 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3d50089480 con 0x7f3d600b8430 2023-07-11T00:31:07.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.585+0000 7f3d57fff700 1 --2- 172.21.15.22:0/2681943214 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3d4006ace0 0x7f3d4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:07.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.586+0000 7f3d57fff700 1 --2- 172.21.15.22:0/2681943214 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3d4006ace0 0x7f3d4006d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3d601f2c30 tx=0x7f3d48009210 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:07.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.589+0000 7f3d56ffd700 1 -- 172.21.15.22:0/2681943214 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3d50054160 con 0x7f3d600b8430 2023-07-11T00:31:07.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.792+0000 7f3d64bff700 1 -- 172.21.15.22:0/2681943214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d6004ea60 con 0x7f3d600b8430 2023-07-11T00:31:07.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.792+0000 7f3d56ffd700 1 -- 172.21.15.22:0/2681943214 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d50057780 con 0x7f3d600b8430 2023-07-11T00:31:07.795 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:07.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.795+0000 7f3d64bff700 1 -- 172.21.15.22:0/2681943214 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3d4006ace0 msgr2=0x7f3d4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:07.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.795+0000 7f3d64bff700 1 --2- 172.21.15.22:0/2681943214 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3d4006ace0 0x7f3d4006d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3d601f2c30 tx=0x7f3d48009210 comp rx=0 tx=0).stop 2023-07-11T00:31:07.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.795+0000 7f3d64bff700 1 -- 172.21.15.22:0/2681943214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d600b8430 msgr2=0x7f3d6015e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:07.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.795+0000 7f3d64bff700 1 --2- 172.21.15.22:0/2681943214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d600b8430 0x7f3d6015e7c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3d500011e0 tx=0x7f3d5000ca30 comp rx=0 tx=0).stop 2023-07-11T00:31:07.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.795+0000 7f3d64bff700 1 -- 172.21.15.22:0/2681943214 shutdown_connections 2023-07-11T00:31:07.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.795+0000 7f3d64bff700 1 --2- 172.21.15.22:0/2681943214 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3d4006ace0 0x7f3d4006d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.795+0000 7f3d64bff700 1 --2- 172.21.15.22:0/2681943214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d600d3730 0x7f3d601f50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.795+0000 7f3d64bff700 1 --2- 172.21.15.22:0/2681943214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d600b8430 0x7f3d6015e7c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.795+0000 7f3d64bff700 1 --2- 172.21.15.22:0/2681943214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d600cfa90 0x7f3d600cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:07.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.795+0000 7f3d64bff700 1 -- 172.21.15.22:0/2681943214 >> 172.21.15.22:0/2681943214 conn(0x7f3d6006b3f0 msgr2=0x7f3d600b5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:07.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.795+0000 7f3d64bff700 1 -- 172.21.15.22:0/2681943214 shutdown_connections 2023-07-11T00:31:07.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:07.795+0000 7f3d64bff700 1 -- 172.21.15.22:0/2681943214 wait complete. 2023-07-11T00:31:07.815 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:31:08.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.021+0000 7fd1975ff700 1 Processor -- start 2023-07-11T00:31:08.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.022+0000 7fd1975ff700 1 -- start start 2023-07-11T00:31:08.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.023+0000 7fd1975ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd1900d3730 0x7fd1900cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:08.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.023+0000 7fd1975ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd1900cfa90 0x7fd1900d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:08.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.023+0000 7fd1975ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1900d0b20 con 0x7fd1900b8430 2023-07-11T00:31:08.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.023+0000 7fd1975ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1900cda30 con 0x7fd1900d3730 2023-07-11T00:31:08.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.023+0000 7fd1975ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1900b8800 con 0x7fd1900cfa90 2023-07-11T00:31:08.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.023+0000 7fd194b9a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd1900d3730 0x7fd1900cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:08.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.023+0000 7fd194b9a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd1900d3730 0x7fd1900cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55422/0 (socket says 172.21.15.22:55422) 2023-07-11T00:31:08.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.023+0000 7fd194b9a700 1 -- 172.21.15.22:0/2694627688 learned_addr learned my addr 172.21.15.22:0/2694627688 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:08.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.023+0000 7fd195b9c700 1 --2- 172.21.15.22:0/2694627688 >> v2:172.21.15.184:3300/0 conn(0x7fd1900cfa90 0x7fd1900d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:08.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.023+0000 7fd194b9a700 1 -- 172.21.15.22:0/2694627688 >> v2:172.21.15.184:3300/0 conn(0x7fd1900cfa90 msgr2=0x7fd1900d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:08.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.023+0000 7fd194b9a700 1 --2- 172.21.15.22:0/2694627688 >> v2:172.21.15.184:3300/0 conn(0x7fd1900cfa90 0x7fd1900d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.023+0000 7fd194b9a700 1 -- 172.21.15.22:0/2694627688 >> v1:172.21.15.184:6789/0 conn(0x7fd1900b8430 legacy=0x7fd1900cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:08.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.024+0000 7fd194b9a700 1 -- 172.21.15.22:0/2694627688 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1900cfe90 con 0x7fd1900d3730 2023-07-11T00:31:08.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.024+0000 7fd195b9c700 1 --2- 172.21.15.22:0/2694627688 >> v2:172.21.15.184:3300/0 conn(0x7fd1900cfa90 0x7fd1900d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:08.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.024+0000 7fd194b9a700 1 --2- 172.21.15.22:0/2694627688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1900d3730 0x7fd1900cf550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd1900b2100 tx=0x7fd180009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4d6805749d3e93 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:08.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.024+0000 7fd187fff700 1 -- 172.21.15.22:0/2694627688 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd180004230 con 0x7fd1900d3730 2023-07-11T00:31:08.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.024+0000 7fd187fff700 1 -- 172.21.15.22:0/2694627688 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd180004390 con 0x7fd1900d3730 2023-07-11T00:31:08.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.024+0000 7fd187fff700 1 -- 172.21.15.22:0/2694627688 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1800036a0 con 0x7fd1900d3730 2023-07-11T00:31:08.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.025+0000 7fd1975ff700 1 -- 172.21.15.22:0/2694627688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1900d3730 msgr2=0x7fd1900cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:08.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.025+0000 7fd1975ff700 1 --2- 172.21.15.22:0/2694627688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1900d3730 0x7fd1900cf550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd1900b2100 tx=0x7fd180009bd0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.025+0000 7fd1975ff700 1 -- 172.21.15.22:0/2694627688 shutdown_connections 2023-07-11T00:31:08.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.025+0000 7fd1975ff700 1 --2- 172.21.15.22:0/2694627688 >> v2:172.21.15.184:3300/0 conn(0x7fd1900cfa90 0x7fd1900d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.025+0000 7fd1975ff700 1 --2- 172.21.15.22:0/2694627688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1900d3730 0x7fd1900cf550 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.025+0000 7fd1975ff700 1 -- 172.21.15.22:0/2694627688 >> 172.21.15.22:0/2694627688 conn(0x7fd19006b3f0 msgr2=0x7fd19006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:08.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.025+0000 7fd1975ff700 1 -- 172.21.15.22:0/2694627688 shutdown_connections 2023-07-11T00:31:08.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.025+0000 7fd1975ff700 1 -- 172.21.15.22:0/2694627688 wait complete. 2023-07-11T00:31:08.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.026+0000 7fd1975ff700 1 Processor -- start 2023-07-11T00:31:08.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.027+0000 7fd1975ff700 1 -- start start 2023-07-11T00:31:08.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd1975ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1900b8430 0x7fd1901f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:08.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd1975ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1900cfa90 0x7fd1901f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:08.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd1975ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1900d3730 0x7fd1900c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:08.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd1975ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1901f4f50 con 0x7fd1900b8430 2023-07-11T00:31:08.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd1975ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19015b4a0 con 0x7fd1900d3730 2023-07-11T00:31:08.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd1975ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1900cb010 con 0x7fd1900cfa90 2023-07-11T00:31:08.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd19539b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1900b8430 0x7fd1901f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:08.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd19539b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1900b8430 0x7fd1901f1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55436/0 (socket says 172.21.15.22:55436) 2023-07-11T00:31:08.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd19539b700 1 -- 172.21.15.22:0/267503834 learned_addr learned my addr 172.21.15.22:0/267503834 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:08.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd195b9c700 1 --2- 172.21.15.22:0/267503834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1900d3730 0x7fd1900c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:08.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd19539b700 1 -- 172.21.15.22:0/267503834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1900cfa90 msgr2=0x7fd1901f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:08.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd194b9a700 1 --2- 172.21.15.22:0/267503834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1900cfa90 0x7fd1901f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:08.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd19539b700 1 --2- 172.21.15.22:0/267503834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1900cfa90 0x7fd1901f4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd19539b700 1 -- 172.21.15.22:0/267503834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1900d3730 msgr2=0x7fd1900c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:08.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd19539b700 1 --2- 172.21.15.22:0/267503834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1900d3730 0x7fd1900c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd19539b700 1 -- 172.21.15.22:0/267503834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd180009550 con 0x7fd1900b8430 2023-07-11T00:31:08.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd195b9c700 1 --2- 172.21.15.22:0/267503834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1900d3730 0x7fd1900c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:08.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.028+0000 7fd19539b700 1 --2- 172.21.15.22:0/267503834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1900b8430 0x7fd1901f1b00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00c4d0 tx=0x7fd18c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:08.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.029+0000 7fd185ffb700 1 -- 172.21.15.22:0/267503834 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c011790 con 0x7fd1900b8430 2023-07-11T00:31:08.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.029+0000 7fd185ffb700 1 -- 172.21.15.22:0/267503834 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c0118f0 con 0x7fd1900b8430 2023-07-11T00:31:08.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.029+0000 7fd185ffb700 1 -- 172.21.15.22:0/267503834 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c011ca0 con 0x7fd1900b8430 2023-07-11T00:31:08.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.029+0000 7fd1975ff700 1 -- 172.21.15.22:0/267503834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1900cb2f0 con 0x7fd1900b8430 2023-07-11T00:31:08.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.029+0000 7fd1975ff700 1 -- 172.21.15.22:0/267503834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1900cb8b0 con 0x7fd1900b8430 2023-07-11T00:31:08.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.030+0000 7fd1975ff700 1 -- 172.21.15.22:0/267503834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19004ea60 con 0x7fd1900b8430 2023-07-11T00:31:08.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.031+0000 7fd185ffb700 1 -- 172.21.15.22:0/267503834 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd18c01c460 con 0x7fd1900b8430 2023-07-11T00:31:08.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.032+0000 7fd185ffb700 1 --2- 172.21.15.22:0/267503834 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd17406ace0 0x7fd17406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:08.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.032+0000 7fd185ffb700 1 -- 172.21.15.22:0/267503834 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd18c0895f0 con 0x7fd1900b8430 2023-07-11T00:31:08.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.033+0000 7fd194b9a700 1 --2- 172.21.15.22:0/267503834 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd17406ace0 0x7fd17406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:08.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.033+0000 7fd194b9a700 1 --2- 172.21.15.22:0/267503834 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd17406ace0 0x7fd17406d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd1900b3f20 tx=0x7fd180008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:08.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.037+0000 7fd185ffb700 1 -- 172.21.15.22:0/267503834 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd18c054370 con 0x7fd1900b8430 2023-07-11T00:31:08.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.244+0000 7fd1975ff700 1 -- 172.21.15.22:0/267503834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd19006ba10 con 0x7fd1900b8430 2023-07-11T00:31:08.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.244+0000 7fd185ffb700 1 -- 172.21.15.22:0/267503834 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd18c057990 con 0x7fd1900b8430 2023-07-11T00:31:08.247 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-07-11T00:31:08.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.246+0000 7fd1975ff700 1 -- 172.21.15.22:0/267503834 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd17406ace0 msgr2=0x7fd17406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:08.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.246+0000 7fd1975ff700 1 --2- 172.21.15.22:0/267503834 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd17406ace0 0x7fd17406d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd1900b3f20 tx=0x7fd180008030 comp rx=0 tx=0).stop 2023-07-11T00:31:08.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.246+0000 7fd1975ff700 1 -- 172.21.15.22:0/267503834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1900b8430 msgr2=0x7fd1901f1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:08.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.246+0000 7fd1975ff700 1 --2- 172.21.15.22:0/267503834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1900b8430 0x7fd1901f1b00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00c4d0 tx=0x7fd18c00c890 comp rx=0 tx=0).stop 2023-07-11T00:31:08.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.247+0000 7fd1975ff700 1 -- 172.21.15.22:0/267503834 shutdown_connections 2023-07-11T00:31:08.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.247+0000 7fd1975ff700 1 --2- 172.21.15.22:0/267503834 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd17406ace0 0x7fd17406d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.247+0000 7fd1975ff700 1 --2- 172.21.15.22:0/267503834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1900d3730 0x7fd1900c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.247+0000 7fd1975ff700 1 --2- 172.21.15.22:0/267503834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1900b8430 0x7fd1901f1b00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.247+0000 7fd1975ff700 1 --2- 172.21.15.22:0/267503834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1900cfa90 0x7fd1901f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.247+0000 7fd1975ff700 1 -- 172.21.15.22:0/267503834 >> 172.21.15.22:0/267503834 conn(0x7fd19006b3f0 msgr2=0x7fd1900b6060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:08.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.247+0000 7fd1975ff700 1 -- 172.21.15.22:0/267503834 shutdown_connections 2023-07-11T00:31:08.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.247+0000 7fd1975ff700 1 -- 172.21.15.22:0/267503834 wait complete. 2023-07-11T00:31:08.267 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-11T00:31:08.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.471+0000 7f0a2cdff700 1 Processor -- start 2023-07-11T00:31:08.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.471+0000 7f0a2cdff700 1 -- start start 2023-07-11T00:31:08.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.472+0000 7f0a2cdff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0a280b8430 0x7f0a280cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:08.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.472+0000 7f0a2cdff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a280d0b20 con 0x7f0a280d3730 2023-07-11T00:31:08.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.472+0000 7f0a2cdff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a280b4ee0 con 0x7f0a280cfc60 2023-07-11T00:31:08.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.472+0000 7f0a2cdff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a280b8800 con 0x7f0a280b8430 2023-07-11T00:31:08.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.473+0000 7f0a2659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0a280b8430 0x7f0a280cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:08.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.473+0000 7f0a25d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0a280d3730 0x7f0a280cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47706/0 (socket says 172.21.15.22:47706) 2023-07-11T00:31:08.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.473+0000 7f0a2659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0a280b8430 0x7f0a280cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55440/0 (socket says 172.21.15.22:55440) 2023-07-11T00:31:08.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.473+0000 7f0a25d9b700 1 -- 172.21.15.22:0/3890407184 learned_addr learned my addr 172.21.15.22:0/3890407184 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:08.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.473+0000 7f0a2659c700 1 -- 172.21.15.22:0/3890407184 >> v1:172.21.15.184:6789/0 conn(0x7f0a280cfc60 legacy=0x7f0a280d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:08.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.473+0000 7f0a2659c700 1 -- 172.21.15.22:0/3890407184 >> v1:172.21.15.22:6789/0 conn(0x7f0a280d3730 legacy=0x7f0a280cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:08.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.473+0000 7f0a2659c700 1 -- 172.21.15.22:0/3890407184 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a280b51c0 con 0x7f0a280b8430 2023-07-11T00:31:08.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.473+0000 7f0a2559a700 1 -- 172.21.15.22:0/3890407184 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701940391 0 0) 0x7f0a280d0b20 con 0x7f0a280d3730 2023-07-11T00:31:08.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.473+0000 7f0a2659c700 1 --2- 172.21.15.22:0/3890407184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a280b8430 0x7f0a280cd320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009840 tx=0x7f0a18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849e7c136f502bb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:08.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.474+0000 7f0a2559a700 1 -- 172.21.15.22:0/3890407184 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18004230 con 0x7f0a280b8430 2023-07-11T00:31:08.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.474+0000 7f0a2559a700 1 -- 172.21.15.22:0/3890407184 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a18004390 con 0x7f0a280b8430 2023-07-11T00:31:08.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.474+0000 7f0a2559a700 1 -- 172.21.15.22:0/3890407184 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a180036a0 con 0x7f0a280b8430 2023-07-11T00:31:08.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.474+0000 7f0a2cdff700 1 -- 172.21.15.22:0/3890407184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a280b8430 msgr2=0x7f0a280cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:08.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.474+0000 7f0a2cdff700 1 --2- 172.21.15.22:0/3890407184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a280b8430 0x7f0a280cd320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009840 tx=0x7f0a18009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:08.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.474+0000 7f0a2cdff700 1 -- 172.21.15.22:0/3890407184 shutdown_connections 2023-07-11T00:31:08.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.474+0000 7f0a2cdff700 1 --2- 172.21.15.22:0/3890407184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a280b8430 0x7f0a280cd320 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.474+0000 7f0a2cdff700 1 -- 172.21.15.22:0/3890407184 >> 172.21.15.22:0/3890407184 conn(0x7f0a2806b3f0 msgr2=0x7f0a2806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:08.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.474+0000 7f0a2cdff700 1 -- 172.21.15.22:0/3890407184 shutdown_connections 2023-07-11T00:31:08.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.474+0000 7f0a2cdff700 1 -- 172.21.15.22:0/3890407184 wait complete. 2023-07-11T00:31:08.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.476+0000 7f0a2cdff700 1 Processor -- start 2023-07-11T00:31:08.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.476+0000 7f0a2cdff700 1 -- start start 2023-07-11T00:31:08.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.477+0000 7f0a2cdff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a280b8430 0x7f0a280c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:08.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.477+0000 7f0a2cdff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a280cfc60 0x7f0a280c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:08.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.477+0000 7f0a2cdff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a280d3730 0x7f0a280c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:08.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.477+0000 7f0a2cdff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a280ca4a0 con 0x7f0a280cfc60 2023-07-11T00:31:08.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.477+0000 7f0a2cdff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a280ca780 con 0x7f0a280b8430 2023-07-11T00:31:08.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.477+0000 7f0a2cdff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a280caa60 con 0x7f0a280d3730 2023-07-11T00:31:08.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.477+0000 7f0a25d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a280cfc60 0x7f0a280c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:08.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.477+0000 7f0a25d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a280cfc60 0x7f0a280c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55450/0 (socket says 172.21.15.22:55450) 2023-07-11T00:31:08.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.477+0000 7f0a25d9b700 1 -- 172.21.15.22:0/3155460830 learned_addr learned my addr 172.21.15.22:0/3155460830 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:08.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.478+0000 7f0a2659c700 1 --2- 172.21.15.22:0/3155460830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a280b8430 0x7f0a280c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:08.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.478+0000 7f0a26d9d700 1 --2- 172.21.15.22:0/3155460830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a280d3730 0x7f0a280c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:08.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.478+0000 7f0a25d9b700 1 -- 172.21.15.22:0/3155460830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a280d3730 msgr2=0x7f0a280c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:08.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.478+0000 7f0a25d9b700 1 --2- 172.21.15.22:0/3155460830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a280d3730 0x7f0a280c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.478+0000 7f0a25d9b700 1 -- 172.21.15.22:0/3155460830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a280b8430 msgr2=0x7f0a280c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:08.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.478+0000 7f0a25d9b700 1 --2- 172.21.15.22:0/3155460830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a280b8430 0x7f0a280c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.478+0000 7f0a25d9b700 1 -- 172.21.15.22:0/3155460830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a180094a0 con 0x7f0a280cfc60 2023-07-11T00:31:08.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.478+0000 7f0a2659c700 1 --2- 172.21.15.22:0/3155460830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a280b8430 0x7f0a280c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:08.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.478+0000 7f0a25d9b700 1 --2- 172.21.15.22:0/3155460830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a280cfc60 0x7f0a280c9c10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00c520 tx=0x7f0a1c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:08.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.478+0000 7f0a16ffd700 1 -- 172.21.15.22:0/3155460830 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c004c80 con 0x7f0a280cfc60 2023-07-11T00:31:08.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.478+0000 7f0a16ffd700 1 -- 172.21.15.22:0/3155460830 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1c004de0 con 0x7f0a280cfc60 2023-07-11T00:31:08.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.478+0000 7f0a2cdff700 1 -- 172.21.15.22:0/3155460830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a280cad40 con 0x7f0a280cfc60 2023-07-11T00:31:08.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.478+0000 7f0a16ffd700 1 -- 172.21.15.22:0/3155460830 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c007310 con 0x7f0a280cfc60 2023-07-11T00:31:08.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.479+0000 7f0a2cdff700 1 -- 172.21.15.22:0/3155460830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a280ca150 con 0x7f0a280cfc60 2023-07-11T00:31:08.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.479+0000 7f0a2cdff700 1 -- 172.21.15.22:0/3155460830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a280cb260 con 0x7f0a280cfc60 2023-07-11T00:31:08.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.481+0000 7f0a16ffd700 1 -- 172.21.15.22:0/3155460830 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a1c007470 con 0x7f0a280cfc60 2023-07-11T00:31:08.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.482+0000 7f0a16ffd700 1 --2- 172.21.15.22:0/3155460830 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0a0806ace0 0x7f0a0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:08.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.482+0000 7f0a16ffd700 1 -- 172.21.15.22:0/3155460830 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0a1c089450 con 0x7f0a280cfc60 2023-07-11T00:31:08.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.482+0000 7f0a2659c700 1 --2- 172.21.15.22:0/3155460830 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0a0806ace0 0x7f0a0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:08.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.483+0000 7f0a2659c700 1 --2- 172.21.15.22:0/3155460830 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0a0806ace0 0x7f0a0806d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0a18000c00 tx=0x7f0a1801c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:08.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.486+0000 7f0a16ffd700 1 -- 172.21.15.22:0/3155460830 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0a280cb260 con 0x7f0a280cfc60 2023-07-11T00:31:08.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.691+0000 7f0a2cdff700 1 -- 172.21.15.22:0/3155460830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0a280cb260 con 0x7f0a280cfc60 2023-07-11T00:31:08.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.692+0000 7f0a16ffd700 1 -- 172.21.15.22:0/3155460830 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0a280cb260 con 0x7f0a280cfc60 2023-07-11T00:31:08.695 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:08.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.694+0000 7f0a2cdff700 1 -- 172.21.15.22:0/3155460830 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0a0806ace0 msgr2=0x7f0a0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:08.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.694+0000 7f0a2cdff700 1 --2- 172.21.15.22:0/3155460830 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0a0806ace0 0x7f0a0806d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0a18000c00 tx=0x7f0a1801c040 comp rx=0 tx=0).stop 2023-07-11T00:31:08.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.694+0000 7f0a2cdff700 1 -- 172.21.15.22:0/3155460830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a280cfc60 msgr2=0x7f0a280c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:08.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.694+0000 7f0a2cdff700 1 --2- 172.21.15.22:0/3155460830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a280cfc60 0x7f0a280c9c10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00c520 tx=0x7f0a1c00c830 comp rx=0 tx=0).stop 2023-07-11T00:31:08.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.694+0000 7f0a2cdff700 1 -- 172.21.15.22:0/3155460830 shutdown_connections 2023-07-11T00:31:08.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.694+0000 7f0a2cdff700 1 --2- 172.21.15.22:0/3155460830 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0a0806ace0 0x7f0a0806d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.694+0000 7f0a2cdff700 1 --2- 172.21.15.22:0/3155460830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a280d3730 0x7f0a280c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.694+0000 7f0a2cdff700 1 --2- 172.21.15.22:0/3155460830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a280b8430 0x7f0a280c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.694+0000 7f0a2cdff700 1 --2- 172.21.15.22:0/3155460830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a280cfc60 0x7f0a280c9c10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.694+0000 7f0a2cdff700 1 -- 172.21.15.22:0/3155460830 >> 172.21.15.22:0/3155460830 conn(0x7f0a2806b3f0 msgr2=0x7f0a2806b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:08.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.694+0000 7f0a2cdff700 1 -- 172.21.15.22:0/3155460830 shutdown_connections 2023-07-11T00:31:08.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.694+0000 7f0a2cdff700 1 -- 172.21.15.22:0/3155460830 wait complete. 2023-07-11T00:31:08.716 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:31:08.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.916+0000 7f31625ff700 1 Processor -- start 2023-07-11T00:31:08.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.917+0000 7f31625ff700 1 -- start start 2023-07-11T00:31:08.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.918+0000 7f31625ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0d2640 0x7f315c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:08.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.918+0000 7f31625ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f315c0cf8f0 0x7f315c15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:08.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.918+0000 7f31625ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315c0d1790 con 0x7f315c15c460 2023-07-11T00:31:08.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.918+0000 7f31625ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315c0cedd0 con 0x7f315c0cf8f0 2023-07-11T00:31:08.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.918+0000 7f31625ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0cd950 con 0x7f315c0d2640 2023-07-11T00:31:08.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.918+0000 7f3160b9c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f315c0cf8f0 0x7f315c15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:08.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.918+0000 7f3160b9c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f315c0cf8f0 0x7f315c15fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55454/0 (socket says 172.21.15.22:55454) 2023-07-11T00:31:08.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.918+0000 7f3160b9c700 1 -- 172.21.15.22:0/4119217152 learned_addr learned my addr 172.21.15.22:0/4119217152 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:08.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.918+0000 7f315b7fe700 1 --2- 172.21.15.22:0/4119217152 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0d2640 0x7f315c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:08.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.918+0000 7f3160b9c700 1 -- 172.21.15.22:0/4119217152 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0d2640 msgr2=0x7f315c0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:08.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.918+0000 7f3160b9c700 1 --2- 172.21.15.22:0/4119217152 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0d2640 0x7f315c0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.919+0000 7f3160b9c700 1 -- 172.21.15.22:0/4119217152 >> v1:172.21.15.184:6789/0 conn(0x7f315c15c460 legacy=0x7f315c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:08.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.919+0000 7f3160b9c700 1 -- 172.21.15.22:0/4119217152 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c0d14b0 con 0x7f315c0cf8f0 2023-07-11T00:31:08.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.919+0000 7f3160b9c700 1 --2- 172.21.15.22:0/4119217152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f315c0cf8f0 0x7f315c15fe20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3154009e50 tx=0x7f315400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf89c9d8e05b29f server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:08.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.919+0000 7f315affd700 1 -- 172.21.15.22:0/4119217152 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315400e070 con 0x7f315c0cf8f0 2023-07-11T00:31:08.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.919+0000 7f315affd700 1 -- 172.21.15.22:0/4119217152 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315400b9c0 con 0x7f315c0cf8f0 2023-07-11T00:31:08.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.919+0000 7f315affd700 1 -- 172.21.15.22:0/4119217152 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315400bd70 con 0x7f315c0cf8f0 2023-07-11T00:31:08.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.919+0000 7f31625ff700 1 -- 172.21.15.22:0/4119217152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f315c0cf8f0 msgr2=0x7f315c15fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:08.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.919+0000 7f31625ff700 1 --2- 172.21.15.22:0/4119217152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f315c0cf8f0 0x7f315c15fe20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3154009e50 tx=0x7f315400b330 comp rx=0 tx=0).stop 2023-07-11T00:31:08.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.920+0000 7f31625ff700 1 -- 172.21.15.22:0/4119217152 shutdown_connections 2023-07-11T00:31:08.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.920+0000 7f31625ff700 1 --2- 172.21.15.22:0/4119217152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f315c0cf8f0 0x7f315c15fe20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.920+0000 7f31625ff700 1 --2- 172.21.15.22:0/4119217152 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0d2640 0x7f315c0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.920+0000 7f31625ff700 1 -- 172.21.15.22:0/4119217152 >> 172.21.15.22:0/4119217152 conn(0x7f315c071660 msgr2=0x7f315c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:08.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.920+0000 7f31625ff700 1 -- 172.21.15.22:0/4119217152 shutdown_connections 2023-07-11T00:31:08.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.920+0000 7f31625ff700 1 -- 172.21.15.22:0/4119217152 wait complete. 2023-07-11T00:31:08.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.921+0000 7f31625ff700 1 Processor -- start 2023-07-11T00:31:08.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.922+0000 7f31625ff700 1 -- start start 2023-07-11T00:31:08.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.923+0000 7f31625ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f315c0cf8f0 0x7f315c1ef170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:08.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.923+0000 7f31625ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0d2640 0x7f315c1f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:08.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.923+0000 7f31625ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f315c15c460 0x7f315c1511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:08.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.923+0000 7f31625ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c1ef6b0 con 0x7f315c0cf8f0 2023-07-11T00:31:08.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.923+0000 7f31625ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c1f27a0 con 0x7f315c15c460 2023-07-11T00:31:08.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.923+0000 7f31625ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c1f2a80 con 0x7f315c0d2640 2023-07-11T00:31:08.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.923+0000 7f315bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f315c0cf8f0 0x7f315c1ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:08.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.923+0000 7f315bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f315c0cf8f0 0x7f315c1ef170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55466/0 (socket says 172.21.15.22:55466) 2023-07-11T00:31:08.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.923+0000 7f315bfff700 1 -- 172.21.15.22:0/2659834612 learned_addr learned my addr 172.21.15.22:0/2659834612 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:08.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.923+0000 7f315b7fe700 1 --2- 172.21.15.22:0/2659834612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0d2640 0x7f315c1f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:08.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.923+0000 7f3160b9c700 1 --2- 172.21.15.22:0/2659834612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f315c15c460 0x7f315c1511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:08.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.924+0000 7f315bfff700 1 -- 172.21.15.22:0/2659834612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0d2640 msgr2=0x7f315c1f2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:08.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.924+0000 7f315bfff700 1 --2- 172.21.15.22:0/2659834612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0d2640 0x7f315c1f2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.924+0000 7f315bfff700 1 -- 172.21.15.22:0/2659834612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f315c15c460 msgr2=0x7f315c1511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:08.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.924+0000 7f315bfff700 1 --2- 172.21.15.22:0/2659834612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f315c15c460 0x7f315c1511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:08.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.924+0000 7f315bfff700 1 -- 172.21.15.22:0/2659834612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3154009b30 con 0x7f315c0cf8f0 2023-07-11T00:31:08.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.924+0000 7f315b7fe700 1 --2- 172.21.15.22:0/2659834612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0d2640 0x7f315c1f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:08.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.924+0000 7f315bfff700 1 --2- 172.21.15.22:0/2659834612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f315c0cf8f0 0x7f315c1ef170 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f314c00c4e0 tx=0x7f314c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:08.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.924+0000 7f3158ff9700 1 -- 172.21.15.22:0/2659834612 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c0052d0 con 0x7f315c0cf8f0 2023-07-11T00:31:08.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.924+0000 7f3158ff9700 1 -- 172.21.15.22:0/2659834612 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c005430 con 0x7f315c0cf8f0 2023-07-11T00:31:08.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.924+0000 7f31625ff700 1 -- 172.21.15.22:0/2659834612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315c1509e0 con 0x7f315c0cf8f0 2023-07-11T00:31:08.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.924+0000 7f3158ff9700 1 -- 172.21.15.22:0/2659834612 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c0038c0 con 0x7f315c0cf8f0 2023-07-11T00:31:08.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.924+0000 7f31625ff700 1 -- 172.21.15.22:0/2659834612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c1f54b0 con 0x7f315c0cf8f0 2023-07-11T00:31:08.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.925+0000 7f31625ff700 1 -- 172.21.15.22:0/2659834612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315c04ea60 con 0x7f315c0cf8f0 2023-07-11T00:31:08.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.926+0000 7f3158ff9700 1 -- 172.21.15.22:0/2659834612 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f314c003a20 con 0x7f315c0cf8f0 2023-07-11T00:31:08.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.928+0000 7f3158ff9700 1 --2- 172.21.15.22:0/2659834612 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f314806ace0 0x7f314806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:08.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.928+0000 7f3158ff9700 1 -- 172.21.15.22:0/2659834612 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f314c088ba0 con 0x7f315c0cf8f0 2023-07-11T00:31:08.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.928+0000 7f315b7fe700 1 --2- 172.21.15.22:0/2659834612 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f314806ace0 0x7f314806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:08.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.929+0000 7f315b7fe700 1 --2- 172.21.15.22:0/2659834612 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f314806ace0 0x7f314806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f315c0cc9b0 tx=0x7f3150008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:08.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:08.932+0000 7f3158ff9700 1 -- 172.21.15.22:0/2659834612 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f314c053910 con 0x7f315c0cf8f0 2023-07-11T00:31:09.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.139+0000 7f31625ff700 1 -- 172.21.15.22:0/2659834612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f315c0b4fa0 con 0x7f315c0cf8f0 2023-07-11T00:31:09.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.140+0000 7f3158ff9700 1 -- 172.21.15.22:0/2659834612 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f314c056f30 con 0x7f315c0cf8f0 2023-07-11T00:31:09.143 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:09.144 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:54.208536+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:31:09.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.143+0000 7f31625ff700 1 -- 172.21.15.22:0/2659834612 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f314806ace0 msgr2=0x7f314806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:09.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.143+0000 7f31625ff700 1 --2- 172.21.15.22:0/2659834612 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f314806ace0 0x7f314806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f315c0cc9b0 tx=0x7f3150008040 comp rx=0 tx=0).stop 2023-07-11T00:31:09.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.143+0000 7f31625ff700 1 -- 172.21.15.22:0/2659834612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f315c0cf8f0 msgr2=0x7f315c1ef170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:09.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.143+0000 7f31625ff700 1 --2- 172.21.15.22:0/2659834612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f315c0cf8f0 0x7f315c1ef170 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f314c00c4e0 tx=0x7f314c00c7f0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.143+0000 7f31625ff700 1 -- 172.21.15.22:0/2659834612 shutdown_connections 2023-07-11T00:31:09.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.143+0000 7f31625ff700 1 --2- 172.21.15.22:0/2659834612 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f314806ace0 0x7f314806d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.143+0000 7f31625ff700 1 --2- 172.21.15.22:0/2659834612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f315c15c460 0x7f315c1511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.143+0000 7f31625ff700 1 --2- 172.21.15.22:0/2659834612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f315c0cf8f0 0x7f315c1ef170 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.143+0000 7f31625ff700 1 --2- 172.21.15.22:0/2659834612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f315c0d2640 0x7f315c1f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.143+0000 7f31625ff700 1 -- 172.21.15.22:0/2659834612 >> 172.21.15.22:0/2659834612 conn(0x7f315c071660 msgr2=0x7f315c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:09.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.143+0000 7f31625ff700 1 -- 172.21.15.22:0/2659834612 shutdown_connections 2023-07-11T00:31:09.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.143+0000 7f31625ff700 1 -- 172.21.15.22:0/2659834612 wait complete. 2023-07-11T00:31:09.165 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:29:57.631007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:29:58.547599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:30:03.826184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:30:04.383448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-11T00:30:08.075875+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-11T00:31:09.166 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:31:09.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.376+0000 7f552ffff700 1 Processor -- start 2023-07-11T00:31:09.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.376+0000 7f552ffff700 1 -- start start 2023-07-11T00:31:09.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.377+0000 7f552ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f55280b8430 0x7f55280cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:09.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.377+0000 7f552ffff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f55280d3730 0x7f55280cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:09.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.377+0000 7f552ffff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55280d0b20 con 0x7f55280cfa90 2023-07-11T00:31:09.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.377+0000 7f552ffff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55280b8800 con 0x7f55280b8430 2023-07-11T00:31:09.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.377+0000 7f552ffff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55280cfe90 con 0x7f55280d3730 2023-07-11T00:31:09.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.377+0000 7f552dd9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f55280b8430 0x7f55280cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:09.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.378+0000 7f552e59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f55280cfa90 0x7f552815feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47718/0 (socket says 172.21.15.22:47718) 2023-07-11T00:31:09.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.378+0000 7f552e59c700 1 -- 172.21.15.22:0/1766726485 learned_addr learned my addr 172.21.15.22:0/1766726485 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:09.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.378+0000 7f552dd9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f55280b8430 0x7f55280cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55470/0 (socket says 172.21.15.22:55470) 2023-07-11T00:31:09.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.378+0000 7f552d59a700 1 --2- 172.21.15.22:0/1766726485 >> v2:172.21.15.184:3300/0 conn(0x7f55280d3730 0x7f55280cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:09.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.378+0000 7f552dd9b700 1 -- 172.21.15.22:0/1766726485 >> v2:172.21.15.184:3300/0 conn(0x7f55280d3730 msgr2=0x7f55280cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:09.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.378+0000 7f552dd9b700 1 --2- 172.21.15.22:0/1766726485 >> v2:172.21.15.184:3300/0 conn(0x7f55280d3730 0x7f55280cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.378+0000 7f552dd9b700 1 -- 172.21.15.22:0/1766726485 >> v1:172.21.15.22:6789/0 conn(0x7f55280cfa90 legacy=0x7f552815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:09.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.378+0000 7f552dd9b700 1 -- 172.21.15.22:0/1766726485 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55280b4ee0 con 0x7f55280b8430 2023-07-11T00:31:09.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.378+0000 7f552cd99700 1 -- 172.21.15.22:0/1766726485 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028259763 0 0) 0x7f55280d0b20 con 0x7f55280cfa90 2023-07-11T00:31:09.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.378+0000 7f552dd9b700 1 --2- 172.21.15.22:0/1766726485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55280b8430 0x7f55280cd320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5528160f50 tx=0x7f5524009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d7a6ad2aa14eb6 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:09.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.379+0000 7f552cd99700 1 -- 172.21.15.22:0/1766726485 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5524011830 con 0x7f55280b8430 2023-07-11T00:31:09.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.379+0000 7f552cd99700 1 -- 172.21.15.22:0/1766726485 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5524011990 con 0x7f55280b8430 2023-07-11T00:31:09.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.379+0000 7f552cd99700 1 -- 172.21.15.22:0/1766726485 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5524011d20 con 0x7f55280b8430 2023-07-11T00:31:09.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.379+0000 7f552ffff700 1 -- 172.21.15.22:0/1766726485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55280b8430 msgr2=0x7f55280cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:09.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.379+0000 7f552ffff700 1 --2- 172.21.15.22:0/1766726485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55280b8430 0x7f55280cd320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5528160f50 tx=0x7f5524009b20 comp rx=0 tx=0).stop 2023-07-11T00:31:09.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.379+0000 7f552ffff700 1 -- 172.21.15.22:0/1766726485 shutdown_connections 2023-07-11T00:31:09.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.379+0000 7f552ffff700 1 --2- 172.21.15.22:0/1766726485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55280b8430 0x7f55280cd320 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.379+0000 7f552ffff700 1 --2- 172.21.15.22:0/1766726485 >> v2:172.21.15.184:3300/0 conn(0x7f55280d3730 0x7f55280cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.379+0000 7f552ffff700 1 -- 172.21.15.22:0/1766726485 >> 172.21.15.22:0/1766726485 conn(0x7f552806b3f0 msgr2=0x7f552806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:09.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.379+0000 7f552ffff700 1 -- 172.21.15.22:0/1766726485 shutdown_connections 2023-07-11T00:31:09.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.379+0000 7f552ffff700 1 -- 172.21.15.22:0/1766726485 wait complete. 2023-07-11T00:31:09.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.381+0000 7f552ffff700 1 Processor -- start 2023-07-11T00:31:09.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.381+0000 7f552ffff700 1 -- start start 2023-07-11T00:31:09.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.382+0000 7f552ffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55280b8430 0x7f552815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:09.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.382+0000 7f552ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55280cfa90 0x7f552815eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:09.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.382+0000 7f552ffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55280d3730 0x7f552815f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:09.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.382+0000 7f552ffff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552815e860 con 0x7f55280cfa90 2023-07-11T00:31:09.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.382+0000 7f552ffff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55280cb7b0 con 0x7f55280d3730 2023-07-11T00:31:09.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.382+0000 7f552ffff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55280cba50 con 0x7f55280b8430 2023-07-11T00:31:09.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.382+0000 7f552d59a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55280cfa90 0x7f552815eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:09.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.382+0000 7f552d59a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55280cfa90 0x7f552815eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55476/0 (socket says 172.21.15.22:55476) 2023-07-11T00:31:09.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.382+0000 7f552d59a700 1 -- 172.21.15.22:0/2948216565 learned_addr learned my addr 172.21.15.22:0/2948216565 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:09.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.383+0000 7f552e59c700 1 --2- 172.21.15.22:0/2948216565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55280d3730 0x7f552815f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:09.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.383+0000 7f552dd9b700 1 --2- 172.21.15.22:0/2948216565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55280b8430 0x7f552815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:09.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.383+0000 7f552d59a700 1 -- 172.21.15.22:0/2948216565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55280b8430 msgr2=0x7f552815aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:09.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.383+0000 7f552d59a700 1 --2- 172.21.15.22:0/2948216565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55280b8430 0x7f552815aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.383+0000 7f552d59a700 1 -- 172.21.15.22:0/2948216565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55280d3730 msgr2=0x7f552815f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.383+0000 7f552d59a700 1 --2- 172.21.15.22:0/2948216565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55280d3730 0x7f552815f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.383+0000 7f552d59a700 1 -- 172.21.15.22:0/2948216565 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55240094a0 con 0x7f55280cfa90 2023-07-11T00:31:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.383+0000 7f552dd9b700 1 --2- 172.21.15.22:0/2948216565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55280b8430 0x7f552815aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.383+0000 7f552d59a700 1 --2- 172.21.15.22:0/2948216565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55280cfa90 0x7f552815eec0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f551800e810 tx=0x7f551800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.383+0000 7f551e7fc700 1 -- 172.21.15.22:0/2948216565 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518013610 con 0x7f55280cfa90 2023-07-11T00:31:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.383+0000 7f551e7fc700 1 -- 172.21.15.22:0/2948216565 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5518013770 con 0x7f55280cfa90 2023-07-11T00:31:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.383+0000 7f552ffff700 1 -- 172.21.15.22:0/2948216565 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55280cbd30 con 0x7f55280cfa90 2023-07-11T00:31:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.383+0000 7f551e7fc700 1 -- 172.21.15.22:0/2948216565 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518013b00 con 0x7f55280cfa90 2023-07-11T00:31:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.383+0000 7f552ffff700 1 -- 172.21.15.22:0/2948216565 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55280cc2f0 con 0x7f55280cfa90 2023-07-11T00:31:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.385+0000 7f552ffff700 1 -- 172.21.15.22:0/2948216565 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55280cf550 con 0x7f55280cfa90 2023-07-11T00:31:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.385+0000 7f551e7fc700 1 -- 172.21.15.22:0/2948216565 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5518013c60 con 0x7f55280cfa90 2023-07-11T00:31:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.386+0000 7f551e7fc700 1 --2- 172.21.15.22:0/2948216565 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f550c06ace0 0x7f550c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.387+0000 7f551e7fc700 1 -- 172.21.15.22:0/2948216565 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5518089570 con 0x7f55280cfa90 2023-07-11T00:31:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.387+0000 7f552dd9b700 1 --2- 172.21.15.22:0/2948216565 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f550c06ace0 0x7f550c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:09.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.388+0000 7f552dd9b700 1 --2- 172.21.15.22:0/2948216565 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f550c06ace0 0x7f550c06d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f55240090b0 tx=0x7f5524008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:09.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.390+0000 7f551e7fc700 1 -- 172.21.15.22:0/2948216565 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5518054260 con 0x7f55280cfa90 2023-07-11T00:31:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.598+0000 7f552ffff700 1 -- 172.21.15.22:0/2948216565 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f55280b6ef0 con 0x7f55280cfa90 2023-07-11T00:31:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.599+0000 7f551e7fc700 1 -- 172.21.15.22:0/2948216565 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5518057880 con 0x7f55280cfa90 2023-07-11T00:31:09.605 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2023-07-11T00:31:09.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.601+0000 7f552ffff700 1 -- 172.21.15.22:0/2948216565 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f550c06ace0 msgr2=0x7f550c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:09.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.601+0000 7f552ffff700 1 --2- 172.21.15.22:0/2948216565 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f550c06ace0 0x7f550c06d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f55240090b0 tx=0x7f5524008030 comp rx=0 tx=0).stop 2023-07-11T00:31:09.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.601+0000 7f552ffff700 1 -- 172.21.15.22:0/2948216565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55280cfa90 msgr2=0x7f552815eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:09.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.601+0000 7f552ffff700 1 --2- 172.21.15.22:0/2948216565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55280cfa90 0x7f552815eec0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f551800e810 tx=0x7f551800ebd0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.601+0000 7f552ffff700 1 -- 172.21.15.22:0/2948216565 shutdown_connections 2023-07-11T00:31:09.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.601+0000 7f552ffff700 1 --2- 172.21.15.22:0/2948216565 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f550c06ace0 0x7f550c06d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.601+0000 7f552ffff700 1 --2- 172.21.15.22:0/2948216565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55280b8430 0x7f552815aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.601+0000 7f552ffff700 1 --2- 172.21.15.22:0/2948216565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55280d3730 0x7f552815f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.601+0000 7f552ffff700 1 --2- 172.21.15.22:0/2948216565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55280cfa90 0x7f552815eec0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.601+0000 7f552ffff700 1 -- 172.21.15.22:0/2948216565 >> 172.21.15.22:0/2948216565 conn(0x7f552806b3f0 msgr2=0x7f552806b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:09.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.601+0000 7f552ffff700 1 -- 172.21.15.22:0/2948216565 shutdown_connections 2023-07-11T00:31:09.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.601+0000 7f552ffff700 1 -- 172.21.15.22:0/2948216565 wait complete. 2023-07-11T00:31:09.621 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:31:09.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.825+0000 7f7a571ff700 1 Processor -- start 2023-07-11T00:31:09.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.825+0000 7f7a571ff700 1 -- start start 2023-07-11T00:31:09.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.826+0000 7f7a571ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7a500d3730 0x7f7a500cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:09.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.826+0000 7f7a571ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a500d0b20 con 0x7f7a500b8430 2023-07-11T00:31:09.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.826+0000 7f7a571ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a500cfe90 con 0x7f7a500cfa90 2023-07-11T00:31:09.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.827+0000 7f7a571ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a500cda30 con 0x7f7a500d3730 2023-07-11T00:31:09.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.827+0000 7f7a4ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7a500d3730 0x7f7a500cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:09.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.827+0000 7f7a54f9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7a500b8430 0x7f7a500cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47722/0 (socket says 172.21.15.22:47722) 2023-07-11T00:31:09.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.827+0000 7f7a4ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7a500d3730 0x7f7a500cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55482/0 (socket says 172.21.15.22:55482) 2023-07-11T00:31:09.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.827+0000 7f7a54f9b700 1 -- 172.21.15.22:0/3672642576 learned_addr learned my addr 172.21.15.22:0/3672642576 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:09.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.827+0000 7f7a4ffff700 1 -- 172.21.15.22:0/3672642576 >> v1:172.21.15.184:6789/0 conn(0x7f7a500cfa90 legacy=0x7f7a500d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:09.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.827+0000 7f7a4ffff700 1 -- 172.21.15.22:0/3672642576 >> v1:172.21.15.22:6789/0 conn(0x7f7a500b8430 legacy=0x7f7a500cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:09.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.827+0000 7f7a4f7fe700 1 -- 172.21.15.22:0/3672642576 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449236422 0 0) 0x7f7a500cfe90 con 0x7f7a500cfa90 2023-07-11T00:31:09.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.827+0000 7f7a4ffff700 1 -- 172.21.15.22:0/3672642576 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a500b4ee0 con 0x7f7a500d3730 2023-07-11T00:31:09.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.828+0000 7f7a4ffff700 1 --2- 172.21.15.22:0/3672642576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a500d3730 0x7f7a500cf550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009840 tx=0x7f7a3c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59c8e7b7c2d1944 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:09.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.828+0000 7f7a4f7fe700 1 -- 172.21.15.22:0/3672642576 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c011830 con 0x7f7a500d3730 2023-07-11T00:31:09.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.828+0000 7f7a4f7fe700 1 -- 172.21.15.22:0/3672642576 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c011990 con 0x7f7a500d3730 2023-07-11T00:31:09.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.828+0000 7f7a4f7fe700 1 -- 172.21.15.22:0/3672642576 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c011d20 con 0x7f7a500d3730 2023-07-11T00:31:09.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.828+0000 7f7a571ff700 1 -- 172.21.15.22:0/3672642576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a500d3730 msgr2=0x7f7a500cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:09.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.828+0000 7f7a571ff700 1 --2- 172.21.15.22:0/3672642576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a500d3730 0x7f7a500cf550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009840 tx=0x7f7a3c009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:09.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.828+0000 7f7a571ff700 1 -- 172.21.15.22:0/3672642576 shutdown_connections 2023-07-11T00:31:09.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.828+0000 7f7a571ff700 1 --2- 172.21.15.22:0/3672642576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a500d3730 0x7f7a500cf550 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.828+0000 7f7a571ff700 1 -- 172.21.15.22:0/3672642576 >> 172.21.15.22:0/3672642576 conn(0x7f7a5006b3f0 msgr2=0x7f7a5006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:09.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.829+0000 7f7a571ff700 1 -- 172.21.15.22:0/3672642576 shutdown_connections 2023-07-11T00:31:09.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.829+0000 7f7a571ff700 1 -- 172.21.15.22:0/3672642576 wait complete. 2023-07-11T00:31:09.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.830+0000 7f7a571ff700 1 Processor -- start 2023-07-11T00:31:09.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.831+0000 7f7a571ff700 1 -- start start 2023-07-11T00:31:09.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.831+0000 7f7a571ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a500b8430 0x7f7a500c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:09.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.831+0000 7f7a571ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a500cfa90 0x7f7a501f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:09.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.832+0000 7f7a571ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a500d3730 0x7f7a501f1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:09.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.832+0000 7f7a571ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a501f5f90 con 0x7f7a500d3730 2023-07-11T00:31:09.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.832+0000 7f7a571ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5015d520 con 0x7f7a500cfa90 2023-07-11T00:31:09.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.832+0000 7f7a571ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5015c930 con 0x7f7a500b8430 2023-07-11T00:31:09.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.832+0000 7f7a5579c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a500d3730 0x7f7a501f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:09.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.832+0000 7f7a5579c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a500d3730 0x7f7a501f1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55484/0 (socket says 172.21.15.22:55484) 2023-07-11T00:31:09.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.832+0000 7f7a5579c700 1 -- 172.21.15.22:0/3460878160 learned_addr learned my addr 172.21.15.22:0/3460878160 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:09.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.832+0000 7f7a54f9b700 1 --2- 172.21.15.22:0/3460878160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a500b8430 0x7f7a500c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:09.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.832+0000 7f7a4ffff700 1 --2- 172.21.15.22:0/3460878160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a500cfa90 0x7f7a501f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:09.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.832+0000 7f7a5579c700 1 -- 172.21.15.22:0/3460878160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a500b8430 msgr2=0x7f7a500c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:09.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.832+0000 7f7a5579c700 1 --2- 172.21.15.22:0/3460878160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a500b8430 0x7f7a500c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.832+0000 7f7a5579c700 1 -- 172.21.15.22:0/3460878160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a500cfa90 msgr2=0x7f7a501f5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:09.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.832+0000 7f7a5579c700 1 --2- 172.21.15.22:0/3460878160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a500cfa90 0x7f7a501f5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:09.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.832+0000 7f7a5579c700 1 -- 172.21.15.22:0/3460878160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c0094a0 con 0x7f7a500d3730 2023-07-11T00:31:09.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.832+0000 7f7a54f9b700 1 --2- 172.21.15.22:0/3460878160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a500b8430 0x7f7a500c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:09.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.832+0000 7f7a4ffff700 1 --2- 172.21.15.22:0/3460878160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a500cfa90 0x7f7a501f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:09.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.833+0000 7f7a5579c700 1 --2- 172.21.15.22:0/3460878160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a500d3730 0x7f7a501f1240 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7a48001560 tx=0x7f7a4800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:09.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.833+0000 7f7a4d7fa700 1 -- 172.21.15.22:0/3460878160 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48003e30 con 0x7f7a500d3730 2023-07-11T00:31:09.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.833+0000 7f7a4d7fa700 1 -- 172.21.15.22:0/3460878160 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a48005070 con 0x7f7a500d3730 2023-07-11T00:31:09.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.833+0000 7f7a4d7fa700 1 -- 172.21.15.22:0/3460878160 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48005420 con 0x7f7a500d3730 2023-07-11T00:31:09.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.833+0000 7f7a571ff700 1 -- 172.21.15.22:0/3460878160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5015cbf0 con 0x7f7a500d3730 2023-07-11T00:31:09.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.833+0000 7f7a571ff700 1 -- 172.21.15.22:0/3460878160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5015d1b0 con 0x7f7a500d3730 2023-07-11T00:31:09.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.834+0000 7f7a571ff700 1 -- 172.21.15.22:0/3460878160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5015d690 con 0x7f7a500d3730 2023-07-11T00:31:09.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.835+0000 7f7a4d7fa700 1 -- 172.21.15.22:0/3460878160 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a48005580 con 0x7f7a500d3730 2023-07-11T00:31:09.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.836+0000 7f7a4d7fa700 1 --2- 172.21.15.22:0/3460878160 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7a3406ace0 0x7f7a3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:09.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.836+0000 7f7a4d7fa700 1 -- 172.21.15.22:0/3460878160 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7a48089050 con 0x7f7a500d3730 2023-07-11T00:31:09.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.836+0000 7f7a54f9b700 1 --2- 172.21.15.22:0/3460878160 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7a3406ace0 0x7f7a3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:09.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.837+0000 7f7a54f9b700 1 --2- 172.21.15.22:0/3460878160 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7a3406ace0 0x7f7a3406d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7a44005910 tx=0x7f7a44009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:09.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:09.840+0000 7f7a4d7fa700 1 -- 172.21.15.22:0/3460878160 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7a480bb380 con 0x7f7a500d3730 2023-07-11T00:31:10.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.051+0000 7f7a571ff700 1 -- 172.21.15.22:0/3460878160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a5004ea60 con 0x7f7a500d3730 2023-07-11T00:31:10.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.052+0000 7f7a4d7fa700 1 -- 172.21.15.22:0/3460878160 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a480170a0 con 0x7f7a500d3730 2023-07-11T00:31:10.056 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-07-11T00:31:10.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.054+0000 7f7a571ff700 1 -- 172.21.15.22:0/3460878160 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7a3406ace0 msgr2=0x7f7a3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:10.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.054+0000 7f7a571ff700 1 --2- 172.21.15.22:0/3460878160 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7a3406ace0 0x7f7a3406d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7a44005910 tx=0x7f7a44009040 comp rx=0 tx=0).stop 2023-07-11T00:31:10.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.054+0000 7f7a571ff700 1 -- 172.21.15.22:0/3460878160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a500d3730 msgr2=0x7f7a501f1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:10.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.054+0000 7f7a571ff700 1 --2- 172.21.15.22:0/3460878160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a500d3730 0x7f7a501f1240 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7a48001560 tx=0x7f7a4800cc00 comp rx=0 tx=0).stop 2023-07-11T00:31:10.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.054+0000 7f7a571ff700 1 -- 172.21.15.22:0/3460878160 shutdown_connections 2023-07-11T00:31:10.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.054+0000 7f7a571ff700 1 --2- 172.21.15.22:0/3460878160 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f7a3406ace0 0x7f7a3406d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.054+0000 7f7a571ff700 1 --2- 172.21.15.22:0/3460878160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a500b8430 0x7f7a500c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.054+0000 7f7a571ff700 1 --2- 172.21.15.22:0/3460878160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a500d3730 0x7f7a501f1240 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.054+0000 7f7a571ff700 1 --2- 172.21.15.22:0/3460878160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a500cfa90 0x7f7a501f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.054+0000 7f7a571ff700 1 -- 172.21.15.22:0/3460878160 >> 172.21.15.22:0/3460878160 conn(0x7f7a5006b3f0 msgr2=0x7f7a500d19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:10.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.055+0000 7f7a571ff700 1 -- 172.21.15.22:0/3460878160 shutdown_connections 2023-07-11T00:31:10.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.055+0000 7f7a571ff700 1 -- 172.21.15.22:0/3460878160 wait complete. 2023-07-11T00:31:10.076 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:31:10.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.277+0000 7f80d17ff700 1 Processor -- start 2023-07-11T00:31:10.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.278+0000 7f80d17ff700 1 -- start start 2023-07-11T00:31:10.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.279+0000 7f80d17ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80cc0d3730 0x7f80cc0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:10.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.279+0000 7f80d17ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80cc0d0b20 con 0x7f80cc0b8430 2023-07-11T00:31:10.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.279+0000 7f80d17ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80cc0cfe90 con 0x7f80cc0cfa90 2023-07-11T00:31:10.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.279+0000 7f80d17ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc0cda30 con 0x7f80cc0d3730 2023-07-11T00:31:10.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.279+0000 7f80c3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80cc0d3730 0x7f80cc0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:10.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.279+0000 7f80caffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f80cc0b8430 0x7f80cc0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59836/0 (socket says 172.21.15.22:59836) 2023-07-11T00:31:10.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.279+0000 7f80caffd700 1 -- 172.21.15.22:0/2891673670 learned_addr learned my addr 172.21.15.22:0/2891673670 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:10.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.280+0000 7f80c3fff700 1 -- 172.21.15.22:0/2891673670 >> v1:172.21.15.184:6789/0 conn(0x7f80cc0cfa90 legacy=0x7f80cc0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:10.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.280+0000 7f80c3fff700 1 -- 172.21.15.22:0/2891673670 >> v1:172.21.15.22:6789/0 conn(0x7f80cc0b8430 legacy=0x7f80cc0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:10.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.280+0000 7f80c3fff700 1 -- 172.21.15.22:0/2891673670 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc0b4ee0 con 0x7f80cc0d3730 2023-07-11T00:31:10.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.280+0000 7f80c3fff700 1 --2- 172.21.15.22:0/2891673670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0d3730 0x7f80cc0cf550 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009840 tx=0x7f80b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd431ba84c90aba8 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:10.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.280+0000 7f80ca7fc700 1 -- 172.21.15.22:0/2891673670 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4011830 con 0x7f80cc0d3730 2023-07-11T00:31:10.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.280+0000 7f80ca7fc700 1 -- 172.21.15.22:0/2891673670 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b4011990 con 0x7f80cc0d3730 2023-07-11T00:31:10.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.280+0000 7f80ca7fc700 1 -- 172.21.15.22:0/2891673670 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4011d20 con 0x7f80cc0d3730 2023-07-11T00:31:10.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.281+0000 7f80d17ff700 1 -- 172.21.15.22:0/2891673670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0d3730 msgr2=0x7f80cc0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:10.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.281+0000 7f80d17ff700 1 --2- 172.21.15.22:0/2891673670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0d3730 0x7f80cc0cf550 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009840 tx=0x7f80b4009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:10.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.281+0000 7f80d17ff700 1 -- 172.21.15.22:0/2891673670 shutdown_connections 2023-07-11T00:31:10.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.281+0000 7f80d17ff700 1 --2- 172.21.15.22:0/2891673670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0d3730 0x7f80cc0cf550 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.281+0000 7f80d17ff700 1 -- 172.21.15.22:0/2891673670 >> 172.21.15.22:0/2891673670 conn(0x7f80cc06b3f0 msgr2=0x7f80cc06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:10.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.281+0000 7f80d17ff700 1 -- 172.21.15.22:0/2891673670 shutdown_connections 2023-07-11T00:31:10.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.281+0000 7f80d17ff700 1 -- 172.21.15.22:0/2891673670 wait complete. 2023-07-11T00:31:10.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.283+0000 7f80d17ff700 1 Processor -- start 2023-07-11T00:31:10.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.283+0000 7f80d17ff700 1 -- start start 2023-07-11T00:31:10.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80d17ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80cc0b8430 0x7f80cc0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80d17ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80cc0cfa90 0x7f80cc14cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80d17ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0d3730 0x7f80cc0c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80d17ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc0c9560 con 0x7f80cc0d3730 2023-07-11T00:31:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80d17ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc0c7f80 con 0x7f80cc0cfa90 2023-07-11T00:31:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80d17ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc0c8260 con 0x7f80cc0b8430 2023-07-11T00:31:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80cb7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0d3730 0x7f80cc0c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80cb7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0d3730 0x7f80cc0c7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43304/0 (socket says 172.21.15.22:43304) 2023-07-11T00:31:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80cb7fe700 1 -- 172.21.15.22:0/2321049516 learned_addr learned my addr 172.21.15.22:0/2321049516 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80c3fff700 1 --2- 172.21.15.22:0/2321049516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80cc0cfa90 0x7f80cc14cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80caffd700 1 --2- 172.21.15.22:0/2321049516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80cc0b8430 0x7f80cc0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80cb7fe700 1 -- 172.21.15.22:0/2321049516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80cc0b8430 msgr2=0x7f80cc0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80cb7fe700 1 --2- 172.21.15.22:0/2321049516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80cc0b8430 0x7f80cc0c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80cb7fe700 1 -- 172.21.15.22:0/2321049516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80cc0cfa90 msgr2=0x7f80cc14cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:10.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80cb7fe700 1 --2- 172.21.15.22:0/2321049516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80cc0cfa90 0x7f80cc14cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80cb7fe700 1 -- 172.21.15.22:0/2321049516 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b40094a0 con 0x7f80cc0d3730 2023-07-11T00:31:10.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80c3fff700 1 --2- 172.21.15.22:0/2321049516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80cc0cfa90 0x7f80cc14cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:10.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.284+0000 7f80caffd700 1 --2- 172.21.15.22:0/2321049516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80cc0b8430 0x7f80cc0c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:10.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.285+0000 7f80cb7fe700 1 --2- 172.21.15.22:0/2321049516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0d3730 0x7f80cc0c7730 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f80c400cc50 tx=0x7f80c400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:10.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.285+0000 7f80c37fe700 1 -- 172.21.15.22:0/2321049516 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c400ad80 con 0x7f80cc0d3730 2023-07-11T00:31:10.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.285+0000 7f80c37fe700 1 -- 172.21.15.22:0/2321049516 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c400ce50 con 0x7f80cc0d3730 2023-07-11T00:31:10.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.285+0000 7f80c37fe700 1 -- 172.21.15.22:0/2321049516 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4003c40 con 0x7f80cc0d3730 2023-07-11T00:31:10.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.285+0000 7f80d17ff700 1 -- 172.21.15.22:0/2321049516 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80cc0c8540 con 0x7f80cc0d3730 2023-07-11T00:31:10.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.285+0000 7f80d17ff700 1 -- 172.21.15.22:0/2321049516 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80cc0c8b00 con 0x7f80cc0d3730 2023-07-11T00:31:10.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.286+0000 7f80d17ff700 1 -- 172.21.15.22:0/2321049516 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80cc04ea60 con 0x7f80cc0d3730 2023-07-11T00:31:10.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.287+0000 7f80c37fe700 1 -- 172.21.15.22:0/2321049516 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f80c40050d0 con 0x7f80cc0d3730 2023-07-11T00:31:10.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.288+0000 7f80c37fe700 1 --2- 172.21.15.22:0/2321049516 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80ac06ace0 0x7f80ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:10.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.288+0000 7f80c37fe700 1 -- 172.21.15.22:0/2321049516 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f80c4089960 con 0x7f80cc0d3730 2023-07-11T00:31:10.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.288+0000 7f80caffd700 1 --2- 172.21.15.22:0/2321049516 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80ac06ace0 0x7f80ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:10.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.289+0000 7f80caffd700 1 --2- 172.21.15.22:0/2321049516 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80ac06ace0 0x7f80ac06d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f80bc005910 tx=0x7f80bc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:10.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.292+0000 7f80c37fe700 1 -- 172.21.15.22:0/2321049516 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f80c4054640 con 0x7f80cc0d3730 2023-07-11T00:31:10.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.496+0000 7f80d17ff700 1 -- 172.21.15.22:0/2321049516 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80cc0d1df0 con 0x7f80cc0d3730 2023-07-11T00:31:10.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.497+0000 7f80c37fe700 1 -- 172.21.15.22:0/2321049516 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80c4057c60 con 0x7f80cc0d3730 2023-07-11T00:31:10.500 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:10.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.499+0000 7f80d17ff700 1 -- 172.21.15.22:0/2321049516 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80ac06ace0 msgr2=0x7f80ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:10.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.499+0000 7f80d17ff700 1 --2- 172.21.15.22:0/2321049516 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80ac06ace0 0x7f80ac06d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f80bc005910 tx=0x7f80bc009040 comp rx=0 tx=0).stop 2023-07-11T00:31:10.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.499+0000 7f80d17ff700 1 -- 172.21.15.22:0/2321049516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0d3730 msgr2=0x7f80cc0c7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:10.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.499+0000 7f80d17ff700 1 --2- 172.21.15.22:0/2321049516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0d3730 0x7f80cc0c7730 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f80c400cc50 tx=0x7f80c400a340 comp rx=0 tx=0).stop 2023-07-11T00:31:10.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.499+0000 7f80d17ff700 1 -- 172.21.15.22:0/2321049516 shutdown_connections 2023-07-11T00:31:10.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.500+0000 7f80d17ff700 1 --2- 172.21.15.22:0/2321049516 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80ac06ace0 0x7f80ac06d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.500+0000 7f80d17ff700 1 --2- 172.21.15.22:0/2321049516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80cc0b8430 0x7f80cc0c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.500+0000 7f80d17ff700 1 --2- 172.21.15.22:0/2321049516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0d3730 0x7f80cc0c7730 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.500+0000 7f80d17ff700 1 --2- 172.21.15.22:0/2321049516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80cc0cfa90 0x7f80cc14cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.500+0000 7f80d17ff700 1 -- 172.21.15.22:0/2321049516 >> 172.21.15.22:0/2321049516 conn(0x7f80cc06b3f0 msgr2=0x7f80cc06b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:10.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.500+0000 7f80d17ff700 1 -- 172.21.15.22:0/2321049516 shutdown_connections 2023-07-11T00:31:10.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.500+0000 7f80d17ff700 1 -- 172.21.15.22:0/2321049516 wait complete. 2023-07-11T00:31:10.520 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:31:10.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.721+0000 7f71005ff700 1 Processor -- start 2023-07-11T00:31:10.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.722+0000 7f71005ff700 1 -- start start 2023-07-11T00:31:10.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.723+0000 7f71005ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70f80d3730 0x7f70f80cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:10.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.723+0000 7f71005ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f70f80cfa90 0x7f70f80d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:10.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.723+0000 7f71005ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f80d0b20 con 0x7f70f80b8430 2023-07-11T00:31:10.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.723+0000 7f71005ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f80cda30 con 0x7f70f80cfa90 2023-07-11T00:31:10.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.723+0000 7f71005ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80b8800 con 0x7f70f80d3730 2023-07-11T00:31:10.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.723+0000 7f70feb9c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f70f80cfa90 0x7f70f80d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:10.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.723+0000 7f70fe39b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f70f80b8430 0x7f70f80cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:43260/0 (socket says 172.21.15.22:43260) 2023-07-11T00:31:10.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.723+0000 7f70fe39b700 1 -- 172.21.15.22:0/4199662197 learned_addr learned my addr 172.21.15.22:0/4199662197 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:10.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.723+0000 7f70fdb9a700 1 --2- 172.21.15.22:0/4199662197 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70f80d3730 0x7f70f80cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:10.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.724+0000 7f70feb9c700 1 -- 172.21.15.22:0/4199662197 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70f80d3730 msgr2=0x7f70f80cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:10.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.724+0000 7f70feb9c700 1 --2- 172.21.15.22:0/4199662197 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70f80d3730 0x7f70f80cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.724+0000 7f70feb9c700 1 -- 172.21.15.22:0/4199662197 >> v1:172.21.15.184:6789/0 conn(0x7f70f80b8430 legacy=0x7f70f80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:10.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.724+0000 7f70feb9c700 1 -- 172.21.15.22:0/4199662197 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f80cfeb0 con 0x7f70f80cfa90 2023-07-11T00:31:10.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.724+0000 7f70fd399700 1 -- 172.21.15.22:0/4199662197 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014455825 0 0) 0x7f70f80d0b20 con 0x7f70f80b8430 2023-07-11T00:31:10.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.724+0000 7f70feb9c700 1 --2- 172.21.15.22:0/4199662197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f80cfa90 0x7f70f80d0fb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009d90 tx=0x7f70f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0943ae044fc56a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:10.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.724+0000 7f70fd399700 1 -- 172.21.15.22:0/4199662197 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f000e070 con 0x7f70f80cfa90 2023-07-11T00:31:10.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.724+0000 7f70fd399700 1 -- 172.21.15.22:0/4199662197 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f000bb20 con 0x7f70f80cfa90 2023-07-11T00:31:10.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.724+0000 7f70fd399700 1 -- 172.21.15.22:0/4199662197 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0012430 con 0x7f70f80cfa90 2023-07-11T00:31:10.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.725+0000 7f71005ff700 1 -- 172.21.15.22:0/4199662197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f80cfa90 msgr2=0x7f70f80d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:10.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.725+0000 7f71005ff700 1 --2- 172.21.15.22:0/4199662197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f80cfa90 0x7f70f80d0fb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009d90 tx=0x7f70f000b330 comp rx=0 tx=0).stop 2023-07-11T00:31:10.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.725+0000 7f71005ff700 1 -- 172.21.15.22:0/4199662197 shutdown_connections 2023-07-11T00:31:10.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.725+0000 7f71005ff700 1 --2- 172.21.15.22:0/4199662197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f80cfa90 0x7f70f80d0fb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.725+0000 7f71005ff700 1 --2- 172.21.15.22:0/4199662197 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70f80d3730 0x7f70f80cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.725+0000 7f71005ff700 1 -- 172.21.15.22:0/4199662197 >> 172.21.15.22:0/4199662197 conn(0x7f70f806b3f0 msgr2=0x7f70f806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:10.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.725+0000 7f71005ff700 1 -- 172.21.15.22:0/4199662197 shutdown_connections 2023-07-11T00:31:10.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.725+0000 7f71005ff700 1 -- 172.21.15.22:0/4199662197 wait complete. 2023-07-11T00:31:10.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.727+0000 7f71005ff700 1 Processor -- start 2023-07-11T00:31:10.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.727+0000 7f71005ff700 1 -- start start 2023-07-11T00:31:10.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.728+0000 7f71005ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f80b8430 0x7f70f80b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:10.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.728+0000 7f71005ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70f80cfa90 0x7f70f815ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:10.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.728+0000 7f71005ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70f80d3730 0x7f70f814eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:10.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.728+0000 7f71005ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80c77f0 con 0x7f70f80b8430 2023-07-11T00:31:10.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.728+0000 7f71005ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80c8650 con 0x7f70f80cfa90 2023-07-11T00:31:10.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.728+0000 7f71005ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80c7a40 con 0x7f70f80d3730 2023-07-11T00:31:10.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.728+0000 7f70fe39b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f80b8430 0x7f70f80b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:10.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.728+0000 7f70fe39b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f80b8430 0x7f70f80b5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43326/0 (socket says 172.21.15.22:43326) 2023-07-11T00:31:10.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.728+0000 7f70fe39b700 1 -- 172.21.15.22:0/349669526 learned_addr learned my addr 172.21.15.22:0/349669526 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:10.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.728+0000 7f70feb9c700 1 --2- 172.21.15.22:0/349669526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70f80d3730 0x7f70f814eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:10.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.728+0000 7f70fdb9a700 1 --2- 172.21.15.22:0/349669526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70f80cfa90 0x7f70f815ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:10.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.729+0000 7f70fe39b700 1 -- 172.21.15.22:0/349669526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70f80d3730 msgr2=0x7f70f814eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:10.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.729+0000 7f70fe39b700 1 --2- 172.21.15.22:0/349669526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70f80d3730 0x7f70f814eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.729+0000 7f70fe39b700 1 -- 172.21.15.22:0/349669526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70f80cfa90 msgr2=0x7f70f815ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:10.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.729+0000 7f70fe39b700 1 --2- 172.21.15.22:0/349669526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70f80cfa90 0x7f70f815ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.729+0000 7f70fe39b700 1 -- 172.21.15.22:0/349669526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f0009a70 con 0x7f70f80b8430 2023-07-11T00:31:10.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.729+0000 7f70fe39b700 1 --2- 172.21.15.22:0/349669526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f80b8430 0x7f70f80b5be0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f70f400c520 tx=0x7f70f400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:10.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.729+0000 7f70eeffd700 1 -- 172.21.15.22:0/349669526 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4004c80 con 0x7f70f80b8430 2023-07-11T00:31:10.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.729+0000 7f70eeffd700 1 -- 172.21.15.22:0/349669526 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f4004e00 con 0x7f70f80b8430 2023-07-11T00:31:10.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.729+0000 7f71005ff700 1 -- 172.21.15.22:0/349669526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f80c7d20 con 0x7f70f80b8430 2023-07-11T00:31:10.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.729+0000 7f70eeffd700 1 -- 172.21.15.22:0/349669526 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4007310 con 0x7f70f80b8430 2023-07-11T00:31:10.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.729+0000 7f71005ff700 1 -- 172.21.15.22:0/349669526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f80c82e0 con 0x7f70f80b8430 2023-07-11T00:31:10.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.730+0000 7f71005ff700 1 -- 172.21.15.22:0/349669526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f804ea60 con 0x7f70f80b8430 2023-07-11T00:31:10.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.732+0000 7f70eeffd700 1 -- 172.21.15.22:0/349669526 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f70f4007470 con 0x7f70f80b8430 2023-07-11T00:31:10.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.733+0000 7f70eeffd700 1 --2- 172.21.15.22:0/349669526 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f70dc06ace0 0x7f70dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:10.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.733+0000 7f70eeffd700 1 -- 172.21.15.22:0/349669526 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f70f4089c10 con 0x7f70f80b8430 2023-07-11T00:31:10.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.733+0000 7f70fdb9a700 1 --2- 172.21.15.22:0/349669526 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f70dc06ace0 0x7f70dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:10.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.734+0000 7f70fdb9a700 1 --2- 172.21.15.22:0/349669526 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f70dc06ace0 0x7f70dc06d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f70f80c9640 tx=0x7f70e8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:10.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.736+0000 7f70eeffd700 1 -- 172.21.15.22:0/349669526 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f70f4054970 con 0x7f70f80b8430 2023-07-11T00:31:10.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.943+0000 7f71005ff700 1 -- 172.21.15.22:0/349669526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f70f80c87c0 con 0x7f70f80b8430 2023-07-11T00:31:10.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.943+0000 7f70eeffd700 1 -- 172.21.15.22:0/349669526 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f70f4057f90 con 0x7f70f80b8430 2023-07-11T00:31:10.946 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-07-11T00:31:10.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.945+0000 7f71005ff700 1 -- 172.21.15.22:0/349669526 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f70dc06ace0 msgr2=0x7f70dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:10.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.945+0000 7f71005ff700 1 --2- 172.21.15.22:0/349669526 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f70dc06ace0 0x7f70dc06d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f70f80c9640 tx=0x7f70e8008040 comp rx=0 tx=0).stop 2023-07-11T00:31:10.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.945+0000 7f71005ff700 1 -- 172.21.15.22:0/349669526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f80b8430 msgr2=0x7f70f80b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:10.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.945+0000 7f71005ff700 1 --2- 172.21.15.22:0/349669526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f80b8430 0x7f70f80b5be0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f70f400c520 tx=0x7f70f400c8e0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.946+0000 7f71005ff700 1 -- 172.21.15.22:0/349669526 shutdown_connections 2023-07-11T00:31:10.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.946+0000 7f71005ff700 1 --2- 172.21.15.22:0/349669526 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f70dc06ace0 0x7f70dc06d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.946+0000 7f71005ff700 1 --2- 172.21.15.22:0/349669526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70f80d3730 0x7f70f814eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.946+0000 7f71005ff700 1 --2- 172.21.15.22:0/349669526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70f80b8430 0x7f70f80b5be0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.946+0000 7f71005ff700 1 --2- 172.21.15.22:0/349669526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70f80cfa90 0x7f70f815ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:10.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.946+0000 7f71005ff700 1 -- 172.21.15.22:0/349669526 >> 172.21.15.22:0/349669526 conn(0x7f70f806b3f0 msgr2=0x7f70f80d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:10.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.946+0000 7f71005ff700 1 -- 172.21.15.22:0/349669526 shutdown_connections 2023-07-11T00:31:10.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:10.946+0000 7f71005ff700 1 -- 172.21.15.22:0/349669526 wait complete. 2023-07-11T00:31:10.966 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-11T00:31:11.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.168+0000 7f2fb5dff700 1 Processor -- start 2023-07-11T00:31:11.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.168+0000 7f2fb5dff700 1 -- start start 2023-07-11T00:31:11.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.170+0000 7f2fb5dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fb00d3730 0x7f2fb00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:11.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.170+0000 7f2fb5dff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2fb00cfa90 0x7f2fb00d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:11.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.170+0000 7f2fb5dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb00d0b20 con 0x7f2fb00b8430 2023-07-11T00:31:11.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.170+0000 7f2fb5dff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb00cda30 con 0x7f2fb00cfa90 2023-07-11T00:31:11.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.170+0000 7f2fb5dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00b8800 con 0x7f2fb00d3730 2023-07-11T00:31:11.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.170+0000 7f2faffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2fb00cfa90 0x7f2fb00d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:11.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.170+0000 7f2faffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2fb00cfa90 0x7f2fb00d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43340/0 (socket says 172.21.15.22:43340) 2023-07-11T00:31:11.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.170+0000 7f2faffff700 1 -- 172.21.15.22:0/2271800002 learned_addr learned my addr 172.21.15.22:0/2271800002 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:11.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.170+0000 7f2fa7fff700 1 --2- 172.21.15.22:0/2271800002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fb00d3730 0x7f2fb00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:11.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.170+0000 7f2faffff700 1 -- 172.21.15.22:0/2271800002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fb00d3730 msgr2=0x7f2fb00cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:11.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.170+0000 7f2faffff700 1 --2- 172.21.15.22:0/2271800002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fb00d3730 0x7f2fb00cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:11.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.170+0000 7f2faffff700 1 -- 172.21.15.22:0/2271800002 >> v1:172.21.15.184:6789/0 conn(0x7f2fb00b8430 legacy=0x7f2fb00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:11.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.170+0000 7f2faffff700 1 -- 172.21.15.22:0/2271800002 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00cfeb0 con 0x7f2fb00cfa90 2023-07-11T00:31:11.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.170+0000 7f2fa7fff700 1 --2- 172.21.15.22:0/2271800002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fb00d3730 0x7f2fb00cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:11.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.171+0000 7f2faffff700 1 --2- 172.21.15.22:0/2271800002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2fb00cfa90 0x7f2fb00d0fb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8009e50 tx=0x7f2fa800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f551403d7d6996b server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:11.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.171+0000 7f2faeffd700 1 -- 172.21.15.22:0/2271800002 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa800e070 con 0x7f2fb00cfa90 2023-07-11T00:31:11.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.171+0000 7f2faeffd700 1 -- 172.21.15.22:0/2271800002 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa8003a20 con 0x7f2fb00cfa90 2023-07-11T00:31:11.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.171+0000 7f2faeffd700 1 -- 172.21.15.22:0/2271800002 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8003dd0 con 0x7f2fb00cfa90 2023-07-11T00:31:11.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.171+0000 7f2fb5dff700 1 -- 172.21.15.22:0/2271800002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2fb00cfa90 msgr2=0x7f2fb00d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:11.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.171+0000 7f2fb5dff700 1 --2- 172.21.15.22:0/2271800002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2fb00cfa90 0x7f2fb00d0fb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8009e50 tx=0x7f2fa800b330 comp rx=0 tx=0).stop 2023-07-11T00:31:11.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.171+0000 7f2fb5dff700 1 -- 172.21.15.22:0/2271800002 shutdown_connections 2023-07-11T00:31:11.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.172+0000 7f2fb5dff700 1 --2- 172.21.15.22:0/2271800002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2fb00cfa90 0x7f2fb00d0fb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:11.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.172+0000 7f2fb5dff700 1 --2- 172.21.15.22:0/2271800002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fb00d3730 0x7f2fb00cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:11.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.172+0000 7f2fb5dff700 1 -- 172.21.15.22:0/2271800002 >> 172.21.15.22:0/2271800002 conn(0x7f2fb006b3f0 msgr2=0x7f2fb006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:11.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.172+0000 7f2fb5dff700 1 -- 172.21.15.22:0/2271800002 shutdown_connections 2023-07-11T00:31:11.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.172+0000 7f2fb5dff700 1 -- 172.21.15.22:0/2271800002 wait complete. 2023-07-11T00:31:11.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.173+0000 7f2fb5dff700 1 Processor -- start 2023-07-11T00:31:11.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.173+0000 7f2fb5dff700 1 -- start start 2023-07-11T00:31:11.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.174+0000 7f2fb5dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fb00b8430 0x7f2fb01f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:11.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.174+0000 7f2fb5dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fb00cfa90 0x7f2fb00cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:11.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.174+0000 7f2fb5dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2fb00d3730 0x7f2fb01f1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:11.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.174+0000 7f2fb5dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00ca300 con 0x7f2fb00d3730 2023-07-11T00:31:11.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.174+0000 7f2fb5dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00cbe10 con 0x7f2fb00b8430 2023-07-11T00:31:11.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.174+0000 7f2fb5dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00c9cb0 con 0x7f2fb00cfa90 2023-07-11T00:31:11.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.175+0000 7f2faffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2fb00d3730 0x7f2fb01f1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:11.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.175+0000 7f2faffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2fb00d3730 0x7f2fb01f1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43354/0 (socket says 172.21.15.22:43354) 2023-07-11T00:31:11.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.175+0000 7f2faffff700 1 -- 172.21.15.22:0/2768385274 learned_addr learned my addr 172.21.15.22:0/2768385274 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:11.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.175+0000 7f2faf7fe700 1 --2- 172.21.15.22:0/2768385274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fb00b8430 0x7f2fb01f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:11.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.175+0000 7f2fa7fff700 1 --2- 172.21.15.22:0/2768385274 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fb00cfa90 0x7f2fb00cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:11.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.175+0000 7f2faffff700 1 -- 172.21.15.22:0/2768385274 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fb00cfa90 msgr2=0x7f2fb00cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:11.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.175+0000 7f2faffff700 1 --2- 172.21.15.22:0/2768385274 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fb00cfa90 0x7f2fb00cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:11.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.175+0000 7f2faffff700 1 -- 172.21.15.22:0/2768385274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fb00b8430 msgr2=0x7f2fb01f2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:11.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.175+0000 7f2faffff700 1 --2- 172.21.15.22:0/2768385274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fb00b8430 0x7f2fb01f2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:11.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.175+0000 7f2faffff700 1 -- 172.21.15.22:0/2768385274 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa8009b30 con 0x7f2fb00d3730 2023-07-11T00:31:11.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.175+0000 7f2faf7fe700 1 --2- 172.21.15.22:0/2768385274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fb00b8430 0x7f2fb01f2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:11.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.175+0000 7f2faffff700 1 --2- 172.21.15.22:0/2768385274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2fb00d3730 0x7f2fb01f1500 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2fb006c780 tx=0x7f2fa8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:11.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.176+0000 7f2facff9700 1 -- 172.21.15.22:0/2768385274 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8004440 con 0x7f2fb00d3730 2023-07-11T00:31:11.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.176+0000 7f2facff9700 1 -- 172.21.15.22:0/2768385274 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa80045a0 con 0x7f2fb00d3730 2023-07-11T00:31:11.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.176+0000 7f2facff9700 1 -- 172.21.15.22:0/2768385274 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8004950 con 0x7f2fb00d3730 2023-07-11T00:31:11.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.176+0000 7f2fb5dff700 1 -- 172.21.15.22:0/2768385274 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb00c9f90 con 0x7f2fb00d3730 2023-07-11T00:31:11.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.176+0000 7f2fb5dff700 1 -- 172.21.15.22:0/2768385274 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb01f1a40 con 0x7f2fb00d3730 2023-07-11T00:31:11.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.177+0000 7f2fb5dff700 1 -- 172.21.15.22:0/2768385274 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb004ea60 con 0x7f2fb00d3730 2023-07-11T00:31:11.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.178+0000 7f2facff9700 1 -- 172.21.15.22:0/2768385274 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2fa8025450 con 0x7f2fb00d3730 2023-07-11T00:31:11.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.179+0000 7f2facff9700 1 --2- 172.21.15.22:0/2768385274 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2f9006ace0 0x7f2f9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:11.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.179+0000 7f2facff9700 1 -- 172.21.15.22:0/2768385274 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2fa808b0b0 con 0x7f2fb00d3730 2023-07-11T00:31:11.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.180+0000 7f2faf7fe700 1 --2- 172.21.15.22:0/2768385274 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2f9006ace0 0x7f2f9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:11.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.180+0000 7f2faf7fe700 1 --2- 172.21.15.22:0/2768385274 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2f9006ace0 0x7f2f9006d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00b4ae0 tx=0x7f2fa0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:11.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.184+0000 7f2facff9700 1 -- 172.21.15.22:0/2768385274 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2fa8055da0 con 0x7f2fb00d3730 2023-07-11T00:31:11.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.393+0000 7f2fb5dff700 1 -- 172.21.15.22:0/2768385274 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2fb015c560 con 0x7f2fb00d3730 2023-07-11T00:31:11.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.393+0000 7f2facff9700 1 -- 172.21.15.22:0/2768385274 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2fa80593c0 con 0x7f2fb00d3730 2023-07-11T00:31:11.396 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:11.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.395+0000 7f2fb5dff700 1 -- 172.21.15.22:0/2768385274 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2f9006ace0 msgr2=0x7f2f9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:11.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.395+0000 7f2fb5dff700 1 --2- 172.21.15.22:0/2768385274 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2f9006ace0 0x7f2f9006d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00b4ae0 tx=0x7f2fa0009040 comp rx=0 tx=0).stop 2023-07-11T00:31:11.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.395+0000 7f2fb5dff700 1 -- 172.21.15.22:0/2768385274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2fb00d3730 msgr2=0x7f2fb01f1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:11.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.395+0000 7f2fb5dff700 1 --2- 172.21.15.22:0/2768385274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2fb00d3730 0x7f2fb01f1500 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2fb006c780 tx=0x7f2fa8004ad0 comp rx=0 tx=0).stop 2023-07-11T00:31:11.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.395+0000 7f2fb5dff700 1 -- 172.21.15.22:0/2768385274 shutdown_connections 2023-07-11T00:31:11.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.395+0000 7f2fb5dff700 1 --2- 172.21.15.22:0/2768385274 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f2f9006ace0 0x7f2f9006d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:11.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.395+0000 7f2fb5dff700 1 --2- 172.21.15.22:0/2768385274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2fb00d3730 0x7f2fb01f1500 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:11.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.395+0000 7f2fb5dff700 1 --2- 172.21.15.22:0/2768385274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fb00b8430 0x7f2fb01f2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:11.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.395+0000 7f2fb5dff700 1 --2- 172.21.15.22:0/2768385274 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fb00cfa90 0x7f2fb00cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:11.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.395+0000 7f2fb5dff700 1 -- 172.21.15.22:0/2768385274 >> 172.21.15.22:0/2768385274 conn(0x7f2fb006b3f0 msgr2=0x7f2fb00d1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:11.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.396+0000 7f2fb5dff700 1 -- 172.21.15.22:0/2768385274 shutdown_connections 2023-07-11T00:31:11.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.396+0000 7f2fb5dff700 1 -- 172.21.15.22:0/2768385274 wait complete. 2023-07-11T00:31:11.416 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:31:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.615+0000 7f06f6bff700 1 Processor -- start 2023-07-11T00:31:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.615+0000 7f06f6bff700 1 -- start start 2023-07-11T00:31:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.616+0000 7f06f6bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f06f015c460 0x7f06f00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.616+0000 7f06f6bff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f00d1790 con 0x7f06f00cf8f0 2023-07-11T00:31:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.616+0000 7f06f6bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f00cd950 con 0x7f06f00d2640 2023-07-11T00:31:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.616+0000 7f06f6bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f00cedd0 con 0x7f06f015c460 2023-07-11T00:31:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.616+0000 7f06f519c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f06f00cf8f0 0x7f06f015fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59842/0 (socket says 172.21.15.22:59842) 2023-07-11T00:31:11.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.616+0000 7f06f519c700 1 -- 172.21.15.22:0/3995090609 learned_addr learned my addr 172.21.15.22:0/3995090609 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:11.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.617+0000 7f06f499b700 1 --2- 172.21.15.22:0/3995090609 >> v2:172.21.15.184:3300/0 conn(0x7f06f015c460 0x7f06f00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:11.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.617+0000 7f06ef7fe700 1 -- 172.21.15.22:0/3995090609 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033882413 0 0) 0x7f06f00d1790 con 0x7f06f00cf8f0 2023-07-11T00:31:11.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.617+0000 7f06ef7fe700 1 -- 172.21.15.22:0/3995090609 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06e00035b0 con 0x7f06f00cf8f0 2023-07-11T00:31:11.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.617+0000 7f06ef7fe700 1 -- 172.21.15.22:0/3995090609 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240219064 0 0) 0x7f06f00cd950 con 0x7f06f00d2640 2023-07-11T00:31:11.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.617+0000 7f06ef7fe700 1 -- 172.21.15.22:0/3995090609 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06f00d1790 con 0x7f06f00d2640 2023-07-11T00:31:11.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.617+0000 7f06f499b700 1 -- 172.21.15.22:0/3995090609 >> v1:172.21.15.184:6789/0 conn(0x7f06f00d2640 legacy=0x7f06f00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:11.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.617+0000 7f06f499b700 1 -- 172.21.15.22:0/3995090609 >> v1:172.21.15.22:6789/0 conn(0x7f06f00cf8f0 legacy=0x7f06f015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:11.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.617+0000 7f06f499b700 1 -- 172.21.15.22:0/3995090609 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f00d14b0 con 0x7f06f015c460 2023-07-11T00:31:11.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.618+0000 7f06f499b700 1 --2- 172.21.15.22:0/3995090609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06f015c460 0x7f06f00b59d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009840 tx=0x7f06e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a91b18183f2bf996 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:11.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.618+0000 7f06ef7fe700 1 -- 172.21.15.22:0/3995090609 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4011830 con 0x7f06f015c460 2023-07-11T00:31:11.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.618+0000 7f06ef7fe700 1 -- 172.21.15.22:0/3995090609 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e4011990 con 0x7f06f015c460 2023-07-11T00:31:11.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.618+0000 7f06ef7fe700 1 -- 172.21.15.22:0/3995090609 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4011d20 con 0x7f06f015c460 2023-07-11T00:31:11.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.618+0000 7f06f6bff700 1 -- 172.21.15.22:0/3995090609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06f015c460 msgr2=0x7f06f00b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:11.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.618+0000 7f06f6bff700 1 --2- 172.21.15.22:0/3995090609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06f015c460 0x7f06f00b59d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009840 tx=0x7f06e4009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:11.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.618+0000 7f06f6bff700 1 -- 172.21.15.22:0/3995090609 shutdown_connections 2023-07-11T00:31:11.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.618+0000 7f06f6bff700 1 --2- 172.21.15.22:0/3995090609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06f015c460 0x7f06f00b59d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:11.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.618+0000 7f06f6bff700 1 -- 172.21.15.22:0/3995090609 >> 172.21.15.22:0/3995090609 conn(0x7f06f0071660 msgr2=0x7f06f0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:11.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.619+0000 7f06f6bff700 1 -- 172.21.15.22:0/3995090609 shutdown_connections 2023-07-11T00:31:11.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.619+0000 7f06f6bff700 1 -- 172.21.15.22:0/3995090609 wait complete. 2023-07-11T00:31:11.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.621+0000 7f06f6bff700 1 Processor -- start 2023-07-11T00:31:11.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.621+0000 7f06f6bff700 1 -- start start 2023-07-11T00:31:11.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.622+0000 7f06f6bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06f00cf8f0 0x7f06f01508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:11.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.622+0000 7f06f6bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f00d2640 0x7f06f015c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:11.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.622+0000 7f06f6bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06f015c460 0x7f06f0157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:11.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.622+0000 7f06f6bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f00c8610 con 0x7f06f00d2640 2023-07-11T00:31:11.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.622+0000 7f06f6bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f00c7ce0 con 0x7f06f015c460 2023-07-11T00:31:11.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.622+0000 7f06f6bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f00c7fc0 con 0x7f06f00cf8f0 2023-07-11T00:31:11.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.623+0000 7f06effff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f00d2640 0x7f06f015c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:11.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.623+0000 7f06effff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f00d2640 0x7f06f015c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43364/0 (socket says 172.21.15.22:43364) 2023-07-11T00:31:11.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.623+0000 7f06effff700 1 -- 172.21.15.22:0/1598871688 learned_addr learned my addr 172.21.15.22:0/1598871688 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:11.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.623+0000 7f06f519c700 1 --2- 172.21.15.22:0/1598871688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06f015c460 0x7f06f0157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:11.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.623+0000 7f06f499b700 1 --2- 172.21.15.22:0/1598871688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06f00cf8f0 0x7f06f01508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:11.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.623+0000 7f06effff700 1 -- 172.21.15.22:0/1598871688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06f00cf8f0 msgr2=0x7f06f01508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:11.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.623+0000 7f06effff700 1 --2- 172.21.15.22:0/1598871688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06f00cf8f0 0x7f06f01508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:11.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.623+0000 7f06effff700 1 -- 172.21.15.22:0/1598871688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06f015c460 msgr2=0x7f06f0157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:11.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.623+0000 7f06effff700 1 --2- 172.21.15.22:0/1598871688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06f015c460 0x7f06f0157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:11.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.623+0000 7f06effff700 1 -- 172.21.15.22:0/1598871688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e40094a0 con 0x7f06f00d2640 2023-07-11T00:31:11.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.623+0000 7f06effff700 1 --2- 172.21.15.22:0/1598871688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f00d2640 0x7f06f015c830 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00c520 tx=0x7f06dc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:11.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.624+0000 7f06ed7fa700 1 -- 172.21.15.22:0/1598871688 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0052d0 con 0x7f06f00d2640 2023-07-11T00:31:11.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.624+0000 7f06ed7fa700 1 -- 172.21.15.22:0/1598871688 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc005430 con 0x7f06f00d2640 2023-07-11T00:31:11.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.624+0000 7f06ed7fa700 1 -- 172.21.15.22:0/1598871688 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0038c0 con 0x7f06f00d2640 2023-07-11T00:31:11.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.624+0000 7f06f6bff700 1 -- 172.21.15.22:0/1598871688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f00c82a0 con 0x7f06f00d2640 2023-07-11T00:31:11.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.624+0000 7f06f6bff700 1 -- 172.21.15.22:0/1598871688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f0150e30 con 0x7f06f00d2640 2023-07-11T00:31:11.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.625+0000 7f06f6bff700 1 -- 172.21.15.22:0/1598871688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f00c8780 con 0x7f06f00d2640 2023-07-11T00:31:11.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.626+0000 7f06ed7fa700 1 -- 172.21.15.22:0/1598871688 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06dc003a20 con 0x7f06f00d2640 2023-07-11T00:31:11.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.627+0000 7f06ed7fa700 1 --2- 172.21.15.22:0/1598871688 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f06d406ace0 0x7f06d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:11.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.627+0000 7f06ed7fa700 1 -- 172.21.15.22:0/1598871688 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f06dc088ca0 con 0x7f06f00d2640 2023-07-11T00:31:11.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.627+0000 7f06f499b700 1 --2- 172.21.15.22:0/1598871688 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f06d406ace0 0x7f06d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:11.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.628+0000 7f06f499b700 1 --2- 172.21.15.22:0/1598871688 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f06d406ace0 0x7f06d406d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009fd0 tx=0x7f06e401c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:11.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.631+0000 7f06ed7fa700 1 -- 172.21.15.22:0/1598871688 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f06dc053980 con 0x7f06f00d2640 2023-07-11T00:31:11.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.839+0000 7f06f6bff700 1 -- 172.21.15.22:0/1598871688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06f00ccfb0 con 0x7f06f00d2640 2023-07-11T00:31:11.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.840+0000 7f06ed7fa700 1 -- 172.21.15.22:0/1598871688 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f06dc056fa0 con 0x7f06f00d2640 2023-07-11T00:31:11.843 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:11.844 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:54.208536+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:31:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.842+0000 7f06f6bff700 1 -- 172.21.15.22:0/1598871688 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f06d406ace0 msgr2=0x7f06d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.842+0000 7f06f6bff700 1 --2- 172.21.15.22:0/1598871688 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f06d406ace0 0x7f06d406d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009fd0 tx=0x7f06e401c040 comp rx=0 tx=0).stop 2023-07-11T00:31:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.842+0000 7f06f6bff700 1 -- 172.21.15.22:0/1598871688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f00d2640 msgr2=0x7f06f015c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.842+0000 7f06f6bff700 1 --2- 172.21.15.22:0/1598871688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f00d2640 0x7f06f015c830 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00c520 tx=0x7f06dc00c830 comp rx=0 tx=0).stop 2023-07-11T00:31:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.842+0000 7f06f6bff700 1 -- 172.21.15.22:0/1598871688 shutdown_connections 2023-07-11T00:31:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.842+0000 7f06f6bff700 1 --2- 172.21.15.22:0/1598871688 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f06d406ace0 0x7f06d406d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:11.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.842+0000 7f06f6bff700 1 --2- 172.21.15.22:0/1598871688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06f00cf8f0 0x7f06f01508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:11.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.842+0000 7f06f6bff700 1 --2- 172.21.15.22:0/1598871688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06f015c460 0x7f06f0157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:11.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.842+0000 7f06f6bff700 1 --2- 172.21.15.22:0/1598871688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06f00d2640 0x7f06f015c830 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:11.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.842+0000 7f06f6bff700 1 -- 172.21.15.22:0/1598871688 >> 172.21.15.22:0/1598871688 conn(0x7f06f0071660 msgr2=0x7f06f00b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:11.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.843+0000 7f06f6bff700 1 -- 172.21.15.22:0/1598871688 shutdown_connections 2023-07-11T00:31:11.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:11.843+0000 7f06f6bff700 1 -- 172.21.15.22:0/1598871688 wait complete. 2023-07-11T00:31:11.863 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:29:57.631007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:29:58.547599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:30:03.826184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:30:04.383448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-11T00:30:08.075875+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-11T00:31:11.864 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:31:12.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.066+0000 7fb55cbff700 1 Processor -- start 2023-07-11T00:31:12.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.066+0000 7fb55cbff700 1 -- start start 2023-07-11T00:31:12.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.067+0000 7fb55cbff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb5580d3730 0x7fb5580cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.067+0000 7fb55cbff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5580d0b20 con 0x7fb5580b8430 2023-07-11T00:31:12.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.067+0000 7fb55cbff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5580cfe90 con 0x7fb5580cfa90 2023-07-11T00:31:12.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.067+0000 7fb55cbff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5580cda30 con 0x7fb5580d3730 2023-07-11T00:31:12.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.068+0000 7fb55659c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb5580b8430 0x7fb5580cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59856/0 (socket says 172.21.15.22:59856) 2023-07-11T00:31:12.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.068+0000 7fb55659c700 1 -- 172.21.15.22:0/3693349310 learned_addr learned my addr 172.21.15.22:0/3693349310 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:12.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.068+0000 7fb55559a700 1 -- 172.21.15.22:0/3693349310 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239000466 0 0) 0x7fb5580d0b20 con 0x7fb5580b8430 2023-07-11T00:31:12.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.068+0000 7fb555d9b700 1 --2- 172.21.15.22:0/3693349310 >> v2:172.21.15.184:3300/0 conn(0x7fb5580d3730 0x7fb5580cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.068+0000 7fb55559a700 1 -- 172.21.15.22:0/3693349310 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5400035b0 con 0x7fb5580b8430 2023-07-11T00:31:12.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.068+0000 7fb55559a700 1 -- 172.21.15.22:0/3693349310 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2583328357 0 0) 0x7fb5400035b0 con 0x7fb5580b8430 2023-07-11T00:31:12.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.068+0000 7fb55559a700 1 -- 172.21.15.22:0/3693349310 >> v2:172.21.15.184:3300/0 conn(0x7fb5580d3730 msgr2=0x7fb5580cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:12.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.068+0000 7fb55559a700 1 --2- 172.21.15.22:0/3693349310 >> v2:172.21.15.184:3300/0 conn(0x7fb5580d3730 0x7fb5580cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.068+0000 7fb55559a700 1 -- 172.21.15.22:0/3693349310 >> v1:172.21.15.184:6789/0 conn(0x7fb5580cfa90 legacy=0x7fb5580d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:12.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.068+0000 7fb55559a700 1 -- 172.21.15.22:0/3693349310 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5580b4ee0 con 0x7fb5580b8430 2023-07-11T00:31:12.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb55559a700 1 -- 172.21.15.22:0/3693349310 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7fb548001670 con 0x7fb5580b8430 2023-07-11T00:31:12.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb55559a700 1 -- 172.21.15.22:0/3693349310 >> v1:172.21.15.22:6789/0 conn(0x7fb5580b8430 legacy=0x7fb5580cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:12.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb55559a700 1 --2- 172.21.15.22:0/3693349310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb540003a50 0x7fb540003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb55559a700 1 --2- 172.21.15.22:0/3693349310 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb540004850 0x7fb540004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb55559a700 1 --2- 172.21.15.22:0/3693349310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb540005200 0x7fb54000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb55559a700 1 -- 172.21.15.22:0/3693349310 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54000c0e0 con 0x7fb540003a50 2023-07-11T00:31:12.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb55559a700 1 -- 172.21.15.22:0/3693349310 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54000c220 con 0x7fb540005200 2023-07-11T00:31:12.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb55559a700 1 -- 172.21.15.22:0/3693349310 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54000c3e0 con 0x7fb540004850 2023-07-11T00:31:12.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb55659c700 1 --2- 172.21.15.22:0/3693349310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb540003a50 0x7fb540003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb556d9d700 1 --2- 172.21.15.22:0/3693349310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb540005200 0x7fb54000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb555d9b700 1 --2- 172.21.15.22:0/3693349310 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb540004850 0x7fb540004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb55659c700 1 -- 172.21.15.22:0/3693349310 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb540004850 msgr2=0x7fb540004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:12.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb55659c700 1 --2- 172.21.15.22:0/3693349310 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb540004850 0x7fb540004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb55659c700 1 -- 172.21.15.22:0/3693349310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb540005200 msgr2=0x7fb54000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:12.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb55659c700 1 --2- 172.21.15.22:0/3693349310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb540005200 0x7fb54000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb55659c700 1 -- 172.21.15.22:0/3693349310 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5400035b0 con 0x7fb540003a50 2023-07-11T00:31:12.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb556d9d700 1 --2- 172.21.15.22:0/3693349310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb540005200 0x7fb54000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:12.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.069+0000 7fb556d9d700 1 -- 172.21.15.22:0/3693349310 reap_dead start 2023-07-11T00:31:12.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.070+0000 7fb55659c700 1 --2- 172.21.15.22:0/3693349310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb540003a50 0x7fb540003e60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb548001eb0 tx=0x7fb540005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f710c5a3001aca1 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:12.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.070+0000 7fb55559a700 1 -- 172.21.15.22:0/3693349310 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548007b70 con 0x7fb540003a50 2023-07-11T00:31:12.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.070+0000 7fb55559a700 1 -- 172.21.15.22:0/3693349310 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54800ccf0 con 0x7fb540003a50 2023-07-11T00:31:12.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.070+0000 7fb55559a700 1 -- 172.21.15.22:0/3693349310 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548005ba0 con 0x7fb540003a50 2023-07-11T00:31:12.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.071+0000 7fb55cbff700 1 -- 172.21.15.22:0/3693349310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb540003a50 msgr2=0x7fb540003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:12.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.071+0000 7fb55cbff700 1 --2- 172.21.15.22:0/3693349310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb540003a50 0x7fb540003e60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb548001eb0 tx=0x7fb540005880 comp rx=0 tx=0).stop 2023-07-11T00:31:12.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.071+0000 7fb55cbff700 1 -- 172.21.15.22:0/3693349310 shutdown_connections 2023-07-11T00:31:12.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.071+0000 7fb55cbff700 1 --2- 172.21.15.22:0/3693349310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb540003a50 0x7fb540003e60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.071+0000 7fb55cbff700 1 -- 172.21.15.22:0/3693349310 >> 172.21.15.22:0/3693349310 conn(0x7fb55806b3f0 msgr2=0x7fb55806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:12.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.071+0000 7fb55cbff700 1 -- 172.21.15.22:0/3693349310 shutdown_connections 2023-07-11T00:31:12.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.071+0000 7fb55cbff700 1 -- 172.21.15.22:0/3693349310 wait complete. 2023-07-11T00:31:12.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.073+0000 7fb55cbff700 1 Processor -- start 2023-07-11T00:31:12.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.074+0000 7fb55cbff700 1 -- start start 2023-07-11T00:31:12.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.075+0000 7fb55cbff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb540003a50 0x7fb5580c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.075+0000 7fb55cbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5580c6670 0x7fb5580c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.075+0000 7fb55cbff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb558158ca0 0x7fb558159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.075+0000 7fb55cbff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb558159680 con 0x7fb558158ca0 2023-07-11T00:31:12.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.075+0000 7fb55cbff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580c7130 con 0x7fb540003a50 2023-07-11T00:31:12.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.075+0000 7fb55cbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580c7410 con 0x7fb5580c6670 2023-07-11T00:31:12.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.075+0000 7fb556d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb558158ca0 0x7fb558159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.075+0000 7fb556d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb558158ca0 0x7fb558159140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43384/0 (socket says 172.21.15.22:43384) 2023-07-11T00:31:12.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.076+0000 7fb556d9d700 1 -- 172.21.15.22:0/2206053736 learned_addr learned my addr 172.21.15.22:0/2206053736 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:12.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.076+0000 7fb55659c700 1 --2- 172.21.15.22:0/2206053736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb540003a50 0x7fb5580c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.076+0000 7fb555d9b700 1 --2- 172.21.15.22:0/2206053736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5580c6670 0x7fb5580c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.076+0000 7fb556d9d700 1 -- 172.21.15.22:0/2206053736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5580c6670 msgr2=0x7fb5580c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:12.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.076+0000 7fb556d9d700 1 --2- 172.21.15.22:0/2206053736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5580c6670 0x7fb5580c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.076+0000 7fb556d9d700 1 -- 172.21.15.22:0/2206053736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb540003a50 msgr2=0x7fb5580c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:12.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.076+0000 7fb556d9d700 1 --2- 172.21.15.22:0/2206053736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb540003a50 0x7fb5580c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.076+0000 7fb556d9d700 1 -- 172.21.15.22:0/2206053736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5580c76f0 con 0x7fb558158ca0 2023-07-11T00:31:12.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.076+0000 7fb556d9d700 1 --2- 172.21.15.22:0/2206053736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb558158ca0 0x7fb558159140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb5580d06c0 tx=0x7fb55000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:12.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.076+0000 7fb546ffd700 1 -- 172.21.15.22:0/2206053736 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55000eed0 con 0x7fb558158ca0 2023-07-11T00:31:12.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.076+0000 7fb546ffd700 1 -- 172.21.15.22:0/2206053736 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb550003c10 con 0x7fb558158ca0 2023-07-11T00:31:12.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.076+0000 7fb55cbff700 1 -- 172.21.15.22:0/2206053736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5580c79d0 con 0x7fb558158ca0 2023-07-11T00:31:12.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.076+0000 7fb546ffd700 1 -- 172.21.15.22:0/2206053736 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5500050d0 con 0x7fb558158ca0 2023-07-11T00:31:12.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.077+0000 7fb55cbff700 1 -- 172.21.15.22:0/2206053736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5581f2110 con 0x7fb558158ca0 2023-07-11T00:31:12.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.078+0000 7fb55cbff700 1 -- 172.21.15.22:0/2206053736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5580c7ef0 con 0x7fb558158ca0 2023-07-11T00:31:12.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.079+0000 7fb546ffd700 1 -- 172.21.15.22:0/2206053736 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb550005230 con 0x7fb558158ca0 2023-07-11T00:31:12.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.080+0000 7fb546ffd700 1 --2- 172.21.15.22:0/2206053736 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb53806ace0 0x7fb53806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.080+0000 7fb546ffd700 1 -- 172.21.15.22:0/2206053736 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb550089740 con 0x7fb558158ca0 2023-07-11T00:31:12.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.080+0000 7fb55659c700 1 --2- 172.21.15.22:0/2206053736 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb53806ace0 0x7fb53806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.081+0000 7fb55659c700 1 --2- 172.21.15.22:0/2206053736 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb53806ace0 0x7fb53806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb5581efa50 tx=0x7fb548007000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:12.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.084+0000 7fb546ffd700 1 -- 172.21.15.22:0/2206053736 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb5580c7ef0 con 0x7fb558158ca0 2023-07-11T00:31:12.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.288+0000 7fb55cbff700 1 -- 172.21.15.22:0/2206053736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb5580c7ef0 con 0x7fb558158ca0 2023-07-11T00:31:12.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.288+0000 7fb546ffd700 1 -- 172.21.15.22:0/2206053736 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb5580c7ef0 con 0x7fb558158ca0 2023-07-11T00:31:12.297 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2023-07-11T00:31:12.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.290+0000 7fb55cbff700 1 -- 172.21.15.22:0/2206053736 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb53806ace0 msgr2=0x7fb53806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:12.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.290+0000 7fb55cbff700 1 --2- 172.21.15.22:0/2206053736 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb53806ace0 0x7fb53806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb5581efa50 tx=0x7fb548007000 comp rx=0 tx=0).stop 2023-07-11T00:31:12.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.290+0000 7fb55cbff700 1 -- 172.21.15.22:0/2206053736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb558158ca0 msgr2=0x7fb558159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:12.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.290+0000 7fb55cbff700 1 --2- 172.21.15.22:0/2206053736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb558158ca0 0x7fb558159140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb5580d06c0 tx=0x7fb55000ed50 comp rx=0 tx=0).stop 2023-07-11T00:31:12.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.291+0000 7fb55cbff700 1 -- 172.21.15.22:0/2206053736 shutdown_connections 2023-07-11T00:31:12.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.291+0000 7fb55cbff700 1 --2- 172.21.15.22:0/2206053736 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb53806ace0 0x7fb53806d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.291+0000 7fb55cbff700 1 --2- 172.21.15.22:0/2206053736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb558158ca0 0x7fb558159140 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.291+0000 7fb55cbff700 1 --2- 172.21.15.22:0/2206053736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb540003a50 0x7fb5580c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.291+0000 7fb55cbff700 1 --2- 172.21.15.22:0/2206053736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5580c6670 0x7fb5580c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.291+0000 7fb55cbff700 1 -- 172.21.15.22:0/2206053736 >> 172.21.15.22:0/2206053736 conn(0x7fb55806b3f0 msgr2=0x7fb55815b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:12.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.291+0000 7fb55cbff700 1 -- 172.21.15.22:0/2206053736 shutdown_connections 2023-07-11T00:31:12.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.291+0000 7fb55cbff700 1 -- 172.21.15.22:0/2206053736 wait complete. 2023-07-11T00:31:12.311 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:31:12.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.514+0000 7f246d7ff700 1 Processor -- start 2023-07-11T00:31:12.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.514+0000 7f246d7ff700 1 -- start start 2023-07-11T00:31:12.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.515+0000 7f246d7ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f24680b8430 0x7f24680cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.515+0000 7f246d7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24680cfc60 0x7f24680d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.515+0000 7f246d7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24680d0b20 con 0x7f24680d3730 2023-07-11T00:31:12.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.515+0000 7f246d7ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24680b8800 con 0x7f24680b8430 2023-07-11T00:31:12.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.515+0000 7f246d7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24680b4ee0 con 0x7f24680cfc60 2023-07-11T00:31:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.515+0000 7f24677fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24680cfc60 0x7f24680d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.515+0000 7f2466ffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f24680b8430 0x7f24680cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.515+0000 7f24677fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24680cfc60 0x7f24680d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:60914/0 (socket says 172.21.15.22:60914) 2023-07-11T00:31:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.515+0000 7f24677fe700 1 -- 172.21.15.22:0/1473401965 learned_addr learned my addr 172.21.15.22:0/1473401965 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:12.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.515+0000 7f24667fc700 1 --1- 172.21.15.22:0/1473401965 >> v1:172.21.15.184:6789/0 conn(0x7f24680d3730 0x7f24680cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:43306/0 (socket says 172.21.15.22:43306) 2023-07-11T00:31:12.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.516+0000 7f24677fe700 1 -- 172.21.15.22:0/1473401965 >> v2:172.21.15.184:3300/0 conn(0x7f24680b8430 msgr2=0x7f24680cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:12.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.516+0000 7f24677fe700 1 --2- 172.21.15.22:0/1473401965 >> v2:172.21.15.184:3300/0 conn(0x7f24680b8430 0x7f24680cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.516+0000 7f24677fe700 1 -- 172.21.15.22:0/1473401965 >> v1:172.21.15.184:6789/0 conn(0x7f24680d3730 legacy=0x7f24680cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:12.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.516+0000 7f24677fe700 1 -- 172.21.15.22:0/1473401965 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24680b51c0 con 0x7f24680cfc60 2023-07-11T00:31:12.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.516+0000 7f2465ffb700 1 -- 172.21.15.22:0/1473401965 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648517981 0 0) 0x7f24680d0b20 con 0x7f24680d3730 2023-07-11T00:31:12.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.516+0000 7f24677fe700 1 --2- 172.21.15.22:0/1473401965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24680cfc60 0x7f24680d0fb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2460009e50 tx=0x7f246000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7da640d7e53f0f91 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:12.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.516+0000 7f2465ffb700 1 -- 172.21.15.22:0/1473401965 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246000e070 con 0x7f24680cfc60 2023-07-11T00:31:12.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.516+0000 7f2465ffb700 1 -- 172.21.15.22:0/1473401965 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246000b910 con 0x7f24680cfc60 2023-07-11T00:31:12.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.516+0000 7f2465ffb700 1 -- 172.21.15.22:0/1473401965 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246000bcc0 con 0x7f24680cfc60 2023-07-11T00:31:12.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.517+0000 7f246d7ff700 1 -- 172.21.15.22:0/1473401965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24680cfc60 msgr2=0x7f24680d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:12.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.517+0000 7f246d7ff700 1 --2- 172.21.15.22:0/1473401965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24680cfc60 0x7f24680d0fb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2460009e50 tx=0x7f246000b330 comp rx=0 tx=0).stop 2023-07-11T00:31:12.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.517+0000 7f246d7ff700 1 -- 172.21.15.22:0/1473401965 shutdown_connections 2023-07-11T00:31:12.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.517+0000 7f246d7ff700 1 --2- 172.21.15.22:0/1473401965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24680cfc60 0x7f24680d0fb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.517+0000 7f246d7ff700 1 --2- 172.21.15.22:0/1473401965 >> v2:172.21.15.184:3300/0 conn(0x7f24680b8430 0x7f24680cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.517+0000 7f246d7ff700 1 -- 172.21.15.22:0/1473401965 >> 172.21.15.22:0/1473401965 conn(0x7f246806b3f0 msgr2=0x7f246806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:12.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.517+0000 7f246d7ff700 1 -- 172.21.15.22:0/1473401965 shutdown_connections 2023-07-11T00:31:12.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.517+0000 7f246d7ff700 1 -- 172.21.15.22:0/1473401965 wait complete. 2023-07-11T00:31:12.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.519+0000 7f246d7ff700 1 Processor -- start 2023-07-11T00:31:12.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.519+0000 7f246d7ff700 1 -- start start 2023-07-11T00:31:12.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.520+0000 7f246d7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24680b8430 0x7f24680c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.520+0000 7f246d7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24680cfc60 0x7f24680cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.520+0000 7f246d7ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24680d3730 0x7f24680cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.520+0000 7f246d7ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24680c7d60 con 0x7f24680d3730 2023-07-11T00:31:12.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.520+0000 7f246d7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24680c7120 con 0x7f24680cfc60 2023-07-11T00:31:12.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.520+0000 7f246d7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24680c63e0 con 0x7f24680b8430 2023-07-11T00:31:12.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.520+0000 7f24677fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24680d3730 0x7f24680cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.520+0000 7f24677fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24680d3730 0x7f24680cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43396/0 (socket says 172.21.15.22:43396) 2023-07-11T00:31:12.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.520+0000 7f24677fe700 1 -- 172.21.15.22:0/1079429571 learned_addr learned my addr 172.21.15.22:0/1079429571 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:12.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.520+0000 7f24667fc700 1 --2- 172.21.15.22:0/1079429571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24680cfc60 0x7f24680cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.520+0000 7f2466ffd700 1 --2- 172.21.15.22:0/1079429571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24680b8430 0x7f24680c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.521+0000 7f24677fe700 1 -- 172.21.15.22:0/1079429571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24680b8430 msgr2=0x7f24680c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:12.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.521+0000 7f24677fe700 1 --2- 172.21.15.22:0/1079429571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24680b8430 0x7f24680c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.521+0000 7f24677fe700 1 -- 172.21.15.22:0/1079429571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24680cfc60 msgr2=0x7f24680cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:12.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.521+0000 7f24677fe700 1 --2- 172.21.15.22:0/1079429571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24680cfc60 0x7f24680cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.521+0000 7f24677fe700 1 -- 172.21.15.22:0/1079429571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2460009b30 con 0x7f24680d3730 2023-07-11T00:31:12.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.521+0000 7f2466ffd700 1 --2- 172.21.15.22:0/1079429571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24680b8430 0x7f24680c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:12.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.521+0000 7f24667fc700 1 --2- 172.21.15.22:0/1079429571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24680cfc60 0x7f24680cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:12.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.521+0000 7f24677fe700 1 --2- 172.21.15.22:0/1079429571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24680d3730 0x7f24680cb8c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f246000b680 tx=0x7f2460004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:12.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.521+0000 7f244f7fe700 1 -- 172.21.15.22:0/1079429571 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24600099b0 con 0x7f24680d3730 2023-07-11T00:31:12.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.521+0000 7f244f7fe700 1 -- 172.21.15.22:0/1079429571 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24600092e0 con 0x7f24680d3730 2023-07-11T00:31:12.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.521+0000 7f244f7fe700 1 -- 172.21.15.22:0/1079429571 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246001c660 con 0x7f24680d3730 2023-07-11T00:31:12.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.521+0000 7f246d7ff700 1 -- 172.21.15.22:0/1079429571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24680c73c0 con 0x7f24680d3730 2023-07-11T00:31:12.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.521+0000 7f246d7ff700 1 -- 172.21.15.22:0/1079429571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24680c7980 con 0x7f24680d3730 2023-07-11T00:31:12.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.522+0000 7f246d7ff700 1 -- 172.21.15.22:0/1079429571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246804ea60 con 0x7f24680d3730 2023-07-11T00:31:12.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.523+0000 7f244f7fe700 1 -- 172.21.15.22:0/1079429571 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f246001c7c0 con 0x7f24680d3730 2023-07-11T00:31:12.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.525+0000 7f244f7fe700 1 --2- 172.21.15.22:0/1079429571 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f245406ace0 0x7f245406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.525+0000 7f244f7fe700 1 -- 172.21.15.22:0/1079429571 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f246008b4e0 con 0x7f24680d3730 2023-07-11T00:31:12.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.525+0000 7f2466ffd700 1 --2- 172.21.15.22:0/1079429571 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f245406ace0 0x7f245406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.526+0000 7f2466ffd700 1 --2- 172.21.15.22:0/1079429571 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f245406ace0 0x7f245406d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2458009b90 tx=0x7f2458008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.529+0000 7f244f7fe700 1 -- 172.21.15.22:0/1079429571 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2460056250 con 0x7f24680d3730 2023-07-11T00:31:12.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.735+0000 7f246d7ff700 1 -- 172.21.15.22:0/1079429571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f24680d24f0 con 0x7f24680d3730 2023-07-11T00:31:12.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.736+0000 7f244f7fe700 1 -- 172.21.15.22:0/1079429571 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2460059870 con 0x7f24680d3730 2023-07-11T00:31:12.739 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-07-11T00:31:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.738+0000 7f246d7ff700 1 -- 172.21.15.22:0/1079429571 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f245406ace0 msgr2=0x7f245406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:12.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.738+0000 7f246d7ff700 1 --2- 172.21.15.22:0/1079429571 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f245406ace0 0x7f245406d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2458009b90 tx=0x7f2458008040 comp rx=0 tx=0).stop 2023-07-11T00:31:12.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.738+0000 7f246d7ff700 1 -- 172.21.15.22:0/1079429571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24680d3730 msgr2=0x7f24680cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.738+0000 7f246d7ff700 1 --2- 172.21.15.22:0/1079429571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24680d3730 0x7f24680cb8c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f246000b680 tx=0x7f2460004ad0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.738+0000 7f246d7ff700 1 -- 172.21.15.22:0/1079429571 shutdown_connections 2023-07-11T00:31:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.738+0000 7f246d7ff700 1 --2- 172.21.15.22:0/1079429571 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f245406ace0 0x7f245406d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.738+0000 7f246d7ff700 1 --2- 172.21.15.22:0/1079429571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24680b8430 0x7f24680c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.738+0000 7f246d7ff700 1 --2- 172.21.15.22:0/1079429571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24680d3730 0x7f24680cb8c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.738+0000 7f246d7ff700 1 --2- 172.21.15.22:0/1079429571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24680cfc60 0x7f24680cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.738+0000 7f246d7ff700 1 -- 172.21.15.22:0/1079429571 >> 172.21.15.22:0/1079429571 conn(0x7f246806b3f0 msgr2=0x7f24680d1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:12.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.738+0000 7f246d7ff700 1 -- 172.21.15.22:0/1079429571 shutdown_connections 2023-07-11T00:31:12.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.738+0000 7f246d7ff700 1 -- 172.21.15.22:0/1079429571 wait complete. 2023-07-11T00:31:12.759 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:31:12.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.962+0000 7f0105bff700 1 Processor -- start 2023-07-11T00:31:12.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.962+0000 7f0105bff700 1 -- start start 2023-07-11T00:31:12.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.963+0000 7f0105bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f010006bda0 0x7f01000d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.963+0000 7f0105bff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f010006c210 0x7f01000d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.963+0000 7f0105bff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01000d1490 con 0x7f01000b4590 2023-07-11T00:31:12.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.963+0000 7f0105bff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010006b390 con 0x7f010006c210 2023-07-11T00:31:12.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.963+0000 7f0105bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010015d3d0 con 0x7f010006bda0 2023-07-11T00:31:12.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.963+0000 7f00fffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f010006c210 0x7f01000d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.963+0000 7f00ff7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f01000b4590 0x7f01000b4960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59864/0 (socket says 172.21.15.22:59864) 2023-07-11T00:31:12.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.963+0000 7f00ff7fe700 1 -- 172.21.15.22:0/3565826352 learned_addr learned my addr 172.21.15.22:0/3565826352 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:12.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.963+0000 7f00fffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f010006c210 0x7f01000d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43404/0 (socket says 172.21.15.22:43404) 2023-07-11T00:31:12.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.964+0000 7f00f7fff700 1 --2- 172.21.15.22:0/3565826352 >> v2:172.21.15.184:3300/0 conn(0x7f010006bda0 0x7f01000d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.964+0000 7f00fffff700 1 -- 172.21.15.22:0/3565826352 >> v2:172.21.15.184:3300/0 conn(0x7f010006bda0 msgr2=0x7f01000d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:12.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.964+0000 7f00fffff700 1 --2- 172.21.15.22:0/3565826352 >> v2:172.21.15.184:3300/0 conn(0x7f010006bda0 0x7f01000d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.964+0000 7f00fffff700 1 -- 172.21.15.22:0/3565826352 >> v1:172.21.15.22:6789/0 conn(0x7f01000b4590 legacy=0x7f01000b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:12.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.964+0000 7f00fffff700 1 -- 172.21.15.22:0/3565826352 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010015d6b0 con 0x7f010006c210 2023-07-11T00:31:12.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.964+0000 7f00feffd700 1 -- 172.21.15.22:0/3565826352 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765009827 0 0) 0x7f01000d1490 con 0x7f01000b4590 2023-07-11T00:31:12.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.964+0000 7f00f7fff700 1 --2- 172.21.15.22:0/3565826352 >> v2:172.21.15.184:3300/0 conn(0x7f010006bda0 0x7f01000d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:12.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.964+0000 7f00fffff700 1 --2- 172.21.15.22:0/3565826352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f010006c210 0x7f01000d0f50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f01000b1a40 tx=0x7f00f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9b1a130d2df492 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:12.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.964+0000 7f00feffd700 1 -- 172.21.15.22:0/3565826352 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f800e070 con 0x7f010006c210 2023-07-11T00:31:12.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.965+0000 7f00feffd700 1 -- 172.21.15.22:0/3565826352 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f800bbd0 con 0x7f010006c210 2023-07-11T00:31:12.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.965+0000 7f00feffd700 1 -- 172.21.15.22:0/3565826352 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8012430 con 0x7f010006c210 2023-07-11T00:31:12.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.965+0000 7f0105bff700 1 -- 172.21.15.22:0/3565826352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f010006c210 msgr2=0x7f01000d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:12.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.965+0000 7f0105bff700 1 --2- 172.21.15.22:0/3565826352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f010006c210 0x7f01000d0f50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f01000b1a40 tx=0x7f00f800b330 comp rx=0 tx=0).stop 2023-07-11T00:31:12.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.965+0000 7f0105bff700 1 -- 172.21.15.22:0/3565826352 shutdown_connections 2023-07-11T00:31:12.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.965+0000 7f0105bff700 1 --2- 172.21.15.22:0/3565826352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f010006c210 0x7f01000d0f50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.965+0000 7f0105bff700 1 --2- 172.21.15.22:0/3565826352 >> v2:172.21.15.184:3300/0 conn(0x7f010006bda0 0x7f01000d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.965+0000 7f0105bff700 1 -- 172.21.15.22:0/3565826352 >> 172.21.15.22:0/3565826352 conn(0x7f01000cf590 msgr2=0x7f01000cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:12.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.965+0000 7f0105bff700 1 -- 172.21.15.22:0/3565826352 shutdown_connections 2023-07-11T00:31:12.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.965+0000 7f0105bff700 1 -- 172.21.15.22:0/3565826352 wait complete. 2023-07-11T00:31:12.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.967+0000 7f0105bff700 1 Processor -- start 2023-07-11T00:31:12.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.967+0000 7f0105bff700 1 -- start start 2023-07-11T00:31:12.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.968+0000 7f0105bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f010006bda0 0x7f0100150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.968+0000 7f0105bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f010006c210 0x7f01001e5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.968+0000 7f0105bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01000b4590 0x7f010014f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.968+0000 7f0105bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01001e4d00 con 0x7f01000b4590 2023-07-11T00:31:12.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.968+0000 7f0105bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01000d2080 con 0x7f010006bda0 2023-07-11T00:31:12.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.968+0000 7f0105bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0100150e20 con 0x7f010006c210 2023-07-11T00:31:12.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.968+0000 7f00fffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01000b4590 0x7f010014f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.968+0000 7f00fffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01000b4590 0x7f010014f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43418/0 (socket says 172.21.15.22:43418) 2023-07-11T00:31:12.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.968+0000 7f00fffff700 1 -- 172.21.15.22:0/130713109 learned_addr learned my addr 172.21.15.22:0/130713109 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:12.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.968+0000 7f00ff7fe700 1 --2- 172.21.15.22:0/130713109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f010006bda0 0x7f0100150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.968+0000 7f00f7fff700 1 --2- 172.21.15.22:0/130713109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f010006c210 0x7f01001e5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.969+0000 7f00fffff700 1 -- 172.21.15.22:0/130713109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f010006c210 msgr2=0x7f01001e5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:12.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.969+0000 7f00fffff700 1 --2- 172.21.15.22:0/130713109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f010006c210 0x7f01001e5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.969+0000 7f00fffff700 1 -- 172.21.15.22:0/130713109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f010006bda0 msgr2=0x7f0100150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:12.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.969+0000 7f00fffff700 1 --2- 172.21.15.22:0/130713109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f010006bda0 0x7f0100150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:12.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.969+0000 7f00fffff700 1 -- 172.21.15.22:0/130713109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f8009a70 con 0x7f01000b4590 2023-07-11T00:31:12.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.969+0000 7f00fffff700 1 --2- 172.21.15.22:0/130713109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01000b4590 0x7f010014f9e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f00f800b730 tx=0x7f00f8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:12.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.969+0000 7f00fcff9700 1 -- 172.21.15.22:0/130713109 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8012430 con 0x7f01000b4590 2023-07-11T00:31:12.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.969+0000 7f00fcff9700 1 -- 172.21.15.22:0/130713109 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f8020070 con 0x7f01000b4590 2023-07-11T00:31:12.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.969+0000 7f00fcff9700 1 -- 172.21.15.22:0/130713109 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8004280 con 0x7f01000b4590 2023-07-11T00:31:12.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.969+0000 7f0105bff700 1 -- 172.21.15.22:0/130713109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01001e4960 con 0x7f01000b4590 2023-07-11T00:31:12.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.969+0000 7f0105bff700 1 -- 172.21.15.22:0/130713109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01000d1da0 con 0x7f01000b4590 2023-07-11T00:31:12.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.970+0000 7f0105bff700 1 -- 172.21.15.22:0/130713109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01001e4e40 con 0x7f01000b4590 2023-07-11T00:31:12.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.971+0000 7f00fcff9700 1 -- 172.21.15.22:0/130713109 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f00f80043e0 con 0x7f01000b4590 2023-07-11T00:31:12.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.972+0000 7f00fcff9700 1 --2- 172.21.15.22:0/130713109 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f00e006ace0 0x7f00e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:12.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.972+0000 7f00fcff9700 1 -- 172.21.15.22:0/130713109 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f00f8022070 con 0x7f01000b4590 2023-07-11T00:31:12.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.973+0000 7f00ff7fe700 1 --2- 172.21.15.22:0/130713109 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f00e006ace0 0x7f00e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:12.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.973+0000 7f00ff7fe700 1 --2- 172.21.15.22:0/130713109 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f00e006ace0 0x7f00e006d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f00f0000f60 tx=0x7f00f0007c90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:12.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:12.977+0000 7f00fcff9700 1 -- 172.21.15.22:0/130713109 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f01001e4e40 con 0x7f01000b4590 2023-07-11T00:31:13.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.186+0000 7f0105bff700 1 -- 172.21.15.22:0/130713109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f01001e4e40 con 0x7f01000b4590 2023-07-11T00:31:13.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.186+0000 7f00fcff9700 1 -- 172.21.15.22:0/130713109 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f01001e4e40 con 0x7f01000b4590 2023-07-11T00:31:13.189 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:13.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.189+0000 7f0105bff700 1 -- 172.21.15.22:0/130713109 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f00e006ace0 msgr2=0x7f00e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:13.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.189+0000 7f0105bff700 1 --2- 172.21.15.22:0/130713109 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f00e006ace0 0x7f00e006d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f00f0000f60 tx=0x7f00f0007c90 comp rx=0 tx=0).stop 2023-07-11T00:31:13.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.189+0000 7f0105bff700 1 -- 172.21.15.22:0/130713109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01000b4590 msgr2=0x7f010014f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:13.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.189+0000 7f0105bff700 1 --2- 172.21.15.22:0/130713109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01000b4590 0x7f010014f9e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f00f800b730 tx=0x7f00f8004ad0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.189+0000 7f0105bff700 1 -- 172.21.15.22:0/130713109 shutdown_connections 2023-07-11T00:31:13.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.189+0000 7f0105bff700 1 --2- 172.21.15.22:0/130713109 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f00e006ace0 0x7f00e006d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.189+0000 7f0105bff700 1 --2- 172.21.15.22:0/130713109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01000b4590 0x7f010014f9e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.189+0000 7f0105bff700 1 --2- 172.21.15.22:0/130713109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f010006bda0 0x7f0100150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.189+0000 7f0105bff700 1 --2- 172.21.15.22:0/130713109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f010006c210 0x7f01001e5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.189+0000 7f0105bff700 1 -- 172.21.15.22:0/130713109 >> 172.21.15.22:0/130713109 conn(0x7f01000cf590 msgr2=0x7f01000b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:13.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.189+0000 7f0105bff700 1 -- 172.21.15.22:0/130713109 shutdown_connections 2023-07-11T00:31:13.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.189+0000 7f0105bff700 1 -- 172.21.15.22:0/130713109 wait complete. 2023-07-11T00:31:13.209 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:31:13.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.411+0000 7f359bbff700 1 Processor -- start 2023-07-11T00:31:13.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.411+0000 7f359bbff700 1 -- start start 2023-07-11T00:31:13.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.413+0000 7f359bbff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f35940cfc60 0x7f3594167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:13.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.413+0000 7f359bbff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35940d0b20 con 0x7f35940b8430 2023-07-11T00:31:13.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.413+0000 7f359bbff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35940b4ee0 con 0x7f35940d3730 2023-07-11T00:31:13.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.413+0000 7f359bbff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35940cda30 con 0x7f35940cfc60 2023-07-11T00:31:13.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.413+0000 7f359999b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f35940b8430 0x7f35940cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59880/0 (socket says 172.21.15.22:59880) 2023-07-11T00:31:13.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.413+0000 7f359999b700 1 -- 172.21.15.22:0/2886679565 learned_addr learned my addr 172.21.15.22:0/2886679565 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:13.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.413+0000 7f359a19c700 1 --2- 172.21.15.22:0/2886679565 >> v2:172.21.15.184:3300/0 conn(0x7f35940cfc60 0x7f3594167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:13.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.413+0000 7f3598999700 1 -- 172.21.15.22:0/2886679565 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905543131 0 0) 0x7f35940d0b20 con 0x7f35940b8430 2023-07-11T00:31:13.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.413+0000 7f3598999700 1 -- 172.21.15.22:0/2886679565 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35800035b0 con 0x7f35940b8430 2023-07-11T00:31:13.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f3598999700 1 -- 172.21.15.22:0/2886679565 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271371286 0 0) 0x7f35940b4ee0 con 0x7f35940d3730 2023-07-11T00:31:13.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f3598999700 1 -- 172.21.15.22:0/2886679565 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35940d0b20 con 0x7f35940d3730 2023-07-11T00:31:13.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f3598999700 1 -- 172.21.15.22:0/2886679565 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 976742549 0 0) 0x7f35800035b0 con 0x7f35940b8430 2023-07-11T00:31:13.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f3598999700 1 -- 172.21.15.22:0/2886679565 >> v2:172.21.15.184:3300/0 conn(0x7f35940cfc60 msgr2=0x7f3594167010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:13.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f3598999700 1 --2- 172.21.15.22:0/2886679565 >> v2:172.21.15.184:3300/0 conn(0x7f35940cfc60 0x7f3594167010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f3598999700 1 -- 172.21.15.22:0/2886679565 >> v1:172.21.15.184:6789/0 conn(0x7f35940d3730 legacy=0x7f35940cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:13.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f3598999700 1 -- 172.21.15.22:0/2886679565 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35940b51c0 con 0x7f35940b8430 2023-07-11T00:31:13.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f3598999700 1 -- 172.21.15.22:0/2886679565 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7f3590001670 con 0x7f35940b8430 2023-07-11T00:31:13.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f3598999700 1 -- 172.21.15.22:0/2886679565 >> v1:172.21.15.22:6789/0 conn(0x7f35940b8430 legacy=0x7f35940cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:13.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f3598999700 1 --2- 172.21.15.22:0/2886679565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3580003be0 0x7f3580003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:13.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f3598999700 1 --2- 172.21.15.22:0/2886679565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3580004850 0x7f3580004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:13.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f3598999700 1 --2- 172.21.15.22:0/2886679565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3580005200 0x7f358000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:13.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f3598999700 1 -- 172.21.15.22:0/2886679565 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358000c0e0 con 0x7f3580005200 2023-07-11T00:31:13.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f3598999700 1 -- 172.21.15.22:0/2886679565 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358000c220 con 0x7f3580003be0 2023-07-11T00:31:13.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f3598999700 1 -- 172.21.15.22:0/2886679565 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358000c3b0 con 0x7f3580004850 2023-07-11T00:31:13.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f359a19c700 1 --2- 172.21.15.22:0/2886679565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3580005200 0x7f358000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f359999b700 1 --2- 172.21.15.22:0/2886679565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3580003be0 0x7f3580003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f359919a700 1 --2- 172.21.15.22:0/2886679565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3580004850 0x7f3580004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f359a19c700 1 -- 172.21.15.22:0/2886679565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3580004850 msgr2=0x7f3580004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f359a19c700 1 --2- 172.21.15.22:0/2886679565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3580004850 0x7f3580004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f359a19c700 1 -- 172.21.15.22:0/2886679565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3580003be0 msgr2=0x7f3580003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f359a19c700 1 --2- 172.21.15.22:0/2886679565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3580003be0 0x7f3580003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.414+0000 7f359a19c700 1 -- 172.21.15.22:0/2886679565 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35800035b0 con 0x7f3580005200 2023-07-11T00:31:13.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.415+0000 7f359a19c700 1 -- 172.21.15.22:0/2886679565 reap_dead start 2023-07-11T00:31:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.415+0000 7f359a19c700 1 --2- 172.21.15.22:0/2886679565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3580005200 0x7f358000ba10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f358c009f90 tx=0x7f3580005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12018293fa41cee7 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.415+0000 7f3598999700 1 -- 172.21.15.22:0/2886679565 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c003a20 con 0x7f3580005200 2023-07-11T00:31:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.415+0000 7f3598999700 1 -- 172.21.15.22:0/2886679565 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c00f040 con 0x7f3580005200 2023-07-11T00:31:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.415+0000 7f3598999700 1 -- 172.21.15.22:0/2886679565 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c003dc0 con 0x7f3580005200 2023-07-11T00:31:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.415+0000 7f359bbff700 1 -- 172.21.15.22:0/2886679565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3580005200 msgr2=0x7f358000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.415+0000 7f359bbff700 1 --2- 172.21.15.22:0/2886679565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3580005200 0x7f358000ba10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f358c009f90 tx=0x7f3580005880 comp rx=0 tx=0).stop 2023-07-11T00:31:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.415+0000 7f359bbff700 1 -- 172.21.15.22:0/2886679565 shutdown_connections 2023-07-11T00:31:13.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.415+0000 7f359bbff700 1 --2- 172.21.15.22:0/2886679565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3580005200 0x7f358000ba10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.415+0000 7f359bbff700 1 -- 172.21.15.22:0/2886679565 >> 172.21.15.22:0/2886679565 conn(0x7f359406b3f0 msgr2=0x7f359406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:13.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.416+0000 7f359bbff700 1 -- 172.21.15.22:0/2886679565 shutdown_connections 2023-07-11T00:31:13.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.416+0000 7f359bbff700 1 -- 172.21.15.22:0/2886679565 wait complete. 2023-07-11T00:31:13.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.417+0000 7f359bbff700 1 Processor -- start 2023-07-11T00:31:13.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.417+0000 7f359bbff700 1 -- start start 2023-07-11T00:31:13.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.418+0000 7f359bbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3580005200 0x7f35941f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:13.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.418+0000 7f359bbff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35940c9e70 0x7f35940cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:13.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.418+0000 7f359bbff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35940b0f00 0x7f359415ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:13.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.418+0000 7f359bbff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35940cc400 con 0x7f35940b0f00 2023-07-11T00:31:13.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.418+0000 7f359bbff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35941f5bc0 con 0x7f35940c9e70 2023-07-11T00:31:13.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.418+0000 7f359bbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359415adb0 con 0x7f3580005200 2023-07-11T00:31:13.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.419+0000 7f359a19c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35940b0f00 0x7f359415ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:13.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.419+0000 7f359a19c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35940b0f00 0x7f359415ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43442/0 (socket says 172.21.15.22:43442) 2023-07-11T00:31:13.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.419+0000 7f359a19c700 1 -- 172.21.15.22:0/2592375381 learned_addr learned my addr 172.21.15.22:0/2592375381 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:13.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.419+0000 7f359999b700 1 --2- 172.21.15.22:0/2592375381 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3580005200 0x7f35941f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:13.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.419+0000 7f359919a700 1 --2- 172.21.15.22:0/2592375381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35940c9e70 0x7f35940cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:13.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.419+0000 7f359a19c700 1 -- 172.21.15.22:0/2592375381 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3580005200 msgr2=0x7f35941f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:13.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.419+0000 7f359a19c700 1 --2- 172.21.15.22:0/2592375381 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3580005200 0x7f35941f5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.419+0000 7f359a19c700 1 -- 172.21.15.22:0/2592375381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35940c9e70 msgr2=0x7f35940cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:13.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.419+0000 7f359a19c700 1 --2- 172.21.15.22:0/2592375381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35940c9e70 0x7f35940cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.419+0000 7f359a19c700 1 -- 172.21.15.22:0/2592375381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35940ca330 con 0x7f35940b0f00 2023-07-11T00:31:13.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.419+0000 7f359919a700 1 --2- 172.21.15.22:0/2592375381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35940c9e70 0x7f35940cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:13.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.419+0000 7f359a19c700 1 --2- 172.21.15.22:0/2592375381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35940b0f00 0x7f359415ee10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f359415fe10 tx=0x7f358c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.420+0000 7f358a7fc700 1 -- 172.21.15.22:0/2592375381 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c003e10 con 0x7f35940b0f00 2023-07-11T00:31:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.420+0000 7f358a7fc700 1 -- 172.21.15.22:0/2592375381 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c004230 con 0x7f35940b0f00 2023-07-11T00:31:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.420+0000 7f359bbff700 1 -- 172.21.15.22:0/2592375381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35940ca610 con 0x7f35940b0f00 2023-07-11T00:31:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.420+0000 7f358a7fc700 1 -- 172.21.15.22:0/2592375381 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c0045e0 con 0x7f35940b0f00 2023-07-11T00:31:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.420+0000 7f359bbff700 1 -- 172.21.15.22:0/2592375381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35940cc020 con 0x7f35940b0f00 2023-07-11T00:31:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.421+0000 7f359bbff700 1 -- 172.21.15.22:0/2592375381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35940cc540 con 0x7f35940b0f00 2023-07-11T00:31:13.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.422+0000 7f358a7fc700 1 -- 172.21.15.22:0/2592375381 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f358c004740 con 0x7f35940b0f00 2023-07-11T00:31:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.423+0000 7f358a7fc700 1 --2- 172.21.15.22:0/2592375381 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f357806ace0 0x7f357806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.423+0000 7f358a7fc700 1 -- 172.21.15.22:0/2592375381 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f358c08abb0 con 0x7f35940b0f00 2023-07-11T00:31:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.423+0000 7f359999b700 1 --2- 172.21.15.22:0/2592375381 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f357806ace0 0x7f357806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:13.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.424+0000 7f359999b700 1 --2- 172.21.15.22:0/2592375381 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f357806ace0 0x7f357806d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3590000c00 tx=0x7f3590001510 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:13.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.427+0000 7f358a7fc700 1 -- 172.21.15.22:0/2592375381 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f35940cc540 con 0x7f35940b0f00 2023-07-11T00:31:13.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.632+0000 7f359bbff700 1 -- 172.21.15.22:0/2592375381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35940cc540 con 0x7f35940b0f00 2023-07-11T00:31:13.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.633+0000 7f358a7fc700 1 -- 172.21.15.22:0/2592375381 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f35940cc540 con 0x7f35940b0f00 2023-07-11T00:31:13.636 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-07-11T00:31:13.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.635+0000 7f359bbff700 1 -- 172.21.15.22:0/2592375381 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f357806ace0 msgr2=0x7f357806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:13.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.635+0000 7f359bbff700 1 --2- 172.21.15.22:0/2592375381 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f357806ace0 0x7f357806d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3590000c00 tx=0x7f3590001510 comp rx=0 tx=0).stop 2023-07-11T00:31:13.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.635+0000 7f359bbff700 1 -- 172.21.15.22:0/2592375381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35940b0f00 msgr2=0x7f359415ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:13.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.635+0000 7f359bbff700 1 --2- 172.21.15.22:0/2592375381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35940b0f00 0x7f359415ee10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f359415fe10 tx=0x7f358c004b40 comp rx=0 tx=0).stop 2023-07-11T00:31:13.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.636+0000 7f359bbff700 1 -- 172.21.15.22:0/2592375381 shutdown_connections 2023-07-11T00:31:13.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.636+0000 7f359bbff700 1 --2- 172.21.15.22:0/2592375381 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f357806ace0 0x7f357806d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.636+0000 7f359bbff700 1 --2- 172.21.15.22:0/2592375381 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3580005200 0x7f35941f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.636+0000 7f359bbff700 1 --2- 172.21.15.22:0/2592375381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35940b0f00 0x7f359415ee10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.636+0000 7f359bbff700 1 --2- 172.21.15.22:0/2592375381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35940c9e70 0x7f35940cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.636+0000 7f359bbff700 1 -- 172.21.15.22:0/2592375381 >> 172.21.15.22:0/2592375381 conn(0x7f359406b3f0 msgr2=0x7f35940b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:13.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.636+0000 7f359bbff700 1 -- 172.21.15.22:0/2592375381 shutdown_connections 2023-07-11T00:31:13.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.636+0000 7f359bbff700 1 -- 172.21.15.22:0/2592375381 wait complete. 2023-07-11T00:31:13.656 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-11T00:31:13.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.859+0000 7f034c7ff700 1 Processor -- start 2023-07-11T00:31:13.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.859+0000 7f034c7ff700 1 -- start start 2023-07-11T00:31:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.860+0000 7f034c7ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f03440b8430 0x7f03440cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.860+0000 7f034c7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03440d3730 0x7f03440cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.861+0000 7f034c7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03440d0b20 con 0x7f03440cfa90 2023-07-11T00:31:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.861+0000 7f034c7ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03440b8800 con 0x7f03440b8430 2023-07-11T00:31:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.861+0000 7f034c7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03440cfeb0 con 0x7f03440d3730 2023-07-11T00:31:13.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.861+0000 7f034a59b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f03440b8430 0x7f03440cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:13.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.861+0000 7f034a59b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f03440b8430 0x7f03440cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43456/0 (socket says 172.21.15.22:43456) 2023-07-11T00:31:13.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.861+0000 7f034a59b700 1 -- 172.21.15.22:0/3482777301 learned_addr learned my addr 172.21.15.22:0/3482777301 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:13.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.861+0000 7f0349d9a700 1 --2- 172.21.15.22:0/3482777301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03440d3730 0x7f03440cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:13.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.861+0000 7f034a59b700 1 -- 172.21.15.22:0/3482777301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03440d3730 msgr2=0x7f03440cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:13.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.861+0000 7f034a59b700 1 --2- 172.21.15.22:0/3482777301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03440d3730 0x7f03440cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.861+0000 7f034a59b700 1 -- 172.21.15.22:0/3482777301 >> v1:172.21.15.184:6789/0 conn(0x7f03440cfa90 legacy=0x7f034415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.861+0000 7f034a59b700 1 -- 172.21.15.22:0/3482777301 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03440b4ee0 con 0x7f03440b8430 2023-07-11T00:31:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.861+0000 7f0349d9a700 1 --2- 172.21.15.22:0/3482777301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03440d3730 0x7f03440cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.862+0000 7f034a59b700 1 --2- 172.21.15.22:0/3482777301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03440b8430 0x7f03440cd320 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f03400098f0 tx=0x7f0340009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09a8c17a2604e3a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.862+0000 7f0349599700 1 -- 172.21.15.22:0/3482777301 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034000b8a0 con 0x7f03440b8430 2023-07-11T00:31:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.862+0000 7f0349599700 1 -- 172.21.15.22:0/3482777301 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034000ba00 con 0x7f03440b8430 2023-07-11T00:31:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.862+0000 7f0349599700 1 -- 172.21.15.22:0/3482777301 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034000bd90 con 0x7f03440b8430 2023-07-11T00:31:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.862+0000 7f034c7ff700 1 -- 172.21.15.22:0/3482777301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03440b8430 msgr2=0x7f03440cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:13.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.862+0000 7f034c7ff700 1 --2- 172.21.15.22:0/3482777301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03440b8430 0x7f03440cd320 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f03400098f0 tx=0x7f0340009c00 comp rx=0 tx=0).stop 2023-07-11T00:31:13.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.862+0000 7f034c7ff700 1 -- 172.21.15.22:0/3482777301 shutdown_connections 2023-07-11T00:31:13.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.862+0000 7f034c7ff700 1 --2- 172.21.15.22:0/3482777301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03440b8430 0x7f03440cd320 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.862+0000 7f034c7ff700 1 --2- 172.21.15.22:0/3482777301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03440d3730 0x7f03440cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.862+0000 7f034c7ff700 1 -- 172.21.15.22:0/3482777301 >> 172.21.15.22:0/3482777301 conn(0x7f034406b3f0 msgr2=0x7f034406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:13.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.863+0000 7f034c7ff700 1 -- 172.21.15.22:0/3482777301 shutdown_connections 2023-07-11T00:31:13.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.863+0000 7f034c7ff700 1 -- 172.21.15.22:0/3482777301 wait complete. 2023-07-11T00:31:13.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.864+0000 7f034c7ff700 1 Processor -- start 2023-07-11T00:31:13.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.864+0000 7f034c7ff700 1 -- start start 2023-07-11T00:31:13.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.865+0000 7f034c7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03440b8430 0x7f0344157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:13.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.865+0000 7f034c7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03440cfa90 0x7f03440c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:13.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.865+0000 7f034c7ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03440d3730 0x7f03440ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:13.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.865+0000 7f034c7ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0344157660 con 0x7f03440d3730 2023-07-11T00:31:13.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.865+0000 7f034c7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03440c84d0 con 0x7f03440b8430 2023-07-11T00:31:13.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.865+0000 7f034c7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03440b3fa0 con 0x7f03440cfa90 2023-07-11T00:31:13.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.866+0000 7f034ad9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03440d3730 0x7f03440ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:13.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.866+0000 7f034ad9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03440d3730 0x7f03440ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43468/0 (socket says 172.21.15.22:43468) 2023-07-11T00:31:13.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.866+0000 7f034ad9c700 1 -- 172.21.15.22:0/690573589 learned_addr learned my addr 172.21.15.22:0/690573589 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:13.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.866+0000 7f034a59b700 1 --2- 172.21.15.22:0/690573589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03440b8430 0x7f0344157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:13.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.866+0000 7f0349d9a700 1 --2- 172.21.15.22:0/690573589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03440cfa90 0x7f03440c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:13.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.866+0000 7f034ad9c700 1 -- 172.21.15.22:0/690573589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03440cfa90 msgr2=0x7f03440c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:13.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.866+0000 7f034ad9c700 1 --2- 172.21.15.22:0/690573589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03440cfa90 0x7f03440c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.866+0000 7f034ad9c700 1 -- 172.21.15.22:0/690573589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03440b8430 msgr2=0x7f0344157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:13.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.866+0000 7f034ad9c700 1 --2- 172.21.15.22:0/690573589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03440b8430 0x7f0344157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:13.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.866+0000 7f034ad9c700 1 -- 172.21.15.22:0/690573589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0340009550 con 0x7f03440d3730 2023-07-11T00:31:13.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.866+0000 7f034ad9c700 1 --2- 172.21.15.22:0/690573589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03440d3730 0x7f03440ca440 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f033c00cc80 tx=0x7f033c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:13.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.866+0000 7f033affd700 1 -- 172.21.15.22:0/690573589 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c003c00 con 0x7f03440d3730 2023-07-11T00:31:13.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.867+0000 7f033affd700 1 -- 172.21.15.22:0/690573589 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c003d60 con 0x7f03440d3730 2023-07-11T00:31:13.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.867+0000 7f033affd700 1 -- 172.21.15.22:0/690573589 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c00ab50 con 0x7f03440d3730 2023-07-11T00:31:13.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.867+0000 7f034c7ff700 1 -- 172.21.15.22:0/690573589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03440b39e0 con 0x7f03440d3730 2023-07-11T00:31:13.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.867+0000 7f034c7ff700 1 -- 172.21.15.22:0/690573589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03440c7790 con 0x7f03440d3730 2023-07-11T00:31:13.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.868+0000 7f034c7ff700 1 -- 172.21.15.22:0/690573589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034404ea60 con 0x7f03440d3730 2023-07-11T00:31:13.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.869+0000 7f033affd700 1 -- 172.21.15.22:0/690573589 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f033c00acb0 con 0x7f03440d3730 2023-07-11T00:31:13.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.870+0000 7f033affd700 1 --2- 172.21.15.22:0/690573589 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f032806ace0 0x7f032806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:13.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.870+0000 7f033affd700 1 -- 172.21.15.22:0/690573589 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f033c0898f0 con 0x7f03440d3730 2023-07-11T00:31:13.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.870+0000 7f034a59b700 1 --2- 172.21.15.22:0/690573589 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f032806ace0 0x7f032806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:13.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.871+0000 7f034a59b700 1 --2- 172.21.15.22:0/690573589 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f032806ace0 0x7f032806d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0340014040 tx=0x7f0340008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:13.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:13.874+0000 7f033affd700 1 -- 172.21.15.22:0/690573589 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f033c0545d0 con 0x7f03440d3730 2023-07-11T00:31:14.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.086+0000 7f034c7ff700 1 -- 172.21.15.22:0/690573589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f03440cf550 con 0x7f03440d3730 2023-07-11T00:31:14.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.086+0000 7f033affd700 1 -- 172.21.15.22:0/690573589 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f033c057bf0 con 0x7f03440d3730 2023-07-11T00:31:14.089 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:14.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.088+0000 7f034c7ff700 1 -- 172.21.15.22:0/690573589 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f032806ace0 msgr2=0x7f032806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:14.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.088+0000 7f034c7ff700 1 --2- 172.21.15.22:0/690573589 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f032806ace0 0x7f032806d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0340014040 tx=0x7f0340008030 comp rx=0 tx=0).stop 2023-07-11T00:31:14.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.088+0000 7f034c7ff700 1 -- 172.21.15.22:0/690573589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03440d3730 msgr2=0x7f03440ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:14.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.088+0000 7f034c7ff700 1 --2- 172.21.15.22:0/690573589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03440d3730 0x7f03440ca440 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f033c00cc80 tx=0x7f033c00cf90 comp rx=0 tx=0).stop 2023-07-11T00:31:14.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.089+0000 7f034c7ff700 1 -- 172.21.15.22:0/690573589 shutdown_connections 2023-07-11T00:31:14.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.089+0000 7f034c7ff700 1 --2- 172.21.15.22:0/690573589 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f032806ace0 0x7f032806d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:14.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.089+0000 7f034c7ff700 1 --2- 172.21.15.22:0/690573589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03440d3730 0x7f03440ca440 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:14.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.089+0000 7f034c7ff700 1 --2- 172.21.15.22:0/690573589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03440b8430 0x7f0344157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:14.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.089+0000 7f034c7ff700 1 --2- 172.21.15.22:0/690573589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03440cfa90 0x7f03440c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:14.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.089+0000 7f034c7ff700 1 -- 172.21.15.22:0/690573589 >> 172.21.15.22:0/690573589 conn(0x7f034406b3f0 msgr2=0x7f034415bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:14.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.089+0000 7f034c7ff700 1 -- 172.21.15.22:0/690573589 shutdown_connections 2023-07-11T00:31:14.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.089+0000 7f034c7ff700 1 -- 172.21.15.22:0/690573589 wait complete. 2023-07-11T00:31:14.155 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-11T00:31:14.156 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-07-11T00:31:14.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.355+0000 7f1eb15ff700 1 Processor -- start 2023-07-11T00:31:14.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.356+0000 7f1eb15ff700 1 -- start start 2023-07-11T00:31:14.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.357+0000 7f1eb15ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1eac15c460 0x7f1eac0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:14.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.357+0000 7f1eb15ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1eac0cf8f0 0x7f1eac15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:14.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.357+0000 7f1eb15ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eac0d1790 con 0x7f1eac0d2640 2023-07-11T00:31:14.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.357+0000 7f1eb15ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eac0cedd0 con 0x7f1eac15c460 2023-07-11T00:31:14.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.357+0000 7f1eb15ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac0cd950 con 0x7f1eac0cf8f0 2023-07-11T00:31:14.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.357+0000 7f1eab7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1eac0cf8f0 0x7f1eac15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:14.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.357+0000 7f1eaaffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1eac15c460 0x7f1eac0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:14.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.357+0000 7f1eab7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1eac0cf8f0 0x7f1eac15fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:60954/0 (socket says 172.21.15.22:60954) 2023-07-11T00:31:14.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.357+0000 7f1eaa7fc700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f1eac0d2640 0x7f1eac0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:43334/0 (socket says 172.21.15.22:43334) 2023-07-11T00:31:14.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.357+0000 7f1eab7fe700 1 -- 172.21.15.22:0/3162587038 learned_addr learned my addr 172.21.15.22:0/3162587038 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.358+0000 7f1eab7fe700 1 -- 172.21.15.22:0/3162587038 >> v2:172.21.15.184:3300/0 conn(0x7f1eac15c460 msgr2=0x7f1eac0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.358+0000 7f1eab7fe700 1 --2- 172.21.15.22:0/3162587038 >> v2:172.21.15.184:3300/0 conn(0x7f1eac15c460 0x7f1eac0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.358+0000 7f1eab7fe700 1 -- 172.21.15.22:0/3162587038 >> v1:172.21.15.184:6789/0 conn(0x7f1eac0d2640 legacy=0x7f1eac0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.358+0000 7f1eab7fe700 1 -- 172.21.15.22:0/3162587038 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac0d14b0 con 0x7f1eac0cf8f0 2023-07-11T00:31:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.358+0000 7f1eaaffd700 1 --2- 172.21.15.22:0/3162587038 >> v2:172.21.15.184:3300/0 conn(0x7f1eac15c460 0x7f1eac0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.358+0000 7f1eab7fe700 1 --2- 172.21.15.22:0/3162587038 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1eac0cf8f0 0x7f1eac15fe20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009e50 tx=0x7f1ea400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40f86b17669d02e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:14.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.358+0000 7f1ea9ffb700 1 -- 172.21.15.22:0/3162587038 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea400e070 con 0x7f1eac0cf8f0 2023-07-11T00:31:14.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.358+0000 7f1ea9ffb700 1 -- 172.21.15.22:0/3162587038 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea400b910 con 0x7f1eac0cf8f0 2023-07-11T00:31:14.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.359+0000 7f1ea9ffb700 1 -- 172.21.15.22:0/3162587038 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea400bcc0 con 0x7f1eac0cf8f0 2023-07-11T00:31:14.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.359+0000 7f1eb15ff700 1 -- 172.21.15.22:0/3162587038 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1eac0cf8f0 msgr2=0x7f1eac15fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:14.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.359+0000 7f1eb15ff700 1 --2- 172.21.15.22:0/3162587038 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1eac0cf8f0 0x7f1eac15fe20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009e50 tx=0x7f1ea400b330 comp rx=0 tx=0).stop 2023-07-11T00:31:14.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.359+0000 7f1eb15ff700 1 -- 172.21.15.22:0/3162587038 shutdown_connections 2023-07-11T00:31:14.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.359+0000 7f1eb15ff700 1 --2- 172.21.15.22:0/3162587038 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1eac0cf8f0 0x7f1eac15fe20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:14.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.359+0000 7f1eb15ff700 1 --2- 172.21.15.22:0/3162587038 >> v2:172.21.15.184:3300/0 conn(0x7f1eac15c460 0x7f1eac0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:14.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.359+0000 7f1eb15ff700 1 -- 172.21.15.22:0/3162587038 >> 172.21.15.22:0/3162587038 conn(0x7f1eac071660 msgr2=0x7f1eac071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:14.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.359+0000 7f1eb15ff700 1 -- 172.21.15.22:0/3162587038 shutdown_connections 2023-07-11T00:31:14.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.359+0000 7f1eb15ff700 1 -- 172.21.15.22:0/3162587038 wait complete. 2023-07-11T00:31:14.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.361+0000 7f1eb15ff700 1 Processor -- start 2023-07-11T00:31:14.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.361+0000 7f1eb15ff700 1 -- start start 2023-07-11T00:31:14.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.362+0000 7f1eb15ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1eac0cf8f0 0x7f1eac0c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:14.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.362+0000 7f1eb15ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1eac0d2640 0x7f1eac15e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:14.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.362+0000 7f1eb15ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1eac15c460 0x7f1eac149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:14.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.362+0000 7f1eb15ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac1f2060 con 0x7f1eac0d2640 2023-07-11T00:31:14.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.362+0000 7f1eb15ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac0c9710 con 0x7f1eac15c460 2023-07-11T00:31:14.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.362+0000 7f1eb15ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac1f2300 con 0x7f1eac0cf8f0 2023-07-11T00:31:14.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.362+0000 7f1eaa7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1eac0d2640 0x7f1eac15e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:14.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.362+0000 7f1eaa7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1eac0d2640 0x7f1eac15e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43476/0 (socket says 172.21.15.22:43476) 2023-07-11T00:31:14.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.362+0000 7f1eaa7fc700 1 -- 172.21.15.22:0/3282618898 learned_addr learned my addr 172.21.15.22:0/3282618898 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:14.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.362+0000 7f1eaaffd700 1 --2- 172.21.15.22:0/3282618898 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1eac0cf8f0 0x7f1eac0c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:14.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.362+0000 7f1eab7fe700 1 --2- 172.21.15.22:0/3282618898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1eac15c460 0x7f1eac149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:14.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.363+0000 7f1eaa7fc700 1 -- 172.21.15.22:0/3282618898 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1eac0cf8f0 msgr2=0x7f1eac0c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:14.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.363+0000 7f1eaa7fc700 1 --2- 172.21.15.22:0/3282618898 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1eac0cf8f0 0x7f1eac0c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:14.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.363+0000 7f1eaa7fc700 1 -- 172.21.15.22:0/3282618898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1eac15c460 msgr2=0x7f1eac149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:14.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.363+0000 7f1eaa7fc700 1 --2- 172.21.15.22:0/3282618898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1eac15c460 0x7f1eac149bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:14.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.363+0000 7f1eaa7fc700 1 -- 172.21.15.22:0/3282618898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c0094a0 con 0x7f1eac0d2640 2023-07-11T00:31:14.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.363+0000 7f1eab7fe700 1 --2- 172.21.15.22:0/3282618898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1eac15c460 0x7f1eac149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:14.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.363+0000 7f1eaa7fc700 1 --2- 172.21.15.22:0/3282618898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1eac0d2640 0x7f1eac15e070 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000c520 tx=0x7f1ea000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:14.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.363+0000 7f1e937fe700 1 -- 172.21.15.22:0/3282618898 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0005cb0 con 0x7f1eac0d2640 2023-07-11T00:31:14.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.363+0000 7f1e937fe700 1 -- 172.21.15.22:0/3282618898 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea0005e10 con 0x7f1eac0d2640 2023-07-11T00:31:14.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.363+0000 7f1eb15ff700 1 -- 172.21.15.22:0/3282618898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea4009b30 con 0x7f1eac0d2640 2023-07-11T00:31:14.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.363+0000 7f1e937fe700 1 -- 172.21.15.22:0/3282618898 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea00072d0 con 0x7f1eac0d2640 2023-07-11T00:31:14.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.363+0000 7f1eb15ff700 1 -- 172.21.15.22:0/3282618898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eac1f28c0 con 0x7f1eac0d2640 2023-07-11T00:31:14.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.364+0000 7f1eb15ff700 1 -- 172.21.15.22:0/3282618898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eac04ea60 con 0x7f1eac0d2640 2023-07-11T00:31:14.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.365+0000 7f1e937fe700 1 -- 172.21.15.22:0/3282618898 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ea0007430 con 0x7f1eac0d2640 2023-07-11T00:31:14.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.366+0000 7f1e937fe700 1 --2- 172.21.15.22:0/3282618898 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1e9806acb0 0x7f1e9806d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:14.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.366+0000 7f1e937fe700 1 -- 172.21.15.22:0/3282618898 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1ea0088bb0 con 0x7f1eac0d2640 2023-07-11T00:31:14.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.367+0000 7f1eaaffd700 1 --2- 172.21.15.22:0/3282618898 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1e9806acb0 0x7f1e9806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:14.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.367+0000 7f1eaaffd700 1 --2- 172.21.15.22:0/3282618898 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1e9806acb0 0x7f1e9806d160 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009d00 tx=0x7f1e9c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:14.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.370+0000 7f1e937fe700 1 -- 172.21.15.22:0/3282618898 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1ea00539e0 con 0x7f1eac0d2640 2023-07-11T00:31:14.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:14.665+0000 7f1eb15ff700 1 -- 172.21.15.22:0/3282618898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f1eac0b4fa0 con 0x7f1eac0d2640 2023-07-11T00:31:15.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.085+0000 7f1e937fe700 1 -- 172.21.15.22:0/3282618898 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v81) v1 ==== 147+0+0 (secure 0 0 0) 0x7f1ea00170d0 con 0x7f1eac0d2640 2023-07-11T00:31:15.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.088+0000 7f1eb15ff700 1 -- 172.21.15.22:0/3282618898 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1e9806acb0 msgr2=0x7f1e9806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:15.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.088+0000 7f1eb15ff700 1 --2- 172.21.15.22:0/3282618898 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1e9806acb0 0x7f1e9806d160 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009d00 tx=0x7f1e9c008040 comp rx=0 tx=0).stop 2023-07-11T00:31:15.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.088+0000 7f1eb15ff700 1 -- 172.21.15.22:0/3282618898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1eac0d2640 msgr2=0x7f1eac15e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:15.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.088+0000 7f1eb15ff700 1 --2- 172.21.15.22:0/3282618898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1eac0d2640 0x7f1eac15e070 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000c520 tx=0x7f1ea000c8e0 comp rx=0 tx=0).stop 2023-07-11T00:31:15.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.088+0000 7f1eb15ff700 1 -- 172.21.15.22:0/3282618898 shutdown_connections 2023-07-11T00:31:15.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.088+0000 7f1eb15ff700 1 --2- 172.21.15.22:0/3282618898 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1e9806acb0 0x7f1e9806d160 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:15.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.088+0000 7f1eb15ff700 1 --2- 172.21.15.22:0/3282618898 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1eac0cf8f0 0x7f1eac0c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:15.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.088+0000 7f1eb15ff700 1 --2- 172.21.15.22:0/3282618898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1eac15c460 0x7f1eac149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:15.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.088+0000 7f1eb15ff700 1 --2- 172.21.15.22:0/3282618898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1eac0d2640 0x7f1eac15e070 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:15.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.088+0000 7f1eb15ff700 1 -- 172.21.15.22:0/3282618898 >> 172.21.15.22:0/3282618898 conn(0x7f1eac071660 msgr2=0x7f1eac0b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:15.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.088+0000 7f1eb15ff700 1 -- 172.21.15.22:0/3282618898 shutdown_connections 2023-07-11T00:31:15.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.088+0000 7f1eb15ff700 1 -- 172.21.15.22:0/3282618898 wait complete. 2023-07-11T00:31:15.110 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-11T00:31:15.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.314+0000 7fa1927ff700 1 Processor -- start 2023-07-11T00:31:15.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.315+0000 7fa1927ff700 1 -- start start 2023-07-11T00:31:15.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.316+0000 7fa1927ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa18c0b8430 0x7fa18c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:15.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.316+0000 7fa1927ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa18c0d3730 0x7fa18c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:15.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.316+0000 7fa1927ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa18c0cfa90 0x7fa18c15feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:15.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.316+0000 7fa1927ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18c0b8800 con 0x7fa18c0b8430 2023-07-11T00:31:15.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.316+0000 7fa1927ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18c0d0b20 con 0x7fa18c0d3730 2023-07-11T00:31:15.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.316+0000 7fa1927ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c0cfeb0 con 0x7fa18c0cfa90 2023-07-11T00:31:15.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.316+0000 7fa18bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa18c0b8430 0x7fa18c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:15.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.316+0000 7fa18bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa18c0b8430 0x7fa18c0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43490/0 (socket says 172.21.15.22:43490) 2023-07-11T00:31:15.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.316+0000 7fa18bfff700 1 -- 172.21.15.22:0/4092937194 learned_addr learned my addr 172.21.15.22:0/4092937194 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:15.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.316+0000 7fa190d9c700 1 --2- 172.21.15.22:0/4092937194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa18c0cfa90 0x7fa18c15feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:15.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.316+0000 7fa18b7fe700 1 --2- 172.21.15.22:0/4092937194 >> v2:172.21.15.184:3300/0 conn(0x7fa18c0d3730 0x7fa18c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:15.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.316+0000 7fa18bfff700 1 -- 172.21.15.22:0/4092937194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa18c0cfa90 msgr2=0x7fa18c15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:15.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.316+0000 7fa18bfff700 1 --2- 172.21.15.22:0/4092937194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa18c0cfa90 0x7fa18c15feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:15.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.316+0000 7fa18bfff700 1 -- 172.21.15.22:0/4092937194 >> v2:172.21.15.184:3300/0 conn(0x7fa18c0d3730 msgr2=0x7fa18c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:15.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.316+0000 7fa18bfff700 1 --2- 172.21.15.22:0/4092937194 >> v2:172.21.15.184:3300/0 conn(0x7fa18c0d3730 0x7fa18c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:15.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.316+0000 7fa18bfff700 1 -- 172.21.15.22:0/4092937194 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c0b4ee0 con 0x7fa18c0b8430 2023-07-11T00:31:15.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.316+0000 7fa18b7fe700 1 --2- 172.21.15.22:0/4092937194 >> v2:172.21.15.184:3300/0 conn(0x7fa18c0d3730 0x7fa18c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:15.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.317+0000 7fa18bfff700 1 --2- 172.21.15.22:0/4092937194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa18c0b8430 0x7fa18c0cd320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa18c160f50 tx=0x7fa17c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a7bf8f5b86405e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:15.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.317+0000 7fa18affd700 1 -- 172.21.15.22:0/4092937194 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c00b870 con 0x7fa18c0b8430 2023-07-11T00:31:15.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.317+0000 7fa18affd700 1 -- 172.21.15.22:0/4092937194 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c00b9d0 con 0x7fa18c0b8430 2023-07-11T00:31:15.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.317+0000 7fa18affd700 1 -- 172.21.15.22:0/4092937194 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c00bd60 con 0x7fa18c0b8430 2023-07-11T00:31:15.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.317+0000 7fa1927ff700 1 -- 172.21.15.22:0/4092937194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa18c0b8430 msgr2=0x7fa18c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:15.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.317+0000 7fa1927ff700 1 --2- 172.21.15.22:0/4092937194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa18c0b8430 0x7fa18c0cd320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa18c160f50 tx=0x7fa17c009bd0 comp rx=0 tx=0).stop 2023-07-11T00:31:15.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.318+0000 7fa1927ff700 1 -- 172.21.15.22:0/4092937194 shutdown_connections 2023-07-11T00:31:15.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.318+0000 7fa1927ff700 1 --2- 172.21.15.22:0/4092937194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa18c0cfa90 0x7fa18c15feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:15.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.318+0000 7fa1927ff700 1 --2- 172.21.15.22:0/4092937194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa18c0b8430 0x7fa18c0cd320 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:15.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.318+0000 7fa1927ff700 1 --2- 172.21.15.22:0/4092937194 >> v2:172.21.15.184:3300/0 conn(0x7fa18c0d3730 0x7fa18c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:15.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.318+0000 7fa1927ff700 1 -- 172.21.15.22:0/4092937194 >> 172.21.15.22:0/4092937194 conn(0x7fa18c06b3f0 msgr2=0x7fa18c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:15.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.318+0000 7fa1927ff700 1 -- 172.21.15.22:0/4092937194 shutdown_connections 2023-07-11T00:31:15.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.318+0000 7fa1927ff700 1 -- 172.21.15.22:0/4092937194 wait complete. 2023-07-11T00:31:15.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.320+0000 7fa1927ff700 1 Processor -- start 2023-07-11T00:31:15.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.320+0000 7fa1927ff700 1 -- start start 2023-07-11T00:31:15.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.321+0000 7fa1927ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa18c0b8430 0x7fa18c15f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:15.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.322+0000 7fa1927ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa18c0cfa90 0x7fa18c1f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:15.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.322+0000 7fa1927ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa18c0d3730 0x7fa18c0c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:15.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.322+0000 7fa1927ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c1f98e0 con 0x7fa18c0b8430 2023-07-11T00:31:15.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.322+0000 7fa1927ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c1f6b60 con 0x7fa18c0d3730 2023-07-11T00:31:15.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.322+0000 7fa1927ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c1f6e40 con 0x7fa18c0cfa90 2023-07-11T00:31:15.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.322+0000 7fa18bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa18c0b8430 0x7fa18c15f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:15.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.322+0000 7fa18bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa18c0b8430 0x7fa18c15f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43496/0 (socket says 172.21.15.22:43496) 2023-07-11T00:31:15.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.322+0000 7fa18bfff700 1 -- 172.21.15.22:0/2472961949 learned_addr learned my addr 172.21.15.22:0/2472961949 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:15.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.322+0000 7fa18b7fe700 1 --2- 172.21.15.22:0/2472961949 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa18c0cfa90 0x7fa18c1f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:15.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.322+0000 7fa190d9c700 1 --2- 172.21.15.22:0/2472961949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa18c0d3730 0x7fa18c0c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:15.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.322+0000 7fa18bfff700 1 -- 172.21.15.22:0/2472961949 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa18c0cfa90 msgr2=0x7fa18c1f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:15.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.322+0000 7fa18bfff700 1 --2- 172.21.15.22:0/2472961949 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa18c0cfa90 0x7fa18c1f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:15.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.322+0000 7fa18bfff700 1 -- 172.21.15.22:0/2472961949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa18c0d3730 msgr2=0x7fa18c0c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:15.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.322+0000 7fa18bfff700 1 --2- 172.21.15.22:0/2472961949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa18c0d3730 0x7fa18c0c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:15.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.322+0000 7fa18bfff700 1 -- 172.21.15.22:0/2472961949 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c009550 con 0x7fa18c0b8430 2023-07-11T00:31:15.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.322+0000 7fa190d9c700 1 --2- 172.21.15.22:0/2472961949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa18c0d3730 0x7fa18c0c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:15.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.323+0000 7fa18bfff700 1 --2- 172.21.15.22:0/2472961949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa18c0b8430 0x7fa18c15f550 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa17c000c00 tx=0x7fa17c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:15.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.323+0000 7fa188ff9700 1 -- 172.21.15.22:0/2472961949 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c004520 con 0x7fa18c0b8430 2023-07-11T00:31:15.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.323+0000 7fa188ff9700 1 -- 172.21.15.22:0/2472961949 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c01e070 con 0x7fa18c0b8430 2023-07-11T00:31:15.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.323+0000 7fa1927ff700 1 -- 172.21.15.22:0/2472961949 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18c1f7120 con 0x7fa18c0b8430 2023-07-11T00:31:15.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.323+0000 7fa188ff9700 1 -- 172.21.15.22:0/2472961949 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0038c0 con 0x7fa18c0b8430 2023-07-11T00:31:15.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.323+0000 7fa1927ff700 1 -- 172.21.15.22:0/2472961949 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18c1f6870 con 0x7fa18c0b8430 2023-07-11T00:31:15.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.324+0000 7fa1927ff700 1 -- 172.21.15.22:0/2472961949 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa18c1f9d70 con 0x7fa18c0b8430 2023-07-11T00:31:15.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.325+0000 7fa188ff9700 1 -- 172.21.15.22:0/2472961949 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa17c003a20 con 0x7fa18c0b8430 2023-07-11T00:31:15.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.326+0000 7fa188ff9700 1 --2- 172.21.15.22:0/2472961949 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa17806ace0 0x7fa17806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:15.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.326+0000 7fa188ff9700 1 -- 172.21.15.22:0/2472961949 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa17c020070 con 0x7fa18c0b8430 2023-07-11T00:31:15.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.326+0000 7fa18b7fe700 1 --2- 172.21.15.22:0/2472961949 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa17806ace0 0x7fa17806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:15.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.327+0000 7fa18b7fe700 1 --2- 172.21.15.22:0/2472961949 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa17806ace0 0x7fa17806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa180006fd0 tx=0x7fa180008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:15.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.331+0000 7fa188ff9700 1 -- 172.21.15.22:0/2472961949 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa17c055af0 con 0x7fa18c0b8430 2023-07-11T00:31:15.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.536+0000 7fa1927ff700 1 -- 172.21.15.22:0/2472961949 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa18c066e80 con 0x7fa18c0b8430 2023-07-11T00:31:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.540+0000 7fa188ff9700 1 -- 172.21.15.22:0/2472961949 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa17c059110 con 0x7fa18c0b8430 2023-07-11T00:31:15.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.542+0000 7fa1927ff700 1 -- 172.21.15.22:0/2472961949 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa17806ace0 msgr2=0x7fa17806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:15.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.542+0000 7fa1927ff700 1 --2- 172.21.15.22:0/2472961949 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa17806ace0 0x7fa17806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa180006fd0 tx=0x7fa180008040 comp rx=0 tx=0).stop 2023-07-11T00:31:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.542+0000 7fa1927ff700 1 -- 172.21.15.22:0/2472961949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa18c0b8430 msgr2=0x7fa18c15f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.542+0000 7fa1927ff700 1 --2- 172.21.15.22:0/2472961949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa18c0b8430 0x7fa18c15f550 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa17c000c00 tx=0x7fa17c004750 comp rx=0 tx=0).stop 2023-07-11T00:31:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.543+0000 7fa1927ff700 1 -- 172.21.15.22:0/2472961949 shutdown_connections 2023-07-11T00:31:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.543+0000 7fa1927ff700 1 --2- 172.21.15.22:0/2472961949 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa17806ace0 0x7fa17806d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.543+0000 7fa1927ff700 1 --2- 172.21.15.22:0/2472961949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa18c0d3730 0x7fa18c0c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.543+0000 7fa1927ff700 1 --2- 172.21.15.22:0/2472961949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa18c0b8430 0x7fa18c15f550 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.543+0000 7fa1927ff700 1 --2- 172.21.15.22:0/2472961949 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa18c0cfa90 0x7fa18c1f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.543+0000 7fa1927ff700 1 -- 172.21.15.22:0/2472961949 >> 172.21.15.22:0/2472961949 conn(0x7fa18c06b3f0 msgr2=0x7fa18c0cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.543+0000 7fa1927ff700 1 -- 172.21.15.22:0/2472961949 shutdown_connections 2023-07-11T00:31:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:15.543+0000 7fa1927ff700 1 -- 172.21.15.22:0/2472961949 wait complete. 2023-07-11T00:31:15.563 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-11T00:31:15.563 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-11T00:31:15.669 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-11T00:31:15.780 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-11T00:31:15.781 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:31:15.781 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:31:15.834 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:31:15.834 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:31:15.921 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:31:15.922 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:31:16.007 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:31:16.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.245+0000 7fbe123ff700 1 Processor -- start 2023-07-11T00:31:16.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.245+0000 7fbe123ff700 1 -- start start 2023-07-11T00:31:16.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.247+0000 7fbe123ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbe0c15c460 0x7fbe0c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:16.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.247+0000 7fbe123ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe0c0cf8f0 0x7fbe0c15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:16.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.247+0000 7fbe123ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0c0d1790 con 0x7fbe0c0d2640 2023-07-11T00:31:16.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.247+0000 7fbe123ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0c0cedd0 con 0x7fbe0c15c460 2023-07-11T00:31:16.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.247+0000 7fbe123ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0cd950 con 0x7fbe0c0cf8f0 2023-07-11T00:31:16.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.247+0000 7fbe0b7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbe0c0d2640 0x7fbe0c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59888/0 (socket says 172.21.15.22:59888) 2023-07-11T00:31:16.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.247+0000 7fbe0b7fe700 1 -- 172.21.15.22:0/4221085351 learned_addr learned my addr 172.21.15.22:0/4221085351 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:16.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe1099c700 1 --2- 172.21.15.22:0/4221085351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe0c0cf8f0 0x7fbe0c15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:16.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe0bfff700 1 --2- 172.21.15.22:0/4221085351 >> v2:172.21.15.184:3300/0 conn(0x7fbe0c15c460 0x7fbe0c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:16.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe0affd700 1 -- 172.21.15.22:0/4221085351 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232623732 0 0) 0x7fbe0c0d1790 con 0x7fbe0c0d2640 2023-07-11T00:31:16.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe0affd700 1 -- 172.21.15.22:0/4221085351 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf40035b0 con 0x7fbe0c0d2640 2023-07-11T00:31:16.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe0affd700 1 -- 172.21.15.22:0/4221085351 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4231222221 0 0) 0x7fbdf40035b0 con 0x7fbe0c0d2640 2023-07-11T00:31:16.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe0affd700 1 -- 172.21.15.22:0/4221085351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe0c0cf8f0 msgr2=0x7fbe0c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:16.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe0affd700 1 --2- 172.21.15.22:0/4221085351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe0c0cf8f0 0x7fbe0c15fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe0affd700 1 -- 172.21.15.22:0/4221085351 >> v2:172.21.15.184:3300/0 conn(0x7fbe0c15c460 msgr2=0x7fbe0c0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:16.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe0affd700 1 --2- 172.21.15.22:0/4221085351 >> v2:172.21.15.184:3300/0 conn(0x7fbe0c15c460 0x7fbe0c0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe0affd700 1 -- 172.21.15.22:0/4221085351 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c0d14b0 con 0x7fbe0c0d2640 2023-07-11T00:31:16.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe0affd700 1 -- 172.21.15.22:0/4221085351 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7fbe00001670 con 0x7fbe0c0d2640 2023-07-11T00:31:16.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe0affd700 1 -- 172.21.15.22:0/4221085351 >> v1:172.21.15.22:6789/0 conn(0x7fbe0c0d2640 legacy=0x7fbe0c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:16.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe0affd700 1 --2- 172.21.15.22:0/4221085351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe0c0cf8f0 0x7fbdf4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:16.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe0affd700 1 --2- 172.21.15.22:0/4221085351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdf4003f80 0x7fbdf4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:16.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe0affd700 1 --2- 172.21.15.22:0/4221085351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdf4004d90 0x7fbdf4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:16.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe0affd700 1 -- 172.21.15.22:0/4221085351 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0cedd0 con 0x7fbdf4003f80 2023-07-11T00:31:16.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe0affd700 1 -- 172.21.15.22:0/4221085351 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0cd950 con 0x7fbdf4004d90 2023-07-11T00:31:16.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.248+0000 7fbe0affd700 1 -- 172.21.15.22:0/4221085351 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf400baf0 con 0x7fbe0c0cf8f0 2023-07-11T00:31:16.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.249+0000 7fbe0b7fe700 1 --2- 172.21.15.22:0/4221085351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdf4003f80 0x7fbdf4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:16.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.249+0000 7fbe0bfff700 1 --2- 172.21.15.22:0/4221085351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe0c0cf8f0 0x7fbdf4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:16.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.249+0000 7fbe1099c700 1 --2- 172.21.15.22:0/4221085351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdf4004d90 0x7fbdf4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:16.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.249+0000 7fbe0b7fe700 1 -- 172.21.15.22:0/4221085351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe0c0cf8f0 msgr2=0x7fbdf4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:16.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.249+0000 7fbe0b7fe700 1 --2- 172.21.15.22:0/4221085351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe0c0cf8f0 0x7fbdf4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.249+0000 7fbe0b7fe700 1 -- 172.21.15.22:0/4221085351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdf4004d90 msgr2=0x7fbdf4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:16.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.249+0000 7fbe0b7fe700 1 --2- 172.21.15.22:0/4221085351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdf4004d90 0x7fbdf4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.249+0000 7fbe0b7fe700 1 -- 172.21.15.22:0/4221085351 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf40035b0 con 0x7fbdf4003f80 2023-07-11T00:31:16.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.249+0000 7fbe0bfff700 1 --2- 172.21.15.22:0/4221085351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe0c0cf8f0 0x7fbdf4003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:16.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.249+0000 7fbe0b7fe700 1 --2- 172.21.15.22:0/4221085351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdf4003f80 0x7fbdf4004850 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000c2f0 tx=0x7fbdf4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5789f930ea0667 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:16.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.250+0000 7fbe0affd700 1 -- 172.21.15.22:0/4221085351 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0000cd70 con 0x7fbdf4003f80 2023-07-11T00:31:16.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.250+0000 7fbe0affd700 1 -- 172.21.15.22:0/4221085351 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe00005960 con 0x7fbdf4003f80 2023-07-11T00:31:16.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.250+0000 7fbe0affd700 1 -- 172.21.15.22:0/4221085351 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00005d10 con 0x7fbdf4003f80 2023-07-11T00:31:16.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.250+0000 7fbe123ff700 1 -- 172.21.15.22:0/4221085351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdf4003f80 msgr2=0x7fbdf4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.250+0000 7fbe123ff700 1 --2- 172.21.15.22:0/4221085351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdf4003f80 0x7fbdf4004850 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000c2f0 tx=0x7fbdf4005880 comp rx=0 tx=0).stop 2023-07-11T00:31:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.250+0000 7fbe1099c700 1 -- 172.21.15.22:0/4221085351 reap_dead start 2023-07-11T00:31:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.250+0000 7fbe123ff700 1 -- 172.21.15.22:0/4221085351 shutdown_connections 2023-07-11T00:31:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.250+0000 7fbe123ff700 1 -- 172.21.15.22:0/4221085351 >> 172.21.15.22:0/4221085351 conn(0x7fbe0c071660 msgr2=0x7fbe0c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.250+0000 7fbe123ff700 1 -- 172.21.15.22:0/4221085351 shutdown_connections 2023-07-11T00:31:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.250+0000 7fbe123ff700 1 -- 172.21.15.22:0/4221085351 wait complete. 2023-07-11T00:31:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.252+0000 7fbe123ff700 1 Processor -- start 2023-07-11T00:31:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.252+0000 7fbe123ff700 1 -- start start 2023-07-11T00:31:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.253+0000 7fbe123ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdf4003f80 0x7fbe0c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.253+0000 7fbe123ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe0c14d0c0 0x7fbe0c153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.253+0000 7fbe123ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe0c156ae0 0x7fbe0c156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.253+0000 7fbe123ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c154440 con 0x7fbe0c14d0c0 2023-07-11T00:31:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.253+0000 7fbe123ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c157490 con 0x7fbdf4003f80 2023-07-11T00:31:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.253+0000 7fbe123ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c15e060 con 0x7fbe0c156ae0 2023-07-11T00:31:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.253+0000 7fbe0b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe0c14d0c0 0x7fbe0c153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.253+0000 7fbe0b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe0c14d0c0 0x7fbe0c153f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43516/0 (socket says 172.21.15.22:43516) 2023-07-11T00:31:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.253+0000 7fbe0b7fe700 1 -- 172.21.15.22:0/3361681137 learned_addr learned my addr 172.21.15.22:0/3361681137 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.254+0000 7fbe1099c700 1 --2- 172.21.15.22:0/3361681137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe0c156ae0 0x7fbe0c156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.254+0000 7fbe0bfff700 1 --2- 172.21.15.22:0/3361681137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdf4003f80 0x7fbe0c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.254+0000 7fbe0b7fe700 1 -- 172.21.15.22:0/3361681137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe0c156ae0 msgr2=0x7fbe0c156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.254+0000 7fbe0b7fe700 1 --2- 172.21.15.22:0/3361681137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe0c156ae0 0x7fbe0c156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.254+0000 7fbe0b7fe700 1 -- 172.21.15.22:0/3361681137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdf4003f80 msgr2=0x7fbe0c15d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.254+0000 7fbe0b7fe700 1 --2- 172.21.15.22:0/3361681137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdf4003f80 0x7fbe0c15d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.254+0000 7fbe0b7fe700 1 -- 172.21.15.22:0/3361681137 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c14d530 con 0x7fbe0c14d0c0 2023-07-11T00:31:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.254+0000 7fbe0bfff700 1 --2- 172.21.15.22:0/3361681137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdf4003f80 0x7fbe0c15d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.254+0000 7fbe0b7fe700 1 --2- 172.21.15.22:0/3361681137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe0c14d0c0 0x7fbe0c153f00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbe00008fd0 tx=0x7fbe00001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.254+0000 7fbe08ff9700 1 -- 172.21.15.22:0/3361681137 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00005ce0 con 0x7fbe0c14d0c0 2023-07-11T00:31:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.254+0000 7fbe08ff9700 1 -- 172.21.15.22:0/3361681137 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe00005e40 con 0x7fbe0c14d0c0 2023-07-11T00:31:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.254+0000 7fbe08ff9700 1 -- 172.21.15.22:0/3361681137 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00004ab0 con 0x7fbe0c14d0c0 2023-07-11T00:31:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.254+0000 7fbe123ff700 1 -- 172.21.15.22:0/3361681137 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0c14e520 con 0x7fbe0c14d0c0 2023-07-11T00:31:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.255+0000 7fbe123ff700 1 -- 172.21.15.22:0/3361681137 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c14eae0 con 0x7fbe0c14d0c0 2023-07-11T00:31:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.256+0000 7fbe123ff700 1 -- 172.21.15.22:0/3361681137 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0c15e2d0 con 0x7fbe0c14d0c0 2023-07-11T00:31:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.256+0000 7fbe08ff9700 1 -- 172.21.15.22:0/3361681137 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe00004c10 con 0x7fbe0c14d0c0 2023-07-11T00:31:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.258+0000 7fbe08ff9700 1 --2- 172.21.15.22:0/3361681137 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbdf806ace0 0x7fbdf806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.258+0000 7fbe08ff9700 1 -- 172.21.15.22:0/3361681137 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbe00089e60 con 0x7fbe0c14d0c0 2023-07-11T00:31:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.258+0000 7fbe0bfff700 1 --2- 172.21.15.22:0/3361681137 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbdf806ace0 0x7fbdf806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.259+0000 7fbe0bfff700 1 --2- 172.21.15.22:0/3361681137 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbdf806ace0 0x7fbdf806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009e00 tx=0x7fbdfc008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.262+0000 7fbe08ff9700 1 -- 172.21.15.22:0/3361681137 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbe00054bd0 con 0x7fbe0c14d0c0 2023-07-11T00:31:16.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.474+0000 7fbe123ff700 1 -- 172.21.15.22:0/3361681137 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe0c04ea60 con 0x7fbe0c14d0c0 2023-07-11T00:31:16.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.475+0000 7fbe08ff9700 1 -- 172.21.15.22:0/3361681137 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20158 (secure 0 0 0) 0x7fbe00007da0 con 0x7fbe0c14d0c0 2023-07-11T00:31:16.482 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:16.482 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:54.208536+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:31:16.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.478+0000 7fbe123ff700 1 -- 172.21.15.22:0/3361681137 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbdf806ace0 msgr2=0x7fbdf806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:16.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.478+0000 7fbe123ff700 1 --2- 172.21.15.22:0/3361681137 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbdf806ace0 0x7fbdf806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009e00 tx=0x7fbdfc008040 comp rx=0 tx=0).stop 2023-07-11T00:31:16.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.478+0000 7fbe123ff700 1 -- 172.21.15.22:0/3361681137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe0c14d0c0 msgr2=0x7fbe0c153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:16.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.478+0000 7fbe123ff700 1 --2- 172.21.15.22:0/3361681137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe0c14d0c0 0x7fbe0c153f00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbe00008fd0 tx=0x7fbe00001a00 comp rx=0 tx=0).stop 2023-07-11T00:31:16.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.478+0000 7fbe123ff700 1 -- 172.21.15.22:0/3361681137 shutdown_connections 2023-07-11T00:31:16.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.478+0000 7fbe123ff700 1 --2- 172.21.15.22:0/3361681137 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbdf806ace0 0x7fbdf806d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.478+0000 7fbe123ff700 1 --2- 172.21.15.22:0/3361681137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe0c156ae0 0x7fbe0c156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.478+0000 7fbe123ff700 1 --2- 172.21.15.22:0/3361681137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdf4003f80 0x7fbe0c15d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.478+0000 7fbe123ff700 1 --2- 172.21.15.22:0/3361681137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe0c14d0c0 0x7fbe0c153f00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.478+0000 7fbe123ff700 1 -- 172.21.15.22:0/3361681137 >> 172.21.15.22:0/3361681137 conn(0x7fbe0c071660 msgr2=0x7fbe0c0b7430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:16.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.478+0000 7fbe123ff700 1 -- 172.21.15.22:0/3361681137 shutdown_connections 2023-07-11T00:31:16.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.478+0000 7fbe123ff700 1 -- 172.21.15.22:0/3361681137 wait complete. 2023-07-11T00:31:16.499 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:29:57.631007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:29:58.547599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:30:03.826184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:30:04.383448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-11T00:30:08.075875+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-11T00:31:16.501 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:31:16.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.702+0000 7fe38bfff700 1 Processor -- start 2023-07-11T00:31:16.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.703+0000 7fe38bfff700 1 -- start start 2023-07-11T00:31:16.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.704+0000 7fe38bfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe3840b8430 0x7fe3840cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:16.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.704+0000 7fe38bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe3840cfc60 0x7fe3840d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:16.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.704+0000 7fe38bfff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3840d0b20 con 0x7fe3840d3730 2023-07-11T00:31:16.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.704+0000 7fe38bfff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3840b8800 con 0x7fe3840cfc60 2023-07-11T00:31:16.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.704+0000 7fe38bfff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3840b4ee0 con 0x7fe3840b8430 2023-07-11T00:31:16.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.704+0000 7fe38a59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe3840cfc60 0x7fe3840d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:16.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.704+0000 7fe38a59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe3840cfc60 0x7fe3840d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43528/0 (socket says 172.21.15.22:43528) 2023-07-11T00:31:16.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.704+0000 7fe38a59c700 1 -- 172.21.15.22:0/811825776 learned_addr learned my addr 172.21.15.22:0/811825776 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:16.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.704+0000 7fe389d9b700 1 --2- 172.21.15.22:0/811825776 >> v2:172.21.15.184:3300/0 conn(0x7fe3840b8430 0x7fe3840cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:16.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.705+0000 7fe38a59c700 1 -- 172.21.15.22:0/811825776 >> v2:172.21.15.184:3300/0 conn(0x7fe3840b8430 msgr2=0x7fe3840cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:16.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.705+0000 7fe38a59c700 1 --2- 172.21.15.22:0/811825776 >> v2:172.21.15.184:3300/0 conn(0x7fe3840b8430 0x7fe3840cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.705+0000 7fe38a59c700 1 -- 172.21.15.22:0/811825776 >> v1:172.21.15.184:6789/0 conn(0x7fe3840d3730 legacy=0x7fe3840cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:16.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.705+0000 7fe38a59c700 1 -- 172.21.15.22:0/811825776 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3840b51c0 con 0x7fe3840cfc60 2023-07-11T00:31:16.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.705+0000 7fe38a59c700 1 --2- 172.21.15.22:0/811825776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3840cfc60 0x7fe3840d0fb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe3840cf520 tx=0x7fe37c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35b2ee1215c08ea server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:16.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.705+0000 7fe388d99700 1 -- 172.21.15.22:0/811825776 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c00e070 con 0x7fe3840cfc60 2023-07-11T00:31:16.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.705+0000 7fe388d99700 1 -- 172.21.15.22:0/811825776 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37c00b9c0 con 0x7fe3840cfc60 2023-07-11T00:31:16.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.705+0000 7fe388d99700 1 -- 172.21.15.22:0/811825776 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c00bd70 con 0x7fe3840cfc60 2023-07-11T00:31:16.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.706+0000 7fe38bfff700 1 -- 172.21.15.22:0/811825776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3840cfc60 msgr2=0x7fe3840d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:16.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.706+0000 7fe38bfff700 1 --2- 172.21.15.22:0/811825776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3840cfc60 0x7fe3840d0fb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe3840cf520 tx=0x7fe37c00b330 comp rx=0 tx=0).stop 2023-07-11T00:31:16.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.706+0000 7fe38bfff700 1 -- 172.21.15.22:0/811825776 shutdown_connections 2023-07-11T00:31:16.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.706+0000 7fe38bfff700 1 --2- 172.21.15.22:0/811825776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3840cfc60 0x7fe3840d0fb0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.706+0000 7fe38bfff700 1 --2- 172.21.15.22:0/811825776 >> v2:172.21.15.184:3300/0 conn(0x7fe3840b8430 0x7fe3840cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.706+0000 7fe38bfff700 1 -- 172.21.15.22:0/811825776 >> 172.21.15.22:0/811825776 conn(0x7fe38406b3f0 msgr2=0x7fe38406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:16.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.706+0000 7fe38bfff700 1 -- 172.21.15.22:0/811825776 shutdown_connections 2023-07-11T00:31:16.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.706+0000 7fe38bfff700 1 -- 172.21.15.22:0/811825776 wait complete. 2023-07-11T00:31:16.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.708+0000 7fe38bfff700 1 Processor -- start 2023-07-11T00:31:16.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.708+0000 7fe38bfff700 1 -- start start 2023-07-11T00:31:16.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.709+0000 7fe38bfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3840b8430 0x7fe3840d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:16.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.709+0000 7fe38bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3840cfc60 0x7fe3840c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:16.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.709+0000 7fe38bfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3840d3730 0x7fe38415aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:16.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.709+0000 7fe38bfff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3840cab70 con 0x7fe3840cfc60 2023-07-11T00:31:16.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.709+0000 7fe38bfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3840c9570 con 0x7fe3840b8430 2023-07-11T00:31:16.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.709+0000 7fe38bfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3840c9c10 con 0x7fe3840d3730 2023-07-11T00:31:16.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.709+0000 7fe38959a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3840cfc60 0x7fe3840c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:16.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.709+0000 7fe38959a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3840cfc60 0x7fe3840c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43540/0 (socket says 172.21.15.22:43540) 2023-07-11T00:31:16.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.709+0000 7fe38959a700 1 -- 172.21.15.22:0/3809414604 learned_addr learned my addr 172.21.15.22:0/3809414604 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:16.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.709+0000 7fe389d9b700 1 --2- 172.21.15.22:0/3809414604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3840b8430 0x7fe3840d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:16.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.709+0000 7fe38a59c700 1 --2- 172.21.15.22:0/3809414604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3840d3730 0x7fe38415aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:16.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.709+0000 7fe38959a700 1 -- 172.21.15.22:0/3809414604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3840d3730 msgr2=0x7fe38415aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:16.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.709+0000 7fe38959a700 1 --2- 172.21.15.22:0/3809414604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3840d3730 0x7fe38415aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.709+0000 7fe38959a700 1 -- 172.21.15.22:0/3809414604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3840b8430 msgr2=0x7fe3840d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:16.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.709+0000 7fe38959a700 1 --2- 172.21.15.22:0/3809414604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3840b8430 0x7fe3840d1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.709+0000 7fe38959a700 1 -- 172.21.15.22:0/3809414604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c009b30 con 0x7fe3840cfc60 2023-07-11T00:31:16.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.710+0000 7fe38959a700 1 --2- 172.21.15.22:0/3809414604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3840cfc60 0x7fe3840c6670 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe37400c450 tx=0x7fe37400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:16.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.710+0000 7fe37a7fc700 1 -- 172.21.15.22:0/3809414604 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3740052d0 con 0x7fe3840cfc60 2023-07-11T00:31:16.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.710+0000 7fe37a7fc700 1 -- 172.21.15.22:0/3809414604 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe374005430 con 0x7fe3840cfc60 2023-07-11T00:31:16.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.710+0000 7fe37a7fc700 1 -- 172.21.15.22:0/3809414604 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3740038c0 con 0x7fe3840cfc60 2023-07-11T00:31:16.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.710+0000 7fe38bfff700 1 -- 172.21.15.22:0/3809414604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3840c9ef0 con 0x7fe3840cfc60 2023-07-11T00:31:16.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.710+0000 7fe38bfff700 1 -- 172.21.15.22:0/3809414604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3840ca4b0 con 0x7fe3840cfc60 2023-07-11T00:31:16.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.711+0000 7fe38bfff700 1 -- 172.21.15.22:0/3809414604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38404ea60 con 0x7fe3840cfc60 2023-07-11T00:31:16.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.712+0000 7fe37a7fc700 1 -- 172.21.15.22:0/3809414604 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe374003a20 con 0x7fe3840cfc60 2023-07-11T00:31:16.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.713+0000 7fe37a7fc700 1 --2- 172.21.15.22:0/3809414604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe36806ace0 0x7fe36806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:16.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.713+0000 7fe37a7fc700 1 -- 172.21.15.22:0/3809414604 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe374088b80 con 0x7fe3840cfc60 2023-07-11T00:31:16.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.714+0000 7fe389d9b700 1 --2- 172.21.15.22:0/3809414604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe36806ace0 0x7fe36806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:16.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.714+0000 7fe389d9b700 1 --2- 172.21.15.22:0/3809414604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe36806ace0 0x7fe36806d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe380009930 tx=0x7fe380008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:16.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.717+0000 7fe37a7fc700 1 -- 172.21.15.22:0/3809414604 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe3740538f0 con 0x7fe3840cfc60 2023-07-11T00:31:16.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.932+0000 7fe38bfff700 1 -- 172.21.15.22:0/3809414604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe3840ce700 con 0x7fe3840cfc60 2023-07-11T00:31:16.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.933+0000 7fe37a7fc700 1 -- 172.21.15.22:0/3809414604 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe374056f10 con 0x7fe3840cfc60 2023-07-11T00:31:16.935 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2023-07-11T00:31:16.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.935+0000 7fe38bfff700 1 -- 172.21.15.22:0/3809414604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe36806ace0 msgr2=0x7fe36806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:16.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.935+0000 7fe38bfff700 1 --2- 172.21.15.22:0/3809414604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe36806ace0 0x7fe36806d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe380009930 tx=0x7fe380008040 comp rx=0 tx=0).stop 2023-07-11T00:31:16.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.935+0000 7fe38bfff700 1 -- 172.21.15.22:0/3809414604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3840cfc60 msgr2=0x7fe3840c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:16.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.935+0000 7fe38bfff700 1 --2- 172.21.15.22:0/3809414604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3840cfc60 0x7fe3840c6670 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe37400c450 tx=0x7fe37400c810 comp rx=0 tx=0).stop 2023-07-11T00:31:16.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.935+0000 7fe38bfff700 1 -- 172.21.15.22:0/3809414604 shutdown_connections 2023-07-11T00:31:16.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.935+0000 7fe38bfff700 1 --2- 172.21.15.22:0/3809414604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe36806ace0 0x7fe36806d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.935+0000 7fe38bfff700 1 --2- 172.21.15.22:0/3809414604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3840d3730 0x7fe38415aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.935+0000 7fe38bfff700 1 --2- 172.21.15.22:0/3809414604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3840b8430 0x7fe3840d1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.935+0000 7fe38bfff700 1 --2- 172.21.15.22:0/3809414604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3840cfc60 0x7fe3840c6670 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:16.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.935+0000 7fe38bfff700 1 -- 172.21.15.22:0/3809414604 >> 172.21.15.22:0/3809414604 conn(0x7fe38406b3f0 msgr2=0x7fe38415bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:16.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.935+0000 7fe38bfff700 1 -- 172.21.15.22:0/3809414604 shutdown_connections 2023-07-11T00:31:16.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:16.935+0000 7fe38bfff700 1 -- 172.21.15.22:0/3809414604 wait complete. 2023-07-11T00:31:16.955 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:31:17.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.159+0000 7eff1e9ff700 1 Processor -- start 2023-07-11T00:31:17.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.160+0000 7eff1e9ff700 1 -- start start 2023-07-11T00:31:17.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.161+0000 7eff1e9ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7eff180d3730 0x7eff180cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:17.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.161+0000 7eff1e9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff180cfa90 0x7eff180d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:17.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.161+0000 7eff1e9ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff180d0b20 con 0x7eff180b8430 2023-07-11T00:31:17.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.161+0000 7eff1e9ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff180cda30 con 0x7eff180d3730 2023-07-11T00:31:17.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.161+0000 7eff1e9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff180b8800 con 0x7eff180cfa90 2023-07-11T00:31:17.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.161+0000 7eff177fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7eff180d3730 0x7eff180cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:17.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.161+0000 7eff177fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7eff180d3730 0x7eff180cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43546/0 (socket says 172.21.15.22:43546) 2023-07-11T00:31:17.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.161+0000 7eff17fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7eff180b8430 0x7eff180cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59904/0 (socket says 172.21.15.22:59904) 2023-07-11T00:31:17.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.161+0000 7eff177fe700 1 -- 172.21.15.22:0/2028356094 learned_addr learned my addr 172.21.15.22:0/2028356094 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:17.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.161+0000 7eff1cf9c700 1 --2- 172.21.15.22:0/2028356094 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff180cfa90 0x7eff180d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:17.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.162+0000 7eff177fe700 1 -- 172.21.15.22:0/2028356094 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff180cfa90 msgr2=0x7eff180d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:17.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.162+0000 7eff177fe700 1 --2- 172.21.15.22:0/2028356094 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff180cfa90 0x7eff180d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.162+0000 7eff177fe700 1 -- 172.21.15.22:0/2028356094 >> v1:172.21.15.22:6789/0 conn(0x7eff180b8430 legacy=0x7eff180cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:17.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.162+0000 7eff177fe700 1 -- 172.21.15.22:0/2028356094 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff180cfeb0 con 0x7eff180d3730 2023-07-11T00:31:17.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.162+0000 7eff16ffd700 1 -- 172.21.15.22:0/2028356094 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852501527 0 0) 0x7eff180d0b20 con 0x7eff180b8430 2023-07-11T00:31:17.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.162+0000 7eff177fe700 1 --2- 172.21.15.22:0/2028356094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff180d3730 0x7eff180cf550 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0098f0 tx=0x7eff0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c8db1b683238c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:17.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.162+0000 7eff16ffd700 1 -- 172.21.15.22:0/2028356094 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00b8a0 con 0x7eff180d3730 2023-07-11T00:31:17.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.162+0000 7eff16ffd700 1 -- 172.21.15.22:0/2028356094 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c00ba00 con 0x7eff180d3730 2023-07-11T00:31:17.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.162+0000 7eff16ffd700 1 -- 172.21.15.22:0/2028356094 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00bd90 con 0x7eff180d3730 2023-07-11T00:31:17.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.163+0000 7eff1e9ff700 1 -- 172.21.15.22:0/2028356094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff180d3730 msgr2=0x7eff180cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:17.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.163+0000 7eff1e9ff700 1 --2- 172.21.15.22:0/2028356094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff180d3730 0x7eff180cf550 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0098f0 tx=0x7eff0c009c00 comp rx=0 tx=0).stop 2023-07-11T00:31:17.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.163+0000 7eff1e9ff700 1 -- 172.21.15.22:0/2028356094 shutdown_connections 2023-07-11T00:31:17.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.163+0000 7eff1e9ff700 1 --2- 172.21.15.22:0/2028356094 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff180cfa90 0x7eff180d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.163+0000 7eff1e9ff700 1 --2- 172.21.15.22:0/2028356094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff180d3730 0x7eff180cf550 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.163+0000 7eff1e9ff700 1 -- 172.21.15.22:0/2028356094 >> 172.21.15.22:0/2028356094 conn(0x7eff1806b3f0 msgr2=0x7eff1806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:17.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.163+0000 7eff1e9ff700 1 -- 172.21.15.22:0/2028356094 shutdown_connections 2023-07-11T00:31:17.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.163+0000 7eff1e9ff700 1 -- 172.21.15.22:0/2028356094 wait complete. 2023-07-11T00:31:17.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.165+0000 7eff1e9ff700 1 Processor -- start 2023-07-11T00:31:17.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.165+0000 7eff1e9ff700 1 -- start start 2023-07-11T00:31:17.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.166+0000 7eff1e9ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff180b8430 0x7eff1815f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:17.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.166+0000 7eff1e9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff180cfa90 0x7eff180b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:17.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.166+0000 7eff1e9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff180d3730 0x7eff1814cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:17.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.166+0000 7eff1e9ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1815d080 con 0x7eff180b8430 2023-07-11T00:31:17.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.166+0000 7eff1e9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff18150a50 con 0x7eff180cfa90 2023-07-11T00:31:17.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.166+0000 7eff1e9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff181f1f40 con 0x7eff180d3730 2023-07-11T00:31:17.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.166+0000 7eff17fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff180b8430 0x7eff1815f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:17.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.166+0000 7eff17fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff180b8430 0x7eff1815f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43548/0 (socket says 172.21.15.22:43548) 2023-07-11T00:31:17.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.166+0000 7eff17fff700 1 -- 172.21.15.22:0/3053546639 learned_addr learned my addr 172.21.15.22:0/3053546639 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:17.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.166+0000 7eff17fff700 1 -- 172.21.15.22:0/3053546639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff180d3730 msgr2=0x7eff1814cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:17.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.166+0000 7eff1cf9c700 1 --2- 172.21.15.22:0/3053546639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff180d3730 0x7eff1814cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:17.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.166+0000 7eff17fff700 1 --2- 172.21.15.22:0/3053546639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff180d3730 0x7eff1814cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.166+0000 7eff17fff700 1 -- 172.21.15.22:0/3053546639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff180cfa90 msgr2=0x7eff180b7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:17.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.166+0000 7eff17fff700 1 --2- 172.21.15.22:0/3053546639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff180cfa90 0x7eff180b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.166+0000 7eff17fff700 1 -- 172.21.15.22:0/3053546639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c009550 con 0x7eff180b8430 2023-07-11T00:31:17.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.166+0000 7eff1cf9c700 1 --2- 172.21.15.22:0/3053546639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff180d3730 0x7eff1814cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:17.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.167+0000 7eff17fff700 1 --2- 172.21.15.22:0/3053546639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff180b8430 0x7eff1815f210 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7eff080011e0 tx=0x7eff0800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:17.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.167+0000 7eff14ff9700 1 -- 172.21.15.22:0/3053546639 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08004c80 con 0x7eff180b8430 2023-07-11T00:31:17.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.167+0000 7eff14ff9700 1 -- 172.21.15.22:0/3053546639 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff08004e00 con 0x7eff180b8430 2023-07-11T00:31:17.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.167+0000 7eff14ff9700 1 -- 172.21.15.22:0/3053546639 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08007310 con 0x7eff180b8430 2023-07-11T00:31:17.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.167+0000 7eff1e9ff700 1 -- 172.21.15.22:0/3053546639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff181f2150 con 0x7eff180b8430 2023-07-11T00:31:17.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.167+0000 7eff1e9ff700 1 -- 172.21.15.22:0/3053546639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff181f2710 con 0x7eff180b8430 2023-07-11T00:31:17.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.168+0000 7eff1e9ff700 1 -- 172.21.15.22:0/3053546639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff181f2930 con 0x7eff180b8430 2023-07-11T00:31:17.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.169+0000 7eff14ff9700 1 -- 172.21.15.22:0/3053546639 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff08007470 con 0x7eff180b8430 2023-07-11T00:31:17.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.170+0000 7eff14ff9700 1 --2- 172.21.15.22:0/3053546639 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7eff0406ace0 0x7eff0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:17.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.170+0000 7eff14ff9700 1 -- 172.21.15.22:0/3053546639 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7eff08089500 con 0x7eff180b8430 2023-07-11T00:31:17.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.170+0000 7eff177fe700 1 --2- 172.21.15.22:0/3053546639 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7eff0406ace0 0x7eff0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:17.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.171+0000 7eff177fe700 1 --2- 172.21.15.22:0/3053546639 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7eff0406ace0 0x7eff0406d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7eff0c014040 tx=0x7eff0c010000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:17.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.175+0000 7eff14ff9700 1 -- 172.21.15.22:0/3053546639 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7eff08054270 con 0x7eff180b8430 2023-07-11T00:31:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.378+0000 7eff1e9ff700 1 -- 172.21.15.22:0/3053546639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff1815cdf0 con 0x7eff180b8430 2023-07-11T00:31:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.379+0000 7eff14ff9700 1 -- 172.21.15.22:0/3053546639 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff08057890 con 0x7eff180b8430 2023-07-11T00:31:17.382 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-07-11T00:31:17.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.381+0000 7eff1e9ff700 1 -- 172.21.15.22:0/3053546639 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7eff0406ace0 msgr2=0x7eff0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:17.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.381+0000 7eff1e9ff700 1 --2- 172.21.15.22:0/3053546639 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7eff0406ace0 0x7eff0406d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7eff0c014040 tx=0x7eff0c010000 comp rx=0 tx=0).stop 2023-07-11T00:31:17.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.381+0000 7eff1e9ff700 1 -- 172.21.15.22:0/3053546639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff180b8430 msgr2=0x7eff1815f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:17.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.381+0000 7eff1e9ff700 1 --2- 172.21.15.22:0/3053546639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff180b8430 0x7eff1815f210 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7eff080011e0 tx=0x7eff0800cae0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.381+0000 7eff1e9ff700 1 -- 172.21.15.22:0/3053546639 shutdown_connections 2023-07-11T00:31:17.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.381+0000 7eff1e9ff700 1 --2- 172.21.15.22:0/3053546639 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7eff0406ace0 0x7eff0406d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.381+0000 7eff1e9ff700 1 --2- 172.21.15.22:0/3053546639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff180d3730 0x7eff1814cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.381+0000 7eff1e9ff700 1 --2- 172.21.15.22:0/3053546639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff180b8430 0x7eff1815f210 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.381+0000 7eff1e9ff700 1 --2- 172.21.15.22:0/3053546639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff180cfa90 0x7eff180b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.381+0000 7eff1e9ff700 1 -- 172.21.15.22:0/3053546639 >> 172.21.15.22:0/3053546639 conn(0x7eff1806b3f0 msgr2=0x7eff180b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:17.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.381+0000 7eff1e9ff700 1 -- 172.21.15.22:0/3053546639 shutdown_connections 2023-07-11T00:31:17.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.381+0000 7eff1e9ff700 1 -- 172.21.15.22:0/3053546639 wait complete. 2023-07-11T00:31:17.402 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:31:17.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.605+0000 7f44ef7ff700 1 Processor -- start 2023-07-11T00:31:17.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.606+0000 7f44ef7ff700 1 -- start start 2023-07-11T00:31:17.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.607+0000 7f44ef7ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f44e80cfc60 0x7f44e8167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:17.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.607+0000 7f44ef7ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e80d0b20 con 0x7f44e80b8430 2023-07-11T00:31:17.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.607+0000 7f44ef7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e80b4ee0 con 0x7f44e80d3730 2023-07-11T00:31:17.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.607+0000 7f44ef7ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e80cda30 con 0x7f44e80cfc60 2023-07-11T00:31:17.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.607+0000 7f44edd9c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f44e80cfc60 0x7f44e8167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:17.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.607+0000 7f44ed59b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f44e80b8430 0x7f44e80cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59914/0 (socket says 172.21.15.22:59914) 2023-07-11T00:31:17.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.607+0000 7f44ed59b700 1 -- 172.21.15.22:0/3343071723 learned_addr learned my addr 172.21.15.22:0/3343071723 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:17.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.607+0000 7f44edd9c700 1 -- 172.21.15.22:0/3343071723 >> v1:172.21.15.184:6789/0 conn(0x7f44e80d3730 legacy=0x7f44e80cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:17.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.607+0000 7f44edd9c700 1 -- 172.21.15.22:0/3343071723 >> v1:172.21.15.22:6789/0 conn(0x7f44e80b8430 legacy=0x7f44e80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:17.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.607+0000 7f44edd9c700 1 -- 172.21.15.22:0/3343071723 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e80b51c0 con 0x7f44e80cfc60 2023-07-11T00:31:17.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.608+0000 7f44edd9c700 1 --2- 172.21.15.22:0/3343071723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e80cfc60 0x7f44e8167010 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009d90 tx=0x7f44e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cc90e1a947f7d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:17.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.608+0000 7f44dffff700 1 -- 172.21.15.22:0/3343071723 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e000e070 con 0x7f44e80cfc60 2023-07-11T00:31:17.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.608+0000 7f44dffff700 1 -- 172.21.15.22:0/3343071723 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e000bb90 con 0x7f44e80cfc60 2023-07-11T00:31:17.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.608+0000 7f44dffff700 1 -- 172.21.15.22:0/3343071723 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0003a20 con 0x7f44e80cfc60 2023-07-11T00:31:17.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.608+0000 7f44ef7ff700 1 -- 172.21.15.22:0/3343071723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e80cfc60 msgr2=0x7f44e8167010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:17.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.608+0000 7f44ef7ff700 1 --2- 172.21.15.22:0/3343071723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e80cfc60 0x7f44e8167010 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009d90 tx=0x7f44e000b330 comp rx=0 tx=0).stop 2023-07-11T00:31:17.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.609+0000 7f44ef7ff700 1 -- 172.21.15.22:0/3343071723 shutdown_connections 2023-07-11T00:31:17.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.609+0000 7f44ef7ff700 1 --2- 172.21.15.22:0/3343071723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e80cfc60 0x7f44e8167010 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.609+0000 7f44ef7ff700 1 -- 172.21.15.22:0/3343071723 >> 172.21.15.22:0/3343071723 conn(0x7f44e806b3f0 msgr2=0x7f44e806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:17.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.609+0000 7f44ef7ff700 1 -- 172.21.15.22:0/3343071723 shutdown_connections 2023-07-11T00:31:17.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.609+0000 7f44ef7ff700 1 -- 172.21.15.22:0/3343071723 wait complete. 2023-07-11T00:31:17.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.610+0000 7f44ef7ff700 1 Processor -- start 2023-07-11T00:31:17.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.610+0000 7f44ef7ff700 1 -- start start 2023-07-11T00:31:17.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.611+0000 7f44ef7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44e80b8430 0x7f44e81512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:17.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.611+0000 7f44ef7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e80cfc60 0x7f44e81f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:17.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.611+0000 7f44ef7ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e80d3730 0x7f44e80b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:17.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.611+0000 7f44ef7ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80b77a0 con 0x7f44e80d3730 2023-07-11T00:31:17.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.611+0000 7f44ef7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80ccb10 con 0x7f44e80b8430 2023-07-11T00:31:17.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.611+0000 7f44ef7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80ccdf0 con 0x7f44e80cfc60 2023-07-11T00:31:17.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.612+0000 7f44edd9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e80d3730 0x7f44e80b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:17.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.612+0000 7f44edd9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e80d3730 0x7f44e80b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43558/0 (socket says 172.21.15.22:43558) 2023-07-11T00:31:17.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.612+0000 7f44edd9c700 1 -- 172.21.15.22:0/2242917921 learned_addr learned my addr 172.21.15.22:0/2242917921 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:17.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.612+0000 7f44ed59b700 1 --2- 172.21.15.22:0/2242917921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44e80b8430 0x7f44e81512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:17.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.612+0000 7f44ecd9a700 1 --2- 172.21.15.22:0/2242917921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e80cfc60 0x7f44e81f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:17.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.612+0000 7f44edd9c700 1 -- 172.21.15.22:0/2242917921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e80cfc60 msgr2=0x7f44e81f1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:17.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.612+0000 7f44edd9c700 1 --2- 172.21.15.22:0/2242917921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e80cfc60 0x7f44e81f1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.612+0000 7f44edd9c700 1 -- 172.21.15.22:0/2242917921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44e80b8430 msgr2=0x7f44e81512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:17.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.612+0000 7f44edd9c700 1 --2- 172.21.15.22:0/2242917921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44e80b8430 0x7f44e81512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.612+0000 7f44edd9c700 1 -- 172.21.15.22:0/2242917921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e0009a70 con 0x7f44e80d3730 2023-07-11T00:31:17.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.613+0000 7f44edd9c700 1 --2- 172.21.15.22:0/2242917921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e80d3730 0x7f44e80b3600 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f44e806c780 tx=0x7f44e0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:17.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.613+0000 7f44ddffb700 1 -- 172.21.15.22:0/2242917921 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0012630 con 0x7f44e80d3730 2023-07-11T00:31:17.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.613+0000 7f44ddffb700 1 -- 172.21.15.22:0/2242917921 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e00127b0 con 0x7f44e80d3730 2023-07-11T00:31:17.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.613+0000 7f44ddffb700 1 -- 172.21.15.22:0/2242917921 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0012b60 con 0x7f44e80d3730 2023-07-11T00:31:17.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.613+0000 7f44ef7ff700 1 -- 172.21.15.22:0/2242917921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e80c76c0 con 0x7f44e80d3730 2023-07-11T00:31:17.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.613+0000 7f44ef7ff700 1 -- 172.21.15.22:0/2242917921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e80c7c80 con 0x7f44e80d3730 2023-07-11T00:31:17.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.614+0000 7f44ef7ff700 1 -- 172.21.15.22:0/2242917921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e804ea60 con 0x7f44e80d3730 2023-07-11T00:31:17.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.615+0000 7f44ddffb700 1 -- 172.21.15.22:0/2242917921 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f44e0012cc0 con 0x7f44e80d3730 2023-07-11T00:31:17.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.616+0000 7f44ddffb700 1 --2- 172.21.15.22:0/2242917921 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f44cc06ace0 0x7f44cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:17.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.616+0000 7f44ddffb700 1 -- 172.21.15.22:0/2242917921 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f44e008ba40 con 0x7f44e80d3730 2023-07-11T00:31:17.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.616+0000 7f44ed59b700 1 --2- 172.21.15.22:0/2242917921 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f44cc06ace0 0x7f44cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:17.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.617+0000 7f44ed59b700 1 --2- 172.21.15.22:0/2242917921 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f44cc06ace0 0x7f44cc06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f44e4000f60 tx=0x7f44e4007f10 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:17.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.620+0000 7f44ddffb700 1 -- 172.21.15.22:0/2242917921 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f44e00567b0 con 0x7f44e80d3730 2023-07-11T00:31:17.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.825+0000 7f44ef7ff700 1 -- 172.21.15.22:0/2242917921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44e80cf110 con 0x7f44e80d3730 2023-07-11T00:31:17.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.825+0000 7f44ddffb700 1 -- 172.21.15.22:0/2242917921 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f44e0089e60 con 0x7f44e80d3730 2023-07-11T00:31:17.828 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:17.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.828+0000 7f44ef7ff700 1 -- 172.21.15.22:0/2242917921 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f44cc06ace0 msgr2=0x7f44cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:17.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.828+0000 7f44ef7ff700 1 --2- 172.21.15.22:0/2242917921 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f44cc06ace0 0x7f44cc06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f44e4000f60 tx=0x7f44e4007f10 comp rx=0 tx=0).stop 2023-07-11T00:31:17.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.828+0000 7f44ef7ff700 1 -- 172.21.15.22:0/2242917921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e80d3730 msgr2=0x7f44e80b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:17.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.828+0000 7f44ef7ff700 1 --2- 172.21.15.22:0/2242917921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e80d3730 0x7f44e80b3600 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f44e806c780 tx=0x7f44e0004ad0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.828+0000 7f44ef7ff700 1 -- 172.21.15.22:0/2242917921 shutdown_connections 2023-07-11T00:31:17.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.828+0000 7f44ef7ff700 1 --2- 172.21.15.22:0/2242917921 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f44cc06ace0 0x7f44cc06d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.828+0000 7f44ef7ff700 1 --2- 172.21.15.22:0/2242917921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44e80d3730 0x7f44e80b3600 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.828+0000 7f44ef7ff700 1 --2- 172.21.15.22:0/2242917921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44e80b8430 0x7f44e81512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.828+0000 7f44ef7ff700 1 --2- 172.21.15.22:0/2242917921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e80cfc60 0x7f44e81f1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:17.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.828+0000 7f44ef7ff700 1 -- 172.21.15.22:0/2242917921 >> 172.21.15.22:0/2242917921 conn(0x7f44e806b3f0 msgr2=0x7f44e80b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:17.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.828+0000 7f44ef7ff700 1 -- 172.21.15.22:0/2242917921 shutdown_connections 2023-07-11T00:31:17.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:17.828+0000 7f44ef7ff700 1 -- 172.21.15.22:0/2242917921 wait complete. 2023-07-11T00:31:17.850 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:31:18.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.055+0000 7feabf5ff700 1 Processor -- start 2023-07-11T00:31:18.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.055+0000 7feabf5ff700 1 -- start start 2023-07-11T00:31:18.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.056+0000 7feabf5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7feab80cd0a0 0x7feab80adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.056+0000 7feabf5ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab80c9750 con 0x7feab815c690 2023-07-11T00:31:18.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.056+0000 7feabf5ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab80cf1c0 con 0x7feab80ca1f0 2023-07-11T00:31:18.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.056+0000 7feabf5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab80cd610 con 0x7feab80cd0a0 2023-07-11T00:31:18.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.056+0000 7feabd39b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7feab815c690 0x7feab806c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59928/0 (socket says 172.21.15.22:59928) 2023-07-11T00:31:18.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.056+0000 7feabd39b700 1 -- 172.21.15.22:0/2391733106 learned_addr learned my addr 172.21.15.22:0/2391733106 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:18.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.057+0000 7feabcb9a700 1 --2- 172.21.15.22:0/2391733106 >> v2:172.21.15.184:3300/0 conn(0x7feab80cd0a0 0x7feab80adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.057+0000 7feaaffff700 1 -- 172.21.15.22:0/2391733106 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231525649 0 0) 0x7feab80c9750 con 0x7feab815c690 2023-07-11T00:31:18.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.057+0000 7feaaffff700 1 -- 172.21.15.22:0/2391733106 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaa40035b0 con 0x7feab815c690 2023-07-11T00:31:18.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.057+0000 7feaaffff700 1 -- 172.21.15.22:0/2391733106 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 936947442 0 0) 0x7feaa40035b0 con 0x7feab815c690 2023-07-11T00:31:18.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.057+0000 7feaaffff700 1 -- 172.21.15.22:0/2391733106 >> v2:172.21.15.184:3300/0 conn(0x7feab80cd0a0 msgr2=0x7feab80adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:18.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.057+0000 7feaaffff700 1 --2- 172.21.15.22:0/2391733106 >> v2:172.21.15.184:3300/0 conn(0x7feab80cd0a0 0x7feab80adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.057+0000 7feaaffff700 1 -- 172.21.15.22:0/2391733106 >> v1:172.21.15.184:6789/0 conn(0x7feab80ca1f0 legacy=0x7feab8070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:18.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.057+0000 7feaaffff700 1 -- 172.21.15.22:0/2391733106 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab80cd8f0 con 0x7feab815c690 2023-07-11T00:31:18.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.057+0000 7feaaffff700 1 -- 172.21.15.22:0/2391733106 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7feab4001670 con 0x7feab815c690 2023-07-11T00:31:18.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.057+0000 7feaaffff700 1 -- 172.21.15.22:0/2391733106 >> v1:172.21.15.22:6789/0 conn(0x7feab815c690 legacy=0x7feab806c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:18.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.057+0000 7feaaffff700 1 --2- 172.21.15.22:0/2391733106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa4003a00 0x7feaa4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.057+0000 7feaaffff700 1 --2- 172.21.15.22:0/2391733106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feaa4004850 0x7feaa4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.057+0000 7feaaffff700 1 --2- 172.21.15.22:0/2391733106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feaa4005200 0x7feaa400dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.057+0000 7feaaffff700 1 -- 172.21.15.22:0/2391733106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab80cd610 con 0x7feaa4005200 2023-07-11T00:31:18.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.057+0000 7feaaffff700 1 -- 172.21.15.22:0/2391733106 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa400e290 con 0x7feaa4003a00 2023-07-11T00:31:18.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.057+0000 7feaaffff700 1 -- 172.21.15.22:0/2391733106 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa400e450 con 0x7feaa4004850 2023-07-11T00:31:18.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.058+0000 7feabdb9c700 1 --2- 172.21.15.22:0/2391733106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feaa4005200 0x7feaa400dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.058+0000 7feabd39b700 1 --2- 172.21.15.22:0/2391733106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa4003a00 0x7feaa4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.058+0000 7feabcb9a700 1 --2- 172.21.15.22:0/2391733106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feaa4004850 0x7feaa4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.058+0000 7feabd39b700 1 -- 172.21.15.22:0/2391733106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feaa4004850 msgr2=0x7feaa4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:18.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.058+0000 7feabd39b700 1 --2- 172.21.15.22:0/2391733106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feaa4004850 0x7feaa4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.058+0000 7feabd39b700 1 -- 172.21.15.22:0/2391733106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feaa4005200 msgr2=0x7feaa400dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:18.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.058+0000 7feabd39b700 1 --2- 172.21.15.22:0/2391733106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feaa4005200 0x7feaa400dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.058+0000 7feabd39b700 1 -- 172.21.15.22:0/2391733106 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa40035b0 con 0x7feaa4003a00 2023-07-11T00:31:18.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.058+0000 7feabdb9c700 1 --2- 172.21.15.22:0/2391733106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feaa4005200 0x7feaa400dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:18.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.058+0000 7feabdb9c700 1 -- 172.21.15.22:0/2391733106 reap_dead start 2023-07-11T00:31:18.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.058+0000 7feabd39b700 1 --2- 172.21.15.22:0/2391733106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa4003a00 0x7feaa4003e10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feab400c240 tx=0x7feaa4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36749544e616301a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.059+0000 7feaaffff700 1 -- 172.21.15.22:0/2391733106 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4007c10 con 0x7feaa4003a00 2023-07-11T00:31:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.059+0000 7feaaffff700 1 -- 172.21.15.22:0/2391733106 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab400ce00 con 0x7feaa4003a00 2023-07-11T00:31:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.059+0000 7feaaffff700 1 -- 172.21.15.22:0/2391733106 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4005ba0 con 0x7feaa4003a00 2023-07-11T00:31:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.059+0000 7feabf5ff700 1 -- 172.21.15.22:0/2391733106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa4003a00 msgr2=0x7feaa4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.059+0000 7feabf5ff700 1 --2- 172.21.15.22:0/2391733106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa4003a00 0x7feaa4003e10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feab400c240 tx=0x7feaa4005880 comp rx=0 tx=0).stop 2023-07-11T00:31:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.059+0000 7feabf5ff700 1 -- 172.21.15.22:0/2391733106 shutdown_connections 2023-07-11T00:31:18.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.059+0000 7feabf5ff700 1 --2- 172.21.15.22:0/2391733106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa4003a00 0x7feaa4003e10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.059+0000 7feabf5ff700 1 -- 172.21.15.22:0/2391733106 >> 172.21.15.22:0/2391733106 conn(0x7feab80b0fd0 msgr2=0x7feab80ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:18.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.059+0000 7feabf5ff700 1 -- 172.21.15.22:0/2391733106 shutdown_connections 2023-07-11T00:31:18.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.059+0000 7feabf5ff700 1 -- 172.21.15.22:0/2391733106 wait complete. 2023-07-11T00:31:18.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.061+0000 7feabf5ff700 1 Processor -- start 2023-07-11T00:31:18.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.061+0000 7feabf5ff700 1 -- start start 2023-07-11T00:31:18.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.062+0000 7feabf5ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feaa4003a00 0x7feab80c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.062+0000 7feabf5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feab81e3a90 0x7feab81e5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.062+0000 7feabf5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feab81e5c80 0x7feab81f1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.062+0000 7feabf5ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab81e32f0 con 0x7feaa4003a00 2023-07-11T00:31:18.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.062+0000 7feabf5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab81e4000 con 0x7feab81e5c80 2023-07-11T00:31:18.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.062+0000 7feabf5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab81e6230 con 0x7feab81e3a90 2023-07-11T00:31:18.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.062+0000 7feabd39b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feaa4003a00 0x7feab80c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.062+0000 7feabd39b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feaa4003a00 0x7feab80c4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43574/0 (socket says 172.21.15.22:43574) 2023-07-11T00:31:18.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.062+0000 7feabd39b700 1 -- 172.21.15.22:0/2450786241 learned_addr learned my addr 172.21.15.22:0/2450786241 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:18.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.062+0000 7feabcb9a700 1 --2- 172.21.15.22:0/2450786241 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feab81e3a90 0x7feab81e5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.063+0000 7feabdb9c700 1 --2- 172.21.15.22:0/2450786241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feab81e5c80 0x7feab81f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.063+0000 7feabd39b700 1 -- 172.21.15.22:0/2450786241 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feab81e3a90 msgr2=0x7feab81e5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:18.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.063+0000 7feabd39b700 1 --2- 172.21.15.22:0/2450786241 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feab81e3a90 0x7feab81e5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.063+0000 7feabd39b700 1 -- 172.21.15.22:0/2450786241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feab81e5c80 msgr2=0x7feab81f1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:18.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.063+0000 7feabd39b700 1 --2- 172.21.15.22:0/2450786241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feab81e5c80 0x7feab81f1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.063+0000 7feabd39b700 1 -- 172.21.15.22:0/2450786241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab81e6510 con 0x7feaa4003a00 2023-07-11T00:31:18.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.063+0000 7feabcb9a700 1 --2- 172.21.15.22:0/2450786241 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feab81e3a90 0x7feab81e5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:18.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.063+0000 7feabdb9c700 1 --2- 172.21.15.22:0/2450786241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feab81e5c80 0x7feab81f1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:18.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.063+0000 7feabd39b700 1 --2- 172.21.15.22:0/2450786241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feaa4003a00 0x7feab80c4ed0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feab400c830 tx=0x7feab4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:18.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.063+0000 7feaadffb700 1 -- 172.21.15.22:0/2450786241 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4001630 con 0x7feaa4003a00 2023-07-11T00:31:18.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.063+0000 7feaadffb700 1 -- 172.21.15.22:0/2450786241 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab40070d0 con 0x7feaa4003a00 2023-07-11T00:31:18.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.063+0000 7feabf5ff700 1 -- 172.21.15.22:0/2450786241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab81e67f0 con 0x7feaa4003a00 2023-07-11T00:31:18.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.063+0000 7feaadffb700 1 -- 172.21.15.22:0/2450786241 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4007480 con 0x7feaa4003a00 2023-07-11T00:31:18.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.063+0000 7feabf5ff700 1 -- 172.21.15.22:0/2450786241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab81f17a0 con 0x7feaa4003a00 2023-07-11T00:31:18.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.065+0000 7feabf5ff700 1 -- 172.21.15.22:0/2450786241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab8066a70 con 0x7feaa4003a00 2023-07-11T00:31:18.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.066+0000 7feaadffb700 1 -- 172.21.15.22:0/2450786241 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feab40075e0 con 0x7feaa4003a00 2023-07-11T00:31:18.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.066+0000 7feaadffb700 1 --2- 172.21.15.22:0/2450786241 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fea9c06ace0 0x7fea9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.067+0000 7feaadffb700 1 -- 172.21.15.22:0/2450786241 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feab408ad00 con 0x7feaa4003a00 2023-07-11T00:31:18.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.067+0000 7feabcb9a700 1 --2- 172.21.15.22:0/2450786241 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fea9c06ace0 0x7fea9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.068+0000 7feabcb9a700 1 --2- 172.21.15.22:0/2450786241 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fea9c06ace0 0x7fea9c06d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feab80b44c0 tx=0x7feaa8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:18.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.071+0000 7feaadffb700 1 -- 172.21.15.22:0/2450786241 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7feab4055ab0 con 0x7feaa4003a00 2023-07-11T00:31:18.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.278+0000 7feabf5ff700 1 -- 172.21.15.22:0/2450786241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feab804ea60 con 0x7feaa4003a00 2023-07-11T00:31:18.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.278+0000 7feaadffb700 1 -- 172.21.15.22:0/2450786241 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7feab4019310 con 0x7feaa4003a00 2023-07-11T00:31:18.281 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-07-11T00:31:18.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.281+0000 7feabf5ff700 1 -- 172.21.15.22:0/2450786241 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fea9c06ace0 msgr2=0x7fea9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:18.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.281+0000 7feabf5ff700 1 --2- 172.21.15.22:0/2450786241 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fea9c06ace0 0x7fea9c06d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feab80b44c0 tx=0x7feaa8008040 comp rx=0 tx=0).stop 2023-07-11T00:31:18.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.281+0000 7feabf5ff700 1 -- 172.21.15.22:0/2450786241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feaa4003a00 msgr2=0x7feab80c4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:18.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.281+0000 7feabf5ff700 1 --2- 172.21.15.22:0/2450786241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feaa4003a00 0x7feab80c4ed0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feab400c830 tx=0x7feab4001a00 comp rx=0 tx=0).stop 2023-07-11T00:31:18.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.281+0000 7feabf5ff700 1 -- 172.21.15.22:0/2450786241 shutdown_connections 2023-07-11T00:31:18.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.281+0000 7feabf5ff700 1 --2- 172.21.15.22:0/2450786241 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fea9c06ace0 0x7fea9c06d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.281+0000 7feabf5ff700 1 --2- 172.21.15.22:0/2450786241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feab81e5c80 0x7feab81f1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.281+0000 7feabf5ff700 1 --2- 172.21.15.22:0/2450786241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feaa4003a00 0x7feab80c4ed0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.281+0000 7feabf5ff700 1 --2- 172.21.15.22:0/2450786241 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feab81e3a90 0x7feab81e5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.281+0000 7feabf5ff700 1 -- 172.21.15.22:0/2450786241 >> 172.21.15.22:0/2450786241 conn(0x7feab80b0fd0 msgr2=0x7feab80acee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:18.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.281+0000 7feabf5ff700 1 -- 172.21.15.22:0/2450786241 shutdown_connections 2023-07-11T00:31:18.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.281+0000 7feabf5ff700 1 -- 172.21.15.22:0/2450786241 wait complete. 2023-07-11T00:31:18.302 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-11T00:31:18.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.505+0000 7fcbb3dff700 1 Processor -- start 2023-07-11T00:31:18.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.505+0000 7fcbb3dff700 1 -- start start 2023-07-11T00:31:18.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.506+0000 7fcbb3dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcbac0cd0a0 0x7fcbac0adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.506+0000 7fcbb3dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbac0ca1f0 0x7fcbac0ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.506+0000 7fcbb3dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbac0c9750 con 0x7fcbac15c690 2023-07-11T00:31:18.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.506+0000 7fcbb3dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbac0cabd0 con 0x7fcbac0cd0a0 2023-07-11T00:31:18.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.506+0000 7fcbb3dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0cf1c0 con 0x7fcbac0ca1f0 2023-07-11T00:31:18.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.507+0000 7fcbb239c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbac0ca1f0 0x7fcbac0ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.507+0000 7fcbb239c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbac0ca1f0 0x7fcbac0ca690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:32844/0 (socket says 172.21.15.22:32844) 2023-07-11T00:31:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.507+0000 7fcbb239c700 1 -- 172.21.15.22:0/1645558370 learned_addr learned my addr 172.21.15.22:0/1645558370 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.507+0000 7fcbb1b9b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fcbac15c690 0x7fcbac06c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:43384/0 (socket says 172.21.15.22:43384) 2023-07-11T00:31:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.507+0000 7fcbb139a700 1 --2- 172.21.15.22:0/1645558370 >> v2:172.21.15.184:3300/0 conn(0x7fcbac0cd0a0 0x7fcbac0adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.507+0000 7fcbb0b99700 1 -- 172.21.15.22:0/1645558370 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622423404 0 0) 0x7fcbac0c9750 con 0x7fcbac15c690 2023-07-11T00:31:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.507+0000 7fcbb0b99700 1 -- 172.21.15.22:0/1645558370 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb980035b0 con 0x7fcbac15c690 2023-07-11T00:31:18.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.507+0000 7fcbb239c700 1 -- 172.21.15.22:0/1645558370 >> v2:172.21.15.184:3300/0 conn(0x7fcbac0cd0a0 msgr2=0x7fcbac0adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:18.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.507+0000 7fcbb239c700 1 --2- 172.21.15.22:0/1645558370 >> v2:172.21.15.184:3300/0 conn(0x7fcbac0cd0a0 0x7fcbac0adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.507+0000 7fcbb239c700 1 -- 172.21.15.22:0/1645558370 >> v1:172.21.15.184:6789/0 conn(0x7fcbac15c690 legacy=0x7fcbac06c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:18.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.507+0000 7fcbb239c700 1 -- 172.21.15.22:0/1645558370 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac0cd610 con 0x7fcbac0ca1f0 2023-07-11T00:31:18.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.508+0000 7fcbb239c700 1 --2- 172.21.15.22:0/1645558370 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbac0ca1f0 0x7fcbac0ca690 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009e50 tx=0x7fcba400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1158ff548e625f5f server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:18.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.508+0000 7fcbb0b99700 1 -- 172.21.15.22:0/1645558370 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba400e070 con 0x7fcbac0ca1f0 2023-07-11T00:31:18.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.508+0000 7fcbb0b99700 1 -- 172.21.15.22:0/1645558370 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba400b910 con 0x7fcbac0ca1f0 2023-07-11T00:31:18.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.508+0000 7fcbb0b99700 1 -- 172.21.15.22:0/1645558370 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba400bc80 con 0x7fcbac0ca1f0 2023-07-11T00:31:18.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.508+0000 7fcbb3dff700 1 -- 172.21.15.22:0/1645558370 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbac0ca1f0 msgr2=0x7fcbac0ca690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:18.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.508+0000 7fcbb3dff700 1 --2- 172.21.15.22:0/1645558370 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbac0ca1f0 0x7fcbac0ca690 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009e50 tx=0x7fcba400b330 comp rx=0 tx=0).stop 2023-07-11T00:31:18.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.509+0000 7fcbb3dff700 1 -- 172.21.15.22:0/1645558370 shutdown_connections 2023-07-11T00:31:18.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.509+0000 7fcbb3dff700 1 --2- 172.21.15.22:0/1645558370 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbac0ca1f0 0x7fcbac0ca690 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.509+0000 7fcbb3dff700 1 --2- 172.21.15.22:0/1645558370 >> v2:172.21.15.184:3300/0 conn(0x7fcbac0cd0a0 0x7fcbac0adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.509+0000 7fcbb3dff700 1 -- 172.21.15.22:0/1645558370 >> 172.21.15.22:0/1645558370 conn(0x7fcbac0b0fd0 msgr2=0x7fcbac0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:18.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.509+0000 7fcbb3dff700 1 -- 172.21.15.22:0/1645558370 shutdown_connections 2023-07-11T00:31:18.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.509+0000 7fcbb3dff700 1 -- 172.21.15.22:0/1645558370 wait complete. 2023-07-11T00:31:18.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.510+0000 7fcbb3dff700 1 Processor -- start 2023-07-11T00:31:18.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.511+0000 7fcbb3dff700 1 -- start start 2023-07-11T00:31:18.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.511+0000 7fcbb3dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbac0ca1f0 0x7fcbac14bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.512+0000 7fcbb3dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbac0cd0a0 0x7fcbac15d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.512+0000 7fcbb3dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbac15c690 0x7fcbac0ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.512+0000 7fcbb3dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac14c240 con 0x7fcbac15c690 2023-07-11T00:31:18.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.512+0000 7fcbb3dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0b2760 con 0x7fcbac0cd0a0 2023-07-11T00:31:18.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.512+0000 7fcbb3dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0b2a00 con 0x7fcbac0ca1f0 2023-07-11T00:31:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.512+0000 7fcbb239c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbac15c690 0x7fcbac0ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.512+0000 7fcbb239c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbac15c690 0x7fcbac0ae960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43584/0 (socket says 172.21.15.22:43584) 2023-07-11T00:31:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.512+0000 7fcbb239c700 1 -- 172.21.15.22:0/1264371320 learned_addr learned my addr 172.21.15.22:0/1264371320 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.512+0000 7fcbb1b9b700 1 --2- 172.21.15.22:0/1264371320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbac0ca1f0 0x7fcbac14bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.512+0000 7fcbb139a700 1 --2- 172.21.15.22:0/1264371320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbac0cd0a0 0x7fcbac15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.512+0000 7fcbb239c700 1 -- 172.21.15.22:0/1264371320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbac0ca1f0 msgr2=0x7fcbac14bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.512+0000 7fcbb239c700 1 --2- 172.21.15.22:0/1264371320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbac0ca1f0 0x7fcbac14bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.512+0000 7fcbb239c700 1 -- 172.21.15.22:0/1264371320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbac0cd0a0 msgr2=0x7fcbac15d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.512+0000 7fcbb239c700 1 --2- 172.21.15.22:0/1264371320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbac0cd0a0 0x7fcbac15d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.512+0000 7fcbb239c700 1 -- 172.21.15.22:0/1264371320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba4009b30 con 0x7fcbac15c690 2023-07-11T00:31:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.513+0000 7fcbb239c700 1 --2- 172.21.15.22:0/1264371320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbac15c690 0x7fcbac0ae960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcba400b370 tx=0x7fcba4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:18.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.513+0000 7fcba27fc700 1 -- 172.21.15.22:0/1264371320 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba4004450 con 0x7fcbac15c690 2023-07-11T00:31:18.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.513+0000 7fcba27fc700 1 -- 172.21.15.22:0/1264371320 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba40045b0 con 0x7fcbac15c690 2023-07-11T00:31:18.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.513+0000 7fcba27fc700 1 -- 172.21.15.22:0/1264371320 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba4004960 con 0x7fcbac15c690 2023-07-11T00:31:18.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.513+0000 7fcbb3dff700 1 -- 172.21.15.22:0/1264371320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbac0b2ce0 con 0x7fcbac15c690 2023-07-11T00:31:18.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.513+0000 7fcbb3dff700 1 -- 172.21.15.22:0/1264371320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac0b32a0 con 0x7fcbac15c690 2023-07-11T00:31:18.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.514+0000 7fcbb3dff700 1 -- 172.21.15.22:0/1264371320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbac066a70 con 0x7fcbac15c690 2023-07-11T00:31:18.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.515+0000 7fcba27fc700 1 -- 172.21.15.22:0/1264371320 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcba4024450 con 0x7fcbac15c690 2023-07-11T00:31:18.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.516+0000 7fcba27fc700 1 --2- 172.21.15.22:0/1264371320 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fcb9006ace0 0x7fcb9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.516+0000 7fcba27fc700 1 -- 172.21.15.22:0/1264371320 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcba408b0e0 con 0x7fcbac15c690 2023-07-11T00:31:18.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.516+0000 7fcbb1b9b700 1 --2- 172.21.15.22:0/1264371320 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fcb9006ace0 0x7fcb9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.517+0000 7fcbb1b9b700 1 --2- 172.21.15.22:0/1264371320 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fcb9006ace0 0x7fcb9006d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcba8006a30 tx=0x7fcba8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:18.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.520+0000 7fcba27fc700 1 -- 172.21.15.22:0/1264371320 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fcba40598e0 con 0x7fcbac15c690 2023-07-11T00:31:18.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.724+0000 7fcbb3dff700 1 -- 172.21.15.22:0/1264371320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcbac071690 con 0x7fcbac15c690 2023-07-11T00:31:18.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.724+0000 7fcba27fc700 1 -- 172.21.15.22:0/1264371320 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcba4059470 con 0x7fcbac15c690 2023-07-11T00:31:18.728 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:18.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.726+0000 7fcbb3dff700 1 -- 172.21.15.22:0/1264371320 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fcb9006ace0 msgr2=0x7fcb9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:18.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.726+0000 7fcbb3dff700 1 --2- 172.21.15.22:0/1264371320 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fcb9006ace0 0x7fcb9006d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcba8006a30 tx=0x7fcba8009040 comp rx=0 tx=0).stop 2023-07-11T00:31:18.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.726+0000 7fcbb3dff700 1 -- 172.21.15.22:0/1264371320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbac15c690 msgr2=0x7fcbac0ae960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:18.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.726+0000 7fcbb3dff700 1 --2- 172.21.15.22:0/1264371320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbac15c690 0x7fcbac0ae960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcba400b370 tx=0x7fcba4004ad0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.727+0000 7fcbb3dff700 1 -- 172.21.15.22:0/1264371320 shutdown_connections 2023-07-11T00:31:18.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.727+0000 7fcbb3dff700 1 --2- 172.21.15.22:0/1264371320 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fcb9006ace0 0x7fcb9006d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.727+0000 7fcbb3dff700 1 --2- 172.21.15.22:0/1264371320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbac0ca1f0 0x7fcbac14bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.727+0000 7fcbb3dff700 1 --2- 172.21.15.22:0/1264371320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbac15c690 0x7fcbac0ae960 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.727+0000 7fcbb3dff700 1 --2- 172.21.15.22:0/1264371320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbac0cd0a0 0x7fcbac15d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.727+0000 7fcbb3dff700 1 -- 172.21.15.22:0/1264371320 >> 172.21.15.22:0/1264371320 conn(0x7fcbac0b0fd0 msgr2=0x7fcbac1568a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:18.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.727+0000 7fcbb3dff700 1 -- 172.21.15.22:0/1264371320 shutdown_connections 2023-07-11T00:31:18.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.727+0000 7fcbb3dff700 1 -- 172.21.15.22:0/1264371320 wait complete. 2023-07-11T00:31:18.748 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-11T00:31:18.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.948+0000 7fdb03fff700 1 Processor -- start 2023-07-11T00:31:18.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.948+0000 7fdb03fff700 1 -- start start 2023-07-11T00:31:18.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.949+0000 7fdb03fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdafc0d2640 0x7fdafc0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.949+0000 7fdb03fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdafc0cf8f0 0x7fdafc15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.949+0000 7fdb03fff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdafc0d1790 con 0x7fdafc15c460 2023-07-11T00:31:18.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.949+0000 7fdb03fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdafc0cedd0 con 0x7fdafc0cf8f0 2023-07-11T00:31:18.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.949+0000 7fdb03fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0cd950 con 0x7fdafc0d2640 2023-07-11T00:31:18.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.949+0000 7fdb01d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdafc15c460 0x7fdafc0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59932/0 (socket says 172.21.15.22:59932) 2023-07-11T00:31:18.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.950+0000 7fdb01d9b700 1 -- 172.21.15.22:0/937063251 learned_addr learned my addr 172.21.15.22:0/937063251 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:18.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.950+0000 7fdb0159a700 1 --2- 172.21.15.22:0/937063251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdafc0d2640 0x7fdafc0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.950+0000 7fdb0259c700 1 --2- 172.21.15.22:0/937063251 >> v2:172.21.15.184:3300/0 conn(0x7fdafc0cf8f0 0x7fdafc15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.950+0000 7fdb00d99700 1 -- 172.21.15.22:0/937063251 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766781882 0 0) 0x7fdafc0d1790 con 0x7fdafc15c460 2023-07-11T00:31:18.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.950+0000 7fdb00d99700 1 -- 172.21.15.22:0/937063251 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdae80035b0 con 0x7fdafc15c460 2023-07-11T00:31:18.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.950+0000 7fdb0159a700 1 -- 172.21.15.22:0/937063251 >> v2:172.21.15.184:3300/0 conn(0x7fdafc0cf8f0 msgr2=0x7fdafc15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:18.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.950+0000 7fdb0159a700 1 --2- 172.21.15.22:0/937063251 >> v2:172.21.15.184:3300/0 conn(0x7fdafc0cf8f0 0x7fdafc15fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.950+0000 7fdb0159a700 1 -- 172.21.15.22:0/937063251 >> v1:172.21.15.22:6789/0 conn(0x7fdafc15c460 legacy=0x7fdafc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:18.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.950+0000 7fdb0159a700 1 -- 172.21.15.22:0/937063251 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc0d14b0 con 0x7fdafc0d2640 2023-07-11T00:31:18.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.950+0000 7fdb0259c700 1 --2- 172.21.15.22:0/937063251 >> v2:172.21.15.184:3300/0 conn(0x7fdafc0cf8f0 0x7fdafc15fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:18.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.951+0000 7fdb0159a700 1 --2- 172.21.15.22:0/937063251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdafc0d2640 0x7fdafc0b59d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009840 tx=0x7fdaec009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ebf9a50af5e279 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:18.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.951+0000 7fdb00d99700 1 -- 172.21.15.22:0/937063251 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec011830 con 0x7fdafc0d2640 2023-07-11T00:31:18.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.951+0000 7fdb00d99700 1 -- 172.21.15.22:0/937063251 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec011990 con 0x7fdafc0d2640 2023-07-11T00:31:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.951+0000 7fdb00d99700 1 -- 172.21.15.22:0/937063251 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec011d20 con 0x7fdafc0d2640 2023-07-11T00:31:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.951+0000 7fdb03fff700 1 -- 172.21.15.22:0/937063251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdafc0d2640 msgr2=0x7fdafc0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.951+0000 7fdb03fff700 1 --2- 172.21.15.22:0/937063251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdafc0d2640 0x7fdafc0b59d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009840 tx=0x7fdaec009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.951+0000 7fdb03fff700 1 -- 172.21.15.22:0/937063251 shutdown_connections 2023-07-11T00:31:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.951+0000 7fdb03fff700 1 --2- 172.21.15.22:0/937063251 >> v2:172.21.15.184:3300/0 conn(0x7fdafc0cf8f0 0x7fdafc15fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.951+0000 7fdb03fff700 1 --2- 172.21.15.22:0/937063251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdafc0d2640 0x7fdafc0b59d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.951+0000 7fdb03fff700 1 -- 172.21.15.22:0/937063251 >> 172.21.15.22:0/937063251 conn(0x7fdafc071660 msgr2=0x7fdafc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.952+0000 7fdb03fff700 1 -- 172.21.15.22:0/937063251 shutdown_connections 2023-07-11T00:31:18.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.952+0000 7fdb03fff700 1 -- 172.21.15.22:0/937063251 wait complete. 2023-07-11T00:31:18.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.953+0000 7fdb03fff700 1 Processor -- start 2023-07-11T00:31:18.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.953+0000 7fdb03fff700 1 -- start start 2023-07-11T00:31:18.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.954+0000 7fdb03fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdafc0cf8f0 0x7fdafc15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.954+0000 7fdb03fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdafc0d2640 0x7fdafc14c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.954+0000 7fdb03fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdafc15c460 0x7fdafc0c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.954+0000 7fdb03fff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0c8240 con 0x7fdafc15c460 2023-07-11T00:31:18.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.954+0000 7fdb03fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0caf40 con 0x7fdafc0d2640 2023-07-11T00:31:18.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.954+0000 7fdb03fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0cc930 con 0x7fdafc0cf8f0 2023-07-11T00:31:18.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.955+0000 7fdb0259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdafc15c460 0x7fdafc0c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.955+0000 7fdb0259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdafc15c460 0x7fdafc0c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43596/0 (socket says 172.21.15.22:43596) 2023-07-11T00:31:18.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.955+0000 7fdb0259c700 1 -- 172.21.15.22:0/4007443080 learned_addr learned my addr 172.21.15.22:0/4007443080 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:18.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.955+0000 7fdb0159a700 1 --2- 172.21.15.22:0/4007443080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdafc0d2640 0x7fdafc14c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.955+0000 7fdb01d9b700 1 --2- 172.21.15.22:0/4007443080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdafc0cf8f0 0x7fdafc15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.955+0000 7fdb0259c700 1 -- 172.21.15.22:0/4007443080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdafc0cf8f0 msgr2=0x7fdafc15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:18.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.955+0000 7fdb0259c700 1 --2- 172.21.15.22:0/4007443080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdafc0cf8f0 0x7fdafc15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.955+0000 7fdb0259c700 1 -- 172.21.15.22:0/4007443080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdafc0d2640 msgr2=0x7fdafc14c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:18.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.955+0000 7fdb0259c700 1 --2- 172.21.15.22:0/4007443080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdafc0d2640 0x7fdafc14c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:18.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.955+0000 7fdb0259c700 1 -- 172.21.15.22:0/4007443080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf4009a70 con 0x7fdafc15c460 2023-07-11T00:31:18.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.955+0000 7fdb0259c700 1 --2- 172.21.15.22:0/4007443080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdafc15c460 0x7fdafc0c86d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400efc0 tx=0x7fdaf400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:18.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.955+0000 7fdaf27fc700 1 -- 172.21.15.22:0/4007443080 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf400ca90 con 0x7fdafc15c460 2023-07-11T00:31:18.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.956+0000 7fdaf27fc700 1 -- 172.21.15.22:0/4007443080 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf400f040 con 0x7fdafc15c460 2023-07-11T00:31:18.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.956+0000 7fdaf27fc700 1 -- 172.21.15.22:0/4007443080 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf400ce30 con 0x7fdafc15c460 2023-07-11T00:31:18.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.956+0000 7fdb03fff700 1 -- 172.21.15.22:0/4007443080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaec0094a0 con 0x7fdafc15c460 2023-07-11T00:31:18.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.956+0000 7fdb03fff700 1 -- 172.21.15.22:0/4007443080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdafc0cc570 con 0x7fdafc15c460 2023-07-11T00:31:18.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.957+0000 7fdb03fff700 1 -- 172.21.15.22:0/4007443080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdafc0c83b0 con 0x7fdafc15c460 2023-07-11T00:31:18.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.958+0000 7fdaf27fc700 1 -- 172.21.15.22:0/4007443080 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdaf4014480 con 0x7fdafc15c460 2023-07-11T00:31:18.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.959+0000 7fdaf27fc700 1 --2- 172.21.15.22:0/4007443080 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdae006ace0 0x7fdae006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:18.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.959+0000 7fdaf27fc700 1 -- 172.21.15.22:0/4007443080 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdaf4089dd0 con 0x7fdafc15c460 2023-07-11T00:31:18.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.959+0000 7fdb01d9b700 1 --2- 172.21.15.22:0/4007443080 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdae006ace0 0x7fdae006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:18.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.960+0000 7fdb01d9b700 1 --2- 172.21.15.22:0/4007443080 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdae006ace0 0x7fdae006d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8007fd0 tx=0x7fdaf8007dc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:18.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:18.963+0000 7fdaf27fc700 1 -- 172.21.15.22:0/4007443080 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fdaf4054be0 con 0x7fdafc15c460 2023-07-11T00:31:19.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.189+0000 7fdb03fff700 1 -- 172.21.15.22:0/4007443080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdafc04ea60 con 0x7fdafc15c460 2023-07-11T00:31:19.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.189+0000 7fdaf27fc700 1 -- 172.21.15.22:0/4007443080 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdaf4018080 con 0x7fdafc15c460 2023-07-11T00:31:19.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.192+0000 7fdb03fff700 1 -- 172.21.15.22:0/4007443080 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdae006ace0 msgr2=0x7fdae006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:19.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.192+0000 7fdb03fff700 1 --2- 172.21.15.22:0/4007443080 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdae006ace0 0x7fdae006d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8007fd0 tx=0x7fdaf8007dc0 comp rx=0 tx=0).stop 2023-07-11T00:31:19.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.192+0000 7fdb03fff700 1 -- 172.21.15.22:0/4007443080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdafc15c460 msgr2=0x7fdafc0c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:19.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.192+0000 7fdb03fff700 1 --2- 172.21.15.22:0/4007443080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdafc15c460 0x7fdafc0c86d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400efc0 tx=0x7fdaf400c3a0 comp rx=0 tx=0).stop 2023-07-11T00:31:19.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.192+0000 7fdb03fff700 1 -- 172.21.15.22:0/4007443080 shutdown_connections 2023-07-11T00:31:19.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.192+0000 7fdb03fff700 1 --2- 172.21.15.22:0/4007443080 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fdae006ace0 0x7fdae006d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:19.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.192+0000 7fdb03fff700 1 --2- 172.21.15.22:0/4007443080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdafc0cf8f0 0x7fdafc15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:19.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.192+0000 7fdb03fff700 1 --2- 172.21.15.22:0/4007443080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdafc15c460 0x7fdafc0c86d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:19.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.192+0000 7fdb03fff700 1 --2- 172.21.15.22:0/4007443080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdafc0d2640 0x7fdafc14c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:19.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.192+0000 7fdb03fff700 1 -- 172.21.15.22:0/4007443080 >> 172.21.15.22:0/4007443080 conn(0x7fdafc071660 msgr2=0x7fdafc0cf070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:19.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.192+0000 7fdb03fff700 1 -- 172.21.15.22:0/4007443080 shutdown_connections 2023-07-11T00:31:19.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.192+0000 7fdb03fff700 1 -- 172.21.15.22:0/4007443080 wait complete. 2023-07-11T00:31:19.196 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-07-11T00:31:19.213 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-11T00:31:19.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:19.213 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-11T00:31:19.302 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-07-11T00:31:19.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:19.303 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-11T00:31:19.350 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:31:19.350 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:31:19.400 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:31:19.401 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:31:19.449 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:31:19.450 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:31:19.535 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:31:19.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.735+0000 7fb6fd9ff700 1 Processor -- start 2023-07-11T00:31:19.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.735+0000 7fb6fd9ff700 1 -- start start 2023-07-11T00:31:19.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.736+0000 7fb6fd9ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6f815c460 0x7fb6f80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:19.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.736+0000 7fb6fd9ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f80d1790 con 0x7fb6f80cf8f0 2023-07-11T00:31:19.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.736+0000 7fb6fd9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f80cd950 con 0x7fb6f80d2640 2023-07-11T00:31:19.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.736+0000 7fb6fd9ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f80cedd0 con 0x7fb6f815c460 2023-07-11T00:31:19.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.736+0000 7fb6f6ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6f815c460 0x7fb6f80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:19.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.736+0000 7fb6f77fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb6f80cf8f0 0x7fb6f815fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59938/0 (socket says 172.21.15.22:59938) 2023-07-11T00:31:19.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.736+0000 7fb6f77fe700 1 -- 172.21.15.22:0/1896527609 learned_addr learned my addr 172.21.15.22:0/1896527609 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:19.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.737+0000 7fb6f6ffd700 1 -- 172.21.15.22:0/1896527609 >> v1:172.21.15.184:6789/0 conn(0x7fb6f80d2640 legacy=0x7fb6f80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:19.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.737+0000 7fb6f6ffd700 1 -- 172.21.15.22:0/1896527609 >> v1:172.21.15.22:6789/0 conn(0x7fb6f80cf8f0 legacy=0x7fb6f815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:19.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.737+0000 7fb6f6ffd700 1 -- 172.21.15.22:0/1896527609 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f80d14b0 con 0x7fb6f815c460 2023-07-11T00:31:19.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.737+0000 7fb6f5ffb700 1 -- 172.21.15.22:0/1896527609 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479245417 0 0) 0x7fb6f80d1790 con 0x7fb6f80cf8f0 2023-07-11T00:31:19.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.737+0000 7fb6f6ffd700 1 --2- 172.21.15.22:0/1896527609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6f815c460 0x7fb6f80b59d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8009840 tx=0x7fb6e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5736d83dc6839bfb server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:19.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.737+0000 7fb6f5ffb700 1 -- 172.21.15.22:0/1896527609 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8004230 con 0x7fb6f815c460 2023-07-11T00:31:19.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.737+0000 7fb6f5ffb700 1 -- 172.21.15.22:0/1896527609 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e8004390 con 0x7fb6f815c460 2023-07-11T00:31:19.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.737+0000 7fb6f5ffb700 1 -- 172.21.15.22:0/1896527609 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80036a0 con 0x7fb6f815c460 2023-07-11T00:31:19.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.738+0000 7fb6fd9ff700 1 -- 172.21.15.22:0/1896527609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6f815c460 msgr2=0x7fb6f80b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:19.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.738+0000 7fb6fd9ff700 1 --2- 172.21.15.22:0/1896527609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6f815c460 0x7fb6f80b59d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8009840 tx=0x7fb6e8009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:19.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.738+0000 7fb6fd9ff700 1 -- 172.21.15.22:0/1896527609 shutdown_connections 2023-07-11T00:31:19.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.738+0000 7fb6fd9ff700 1 --2- 172.21.15.22:0/1896527609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6f815c460 0x7fb6f80b59d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:19.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.738+0000 7fb6fd9ff700 1 -- 172.21.15.22:0/1896527609 >> 172.21.15.22:0/1896527609 conn(0x7fb6f8071660 msgr2=0x7fb6f8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:19.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.738+0000 7fb6fd9ff700 1 -- 172.21.15.22:0/1896527609 shutdown_connections 2023-07-11T00:31:19.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.738+0000 7fb6fd9ff700 1 -- 172.21.15.22:0/1896527609 wait complete. 2023-07-11T00:31:19.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.740+0000 7fb6fd9ff700 1 Processor -- start 2023-07-11T00:31:19.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.740+0000 7fb6fd9ff700 1 -- start start 2023-07-11T00:31:19.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.741+0000 7fb6fd9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6f80cf8f0 0x7fb6f814e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:19.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.741+0000 7fb6fd9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6f80d2640 0x7fb6f81e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:19.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.741+0000 7fb6fd9ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6f815c460 0x7fb6f8152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:19.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.741+0000 7fb6fd9ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f81e6570 con 0x7fb6f815c460 2023-07-11T00:31:19.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.741+0000 7fb6fd9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f81e6850 con 0x7fb6f80cf8f0 2023-07-11T00:31:19.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.741+0000 7fb6fd9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f81e6b30 con 0x7fb6f80d2640 2023-07-11T00:31:19.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.741+0000 7fb6f77fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6f815c460 0x7fb6f8152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:19.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.741+0000 7fb6f77fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6f815c460 0x7fb6f8152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43622/0 (socket says 172.21.15.22:43622) 2023-07-11T00:31:19.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.741+0000 7fb6f77fe700 1 -- 172.21.15.22:0/1157515933 learned_addr learned my addr 172.21.15.22:0/1157515933 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:19.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.741+0000 7fb6f6ffd700 1 --2- 172.21.15.22:0/1157515933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6f80cf8f0 0x7fb6f814e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:19.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.741+0000 7fb6f67fc700 1 --2- 172.21.15.22:0/1157515933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6f80d2640 0x7fb6f81e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:19.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.741+0000 7fb6f77fe700 1 -- 172.21.15.22:0/1157515933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6f80d2640 msgr2=0x7fb6f81e5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:19.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.741+0000 7fb6f77fe700 1 --2- 172.21.15.22:0/1157515933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6f80d2640 0x7fb6f81e5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:19.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.741+0000 7fb6f77fe700 1 -- 172.21.15.22:0/1157515933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6f80cf8f0 msgr2=0x7fb6f814e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:19.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.741+0000 7fb6f77fe700 1 --2- 172.21.15.22:0/1157515933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6f80cf8f0 0x7fb6f814e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:19.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.741+0000 7fb6f77fe700 1 -- 172.21.15.22:0/1157515933 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e80094a0 con 0x7fb6f815c460 2023-07-11T00:31:19.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.742+0000 7fb6f77fe700 1 --2- 172.21.15.22:0/1157515933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6f815c460 0x7fb6f8152fe0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000cb60 tx=0x7fb6f000ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:19.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.742+0000 7fb6dffff700 1 -- 172.21.15.22:0/1157515933 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f000a9e0 con 0x7fb6f815c460 2023-07-11T00:31:19.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.742+0000 7fb6dffff700 1 -- 172.21.15.22:0/1157515933 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f000ab40 con 0x7fb6f815c460 2023-07-11T00:31:19.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.742+0000 7fb6fd9ff700 1 -- 172.21.15.22:0/1157515933 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f81e6e10 con 0x7fb6f815c460 2023-07-11T00:31:19.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.742+0000 7fb6dffff700 1 -- 172.21.15.22:0/1157515933 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f00070d0 con 0x7fb6f815c460 2023-07-11T00:31:19.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.742+0000 7fb6fd9ff700 1 -- 172.21.15.22:0/1157515933 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f81e6180 con 0x7fb6f815c460 2023-07-11T00:31:19.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.743+0000 7fb6fd9ff700 1 -- 172.21.15.22:0/1157515933 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f81e7330 con 0x7fb6f815c460 2023-07-11T00:31:19.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.744+0000 7fb6dffff700 1 -- 172.21.15.22:0/1157515933 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb6f0007230 con 0x7fb6f815c460 2023-07-11T00:31:19.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.745+0000 7fb6dffff700 1 --2- 172.21.15.22:0/1157515933 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb6e406ace0 0x7fb6e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:19.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.745+0000 7fb6dffff700 1 -- 172.21.15.22:0/1157515933 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb6f0089330 con 0x7fb6f815c460 2023-07-11T00:31:19.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.745+0000 7fb6f6ffd700 1 --2- 172.21.15.22:0/1157515933 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb6e406ace0 0x7fb6e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:19.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.746+0000 7fb6f6ffd700 1 --2- 172.21.15.22:0/1157515933 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb6e406ace0 0x7fb6e406d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80090b0 tx=0x7fb6e801c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:19.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.749+0000 7fb6dffff700 1 -- 172.21.15.22:0/1157515933 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb6f81e7330 con 0x7fb6f815c460 2023-07-11T00:31:19.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.958+0000 7fb6fd9ff700 1 -- 172.21.15.22:0/1157515933 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6f81e7330 con 0x7fb6f815c460 2023-07-11T00:31:19.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.959+0000 7fb6dffff700 1 -- 172.21.15.22:0/1157515933 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20158 (secure 0 0 0) 0x7fb6f81e7330 con 0x7fb6f815c460 2023-07-11T00:31:19.962 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:19.963 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:54.208536+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:31:19.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.961+0000 7fb6fd9ff700 1 -- 172.21.15.22:0/1157515933 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb6e406ace0 msgr2=0x7fb6e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:19.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.961+0000 7fb6fd9ff700 1 --2- 172.21.15.22:0/1157515933 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb6e406ace0 0x7fb6e406d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80090b0 tx=0x7fb6e801c040 comp rx=0 tx=0).stop 2023-07-11T00:31:19.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.961+0000 7fb6fd9ff700 1 -- 172.21.15.22:0/1157515933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6f815c460 msgr2=0x7fb6f8152fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:19.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.961+0000 7fb6fd9ff700 1 --2- 172.21.15.22:0/1157515933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6f815c460 0x7fb6f8152fe0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000cb60 tx=0x7fb6f000ce70 comp rx=0 tx=0).stop 2023-07-11T00:31:19.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.961+0000 7fb6fd9ff700 1 -- 172.21.15.22:0/1157515933 shutdown_connections 2023-07-11T00:31:19.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.961+0000 7fb6fd9ff700 1 --2- 172.21.15.22:0/1157515933 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb6e406ace0 0x7fb6e406d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:19.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.961+0000 7fb6fd9ff700 1 --2- 172.21.15.22:0/1157515933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6f815c460 0x7fb6f8152fe0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:19.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.961+0000 7fb6fd9ff700 1 --2- 172.21.15.22:0/1157515933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6f80cf8f0 0x7fb6f814e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:19.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.961+0000 7fb6fd9ff700 1 --2- 172.21.15.22:0/1157515933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6f80d2640 0x7fb6f81e5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:19.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.961+0000 7fb6fd9ff700 1 -- 172.21.15.22:0/1157515933 >> 172.21.15.22:0/1157515933 conn(0x7fb6f8071660 msgr2=0x7fb6f8160580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:19.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.961+0000 7fb6fd9ff700 1 -- 172.21.15.22:0/1157515933 shutdown_connections 2023-07-11T00:31:19.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:19.961+0000 7fb6fd9ff700 1 -- 172.21.15.22:0/1157515933 wait complete. 2023-07-11T00:31:19.982 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:29:57.631007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:29:58.547599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:30:03.826184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:30:04.383448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-11T00:30:08.075875+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-11T00:31:19.983 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:31:20.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.186+0000 7f07631ff700 1 Processor -- start 2023-07-11T00:31:20.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.186+0000 7f07631ff700 1 -- start start 2023-07-11T00:31:20.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.187+0000 7f07631ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f075c0b8430 0x7f075c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:20.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.187+0000 7f07631ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f075c0d3730 0x7f075c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:20.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.187+0000 7f07631ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075c0d0b20 con 0x7f075c0cfa90 2023-07-11T00:31:20.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.187+0000 7f07631ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075c0b8800 con 0x7f075c0b8430 2023-07-11T00:31:20.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.187+0000 7f07631ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0cfeb0 con 0x7f075c0d3730 2023-07-11T00:31:20.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.188+0000 7f0760f9b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f075c0b8430 0x7f075c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:20.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.188+0000 7f075bfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f075c0d3730 0x7f075c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:20.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.188+0000 7f076179c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f075c0cfa90 0x7f075c15feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:51962/0 (socket says 172.21.15.22:51962) 2023-07-11T00:31:20.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.188+0000 7f076179c700 1 -- 172.21.15.22:0/22299660 learned_addr learned my addr 172.21.15.22:0/22299660 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:20.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.188+0000 7f075bfff700 1 -- 172.21.15.22:0/22299660 >> v2:172.21.15.184:3300/0 conn(0x7f075c0b8430 msgr2=0x7f075c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:20.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.188+0000 7f075bfff700 1 --2- 172.21.15.22:0/22299660 >> v2:172.21.15.184:3300/0 conn(0x7f075c0b8430 0x7f075c0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.188+0000 7f075bfff700 1 -- 172.21.15.22:0/22299660 >> v1:172.21.15.184:6789/0 conn(0x7f075c0cfa90 legacy=0x7f075c15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:20.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.188+0000 7f075bfff700 1 -- 172.21.15.22:0/22299660 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c0b4ee0 con 0x7f075c0d3730 2023-07-11T00:31:20.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.188+0000 7f0760f9b700 1 --2- 172.21.15.22:0/22299660 >> v2:172.21.15.184:3300/0 conn(0x7f075c0b8430 0x7f075c0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:20.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.189+0000 7f075bfff700 1 --2- 172.21.15.22:0/22299660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f075c0d3730 0x7f075c0cf550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0748009840 tx=0x7f0748009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b1093d56e71abb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:20.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.189+0000 7f075b7fe700 1 -- 172.21.15.22:0/22299660 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748011830 con 0x7f075c0d3730 2023-07-11T00:31:20.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.189+0000 7f075b7fe700 1 -- 172.21.15.22:0/22299660 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0748011990 con 0x7f075c0d3730 2023-07-11T00:31:20.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.189+0000 7f075b7fe700 1 -- 172.21.15.22:0/22299660 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748011d20 con 0x7f075c0d3730 2023-07-11T00:31:20.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.189+0000 7f07631ff700 1 -- 172.21.15.22:0/22299660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f075c0d3730 msgr2=0x7f075c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:20.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.189+0000 7f07631ff700 1 --2- 172.21.15.22:0/22299660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f075c0d3730 0x7f075c0cf550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0748009840 tx=0x7f0748009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:20.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.189+0000 7f07631ff700 1 -- 172.21.15.22:0/22299660 shutdown_connections 2023-07-11T00:31:20.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.189+0000 7f07631ff700 1 --2- 172.21.15.22:0/22299660 >> v2:172.21.15.184:3300/0 conn(0x7f075c0b8430 0x7f075c0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.189+0000 7f07631ff700 1 --2- 172.21.15.22:0/22299660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f075c0d3730 0x7f075c0cf550 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.189+0000 7f07631ff700 1 -- 172.21.15.22:0/22299660 >> 172.21.15.22:0/22299660 conn(0x7f075c06b3f0 msgr2=0x7f075c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:20.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.190+0000 7f07631ff700 1 -- 172.21.15.22:0/22299660 shutdown_connections 2023-07-11T00:31:20.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.190+0000 7f07631ff700 1 -- 172.21.15.22:0/22299660 wait complete. 2023-07-11T00:31:20.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.191+0000 7f07631ff700 1 Processor -- start 2023-07-11T00:31:20.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.192+0000 7f07631ff700 1 -- start start 2023-07-11T00:31:20.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.192+0000 7f07631ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f075c0b8430 0x7f075c1f1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:20.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.193+0000 7f07631ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f075c0cfa90 0x7f075c0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:20.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.193+0000 7f07631ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f075c0d3730 0x7f075c15ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:20.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.193+0000 7f07631ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c1f6300 con 0x7f075c0cfa90 2023-07-11T00:31:20.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.193+0000 7f07631ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0cab60 con 0x7f075c0d3730 2023-07-11T00:31:20.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.193+0000 7f07631ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c1f56f0 con 0x7f075c0b8430 2023-07-11T00:31:20.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.193+0000 7f075bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f075c0cfa90 0x7f075c0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:20.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.193+0000 7f075bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f075c0cfa90 0x7f075c0ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46306/0 (socket says 172.21.15.22:46306) 2023-07-11T00:31:20.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.193+0000 7f075bfff700 1 -- 172.21.15.22:0/1706582343 learned_addr learned my addr 172.21.15.22:0/1706582343 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:20.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.193+0000 7f0760f9b700 1 --2- 172.21.15.22:0/1706582343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f075c0b8430 0x7f075c1f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:20.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.193+0000 7f076179c700 1 --2- 172.21.15.22:0/1706582343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f075c0d3730 0x7f075c15ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:20.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.193+0000 7f075bfff700 1 -- 172.21.15.22:0/1706582343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f075c0b8430 msgr2=0x7f075c1f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:20.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.193+0000 7f075bfff700 1 --2- 172.21.15.22:0/1706582343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f075c0b8430 0x7f075c1f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.193+0000 7f075bfff700 1 -- 172.21.15.22:0/1706582343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f075c0d3730 msgr2=0x7f075c15ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:20.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.193+0000 7f075bfff700 1 --2- 172.21.15.22:0/1706582343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f075c0d3730 0x7f075c15ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.193+0000 7f075bfff700 1 -- 172.21.15.22:0/1706582343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07500094a0 con 0x7f075c0cfa90 2023-07-11T00:31:20.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.193+0000 7f0760f9b700 1 --2- 172.21.15.22:0/1706582343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f075c0b8430 0x7f075c1f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:20.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.194+0000 7f075bfff700 1 --2- 172.21.15.22:0/1706582343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f075c0cfa90 0x7f075c0ca620 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f07480090b0 tx=0x7f0748004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:20.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.194+0000 7f07597fa700 1 -- 172.21.15.22:0/1706582343 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748004590 con 0x7f075c0cfa90 2023-07-11T00:31:20.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.194+0000 7f07597fa700 1 -- 172.21.15.22:0/1706582343 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07480036a0 con 0x7f075c0cfa90 2023-07-11T00:31:20.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.194+0000 7f07597fa700 1 -- 172.21.15.22:0/1706582343 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748003a30 con 0x7f075c0cfa90 2023-07-11T00:31:20.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.194+0000 7f07631ff700 1 -- 172.21.15.22:0/1706582343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07480094a0 con 0x7f075c0cfa90 2023-07-11T00:31:20.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.194+0000 7f07631ff700 1 -- 172.21.15.22:0/1706582343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075c1f5cb0 con 0x7f075c0cfa90 2023-07-11T00:31:20.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.195+0000 7f07631ff700 1 -- 172.21.15.22:0/1706582343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075c04ea60 con 0x7f075c0cfa90 2023-07-11T00:31:20.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.196+0000 7f07597fa700 1 -- 172.21.15.22:0/1706582343 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0748003b90 con 0x7f075c0cfa90 2023-07-11T00:31:20.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.197+0000 7f07597fa700 1 --2- 172.21.15.22:0/1706582343 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f074006ace0 0x7f074006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:20.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.197+0000 7f07597fa700 1 -- 172.21.15.22:0/1706582343 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f074808ac90 con 0x7f075c0cfa90 2023-07-11T00:31:20.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.198+0000 7f0760f9b700 1 --2- 172.21.15.22:0/1706582343 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f074006ace0 0x7f074006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:20.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.198+0000 7f0760f9b700 1 --2- 172.21.15.22:0/1706582343 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f074006ace0 0x7f074006d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0750011380 tx=0x7f0750009210 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:20.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.201+0000 7f07597fa700 1 -- 172.21.15.22:0/1706582343 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0748055b20 con 0x7f075c0cfa90 2023-07-11T00:31:20.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.404+0000 7f07631ff700 1 -- 172.21.15.22:0/1706582343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f075c15c470 con 0x7f075c0cfa90 2023-07-11T00:31:20.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.405+0000 7f07597fa700 1 -- 172.21.15.22:0/1706582343 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0748059140 con 0x7f075c0cfa90 2023-07-11T00:31:20.408 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2023-07-11T00:31:20.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.407+0000 7f07631ff700 1 -- 172.21.15.22:0/1706582343 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f074006ace0 msgr2=0x7f074006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:20.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.407+0000 7f07631ff700 1 --2- 172.21.15.22:0/1706582343 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f074006ace0 0x7f074006d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0750011380 tx=0x7f0750009210 comp rx=0 tx=0).stop 2023-07-11T00:31:20.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.407+0000 7f07631ff700 1 -- 172.21.15.22:0/1706582343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f075c0cfa90 msgr2=0x7f075c0ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:20.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.407+0000 7f07631ff700 1 --2- 172.21.15.22:0/1706582343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f075c0cfa90 0x7f075c0ca620 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f07480090b0 tx=0x7f0748004750 comp rx=0 tx=0).stop 2023-07-11T00:31:20.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.407+0000 7f07631ff700 1 -- 172.21.15.22:0/1706582343 shutdown_connections 2023-07-11T00:31:20.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.407+0000 7f07631ff700 1 --2- 172.21.15.22:0/1706582343 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f074006ace0 0x7f074006d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.407+0000 7f07631ff700 1 --2- 172.21.15.22:0/1706582343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f075c0b8430 0x7f075c1f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.407+0000 7f07631ff700 1 --2- 172.21.15.22:0/1706582343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f075c0d3730 0x7f075c15ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.407+0000 7f07631ff700 1 --2- 172.21.15.22:0/1706582343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f075c0cfa90 0x7f075c0ca620 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.407+0000 7f07631ff700 1 -- 172.21.15.22:0/1706582343 >> 172.21.15.22:0/1706582343 conn(0x7f075c06b3f0 msgr2=0x7f075c0d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:20.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.407+0000 7f07631ff700 1 -- 172.21.15.22:0/1706582343 shutdown_connections 2023-07-11T00:31:20.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.407+0000 7f07631ff700 1 -- 172.21.15.22:0/1706582343 wait complete. 2023-07-11T00:31:20.431 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:31:20.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.636+0000 7ff405dff700 1 Processor -- start 2023-07-11T00:31:20.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.636+0000 7ff405dff700 1 -- start start 2023-07-11T00:31:20.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.637+0000 7ff405dff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff4000b8430 0x7ff4000cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:20.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.637+0000 7ff405dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4000d3730 0x7ff4000cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:20.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.637+0000 7ff405dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4000d0b20 con 0x7ff4000cfa90 2023-07-11T00:31:20.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.637+0000 7ff405dff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4000b8800 con 0x7ff4000b8430 2023-07-11T00:31:20.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.637+0000 7ff405dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4000cfeb0 con 0x7ff4000d3730 2023-07-11T00:31:20.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.637+0000 7ff3ff7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff4000b8430 0x7ff4000cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:20.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.637+0000 7ff3ff7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff4000b8430 0x7ff4000cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46308/0 (socket says 172.21.15.22:46308) 2023-07-11T00:31:20.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.637+0000 7ff3ff7fe700 1 -- 172.21.15.22:0/2644809462 learned_addr learned my addr 172.21.15.22:0/2644809462 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:20.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.638+0000 7ff3f7fff700 1 --2- 172.21.15.22:0/2644809462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4000d3730 0x7ff4000cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:20.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.638+0000 7ff3ff7fe700 1 -- 172.21.15.22:0/2644809462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4000d3730 msgr2=0x7ff4000cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:20.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.638+0000 7ff3ff7fe700 1 --2- 172.21.15.22:0/2644809462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4000d3730 0x7ff4000cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.638+0000 7ff3ff7fe700 1 -- 172.21.15.22:0/2644809462 >> v1:172.21.15.184:6789/0 conn(0x7ff4000cfa90 legacy=0x7ff40015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.638+0000 7ff3ff7fe700 1 -- 172.21.15.22:0/2644809462 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4000b4ee0 con 0x7ff4000b8430 2023-07-11T00:31:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.638+0000 7ff3f7fff700 1 --2- 172.21.15.22:0/2644809462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4000d3730 0x7ff4000cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.638+0000 7ff3ff7fe700 1 --2- 172.21.15.22:0/2644809462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4000b8430 0x7ff4000cd320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00098f0 tx=0x7ff3f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87856819f0d7bc12 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.638+0000 7ff3feffd700 1 -- 172.21.15.22:0/2644809462 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0004230 con 0x7ff4000b8430 2023-07-11T00:31:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.638+0000 7ff3feffd700 1 -- 172.21.15.22:0/2644809462 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f0004390 con 0x7ff4000b8430 2023-07-11T00:31:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.638+0000 7ff3feffd700 1 -- 172.21.15.22:0/2644809462 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f00036a0 con 0x7ff4000b8430 2023-07-11T00:31:20.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.639+0000 7ff405dff700 1 -- 172.21.15.22:0/2644809462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4000b8430 msgr2=0x7ff4000cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:20.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.639+0000 7ff405dff700 1 --2- 172.21.15.22:0/2644809462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4000b8430 0x7ff4000cd320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00098f0 tx=0x7ff3f0009c00 comp rx=0 tx=0).stop 2023-07-11T00:31:20.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.639+0000 7ff405dff700 1 -- 172.21.15.22:0/2644809462 shutdown_connections 2023-07-11T00:31:20.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.639+0000 7ff405dff700 1 --2- 172.21.15.22:0/2644809462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4000b8430 0x7ff4000cd320 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.639+0000 7ff405dff700 1 --2- 172.21.15.22:0/2644809462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4000d3730 0x7ff4000cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.639+0000 7ff405dff700 1 -- 172.21.15.22:0/2644809462 >> 172.21.15.22:0/2644809462 conn(0x7ff40006b3f0 msgr2=0x7ff40006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:20.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.639+0000 7ff405dff700 1 -- 172.21.15.22:0/2644809462 shutdown_connections 2023-07-11T00:31:20.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.639+0000 7ff405dff700 1 -- 172.21.15.22:0/2644809462 wait complete. 2023-07-11T00:31:20.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.641+0000 7ff405dff700 1 Processor -- start 2023-07-11T00:31:20.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.641+0000 7ff405dff700 1 -- start start 2023-07-11T00:31:20.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.642+0000 7ff405dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4000b8430 0x7ff400155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:20.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.642+0000 7ff405dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4000cfa90 0x7ff40015d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:20.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.642+0000 7ff405dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4000d3730 0x7ff40015dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:20.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.642+0000 7ff405dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4000cbf20 con 0x7ff4000d3730 2023-07-11T00:31:20.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.642+0000 7ff405dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4000cc200 con 0x7ff4000cfa90 2023-07-11T00:31:20.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.642+0000 7ff405dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4000cc4e0 con 0x7ff4000b8430 2023-07-11T00:31:20.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.642+0000 7ff3fffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4000d3730 0x7ff40015dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:20.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.642+0000 7ff3fffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4000d3730 0x7ff40015dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46322/0 (socket says 172.21.15.22:46322) 2023-07-11T00:31:20.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.642+0000 7ff3fffff700 1 -- 172.21.15.22:0/480248591 learned_addr learned my addr 172.21.15.22:0/480248591 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:20.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.642+0000 7ff3ff7fe700 1 --2- 172.21.15.22:0/480248591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4000b8430 0x7ff400155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:20.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.642+0000 7ff3f7fff700 1 --2- 172.21.15.22:0/480248591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4000cfa90 0x7ff40015d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:20.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.642+0000 7ff3fffff700 1 -- 172.21.15.22:0/480248591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4000b8430 msgr2=0x7ff400155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:20.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.642+0000 7ff3fffff700 1 --2- 172.21.15.22:0/480248591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4000b8430 0x7ff400155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.642+0000 7ff3fffff700 1 -- 172.21.15.22:0/480248591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4000cfa90 msgr2=0x7ff40015d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:20.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.642+0000 7ff3fffff700 1 --2- 172.21.15.22:0/480248591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4000cfa90 0x7ff40015d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.642+0000 7ff3fffff700 1 -- 172.21.15.22:0/480248591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f0009550 con 0x7ff4000d3730 2023-07-11T00:31:20.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.642+0000 7ff3ff7fe700 1 --2- 172.21.15.22:0/480248591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4000b8430 0x7ff400155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:20.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.643+0000 7ff3fffff700 1 --2- 172.21.15.22:0/480248591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4000d3730 0x7ff40015dd00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800cc10 tx=0x7ff3f800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:20.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.643+0000 7ff3fcff9700 1 -- 172.21.15.22:0/480248591 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f800abb0 con 0x7ff4000d3730 2023-07-11T00:31:20.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.643+0000 7ff3fcff9700 1 -- 172.21.15.22:0/480248591 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f800ad10 con 0x7ff4000d3730 2023-07-11T00:31:20.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.643+0000 7ff3fcff9700 1 -- 172.21.15.22:0/480248591 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8012660 con 0x7ff4000d3730 2023-07-11T00:31:20.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.643+0000 7ff405dff700 1 -- 172.21.15.22:0/480248591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4000cc7c0 con 0x7ff4000d3730 2023-07-11T00:31:20.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.643+0000 7ff405dff700 1 -- 172.21.15.22:0/480248591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff400155640 con 0x7ff4000d3730 2023-07-11T00:31:20.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.644+0000 7ff405dff700 1 -- 172.21.15.22:0/480248591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40004ea60 con 0x7ff4000d3730 2023-07-11T00:31:20.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.645+0000 7ff3fcff9700 1 -- 172.21.15.22:0/480248591 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff3f80127c0 con 0x7ff4000d3730 2023-07-11T00:31:20.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.646+0000 7ff3fcff9700 1 --2- 172.21.15.22:0/480248591 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff3e006ace0 0x7ff3e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:20.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.646+0000 7ff3fcff9700 1 -- 172.21.15.22:0/480248591 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff3f8089f70 con 0x7ff4000d3730 2023-07-11T00:31:20.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.646+0000 7ff3ff7fe700 1 --2- 172.21.15.22:0/480248591 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff3e006ace0 0x7ff3e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:20.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.647+0000 7ff3ff7fe700 1 --2- 172.21.15.22:0/480248591 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff3e006ace0 0x7ff3e006d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009130 tx=0x7ff3f0008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:20.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.651+0000 7ff3fcff9700 1 -- 172.21.15.22:0/480248591 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff3f8054ce0 con 0x7ff4000d3730 2023-07-11T00:31:20.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.858+0000 7ff405dff700 1 -- 172.21.15.22:0/480248591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4000b4b10 con 0x7ff4000d3730 2023-07-11T00:31:20.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.858+0000 7ff3fcff9700 1 -- 172.21.15.22:0/480248591 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff3f8016020 con 0x7ff4000d3730 2023-07-11T00:31:20.861 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-07-11T00:31:20.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.861+0000 7ff405dff700 1 -- 172.21.15.22:0/480248591 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff3e006ace0 msgr2=0x7ff3e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:20.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.861+0000 7ff405dff700 1 --2- 172.21.15.22:0/480248591 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff3e006ace0 0x7ff3e006d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009130 tx=0x7ff3f0008030 comp rx=0 tx=0).stop 2023-07-11T00:31:20.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.861+0000 7ff405dff700 1 -- 172.21.15.22:0/480248591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4000d3730 msgr2=0x7ff40015dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:20.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.861+0000 7ff405dff700 1 --2- 172.21.15.22:0/480248591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4000d3730 0x7ff40015dd00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800cc10 tx=0x7ff3f800a060 comp rx=0 tx=0).stop 2023-07-11T00:31:20.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.861+0000 7ff405dff700 1 -- 172.21.15.22:0/480248591 shutdown_connections 2023-07-11T00:31:20.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.861+0000 7ff405dff700 1 --2- 172.21.15.22:0/480248591 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff3e006ace0 0x7ff3e006d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.861+0000 7ff405dff700 1 --2- 172.21.15.22:0/480248591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4000b8430 0x7ff400155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.861+0000 7ff405dff700 1 --2- 172.21.15.22:0/480248591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4000d3730 0x7ff40015dd00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.861+0000 7ff405dff700 1 --2- 172.21.15.22:0/480248591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4000cfa90 0x7ff40015d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:20.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.861+0000 7ff405dff700 1 -- 172.21.15.22:0/480248591 >> 172.21.15.22:0/480248591 conn(0x7ff40006b3f0 msgr2=0x7ff4000b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:20.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.861+0000 7ff405dff700 1 -- 172.21.15.22:0/480248591 shutdown_connections 2023-07-11T00:31:20.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:20.861+0000 7ff405dff700 1 -- 172.21.15.22:0/480248591 wait complete. 2023-07-11T00:31:20.883 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:31:21.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.087+0000 7f527b5ff700 1 Processor -- start 2023-07-11T00:31:21.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.087+0000 7f527b5ff700 1 -- start start 2023-07-11T00:31:21.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.088+0000 7f527b5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52740d3730 0x7f52740cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:21.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.088+0000 7f527b5ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f52740cfa90 0x7f52740d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:21.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.089+0000 7f527b5ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52740d0b20 con 0x7f52740b8430 2023-07-11T00:31:21.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.089+0000 7f527b5ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52740cda30 con 0x7f52740cfa90 2023-07-11T00:31:21.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.089+0000 7f527b5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52740b8800 con 0x7f52740d3730 2023-07-11T00:31:21.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.089+0000 7f5279b9c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f52740cfa90 0x7f52740d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:21.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.089+0000 7f5279b9c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f52740cfa90 0x7f52740d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46332/0 (socket says 172.21.15.22:46332) 2023-07-11T00:31:21.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.089+0000 7f5279b9c700 1 -- 172.21.15.22:0/2802793166 learned_addr learned my addr 172.21.15.22:0/2802793166 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:21.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.089+0000 7f5278b9a700 1 --2- 172.21.15.22:0/2802793166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52740d3730 0x7f52740cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:21.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.089+0000 7f5279b9c700 1 -- 172.21.15.22:0/2802793166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52740d3730 msgr2=0x7f52740cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:21.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.089+0000 7f5279b9c700 1 --2- 172.21.15.22:0/2802793166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52740d3730 0x7f52740cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.089+0000 7f5279b9c700 1 -- 172.21.15.22:0/2802793166 >> v1:172.21.15.184:6789/0 conn(0x7f52740b8430 legacy=0x7f52740cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:21.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.089+0000 7f5279b9c700 1 -- 172.21.15.22:0/2802793166 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52740cfeb0 con 0x7f52740cfa90 2023-07-11T00:31:21.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.090+0000 7f5279b9c700 1 --2- 172.21.15.22:0/2802793166 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52740cfa90 0x7f52740d0fb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f526c009e50 tx=0x7f526c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bdcecdd3b3a820 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:21.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.090+0000 7f526bfff700 1 -- 172.21.15.22:0/2802793166 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c00e070 con 0x7f52740cfa90 2023-07-11T00:31:21.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.090+0000 7f526bfff700 1 -- 172.21.15.22:0/2802793166 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c00b910 con 0x7f52740cfa90 2023-07-11T00:31:21.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.090+0000 7f526bfff700 1 -- 172.21.15.22:0/2802793166 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c00bcc0 con 0x7f52740cfa90 2023-07-11T00:31:21.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.090+0000 7f527b5ff700 1 -- 172.21.15.22:0/2802793166 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52740cfa90 msgr2=0x7f52740d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:21.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.090+0000 7f527b5ff700 1 --2- 172.21.15.22:0/2802793166 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52740cfa90 0x7f52740d0fb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f526c009e50 tx=0x7f526c00b330 comp rx=0 tx=0).stop 2023-07-11T00:31:21.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.090+0000 7f527b5ff700 1 -- 172.21.15.22:0/2802793166 shutdown_connections 2023-07-11T00:31:21.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.090+0000 7f527b5ff700 1 --2- 172.21.15.22:0/2802793166 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52740cfa90 0x7f52740d0fb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.090+0000 7f527b5ff700 1 --2- 172.21.15.22:0/2802793166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52740d3730 0x7f52740cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.090+0000 7f527b5ff700 1 -- 172.21.15.22:0/2802793166 >> 172.21.15.22:0/2802793166 conn(0x7f527406b3f0 msgr2=0x7f527406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:21.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.091+0000 7f527b5ff700 1 -- 172.21.15.22:0/2802793166 shutdown_connections 2023-07-11T00:31:21.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.091+0000 7f527b5ff700 1 -- 172.21.15.22:0/2802793166 wait complete. 2023-07-11T00:31:21.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.092+0000 7f527b5ff700 1 Processor -- start 2023-07-11T00:31:21.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.092+0000 7f527b5ff700 1 -- start start 2023-07-11T00:31:21.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.093+0000 7f527b5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52740b8430 0x7f527414d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:21.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.093+0000 7f527b5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52740cfa90 0x7f52740c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:21.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.094+0000 7f527b5ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52740d3730 0x7f527414f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:21.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.094+0000 7f527b5ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527414d5c0 con 0x7f52740d3730 2023-07-11T00:31:21.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.094+0000 7f527b5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52740c6ba0 con 0x7f52740cfa90 2023-07-11T00:31:21.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.094+0000 7f527b5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527414ed50 con 0x7f52740b8430 2023-07-11T00:31:21.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.094+0000 7f5279b9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52740d3730 0x7f527414f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:21.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.094+0000 7f5279b9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52740d3730 0x7f527414f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46338/0 (socket says 172.21.15.22:46338) 2023-07-11T00:31:21.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.094+0000 7f5279b9c700 1 -- 172.21.15.22:0/1948599647 learned_addr learned my addr 172.21.15.22:0/1948599647 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:21.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.094+0000 7f527939b700 1 --2- 172.21.15.22:0/1948599647 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52740b8430 0x7f527414d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:21.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.094+0000 7f5278b9a700 1 --2- 172.21.15.22:0/1948599647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52740cfa90 0x7f52740c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:21.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.094+0000 7f5279b9c700 1 -- 172.21.15.22:0/1948599647 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52740b8430 msgr2=0x7f527414d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:21.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.094+0000 7f5279b9c700 1 --2- 172.21.15.22:0/1948599647 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52740b8430 0x7f527414d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.094+0000 7f5279b9c700 1 -- 172.21.15.22:0/1948599647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52740cfa90 msgr2=0x7f52740c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:21.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.094+0000 7f5279b9c700 1 --2- 172.21.15.22:0/1948599647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52740cfa90 0x7f52740c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.094+0000 7f5279b9c700 1 -- 172.21.15.22:0/1948599647 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c009b30 con 0x7f52740d3730 2023-07-11T00:31:21.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.095+0000 7f5279b9c700 1 --2- 172.21.15.22:0/1948599647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52740d3730 0x7f527414f830 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f527406c780 tx=0x7f526c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:21.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.095+0000 7f5269ffb700 1 -- 172.21.15.22:0/1948599647 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c004960 con 0x7f52740d3730 2023-07-11T00:31:21.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.095+0000 7f5269ffb700 1 -- 172.21.15.22:0/1948599647 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c0099b0 con 0x7f52740d3730 2023-07-11T00:31:21.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.095+0000 7f527b5ff700 1 -- 172.21.15.22:0/1948599647 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527414f030 con 0x7f52740d3730 2023-07-11T00:31:21.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.095+0000 7f5269ffb700 1 -- 172.21.15.22:0/1948599647 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c01c680 con 0x7f52740d3730 2023-07-11T00:31:21.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.095+0000 7f527b5ff700 1 -- 172.21.15.22:0/1948599647 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52740c93c0 con 0x7f52740d3730 2023-07-11T00:31:21.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.096+0000 7f527b5ff700 1 -- 172.21.15.22:0/1948599647 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52740c9580 con 0x7f52740d3730 2023-07-11T00:31:21.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.097+0000 7f5269ffb700 1 -- 172.21.15.22:0/1948599647 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f526c01c7e0 con 0x7f52740d3730 2023-07-11T00:31:21.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.098+0000 7f5269ffb700 1 --2- 172.21.15.22:0/1948599647 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f525806ace0 0x7f525806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:21.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.098+0000 7f5269ffb700 1 -- 172.21.15.22:0/1948599647 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f526c08b580 con 0x7f52740d3730 2023-07-11T00:31:21.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.098+0000 7f527939b700 1 --2- 172.21.15.22:0/1948599647 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f525806ace0 0x7f525806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:21.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.099+0000 7f527939b700 1 --2- 172.21.15.22:0/1948599647 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f525806ace0 0x7f525806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5270000f60 tx=0x7f5270009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:21.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.102+0000 7f5269ffb700 1 -- 172.21.15.22:0/1948599647 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f526c0562f0 con 0x7f52740d3730 2023-07-11T00:31:21.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.307+0000 7f527b5ff700 1 -- 172.21.15.22:0/1948599647 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f527414f4f0 con 0x7f52740d3730 2023-07-11T00:31:21.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.308+0000 7f5269ffb700 1 -- 172.21.15.22:0/1948599647 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f526c059910 con 0x7f52740d3730 2023-07-11T00:31:21.310 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:21.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.310+0000 7f527b5ff700 1 -- 172.21.15.22:0/1948599647 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f525806ace0 msgr2=0x7f525806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:21.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.310+0000 7f527b5ff700 1 --2- 172.21.15.22:0/1948599647 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f525806ace0 0x7f525806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5270000f60 tx=0x7f5270009040 comp rx=0 tx=0).stop 2023-07-11T00:31:21.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.310+0000 7f527b5ff700 1 -- 172.21.15.22:0/1948599647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52740d3730 msgr2=0x7f527414f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:21.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.310+0000 7f527b5ff700 1 --2- 172.21.15.22:0/1948599647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52740d3730 0x7f527414f830 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f527406c780 tx=0x7f526c004ad0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.310+0000 7f527b5ff700 1 -- 172.21.15.22:0/1948599647 shutdown_connections 2023-07-11T00:31:21.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.310+0000 7f527b5ff700 1 --2- 172.21.15.22:0/1948599647 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f525806ace0 0x7f525806d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.310+0000 7f527b5ff700 1 --2- 172.21.15.22:0/1948599647 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52740b8430 0x7f527414d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.310+0000 7f527b5ff700 1 --2- 172.21.15.22:0/1948599647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52740d3730 0x7f527414f830 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.310+0000 7f527b5ff700 1 --2- 172.21.15.22:0/1948599647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52740cfa90 0x7f52740c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.310+0000 7f527b5ff700 1 -- 172.21.15.22:0/1948599647 >> 172.21.15.22:0/1948599647 conn(0x7f527406b3f0 msgr2=0x7f52740d1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:21.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.310+0000 7f527b5ff700 1 -- 172.21.15.22:0/1948599647 shutdown_connections 2023-07-11T00:31:21.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.310+0000 7f527b5ff700 1 -- 172.21.15.22:0/1948599647 wait complete. 2023-07-11T00:31:21.330 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:31:21.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.532+0000 7fbacb7ff700 1 Processor -- start 2023-07-11T00:31:21.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.532+0000 7fbacb7ff700 1 -- start start 2023-07-11T00:31:21.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.533+0000 7fbacb7ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbac40b8430 0x7fbac40cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:21.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.533+0000 7fbacb7ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac40d0b20 con 0x7fbac40cfc60 2023-07-11T00:31:21.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.533+0000 7fbacb7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac40b4ee0 con 0x7fbac40d3730 2023-07-11T00:31:21.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.533+0000 7fbacb7ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac40b8800 con 0x7fbac40b8430 2023-07-11T00:31:21.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.534+0000 7fbac959b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbac40b8430 0x7fbac40cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:21.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.534+0000 7fbac9d9c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbac40cfc60 0x7fbac40d0fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42724/0 (socket says 172.21.15.22:42724) 2023-07-11T00:31:21.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.534+0000 7fbac9d9c700 1 -- 172.21.15.22:0/3933076669 learned_addr learned my addr 172.21.15.22:0/3933076669 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:21.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.534+0000 7fbac959b700 1 -- 172.21.15.22:0/3933076669 >> v1:172.21.15.184:6789/0 conn(0x7fbac40d3730 legacy=0x7fbac40cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:21.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.534+0000 7fbac959b700 1 -- 172.21.15.22:0/3933076669 >> v1:172.21.15.22:6789/0 conn(0x7fbac40cfc60 legacy=0x7fbac40d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:21.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.534+0000 7fbac959b700 1 -- 172.21.15.22:0/3933076669 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac40b51c0 con 0x7fbac40b8430 2023-07-11T00:31:21.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.534+0000 7fbac959b700 1 --2- 172.21.15.22:0/3933076669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbac40b8430 0x7fbac40cd320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009840 tx=0x7fbac0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9994c4e505c48246 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:21.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.534+0000 7fbabbfff700 1 -- 172.21.15.22:0/3933076669 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0004230 con 0x7fbac40b8430 2023-07-11T00:31:21.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.535+0000 7fbabbfff700 1 -- 172.21.15.22:0/3933076669 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac0004390 con 0x7fbac40b8430 2023-07-11T00:31:21.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.535+0000 7fbabbfff700 1 -- 172.21.15.22:0/3933076669 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac00036a0 con 0x7fbac40b8430 2023-07-11T00:31:21.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.535+0000 7fbacb7ff700 1 -- 172.21.15.22:0/3933076669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbac40b8430 msgr2=0x7fbac40cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:21.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.535+0000 7fbacb7ff700 1 --2- 172.21.15.22:0/3933076669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbac40b8430 0x7fbac40cd320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009840 tx=0x7fbac0009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:21.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.535+0000 7fbacb7ff700 1 -- 172.21.15.22:0/3933076669 shutdown_connections 2023-07-11T00:31:21.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.535+0000 7fbacb7ff700 1 --2- 172.21.15.22:0/3933076669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbac40b8430 0x7fbac40cd320 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.535+0000 7fbacb7ff700 1 -- 172.21.15.22:0/3933076669 >> 172.21.15.22:0/3933076669 conn(0x7fbac406b3f0 msgr2=0x7fbac406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:21.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.535+0000 7fbacb7ff700 1 -- 172.21.15.22:0/3933076669 shutdown_connections 2023-07-11T00:31:21.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.535+0000 7fbacb7ff700 1 -- 172.21.15.22:0/3933076669 wait complete. 2023-07-11T00:31:21.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.537+0000 7fbacb7ff700 1 Processor -- start 2023-07-11T00:31:21.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.537+0000 7fbacb7ff700 1 -- start start 2023-07-11T00:31:21.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.538+0000 7fbacb7ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbac40b8430 0x7fbac41e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:21.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.538+0000 7fbacb7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbac40cfc60 0x7fbac4154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:21.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.538+0000 7fbacb7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbac40d3730 0x7fbac415f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:21.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.538+0000 7fbacb7ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac41e6e30 con 0x7fbac40b8430 2023-07-11T00:31:21.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.538+0000 7fbacb7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac41e6220 con 0x7fbac40d3730 2023-07-11T00:31:21.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.538+0000 7fbacb7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac41e6500 con 0x7fbac40cfc60 2023-07-11T00:31:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.538+0000 7fbac959b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbac40b8430 0x7fbac41e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.538+0000 7fbac959b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbac40b8430 0x7fbac41e72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46360/0 (socket says 172.21.15.22:46360) 2023-07-11T00:31:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.538+0000 7fbac959b700 1 -- 172.21.15.22:0/2403116982 learned_addr learned my addr 172.21.15.22:0/2403116982 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:21.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.538+0000 7fbac8d9a700 1 --2- 172.21.15.22:0/2403116982 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbac40cfc60 0x7fbac4154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:21.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.538+0000 7fbac9d9c700 1 --2- 172.21.15.22:0/2403116982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbac40d3730 0x7fbac415f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:21.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.539+0000 7fbac959b700 1 -- 172.21.15.22:0/2403116982 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbac40cfc60 msgr2=0x7fbac4154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:21.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.539+0000 7fbac959b700 1 --2- 172.21.15.22:0/2403116982 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbac40cfc60 0x7fbac4154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.539+0000 7fbac959b700 1 -- 172.21.15.22:0/2403116982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbac40d3730 msgr2=0x7fbac415f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:21.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.539+0000 7fbac959b700 1 --2- 172.21.15.22:0/2403116982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbac40d3730 0x7fbac415f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.539+0000 7fbac959b700 1 -- 172.21.15.22:0/2403116982 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac00094a0 con 0x7fbac40b8430 2023-07-11T00:31:21.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.539+0000 7fbac959b700 1 --2- 172.21.15.22:0/2403116982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbac40b8430 0x7fbac41e72c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009b90 tx=0x7fbac0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:21.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.539+0000 7fbab9ffb700 1 -- 172.21.15.22:0/2403116982 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0003ea0 con 0x7fbac40b8430 2023-07-11T00:31:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.539+0000 7fbab9ffb700 1 -- 172.21.15.22:0/2403116982 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac001e070 con 0x7fbac40b8430 2023-07-11T00:31:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.539+0000 7fbacb7ff700 1 -- 172.21.15.22:0/2403116982 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac41e67e0 con 0x7fbac40b8430 2023-07-11T00:31:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.539+0000 7fbab9ffb700 1 -- 172.21.15.22:0/2403116982 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0011870 con 0x7fbac40b8430 2023-07-11T00:31:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.539+0000 7fbacb7ff700 1 -- 172.21.15.22:0/2403116982 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac41546c0 con 0x7fbac40b8430 2023-07-11T00:31:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.540+0000 7fbacb7ff700 1 -- 172.21.15.22:0/2403116982 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac41e7110 con 0x7fbac40b8430 2023-07-11T00:31:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.541+0000 7fbab9ffb700 1 -- 172.21.15.22:0/2403116982 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbac00119d0 con 0x7fbac40b8430 2023-07-11T00:31:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.543+0000 7fbab9ffb700 1 --2- 172.21.15.22:0/2403116982 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbaa806ace0 0x7fbaa806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.543+0000 7fbab9ffb700 1 -- 172.21.15.22:0/2403116982 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbac008aa20 con 0x7fbac40b8430 2023-07-11T00:31:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.543+0000 7fbac8d9a700 1 --2- 172.21.15.22:0/2403116982 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbaa806ace0 0x7fbaa806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.544+0000 7fbac8d9a700 1 --2- 172.21.15.22:0/2403116982 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbaa806ace0 0x7fbaa806d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbac40ce220 tx=0x7fbab40090e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:21.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.547+0000 7fbab9ffb700 1 -- 172.21.15.22:0/2403116982 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbac0055790 con 0x7fbac40b8430 2023-07-11T00:31:21.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.754+0000 7fbacb7ff700 1 -- 172.21.15.22:0/2403116982 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbac404ea60 con 0x7fbac40b8430 2023-07-11T00:31:21.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.754+0000 7fbab9ffb700 1 -- 172.21.15.22:0/2403116982 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbac0058db0 con 0x7fbac40b8430 2023-07-11T00:31:21.758 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-07-11T00:31:21.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.756+0000 7fbacb7ff700 1 -- 172.21.15.22:0/2403116982 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbaa806ace0 msgr2=0x7fbaa806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:21.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.756+0000 7fbacb7ff700 1 --2- 172.21.15.22:0/2403116982 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbaa806ace0 0x7fbaa806d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbac40ce220 tx=0x7fbab40090e0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.756+0000 7fbacb7ff700 1 -- 172.21.15.22:0/2403116982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbac40b8430 msgr2=0x7fbac41e72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:21.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.756+0000 7fbacb7ff700 1 --2- 172.21.15.22:0/2403116982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbac40b8430 0x7fbac41e72c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009b90 tx=0x7fbac0004750 comp rx=0 tx=0).stop 2023-07-11T00:31:21.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.756+0000 7fbacb7ff700 1 -- 172.21.15.22:0/2403116982 shutdown_connections 2023-07-11T00:31:21.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.756+0000 7fbacb7ff700 1 --2- 172.21.15.22:0/2403116982 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbaa806ace0 0x7fbaa806d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.756+0000 7fbacb7ff700 1 --2- 172.21.15.22:0/2403116982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbac40d3730 0x7fbac415f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.756+0000 7fbacb7ff700 1 --2- 172.21.15.22:0/2403116982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbac40b8430 0x7fbac41e72c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.756+0000 7fbacb7ff700 1 --2- 172.21.15.22:0/2403116982 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbac40cfc60 0x7fbac4154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.756+0000 7fbacb7ff700 1 -- 172.21.15.22:0/2403116982 >> 172.21.15.22:0/2403116982 conn(0x7fbac406b3f0 msgr2=0x7fbac406b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:21.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.756+0000 7fbacb7ff700 1 -- 172.21.15.22:0/2403116982 shutdown_connections 2023-07-11T00:31:21.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.757+0000 7fbacb7ff700 1 -- 172.21.15.22:0/2403116982 wait complete. 2023-07-11T00:31:21.777 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-11T00:31:21.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.980+0000 7f60cd1ff700 1 Processor -- start 2023-07-11T00:31:21.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.980+0000 7f60cd1ff700 1 -- start start 2023-07-11T00:31:21.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.981+0000 7f60cd1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f60c80b8430 0x7f60c80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:21.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.981+0000 7f60cd1ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f60c80cfc60 0x7f60c80d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:21.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.981+0000 7f60cd1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c80d0b20 con 0x7f60c80d3730 2023-07-11T00:31:21.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.981+0000 7f60cd1ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c80b8800 con 0x7f60c80cfc60 2023-07-11T00:31:21.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.981+0000 7f60cd1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c80b4ee0 con 0x7f60c80b8430 2023-07-11T00:31:21.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.981+0000 7f60c759e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f60c80cfc60 0x7f60c80d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:21.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.981+0000 7f60c759e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f60c80cfc60 0x7f60c80d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46366/0 (socket says 172.21.15.22:46366) 2023-07-11T00:31:21.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.981+0000 7f60c759e700 1 -- 172.21.15.22:0/4142886820 learned_addr learned my addr 172.21.15.22:0/4142886820 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:21.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.982+0000 7f60c6d9d700 1 --2- 172.21.15.22:0/4142886820 >> v2:172.21.15.184:3300/0 conn(0x7f60c80b8430 0x7f60c80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:21.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.982+0000 7f60c759e700 1 -- 172.21.15.22:0/4142886820 >> v2:172.21.15.184:3300/0 conn(0x7f60c80b8430 msgr2=0x7f60c80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:21.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.982+0000 7f60c759e700 1 --2- 172.21.15.22:0/4142886820 >> v2:172.21.15.184:3300/0 conn(0x7f60c80b8430 0x7f60c80cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.982+0000 7f60c759e700 1 -- 172.21.15.22:0/4142886820 >> v1:172.21.15.184:6789/0 conn(0x7f60c80d3730 legacy=0x7f60c80cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:21.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.982+0000 7f60c759e700 1 -- 172.21.15.22:0/4142886820 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c80b51c0 con 0x7f60c80cfc60 2023-07-11T00:31:21.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.982+0000 7f60c759e700 1 --2- 172.21.15.22:0/4142886820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60c80cfc60 0x7f60c80d0fb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f60c80cf520 tx=0x7f60c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17caab8b96919ca server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:21.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.982+0000 7f60c659c700 1 -- 172.21.15.22:0/4142886820 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c000e070 con 0x7f60c80cfc60 2023-07-11T00:31:21.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.982+0000 7f60c659c700 1 -- 172.21.15.22:0/4142886820 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c000b9c0 con 0x7f60c80cfc60 2023-07-11T00:31:21.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.982+0000 7f60c659c700 1 -- 172.21.15.22:0/4142886820 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c000bd70 con 0x7f60c80cfc60 2023-07-11T00:31:21.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.983+0000 7f60cd1ff700 1 -- 172.21.15.22:0/4142886820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60c80cfc60 msgr2=0x7f60c80d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:21.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.983+0000 7f60cd1ff700 1 --2- 172.21.15.22:0/4142886820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60c80cfc60 0x7f60c80d0fb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f60c80cf520 tx=0x7f60c000b330 comp rx=0 tx=0).stop 2023-07-11T00:31:21.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.983+0000 7f60cd1ff700 1 -- 172.21.15.22:0/4142886820 shutdown_connections 2023-07-11T00:31:21.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.983+0000 7f60cd1ff700 1 --2- 172.21.15.22:0/4142886820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60c80cfc60 0x7f60c80d0fb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.983+0000 7f60cd1ff700 1 --2- 172.21.15.22:0/4142886820 >> v2:172.21.15.184:3300/0 conn(0x7f60c80b8430 0x7f60c80cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.983+0000 7f60cd1ff700 1 -- 172.21.15.22:0/4142886820 >> 172.21.15.22:0/4142886820 conn(0x7f60c806b3f0 msgr2=0x7f60c806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:21.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.983+0000 7f60cd1ff700 1 -- 172.21.15.22:0/4142886820 shutdown_connections 2023-07-11T00:31:21.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.983+0000 7f60cd1ff700 1 -- 172.21.15.22:0/4142886820 wait complete. 2023-07-11T00:31:21.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.985+0000 7f60cd1ff700 1 Processor -- start 2023-07-11T00:31:21.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.985+0000 7f60cd1ff700 1 -- start start 2023-07-11T00:31:21.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.986+0000 7f60cd1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60c80b8430 0x7f60c80d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:21.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.986+0000 7f60cd1ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60c80cfc60 0x7f60c80c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:21.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.986+0000 7f60cd1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60c80d3730 0x7f60c815aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:21.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.986+0000 7f60cd1ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c80cab70 con 0x7f60c80cfc60 2023-07-11T00:31:21.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.986+0000 7f60cd1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c80c9570 con 0x7f60c80b8430 2023-07-11T00:31:21.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.986+0000 7f60cd1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c80c9c10 con 0x7f60c80d3730 2023-07-11T00:31:21.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.986+0000 7f60bffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60c80cfc60 0x7f60c80c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:21.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.986+0000 7f60bffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60c80cfc60 0x7f60c80c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46376/0 (socket says 172.21.15.22:46376) 2023-07-11T00:31:21.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.986+0000 7f60bffff700 1 -- 172.21.15.22:0/856446654 learned_addr learned my addr 172.21.15.22:0/856446654 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:21.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.987+0000 7f60c6d9d700 1 --2- 172.21.15.22:0/856446654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60c80b8430 0x7f60c80d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:21.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.987+0000 7f60c759e700 1 --2- 172.21.15.22:0/856446654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60c80d3730 0x7f60c815aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:21.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.987+0000 7f60bffff700 1 -- 172.21.15.22:0/856446654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60c80d3730 msgr2=0x7f60c815aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:21.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.987+0000 7f60bffff700 1 --2- 172.21.15.22:0/856446654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60c80d3730 0x7f60c815aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.987+0000 7f60bffff700 1 -- 172.21.15.22:0/856446654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60c80b8430 msgr2=0x7f60c80d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:21.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.987+0000 7f60bffff700 1 --2- 172.21.15.22:0/856446654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60c80b8430 0x7f60c80d1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:21.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.987+0000 7f60bffff700 1 -- 172.21.15.22:0/856446654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c0009b30 con 0x7f60c80cfc60 2023-07-11T00:31:21.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.987+0000 7f60c759e700 1 --2- 172.21.15.22:0/856446654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60c80d3730 0x7f60c815aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:21.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.987+0000 7f60bffff700 1 --2- 172.21.15.22:0/856446654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60c80cfc60 0x7f60c80c6670 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f60b000c450 tx=0x7f60b000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:21.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.987+0000 7f60bf7fe700 1 -- 172.21.15.22:0/856446654 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b00052d0 con 0x7f60c80cfc60 2023-07-11T00:31:21.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.987+0000 7f60bf7fe700 1 -- 172.21.15.22:0/856446654 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b0005430 con 0x7f60c80cfc60 2023-07-11T00:31:21.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.987+0000 7f60bf7fe700 1 -- 172.21.15.22:0/856446654 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b00038c0 con 0x7f60c80cfc60 2023-07-11T00:31:21.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.987+0000 7f60cd1ff700 1 -- 172.21.15.22:0/856446654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c80c9ef0 con 0x7f60c80cfc60 2023-07-11T00:31:21.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.988+0000 7f60cd1ff700 1 -- 172.21.15.22:0/856446654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c80ca4b0 con 0x7f60c80cfc60 2023-07-11T00:31:21.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.989+0000 7f60cd1ff700 1 -- 172.21.15.22:0/856446654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c804ea60 con 0x7f60c80cfc60 2023-07-11T00:31:21.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.990+0000 7f60bf7fe700 1 -- 172.21.15.22:0/856446654 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f60b0003a20 con 0x7f60c80cfc60 2023-07-11T00:31:21.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.991+0000 7f60bf7fe700 1 --2- 172.21.15.22:0/856446654 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f60a806ace0 0x7f60a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:21.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.991+0000 7f60bf7fe700 1 -- 172.21.15.22:0/856446654 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f60b0088ae0 con 0x7f60c80cfc60 2023-07-11T00:31:21.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.991+0000 7f60c6d9d700 1 --2- 172.21.15.22:0/856446654 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f60a806ace0 0x7f60a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:21.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.992+0000 7f60c6d9d700 1 --2- 172.21.15.22:0/856446654 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f60a806ace0 0x7f60a806d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f60b8006b20 tx=0x7f60b8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:21.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:21.995+0000 7f60bf7fe700 1 -- 172.21.15.22:0/856446654 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f60b0053850 con 0x7f60c80cfc60 2023-07-11T00:31:22.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.204+0000 7f60cd1ff700 1 -- 172.21.15.22:0/856446654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f60c80ce700 con 0x7f60c80cfc60 2023-07-11T00:31:22.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.205+0000 7f60bf7fe700 1 -- 172.21.15.22:0/856446654 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f60b0056e70 con 0x7f60c80cfc60 2023-07-11T00:31:22.208 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:22.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.207+0000 7f60cd1ff700 1 -- 172.21.15.22:0/856446654 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f60a806ace0 msgr2=0x7f60a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:22.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.207+0000 7f60cd1ff700 1 --2- 172.21.15.22:0/856446654 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f60a806ace0 0x7f60a806d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f60b8006b20 tx=0x7f60b8008040 comp rx=0 tx=0).stop 2023-07-11T00:31:22.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.207+0000 7f60cd1ff700 1 -- 172.21.15.22:0/856446654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60c80cfc60 msgr2=0x7f60c80c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:22.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.207+0000 7f60cd1ff700 1 --2- 172.21.15.22:0/856446654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60c80cfc60 0x7f60c80c6670 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f60b000c450 tx=0x7f60b000c760 comp rx=0 tx=0).stop 2023-07-11T00:31:22.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.207+0000 7f60cd1ff700 1 -- 172.21.15.22:0/856446654 shutdown_connections 2023-07-11T00:31:22.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.207+0000 7f60cd1ff700 1 --2- 172.21.15.22:0/856446654 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f60a806ace0 0x7f60a806d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:22.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.207+0000 7f60cd1ff700 1 --2- 172.21.15.22:0/856446654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60c80d3730 0x7f60c815aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:22.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.207+0000 7f60cd1ff700 1 --2- 172.21.15.22:0/856446654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60c80b8430 0x7f60c80d1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:22.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.207+0000 7f60cd1ff700 1 --2- 172.21.15.22:0/856446654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60c80cfc60 0x7f60c80c6670 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:22.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.207+0000 7f60cd1ff700 1 -- 172.21.15.22:0/856446654 >> 172.21.15.22:0/856446654 conn(0x7f60c806b3f0 msgr2=0x7f60c815bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:22.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.207+0000 7f60cd1ff700 1 -- 172.21.15.22:0/856446654 shutdown_connections 2023-07-11T00:31:22.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.207+0000 7f60cd1ff700 1 -- 172.21.15.22:0/856446654 wait complete. 2023-07-11T00:31:22.228 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-11T00:31:22.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.427+0000 7fb9581ff700 1 Processor -- start 2023-07-11T00:31:22.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.427+0000 7fb9581ff700 1 -- start start 2023-07-11T00:31:22.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.428+0000 7fb9581ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9500d2640 0x7fb9500b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:22.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.428+0000 7fb9581ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb9500cf8f0 0x7fb95015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:22.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.428+0000 7fb9581ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9500d1790 con 0x7fb95015c460 2023-07-11T00:31:22.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.428+0000 7fb9581ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9500cedd0 con 0x7fb9500cf8f0 2023-07-11T00:31:22.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.428+0000 7fb9581ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9500cd950 con 0x7fb9500d2640 2023-07-11T00:31:22.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.429+0000 7fb95579a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9500d2640 0x7fb9500b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:22.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.429+0000 7fb95579a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9500d2640 0x7fb9500b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:51392/0 (socket says 172.21.15.22:51392) 2023-07-11T00:31:22.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.429+0000 7fb95579a700 1 -- 172.21.15.22:0/4074183439 learned_addr learned my addr 172.21.15.22:0/4074183439 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:22.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.429+0000 7fb95679c700 1 --2- 172.21.15.22:0/4074183439 >> v2:172.21.15.184:3300/0 conn(0x7fb9500cf8f0 0x7fb95015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:22.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.429+0000 7fb95679c700 1 -- 172.21.15.22:0/4074183439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9500d2640 msgr2=0x7fb9500b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:22.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.429+0000 7fb95679c700 1 --2- 172.21.15.22:0/4074183439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9500d2640 0x7fb9500b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:22.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.429+0000 7fb95679c700 1 -- 172.21.15.22:0/4074183439 >> v1:172.21.15.184:6789/0 conn(0x7fb95015c460 legacy=0x7fb9500cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:22.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.429+0000 7fb95679c700 1 -- 172.21.15.22:0/4074183439 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9500d14b0 con 0x7fb9500cf8f0 2023-07-11T00:31:22.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.429+0000 7fb95579a700 1 --2- 172.21.15.22:0/4074183439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9500d2640 0x7fb9500b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:22.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.430+0000 7fb95679c700 1 --2- 172.21.15.22:0/4074183439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9500cf8f0 0x7fb95015fe20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb948009d90 tx=0x7fb94800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=917336e18065a26c server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:22.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.430+0000 7fb954f99700 1 -- 172.21.15.22:0/4074183439 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94800e070 con 0x7fb9500cf8f0 2023-07-11T00:31:22.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.430+0000 7fb954f99700 1 -- 172.21.15.22:0/4074183439 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94800bb20 con 0x7fb9500cf8f0 2023-07-11T00:31:22.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.430+0000 7fb954f99700 1 -- 172.21.15.22:0/4074183439 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb948012430 con 0x7fb9500cf8f0 2023-07-11T00:31:22.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.431+0000 7fb9581ff700 1 -- 172.21.15.22:0/4074183439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9500cf8f0 msgr2=0x7fb95015fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:22.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.431+0000 7fb9581ff700 1 --2- 172.21.15.22:0/4074183439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9500cf8f0 0x7fb95015fe20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb948009d90 tx=0x7fb94800b330 comp rx=0 tx=0).stop 2023-07-11T00:31:22.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.431+0000 7fb9581ff700 1 -- 172.21.15.22:0/4074183439 shutdown_connections 2023-07-11T00:31:22.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.431+0000 7fb9581ff700 1 --2- 172.21.15.22:0/4074183439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9500cf8f0 0x7fb95015fe20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:22.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.431+0000 7fb9581ff700 1 --2- 172.21.15.22:0/4074183439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9500d2640 0x7fb9500b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:22.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.431+0000 7fb9581ff700 1 -- 172.21.15.22:0/4074183439 >> 172.21.15.22:0/4074183439 conn(0x7fb950071660 msgr2=0x7fb950071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:22.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.431+0000 7fb9581ff700 1 -- 172.21.15.22:0/4074183439 shutdown_connections 2023-07-11T00:31:22.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.431+0000 7fb9581ff700 1 -- 172.21.15.22:0/4074183439 wait complete. 2023-07-11T00:31:22.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.432+0000 7fb9581ff700 1 Processor -- start 2023-07-11T00:31:22.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.433+0000 7fb9581ff700 1 -- start start 2023-07-11T00:31:22.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb9581ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9500cf8f0 0x7fb950158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:22.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb9581ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9500d2640 0x7fb9500b6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb9581ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb95015c460 0x7fb950155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb9581ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9500caff0 con 0x7fb9500cf8f0 2023-07-11T00:31:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb9581ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9500caa30 con 0x7fb9500d2640 2023-07-11T00:31:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb9581ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9500cad10 con 0x7fb95015c460 2023-07-11T00:31:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb955f9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9500cf8f0 0x7fb950158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb955f9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9500cf8f0 0x7fb950158f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46378/0 (socket says 172.21.15.22:46378) 2023-07-11T00:31:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb955f9b700 1 -- 172.21.15.22:0/37749218 learned_addr learned my addr 172.21.15.22:0/37749218 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb95679c700 1 --2- 172.21.15.22:0/37749218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb95015c460 0x7fb950155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb95579a700 1 --2- 172.21.15.22:0/37749218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9500d2640 0x7fb9500b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb955f9b700 1 -- 172.21.15.22:0/37749218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb95015c460 msgr2=0x7fb950155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb955f9b700 1 --2- 172.21.15.22:0/37749218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb95015c460 0x7fb950155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb955f9b700 1 -- 172.21.15.22:0/37749218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9500d2640 msgr2=0x7fb9500b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb955f9b700 1 --2- 172.21.15.22:0/37749218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9500d2640 0x7fb9500b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb955f9b700 1 -- 172.21.15.22:0/37749218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb940009550 con 0x7fb9500cf8f0 2023-07-11T00:31:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb95679c700 1 --2- 172.21.15.22:0/37749218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb95015c460 0x7fb950155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.434+0000 7fb95579a700 1 --2- 172.21.15.22:0/37749218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9500d2640 0x7fb9500b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.435+0000 7fb955f9b700 1 --2- 172.21.15.22:0/37749218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9500cf8f0 0x7fb950158f90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00c4e0 tx=0x7fb94c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.435+0000 7fb9467fc700 1 -- 172.21.15.22:0/37749218 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0052d0 con 0x7fb9500cf8f0 2023-07-11T00:31:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.435+0000 7fb9467fc700 1 -- 172.21.15.22:0/37749218 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c005430 con 0x7fb9500cf8f0 2023-07-11T00:31:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.435+0000 7fb9581ff700 1 -- 172.21.15.22:0/37749218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb948009a70 con 0x7fb9500cf8f0 2023-07-11T00:31:22.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.435+0000 7fb9467fc700 1 -- 172.21.15.22:0/37749218 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0038c0 con 0x7fb9500cf8f0 2023-07-11T00:31:22.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.435+0000 7fb9581ff700 1 -- 172.21.15.22:0/37749218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9501e4e10 con 0x7fb9500cf8f0 2023-07-11T00:31:22.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.436+0000 7fb9581ff700 1 -- 172.21.15.22:0/37749218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95004ea60 con 0x7fb9500cf8f0 2023-07-11T00:31:22.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.437+0000 7fb9467fc700 1 -- 172.21.15.22:0/37749218 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb94c003a20 con 0x7fb9500cf8f0 2023-07-11T00:31:22.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.438+0000 7fb9467fc700 1 --2- 172.21.15.22:0/37749218 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb93406ace0 0x7fb93406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:22.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.438+0000 7fb9467fc700 1 -- 172.21.15.22:0/37749218 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb94c088cd0 con 0x7fb9500cf8f0 2023-07-11T00:31:22.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.438+0000 7fb95579a700 1 --2- 172.21.15.22:0/37749218 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb93406ace0 0x7fb93406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:22.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.439+0000 7fb95579a700 1 --2- 172.21.15.22:0/37749218 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb93406ace0 0x7fb93406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb9500ce8e0 tx=0x7fb940008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:22.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.442+0000 7fb9467fc700 1 -- 172.21.15.22:0/37749218 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb94c053a40 con 0x7fb9500cf8f0 2023-07-11T00:31:22.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.668+0000 7fb9581ff700 1 -- 172.21.15.22:0/37749218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb9501e6a10 con 0x7fb9500cf8f0 2023-07-11T00:31:22.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.668+0000 7fb9467fc700 1 -- 172.21.15.22:0/37749218 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb94c057060 con 0x7fb9500cf8f0 2023-07-11T00:31:22.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.670+0000 7fb9581ff700 1 -- 172.21.15.22:0/37749218 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb93406ace0 msgr2=0x7fb93406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:22.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.670+0000 7fb9581ff700 1 --2- 172.21.15.22:0/37749218 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb93406ace0 0x7fb93406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb9500ce8e0 tx=0x7fb940008040 comp rx=0 tx=0).stop 2023-07-11T00:31:22.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.670+0000 7fb9581ff700 1 -- 172.21.15.22:0/37749218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9500cf8f0 msgr2=0x7fb950158f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:22.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.670+0000 7fb9581ff700 1 --2- 172.21.15.22:0/37749218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9500cf8f0 0x7fb950158f90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00c4e0 tx=0x7fb94c00c8a0 comp rx=0 tx=0).stop 2023-07-11T00:31:22.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.670+0000 7fb9581ff700 1 -- 172.21.15.22:0/37749218 shutdown_connections 2023-07-11T00:31:22.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.670+0000 7fb9581ff700 1 --2- 172.21.15.22:0/37749218 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb93406ace0 0x7fb93406d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:22.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.670+0000 7fb9581ff700 1 --2- 172.21.15.22:0/37749218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb95015c460 0x7fb950155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:22.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.670+0000 7fb9581ff700 1 --2- 172.21.15.22:0/37749218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9500cf8f0 0x7fb950158f90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:22.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.670+0000 7fb9581ff700 1 --2- 172.21.15.22:0/37749218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9500d2640 0x7fb9500b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:22.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.670+0000 7fb9581ff700 1 -- 172.21.15.22:0/37749218 >> 172.21.15.22:0/37749218 conn(0x7fb950071660 msgr2=0x7fb9500b7470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:22.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.671+0000 7fb9581ff700 1 -- 172.21.15.22:0/37749218 shutdown_connections 2023-07-11T00:31:22.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:22.671+0000 7fb9581ff700 1 -- 172.21.15.22:0/37749218 wait complete. 2023-07-11T00:31:22.675 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-07-11T00:31:22.691 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-11T00:31:22.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:22.692 DEBUG:teuthology.orchestra.run.smithi184:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-07-11T00:31:22.788 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-07-11T00:31:22.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:22.789 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-11T00:31:22.950 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:31:22.950 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:31:23.001 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:31:23.001 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:31:23.087 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:31:23.087 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:31:23.173 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:31:23.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.411+0000 7fe2a53ff700 1 Processor -- start 2023-07-11T00:31:23.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.411+0000 7fe2a53ff700 1 -- start start 2023-07-11T00:31:23.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.412+0000 7fe2a53ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2a0157f10 0x7fe2a006a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:23.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.412+0000 7fe2a53ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe2a0070a50 0x7fe2a0070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:23.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.412+0000 7fe2a53ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a015e210 con 0x7fe2a0070340 2023-07-11T00:31:23.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.412+0000 7fe2a53ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a006d900 con 0x7fe2a0157f10 2023-07-11T00:31:23.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.412+0000 7fe2a53ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a00713b0 con 0x7fe2a0070a50 2023-07-11T00:31:23.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.413+0000 7fe29effd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2a0157f10 0x7fe2a006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:23.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.413+0000 7fe29effd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2a0157f10 0x7fe2a006a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46384/0 (socket says 172.21.15.22:46384) 2023-07-11T00:31:23.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.413+0000 7fe29effd700 1 -- 172.21.15.22:0/1193113903 learned_addr learned my addr 172.21.15.22:0/1193113903 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:23.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.413+0000 7fe29e7fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe2a0070340 0x7fe2a015e6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42730/0 (socket says 172.21.15.22:42730) 2023-07-11T00:31:23.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.413+0000 7fe29f7fe700 1 --2- 172.21.15.22:0/1193113903 >> v2:172.21.15.184:3300/0 conn(0x7fe2a0070a50 0x7fe2a0070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:23.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.413+0000 7fe29effd700 1 -- 172.21.15.22:0/1193113903 >> v2:172.21.15.184:3300/0 conn(0x7fe2a0070a50 msgr2=0x7fe2a0070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:23.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.413+0000 7fe29effd700 1 --2- 172.21.15.22:0/1193113903 >> v2:172.21.15.184:3300/0 conn(0x7fe2a0070a50 0x7fe2a0070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:23.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.413+0000 7fe29effd700 1 -- 172.21.15.22:0/1193113903 >> v1:172.21.15.22:6789/0 conn(0x7fe2a0070340 legacy=0x7fe2a015e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:23.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.413+0000 7fe29effd700 1 -- 172.21.15.22:0/1193113903 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a015dee0 con 0x7fe2a0157f10 2023-07-11T00:31:23.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.413+0000 7fe29f7fe700 1 --2- 172.21.15.22:0/1193113903 >> v2:172.21.15.184:3300/0 conn(0x7fe2a0070a50 0x7fe2a0070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:23.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.413+0000 7fe29effd700 1 --2- 172.21.15.22:0/1193113903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2a0157f10 0x7fe2a006a940 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00add00 tx=0x7fe290009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1807951ed422a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:23.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.414+0000 7fe29dffb700 1 -- 172.21.15.22:0/1193113903 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29000b870 con 0x7fe2a0157f10 2023-07-11T00:31:23.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.414+0000 7fe29dffb700 1 -- 172.21.15.22:0/1193113903 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29000b9d0 con 0x7fe2a0157f10 2023-07-11T00:31:23.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.414+0000 7fe29dffb700 1 -- 172.21.15.22:0/1193113903 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29000bd60 con 0x7fe2a0157f10 2023-07-11T00:31:23.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.414+0000 7fe2a53ff700 1 -- 172.21.15.22:0/1193113903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2a0157f10 msgr2=0x7fe2a006a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:23.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.414+0000 7fe2a53ff700 1 --2- 172.21.15.22:0/1193113903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2a0157f10 0x7fe2a006a940 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00add00 tx=0x7fe290009bd0 comp rx=0 tx=0).stop 2023-07-11T00:31:23.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.414+0000 7fe2a53ff700 1 -- 172.21.15.22:0/1193113903 shutdown_connections 2023-07-11T00:31:23.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.414+0000 7fe2a53ff700 1 --2- 172.21.15.22:0/1193113903 >> v2:172.21.15.184:3300/0 conn(0x7fe2a0070a50 0x7fe2a0070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:23.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.414+0000 7fe2a53ff700 1 --2- 172.21.15.22:0/1193113903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2a0157f10 0x7fe2a006a940 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:23.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.414+0000 7fe2a53ff700 1 -- 172.21.15.22:0/1193113903 >> 172.21.15.22:0/1193113903 conn(0x7fe2a00b0390 msgr2=0x7fe2a00b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:23.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.414+0000 7fe2a53ff700 1 -- 172.21.15.22:0/1193113903 shutdown_connections 2023-07-11T00:31:23.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.414+0000 7fe2a53ff700 1 -- 172.21.15.22:0/1193113903 wait complete. 2023-07-11T00:31:23.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.416+0000 7fe2a53ff700 1 Processor -- start 2023-07-11T00:31:23.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.416+0000 7fe2a53ff700 1 -- start start 2023-07-11T00:31:23.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.417+0000 7fe2a53ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2a0070340 0x7fe2a00b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:23.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.417+0000 7fe2a53ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2a0070a50 0x7fe2a0155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:23.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.417+0000 7fe2a53ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2a0157f10 0x7fe2a015cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:23.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.417+0000 7fe2a53ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a00c3910 con 0x7fe2a0070a50 2023-07-11T00:31:23.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.417+0000 7fe2a53ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a00c6830 con 0x7fe2a0157f10 2023-07-11T00:31:23.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.417+0000 7fe2a53ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a00c6b10 con 0x7fe2a0070340 2023-07-11T00:31:23.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.417+0000 7fe29e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2a0070a50 0x7fe2a0155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:23.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.417+0000 7fe29e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2a0070a50 0x7fe2a0155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46388/0 (socket says 172.21.15.22:46388) 2023-07-11T00:31:23.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.417+0000 7fe29e7fc700 1 -- 172.21.15.22:0/482014950 learned_addr learned my addr 172.21.15.22:0/482014950 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:23.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.417+0000 7fe29effd700 1 --2- 172.21.15.22:0/482014950 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2a0070340 0x7fe2a00b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:23.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.418+0000 7fe29f7fe700 1 --2- 172.21.15.22:0/482014950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2a0157f10 0x7fe2a015cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:23.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.418+0000 7fe29e7fc700 1 -- 172.21.15.22:0/482014950 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2a0070340 msgr2=0x7fe2a00b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:23.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.418+0000 7fe29e7fc700 1 --2- 172.21.15.22:0/482014950 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2a0070340 0x7fe2a00b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:23.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.418+0000 7fe29e7fc700 1 -- 172.21.15.22:0/482014950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2a0157f10 msgr2=0x7fe2a015cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:23.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.418+0000 7fe29e7fc700 1 --2- 172.21.15.22:0/482014950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2a0157f10 0x7fe2a015cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:23.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.418+0000 7fe29e7fc700 1 -- 172.21.15.22:0/482014950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe290009550 con 0x7fe2a0070a50 2023-07-11T00:31:23.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.418+0000 7fe29e7fc700 1 --2- 172.21.15.22:0/482014950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2a0070a50 0x7fe2a0155d20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe29400c500 tx=0x7fe29400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:23.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.418+0000 7fe2877fe700 1 -- 172.21.15.22:0/482014950 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe294005cb0 con 0x7fe2a0070a50 2023-07-11T00:31:23.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.418+0000 7fe2877fe700 1 -- 172.21.15.22:0/482014950 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe294005e10 con 0x7fe2a0070a50 2023-07-11T00:31:23.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.418+0000 7fe2877fe700 1 -- 172.21.15.22:0/482014950 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2940072d0 con 0x7fe2a0070a50 2023-07-11T00:31:23.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.418+0000 7fe2a53ff700 1 -- 172.21.15.22:0/482014950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a00c6df0 con 0x7fe2a0070a50 2023-07-11T00:31:23.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.419+0000 7fe2a53ff700 1 -- 172.21.15.22:0/482014950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a0156260 con 0x7fe2a0070a50 2023-07-11T00:31:23.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.420+0000 7fe2a53ff700 1 -- 172.21.15.22:0/482014950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a004ea60 con 0x7fe2a0070a50 2023-07-11T00:31:23.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.420+0000 7fe2877fe700 1 -- 172.21.15.22:0/482014950 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe294007430 con 0x7fe2a0070a50 2023-07-11T00:31:23.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.422+0000 7fe2877fe700 1 --2- 172.21.15.22:0/482014950 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe28c06ace0 0x7fe28c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:23.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.422+0000 7fe2877fe700 1 -- 172.21.15.22:0/482014950 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe294088980 con 0x7fe2a0070a50 2023-07-11T00:31:23.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.422+0000 7fe29effd700 1 --2- 172.21.15.22:0/482014950 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe28c06ace0 0x7fe28c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:23.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.423+0000 7fe29effd700 1 --2- 172.21.15.22:0/482014950 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe28c06ace0 0x7fe28c06d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe290000c00 tx=0x7fe290008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:23.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.426+0000 7fe2877fe700 1 -- 172.21.15.22:0/482014950 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe2940537a0 con 0x7fe2a0070a50 2023-07-11T00:31:23.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.634+0000 7fe2a53ff700 1 -- 172.21.15.22:0/482014950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2a00cb9e0 con 0x7fe2a0070a50 2023-07-11T00:31:23.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.636+0000 7fe2877fe700 1 -- 172.21.15.22:0/482014950 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20158 (secure 0 0 0) 0x7fe294056dc0 con 0x7fe2a0070a50 2023-07-11T00:31:23.638 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:23.639 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:54.208536+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:31:23.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.638+0000 7fe2a53ff700 1 -- 172.21.15.22:0/482014950 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe28c06ace0 msgr2=0x7fe28c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:23.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.638+0000 7fe2a53ff700 1 --2- 172.21.15.22:0/482014950 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe28c06ace0 0x7fe28c06d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe290000c00 tx=0x7fe290008030 comp rx=0 tx=0).stop 2023-07-11T00:31:23.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.638+0000 7fe2a53ff700 1 -- 172.21.15.22:0/482014950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2a0070a50 msgr2=0x7fe2a0155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:23.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.638+0000 7fe2a53ff700 1 --2- 172.21.15.22:0/482014950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2a0070a50 0x7fe2a0155d20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe29400c500 tx=0x7fe29400c810 comp rx=0 tx=0).stop 2023-07-11T00:31:23.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.638+0000 7fe2a53ff700 1 -- 172.21.15.22:0/482014950 shutdown_connections 2023-07-11T00:31:23.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.638+0000 7fe2a53ff700 1 --2- 172.21.15.22:0/482014950 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe28c06ace0 0x7fe28c06d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:23.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.638+0000 7fe2a53ff700 1 --2- 172.21.15.22:0/482014950 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2a0070340 0x7fe2a00b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:23.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.638+0000 7fe2a53ff700 1 --2- 172.21.15.22:0/482014950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2a0157f10 0x7fe2a015cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:23.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.638+0000 7fe2a53ff700 1 --2- 172.21.15.22:0/482014950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2a0070a50 0x7fe2a0155d20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:23.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.638+0000 7fe2a53ff700 1 -- 172.21.15.22:0/482014950 >> 172.21.15.22:0/482014950 conn(0x7fe2a00b0390 msgr2=0x7fe2a00cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:23.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.638+0000 7fe2a53ff700 1 -- 172.21.15.22:0/482014950 shutdown_connections 2023-07-11T00:31:23.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.638+0000 7fe2a53ff700 1 -- 172.21.15.22:0/482014950 wait complete. 2023-07-11T00:31:23.659 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:29:57.631007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:29:58.547599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:30:03.826184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:30:04.383448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-11T00:30:08.075875+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-11T00:31:23.660 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:31:23.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.862+0000 7f69829ff700 1 Processor -- start 2023-07-11T00:31:23.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.862+0000 7f69829ff700 1 -- start start 2023-07-11T00:31:23.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.863+0000 7f69829ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f697c0d3730 0x7f697c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:23.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.863+0000 7f69829ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f697c0cfa90 0x7f697c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:23.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.863+0000 7f69829ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697c0d0b20 con 0x7f697c0b8430 2023-07-11T00:31:23.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.864+0000 7f69829ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c0cda30 con 0x7f697c0d3730 2023-07-11T00:31:23.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.864+0000 7f69829ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c0b8800 con 0x7f697c0cfa90 2023-07-11T00:31:23.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.864+0000 7f697b7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f697c0d3730 0x7f697c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:23.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.864+0000 7f697b7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f697c0d3730 0x7f697c0cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46398/0 (socket says 172.21.15.22:46398) 2023-07-11T00:31:23.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.864+0000 7f697b7fe700 1 -- 172.21.15.22:0/2920983644 learned_addr learned my addr 172.21.15.22:0/2920983644 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:23.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.864+0000 7f6980f9c700 1 --2- 172.21.15.22:0/2920983644 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f697c0cfa90 0x7f697c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:23.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.864+0000 7f697b7fe700 1 -- 172.21.15.22:0/2920983644 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f697c0cfa90 msgr2=0x7f697c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:23.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.864+0000 7f697b7fe700 1 --2- 172.21.15.22:0/2920983644 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f697c0cfa90 0x7f697c0d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:23.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.864+0000 7f697b7fe700 1 -- 172.21.15.22:0/2920983644 >> v1:172.21.15.184:6789/0 conn(0x7f697c0b8430 legacy=0x7f697c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:23.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.864+0000 7f697b7fe700 1 -- 172.21.15.22:0/2920983644 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c0cfeb0 con 0x7f697c0d3730 2023-07-11T00:31:23.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.864+0000 7f697affd700 1 -- 172.21.15.22:0/2920983644 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605998070 0 0) 0x7f697c0d0b20 con 0x7f697c0b8430 2023-07-11T00:31:23.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.865+0000 7f697b7fe700 1 --2- 172.21.15.22:0/2920983644 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f697c0d3730 0x7f697c0cf550 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f69700098f0 tx=0x7f6970009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99a8228b7486d05 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:23.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.865+0000 7f697affd700 1 -- 172.21.15.22:0/2920983644 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6970011830 con 0x7f697c0d3730 2023-07-11T00:31:23.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.865+0000 7f697affd700 1 -- 172.21.15.22:0/2920983644 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6970011990 con 0x7f697c0d3730 2023-07-11T00:31:23.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.865+0000 7f697affd700 1 -- 172.21.15.22:0/2920983644 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6970011d20 con 0x7f697c0d3730 2023-07-11T00:31:23.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.865+0000 7f69829ff700 1 -- 172.21.15.22:0/2920983644 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f697c0d3730 msgr2=0x7f697c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:23.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.865+0000 7f69829ff700 1 --2- 172.21.15.22:0/2920983644 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f697c0d3730 0x7f697c0cf550 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f69700098f0 tx=0x7f6970009c00 comp rx=0 tx=0).stop 2023-07-11T00:31:23.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.866+0000 7f69829ff700 1 -- 172.21.15.22:0/2920983644 shutdown_connections 2023-07-11T00:31:23.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.866+0000 7f69829ff700 1 --2- 172.21.15.22:0/2920983644 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f697c0cfa90 0x7f697c0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:23.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.866+0000 7f69829ff700 1 --2- 172.21.15.22:0/2920983644 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f697c0d3730 0x7f697c0cf550 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:23.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.866+0000 7f69829ff700 1 -- 172.21.15.22:0/2920983644 >> 172.21.15.22:0/2920983644 conn(0x7f697c06b3f0 msgr2=0x7f697c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:23.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.866+0000 7f69829ff700 1 -- 172.21.15.22:0/2920983644 shutdown_connections 2023-07-11T00:31:23.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.866+0000 7f69829ff700 1 -- 172.21.15.22:0/2920983644 wait complete. 2023-07-11T00:31:23.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.867+0000 7f69829ff700 1 Processor -- start 2023-07-11T00:31:23.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.868+0000 7f69829ff700 1 -- start start 2023-07-11T00:31:23.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f69829ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f697c0b8430 0x7f697c15c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:23.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f69829ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f697c0cfa90 0x7f697c15c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:23.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f69829ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f697c0d3730 0x7f697c1f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:23.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f69829ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c1f1ad0 con 0x7f697c0b8430 2023-07-11T00:31:23.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f69829ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c0d1550 con 0x7f697c0d3730 2023-07-11T00:31:23.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f69829ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c0ccc20 con 0x7f697c0cfa90 2023-07-11T00:31:23.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f697bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f697c0b8430 0x7f697c15c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f697bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f697c0b8430 0x7f697c15c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46400/0 (socket says 172.21.15.22:46400) 2023-07-11T00:31:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f697bfff700 1 -- 172.21.15.22:0/2018272981 learned_addr learned my addr 172.21.15.22:0/2018272981 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f697b7fe700 1 --2- 172.21.15.22:0/2018272981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f697c0cfa90 0x7f697c15c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f6980f9c700 1 --2- 172.21.15.22:0/2018272981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f697c0d3730 0x7f697c1f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f697bfff700 1 -- 172.21.15.22:0/2018272981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f697c0cfa90 msgr2=0x7f697c15c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f697bfff700 1 --2- 172.21.15.22:0/2018272981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f697c0cfa90 0x7f697c15c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f697bfff700 1 -- 172.21.15.22:0/2018272981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f697c0d3730 msgr2=0x7f697c1f1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f697bfff700 1 --2- 172.21.15.22:0/2018272981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f697c0d3730 0x7f697c1f1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:23.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f697bfff700 1 -- 172.21.15.22:0/2018272981 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970009550 con 0x7f697c0b8430 2023-07-11T00:31:23.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f6980f9c700 1 --2- 172.21.15.22:0/2018272981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f697c0d3730 0x7f697c1f1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:23.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.869+0000 7f697bfff700 1 --2- 172.21.15.22:0/2018272981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f697c0b8430 0x7f697c15c1e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f696c00c450 tx=0x7f696c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:23.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.870+0000 7f6978ff9700 1 -- 172.21.15.22:0/2018272981 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c0054e0 con 0x7f697c0b8430 2023-07-11T00:31:23.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.870+0000 7f6978ff9700 1 -- 172.21.15.22:0/2018272981 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c003680 con 0x7f697c0b8430 2023-07-11T00:31:23.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.870+0000 7f69829ff700 1 -- 172.21.15.22:0/2018272981 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697c15d3a0 con 0x7f697c0b8430 2023-07-11T00:31:23.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.870+0000 7f6978ff9700 1 -- 172.21.15.22:0/2018272981 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c003a30 con 0x7f697c0b8430 2023-07-11T00:31:23.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.870+0000 7f69829ff700 1 -- 172.21.15.22:0/2018272981 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697c0cce90 con 0x7f697c0b8430 2023-07-11T00:31:23.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.871+0000 7f69829ff700 1 -- 172.21.15.22:0/2018272981 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697c0cdec0 con 0x7f697c0b8430 2023-07-11T00:31:23.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.872+0000 7f6978ff9700 1 -- 172.21.15.22:0/2018272981 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f696c003b90 con 0x7f697c0b8430 2023-07-11T00:31:23.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.873+0000 7f6978ff9700 1 --2- 172.21.15.22:0/2018272981 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f696806ace0 0x7f696806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:23.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.873+0000 7f6978ff9700 1 -- 172.21.15.22:0/2018272981 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f696c088d20 con 0x7f697c0b8430 2023-07-11T00:31:23.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.873+0000 7f697b7fe700 1 --2- 172.21.15.22:0/2018272981 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f696806ace0 0x7f696806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:23.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.874+0000 7f697b7fe700 1 --2- 172.21.15.22:0/2018272981 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f696806ace0 0x7f696806d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6970009c40 tx=0x7f6970008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:23.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:23.877+0000 7f6978ff9700 1 -- 172.21.15.22:0/2018272981 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f696c053a00 con 0x7f697c0b8430 2023-07-11T00:31:24.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.085+0000 7f69829ff700 1 -- 172.21.15.22:0/2018272981 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f697c04ea60 con 0x7f697c0b8430 2023-07-11T00:31:24.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.085+0000 7f6978ff9700 1 -- 172.21.15.22:0/2018272981 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f696c0170a0 con 0x7f697c0b8430 2023-07-11T00:31:24.088 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2023-07-11T00:31:24.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.087+0000 7f69829ff700 1 -- 172.21.15.22:0/2018272981 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f696806ace0 msgr2=0x7f696806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:24.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.087+0000 7f69829ff700 1 --2- 172.21.15.22:0/2018272981 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f696806ace0 0x7f696806d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6970009c40 tx=0x7f6970008030 comp rx=0 tx=0).stop 2023-07-11T00:31:24.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.087+0000 7f69829ff700 1 -- 172.21.15.22:0/2018272981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f697c0b8430 msgr2=0x7f697c15c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:24.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.087+0000 7f69829ff700 1 --2- 172.21.15.22:0/2018272981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f697c0b8430 0x7f697c15c1e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f696c00c450 tx=0x7f696c00c810 comp rx=0 tx=0).stop 2023-07-11T00:31:24.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.087+0000 7f69829ff700 1 -- 172.21.15.22:0/2018272981 shutdown_connections 2023-07-11T00:31:24.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.087+0000 7f69829ff700 1 --2- 172.21.15.22:0/2018272981 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f696806ace0 0x7f696806d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.087+0000 7f69829ff700 1 --2- 172.21.15.22:0/2018272981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f697c0d3730 0x7f697c1f1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.087+0000 7f69829ff700 1 --2- 172.21.15.22:0/2018272981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f697c0b8430 0x7f697c15c1e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.087+0000 7f69829ff700 1 --2- 172.21.15.22:0/2018272981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f697c0cfa90 0x7f697c15c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.087+0000 7f69829ff700 1 -- 172.21.15.22:0/2018272981 >> 172.21.15.22:0/2018272981 conn(0x7f697c06b3f0 msgr2=0x7f697c0b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:24.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.087+0000 7f69829ff700 1 -- 172.21.15.22:0/2018272981 shutdown_connections 2023-07-11T00:31:24.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.087+0000 7f69829ff700 1 -- 172.21.15.22:0/2018272981 wait complete. 2023-07-11T00:31:24.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:31:24.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.313+0000 7ff47b9ff700 1 Processor -- start 2023-07-11T00:31:24.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.313+0000 7ff47b9ff700 1 -- start start 2023-07-11T00:31:24.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.314+0000 7ff47b9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4740b8430 0x7ff4740cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.314+0000 7ff47b9ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff4740cfc60 0x7ff4740d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.314+0000 7ff47b9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4740d0b20 con 0x7ff4740d3730 2023-07-11T00:31:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.314+0000 7ff47b9ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4740b8800 con 0x7ff4740cfc60 2023-07-11T00:31:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.314+0000 7ff47b9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740b4ee0 con 0x7ff4740b8430 2023-07-11T00:31:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.314+0000 7ff479f9c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff4740cfc60 0x7ff4740d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.315+0000 7ff479f9c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff4740cfc60 0x7ff4740d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46404/0 (socket says 172.21.15.22:46404) 2023-07-11T00:31:24.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.315+0000 7ff479f9c700 1 -- 172.21.15.22:0/2964951107 learned_addr learned my addr 172.21.15.22:0/2964951107 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:24.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.315+0000 7ff47979b700 1 --2- 172.21.15.22:0/2964951107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4740b8430 0x7ff4740cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:24.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.315+0000 7ff479f9c700 1 -- 172.21.15.22:0/2964951107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4740b8430 msgr2=0x7ff4740cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:24.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.315+0000 7ff479f9c700 1 --2- 172.21.15.22:0/2964951107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4740b8430 0x7ff4740cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.315+0000 7ff479f9c700 1 -- 172.21.15.22:0/2964951107 >> v1:172.21.15.184:6789/0 conn(0x7ff4740d3730 legacy=0x7ff4740cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.315+0000 7ff479f9c700 1 -- 172.21.15.22:0/2964951107 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4740b51c0 con 0x7ff4740cfc60 2023-07-11T00:31:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.315+0000 7ff479f9c700 1 --2- 172.21.15.22:0/2964951107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4740cfc60 0x7ff4740d0fb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff46c009e50 tx=0x7ff46c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd195804a196a9d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.315+0000 7ff46bfff700 1 -- 172.21.15.22:0/2964951107 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c00e070 con 0x7ff4740cfc60 2023-07-11T00:31:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.316+0000 7ff46bfff700 1 -- 172.21.15.22:0/2964951107 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c00b9c0 con 0x7ff4740cfc60 2023-07-11T00:31:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.316+0000 7ff46bfff700 1 -- 172.21.15.22:0/2964951107 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c00bd70 con 0x7ff4740cfc60 2023-07-11T00:31:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.316+0000 7ff47b9ff700 1 -- 172.21.15.22:0/2964951107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4740cfc60 msgr2=0x7ff4740d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.316+0000 7ff47b9ff700 1 --2- 172.21.15.22:0/2964951107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4740cfc60 0x7ff4740d0fb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff46c009e50 tx=0x7ff46c00b330 comp rx=0 tx=0).stop 2023-07-11T00:31:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.316+0000 7ff47b9ff700 1 -- 172.21.15.22:0/2964951107 shutdown_connections 2023-07-11T00:31:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.316+0000 7ff47b9ff700 1 --2- 172.21.15.22:0/2964951107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4740cfc60 0x7ff4740d0fb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.316+0000 7ff47b9ff700 1 --2- 172.21.15.22:0/2964951107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4740b8430 0x7ff4740cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.316+0000 7ff47b9ff700 1 -- 172.21.15.22:0/2964951107 >> 172.21.15.22:0/2964951107 conn(0x7ff47406b3f0 msgr2=0x7ff47406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:24.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.316+0000 7ff47b9ff700 1 -- 172.21.15.22:0/2964951107 shutdown_connections 2023-07-11T00:31:24.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.316+0000 7ff47b9ff700 1 -- 172.21.15.22:0/2964951107 wait complete. 2023-07-11T00:31:24.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.318+0000 7ff47b9ff700 1 Processor -- start 2023-07-11T00:31:24.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.318+0000 7ff47b9ff700 1 -- start start 2023-07-11T00:31:24.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.319+0000 7ff47b9ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4740b8430 0x7ff47415c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:24.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.319+0000 7ff47b9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4740cfc60 0x7ff47415cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:24.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.319+0000 7ff47b9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4740d3730 0x7ff47415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.319+0000 7ff47b9ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47415d9c0 con 0x7ff4740b8430 2023-07-11T00:31:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.319+0000 7ff47b9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4741e6200 con 0x7ff4740cfc60 2023-07-11T00:31:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.319+0000 7ff47b9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740c9720 con 0x7ff4740d3730 2023-07-11T00:31:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.319+0000 7ff47979b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4740b8430 0x7ff47415c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.319+0000 7ff47979b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4740b8430 0x7ff47415c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46416/0 (socket says 172.21.15.22:46416) 2023-07-11T00:31:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.319+0000 7ff47979b700 1 -- 172.21.15.22:0/2117515070 learned_addr learned my addr 172.21.15.22:0/2117515070 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.320+0000 7ff47979b700 1 -- 172.21.15.22:0/2117515070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4740d3730 msgr2=0x7ff47415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.320+0000 7ff47979b700 1 --2- 172.21.15.22:0/2117515070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4740d3730 0x7ff47415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.320+0000 7ff47979b700 1 -- 172.21.15.22:0/2117515070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4740cfc60 msgr2=0x7ff47415cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.320+0000 7ff47979b700 1 --2- 172.21.15.22:0/2117515070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4740cfc60 0x7ff47415cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.320+0000 7ff47979b700 1 -- 172.21.15.22:0/2117515070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c009b30 con 0x7ff4740b8430 2023-07-11T00:31:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.320+0000 7ff47979b700 1 --2- 172.21.15.22:0/2117515070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4740b8430 0x7ff47415c890 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff47000e810 tx=0x7ff47000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.320+0000 7ff469ffb700 1 -- 172.21.15.22:0/2117515070 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff470013610 con 0x7ff4740b8430 2023-07-11T00:31:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.320+0000 7ff469ffb700 1 -- 172.21.15.22:0/2117515070 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff470013770 con 0x7ff4740b8430 2023-07-11T00:31:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.320+0000 7ff469ffb700 1 -- 172.21.15.22:0/2117515070 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff470013b00 con 0x7ff4740b8430 2023-07-11T00:31:24.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.320+0000 7ff47b9ff700 1 -- 172.21.15.22:0/2117515070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47415d400 con 0x7ff4740b8430 2023-07-11T00:31:24.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.320+0000 7ff47b9ff700 1 -- 172.21.15.22:0/2117515070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4741e5e90 con 0x7ff4740b8430 2023-07-11T00:31:24.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.321+0000 7ff47b9ff700 1 -- 172.21.15.22:0/2117515070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4741e5cf0 con 0x7ff4740b8430 2023-07-11T00:31:24.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.322+0000 7ff469ffb700 1 -- 172.21.15.22:0/2117515070 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff470013c60 con 0x7ff4740b8430 2023-07-11T00:31:24.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.323+0000 7ff469ffb700 1 --2- 172.21.15.22:0/2117515070 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff45806ace0 0x7ff45806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:24.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.323+0000 7ff469ffb700 1 -- 172.21.15.22:0/2117515070 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff4700894d0 con 0x7ff4740b8430 2023-07-11T00:31:24.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.324+0000 7ff478f9a700 1 --2- 172.21.15.22:0/2117515070 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff45806ace0 0x7ff45806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:24.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.325+0000 7ff478f9a700 1 --2- 172.21.15.22:0/2117515070 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff45806ace0 0x7ff45806d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff464000f60 tx=0x7ff464007a40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:24.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.327+0000 7ff469ffb700 1 -- 172.21.15.22:0/2117515070 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff4741e5cf0 con 0x7ff4740b8430 2023-07-11T00:31:24.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.537+0000 7ff47b9ff700 1 -- 172.21.15.22:0/2117515070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4741e5cf0 con 0x7ff4740b8430 2023-07-11T00:31:24.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.537+0000 7ff469ffb700 1 -- 172.21.15.22:0/2117515070 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff4741e5cf0 con 0x7ff4740b8430 2023-07-11T00:31:24.540 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-07-11T00:31:24.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.540+0000 7ff47b9ff700 1 -- 172.21.15.22:0/2117515070 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff45806ace0 msgr2=0x7ff45806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:24.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.540+0000 7ff47b9ff700 1 --2- 172.21.15.22:0/2117515070 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff45806ace0 0x7ff45806d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff464000f60 tx=0x7ff464007a40 comp rx=0 tx=0).stop 2023-07-11T00:31:24.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.540+0000 7ff47b9ff700 1 -- 172.21.15.22:0/2117515070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4740b8430 msgr2=0x7ff47415c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:24.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.540+0000 7ff47b9ff700 1 --2- 172.21.15.22:0/2117515070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4740b8430 0x7ff47415c890 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff47000e810 tx=0x7ff47000ebd0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.540+0000 7ff47b9ff700 1 -- 172.21.15.22:0/2117515070 shutdown_connections 2023-07-11T00:31:24.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.540+0000 7ff47b9ff700 1 --2- 172.21.15.22:0/2117515070 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff45806ace0 0x7ff45806d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.540+0000 7ff47b9ff700 1 --2- 172.21.15.22:0/2117515070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4740d3730 0x7ff47415dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.540+0000 7ff47b9ff700 1 --2- 172.21.15.22:0/2117515070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4740b8430 0x7ff47415c890 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.540+0000 7ff47b9ff700 1 --2- 172.21.15.22:0/2117515070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4740cfc60 0x7ff47415cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.540+0000 7ff47b9ff700 1 -- 172.21.15.22:0/2117515070 >> 172.21.15.22:0/2117515070 conn(0x7ff47406b3f0 msgr2=0x7ff47415fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:24.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.540+0000 7ff47b9ff700 1 -- 172.21.15.22:0/2117515070 shutdown_connections 2023-07-11T00:31:24.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.540+0000 7ff47b9ff700 1 -- 172.21.15.22:0/2117515070 wait complete. 2023-07-11T00:31:24.561 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:31:24.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.764+0000 7fa0245ff700 1 Processor -- start 2023-07-11T00:31:24.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.764+0000 7fa0245ff700 1 -- start start 2023-07-11T00:31:24.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.765+0000 7fa0245ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa01c0b8430 0x7fa01c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:24.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.765+0000 7fa0245ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa01c0d3730 0x7fa01c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:24.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.765+0000 7fa0245ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa01c0cfa90 0x7fa01c15feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:24.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.765+0000 7fa0245ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01c0b8800 con 0x7fa01c0b8430 2023-07-11T00:31:24.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.765+0000 7fa0245ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01c0d0b20 con 0x7fa01c0d3730 2023-07-11T00:31:24.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.765+0000 7fa0245ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c0cfeb0 con 0x7fa01c0cfa90 2023-07-11T00:31:24.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.766+0000 7fa02239b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa01c0b8430 0x7fa01c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:24.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.766+0000 7fa02239b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa01c0b8430 0x7fa01c0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46424/0 (socket says 172.21.15.22:46424) 2023-07-11T00:31:24.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.766+0000 7fa02239b700 1 -- 172.21.15.22:0/308442354 learned_addr learned my addr 172.21.15.22:0/308442354 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:24.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.766+0000 7fa022b9c700 1 --2- 172.21.15.22:0/308442354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa01c0cfa90 0x7fa01c15feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:24.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.766+0000 7fa021b9a700 1 --2- 172.21.15.22:0/308442354 >> v2:172.21.15.184:3300/0 conn(0x7fa01c0d3730 0x7fa01c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:24.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.766+0000 7fa02239b700 1 -- 172.21.15.22:0/308442354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa01c0cfa90 msgr2=0x7fa01c15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:24.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.766+0000 7fa02239b700 1 --2- 172.21.15.22:0/308442354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa01c0cfa90 0x7fa01c15feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.766+0000 7fa02239b700 1 -- 172.21.15.22:0/308442354 >> v2:172.21.15.184:3300/0 conn(0x7fa01c0d3730 msgr2=0x7fa01c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:24.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.766+0000 7fa02239b700 1 --2- 172.21.15.22:0/308442354 >> v2:172.21.15.184:3300/0 conn(0x7fa01c0d3730 0x7fa01c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.766+0000 7fa02239b700 1 -- 172.21.15.22:0/308442354 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c0b4ee0 con 0x7fa01c0b8430 2023-07-11T00:31:24.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.767+0000 7fa02239b700 1 --2- 172.21.15.22:0/308442354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa01c0b8430 0x7fa01c0cd320 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa01c160f50 tx=0x7fa018009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33752b24d4f31fc7 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:24.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.767+0000 7fa021399700 1 -- 172.21.15.22:0/308442354 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa018011830 con 0x7fa01c0b8430 2023-07-11T00:31:24.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.767+0000 7fa021399700 1 -- 172.21.15.22:0/308442354 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa018011990 con 0x7fa01c0b8430 2023-07-11T00:31:24.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.767+0000 7fa021399700 1 -- 172.21.15.22:0/308442354 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa018011d20 con 0x7fa01c0b8430 2023-07-11T00:31:24.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.767+0000 7fa0245ff700 1 -- 172.21.15.22:0/308442354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa01c0b8430 msgr2=0x7fa01c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:24.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.767+0000 7fa0245ff700 1 --2- 172.21.15.22:0/308442354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa01c0b8430 0x7fa01c0cd320 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa01c160f50 tx=0x7fa018009bd0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.768+0000 7fa0245ff700 1 -- 172.21.15.22:0/308442354 shutdown_connections 2023-07-11T00:31:24.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.768+0000 7fa0245ff700 1 --2- 172.21.15.22:0/308442354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa01c0cfa90 0x7fa01c15feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.768+0000 7fa0245ff700 1 --2- 172.21.15.22:0/308442354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa01c0b8430 0x7fa01c0cd320 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.768+0000 7fa0245ff700 1 --2- 172.21.15.22:0/308442354 >> v2:172.21.15.184:3300/0 conn(0x7fa01c0d3730 0x7fa01c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.768+0000 7fa0245ff700 1 -- 172.21.15.22:0/308442354 >> 172.21.15.22:0/308442354 conn(0x7fa01c06b3f0 msgr2=0x7fa01c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:24.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.768+0000 7fa0245ff700 1 -- 172.21.15.22:0/308442354 shutdown_connections 2023-07-11T00:31:24.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.768+0000 7fa0245ff700 1 -- 172.21.15.22:0/308442354 wait complete. 2023-07-11T00:31:24.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.769+0000 7fa0245ff700 1 Processor -- start 2023-07-11T00:31:24.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.770+0000 7fa0245ff700 1 -- start start 2023-07-11T00:31:24.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.770+0000 7fa0245ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa01c0b8430 0x7fa01c15df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:24.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.771+0000 7fa0245ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa01c0cfa90 0x7fa01c0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:24.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.771+0000 7fa0245ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa01c0d3730 0x7fa01c14ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:24.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.771+0000 7fa0245ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c15cea0 con 0x7fa01c0d3730 2023-07-11T00:31:24.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.771+0000 7fa0245ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c15d180 con 0x7fa01c0cfa90 2023-07-11T00:31:24.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.771+0000 7fa0245ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c15d460 con 0x7fa01c0b8430 2023-07-11T00:31:24.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.771+0000 7fa022b9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa01c0d3730 0x7fa01c14ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:24.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.771+0000 7fa022b9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa01c0d3730 0x7fa01c14ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46436/0 (socket says 172.21.15.22:46436) 2023-07-11T00:31:24.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.771+0000 7fa022b9c700 1 -- 172.21.15.22:0/1539125743 learned_addr learned my addr 172.21.15.22:0/1539125743 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:24.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.771+0000 7fa02239b700 1 --2- 172.21.15.22:0/1539125743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa01c0b8430 0x7fa01c15df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:24.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.771+0000 7fa021b9a700 1 --2- 172.21.15.22:0/1539125743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa01c0cfa90 0x7fa01c0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:24.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.771+0000 7fa022b9c700 1 -- 172.21.15.22:0/1539125743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa01c0b8430 msgr2=0x7fa01c15df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:24.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.771+0000 7fa022b9c700 1 --2- 172.21.15.22:0/1539125743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa01c0b8430 0x7fa01c15df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.771+0000 7fa022b9c700 1 -- 172.21.15.22:0/1539125743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa01c0cfa90 msgr2=0x7fa01c0c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:24.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.771+0000 7fa022b9c700 1 --2- 172.21.15.22:0/1539125743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa01c0cfa90 0x7fa01c0c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.771+0000 7fa022b9c700 1 -- 172.21.15.22:0/1539125743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa018009550 con 0x7fa01c0d3730 2023-07-11T00:31:24.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.772+0000 7fa022b9c700 1 --2- 172.21.15.22:0/1539125743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa01c0d3730 0x7fa01c14ae30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa01400efc0 tx=0x7fa01400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:24.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.772+0000 7fa012ffd700 1 -- 172.21.15.22:0/1539125743 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01400cad0 con 0x7fa01c0d3730 2023-07-11T00:31:24.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.772+0000 7fa012ffd700 1 -- 172.21.15.22:0/1539125743 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01400f040 con 0x7fa01c0d3730 2023-07-11T00:31:24.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.772+0000 7fa012ffd700 1 -- 172.21.15.22:0/1539125743 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01400ce70 con 0x7fa01c0d3730 2023-07-11T00:31:24.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.772+0000 7fa0245ff700 1 -- 172.21.15.22:0/1539125743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01c15d740 con 0x7fa01c0d3730 2023-07-11T00:31:24.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.772+0000 7fa0245ff700 1 -- 172.21.15.22:0/1539125743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01c0c7710 con 0x7fa01c0d3730 2023-07-11T00:31:24.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.773+0000 7fa0245ff700 1 -- 172.21.15.22:0/1539125743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01c15dc60 con 0x7fa01c0d3730 2023-07-11T00:31:24.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.774+0000 7fa012ffd700 1 -- 172.21.15.22:0/1539125743 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa014014480 con 0x7fa01c0d3730 2023-07-11T00:31:24.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.775+0000 7fa012ffd700 1 --2- 172.21.15.22:0/1539125743 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa00006ace0 0x7fa00006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:24.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.775+0000 7fa012ffd700 1 -- 172.21.15.22:0/1539125743 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa014089fb0 con 0x7fa01c0d3730 2023-07-11T00:31:24.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.775+0000 7fa02239b700 1 --2- 172.21.15.22:0/1539125743 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa00006ace0 0x7fa00006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:24.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.776+0000 7fa02239b700 1 --2- 172.21.15.22:0/1539125743 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa00006ace0 0x7fa00006d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa018014040 tx=0x7fa018008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:24.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.779+0000 7fa012ffd700 1 -- 172.21.15.22:0/1539125743 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa01c15dc60 con 0x7fa01c0d3730 2023-07-11T00:31:24.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.987+0000 7fa0245ff700 1 -- 172.21.15.22:0/1539125743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa01c15dc60 con 0x7fa01c0d3730 2023-07-11T00:31:24.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.987+0000 7fa012ffd700 1 -- 172.21.15.22:0/1539125743 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa01c15dc60 con 0x7fa01c0d3730 2023-07-11T00:31:24.991 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:24.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.990+0000 7fa0245ff700 1 -- 172.21.15.22:0/1539125743 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa00006ace0 msgr2=0x7fa00006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:24.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.990+0000 7fa0245ff700 1 --2- 172.21.15.22:0/1539125743 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa00006ace0 0x7fa00006d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa018014040 tx=0x7fa018008030 comp rx=0 tx=0).stop 2023-07-11T00:31:24.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.990+0000 7fa0245ff700 1 -- 172.21.15.22:0/1539125743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa01c0d3730 msgr2=0x7fa01c14ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:24.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.990+0000 7fa0245ff700 1 --2- 172.21.15.22:0/1539125743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa01c0d3730 0x7fa01c14ae30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa01400efc0 tx=0x7fa01400c0c0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.990+0000 7fa0245ff700 1 -- 172.21.15.22:0/1539125743 shutdown_connections 2023-07-11T00:31:24.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.990+0000 7fa0245ff700 1 --2- 172.21.15.22:0/1539125743 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa00006ace0 0x7fa00006d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.990+0000 7fa0245ff700 1 --2- 172.21.15.22:0/1539125743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa01c0b8430 0x7fa01c15df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.990+0000 7fa0245ff700 1 --2- 172.21.15.22:0/1539125743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa01c0d3730 0x7fa01c14ae30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.990+0000 7fa0245ff700 1 --2- 172.21.15.22:0/1539125743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa01c0cfa90 0x7fa01c0c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:24.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.990+0000 7fa0245ff700 1 -- 172.21.15.22:0/1539125743 >> 172.21.15.22:0/1539125743 conn(0x7fa01c06b3f0 msgr2=0x7fa01c0cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:24.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.990+0000 7fa0245ff700 1 -- 172.21.15.22:0/1539125743 shutdown_connections 2023-07-11T00:31:24.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:24.990+0000 7fa0245ff700 1 -- 172.21.15.22:0/1539125743 wait complete. 2023-07-11T00:31:25.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:31:25.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.217+0000 7ff7b67ff700 1 Processor -- start 2023-07-11T00:31:25.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.217+0000 7ff7b67ff700 1 -- start start 2023-07-11T00:31:25.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.218+0000 7ff7b67ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff7b00d3730 0x7ff7b00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:25.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.218+0000 7ff7b67ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b00d0b20 con 0x7ff7b00b8430 2023-07-11T00:31:25.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.218+0000 7ff7b67ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b00cfe90 con 0x7ff7b00cfa90 2023-07-11T00:31:25.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.218+0000 7ff7b67ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b00cda30 con 0x7ff7b00d3730 2023-07-11T00:31:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.218+0000 7ff7af7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff7b00d3730 0x7ff7b00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.218+0000 7ff7af7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff7b00d3730 0x7ff7b00cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46444/0 (socket says 172.21.15.22:46444) 2023-07-11T00:31:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.218+0000 7ff7af7fe700 1 -- 172.21.15.22:0/1872612067 learned_addr learned my addr 172.21.15.22:0/1872612067 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.218+0000 7ff7affff700 1 --1- 172.21.15.22:0/1872612067 >> v1:172.21.15.22:6789/0 conn(0x7ff7b00b8430 0x7ff7b00cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42732/0 (socket says 172.21.15.22:42732) 2023-07-11T00:31:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.219+0000 7ff7af7fe700 1 -- 172.21.15.22:0/1872612067 >> v1:172.21.15.184:6789/0 conn(0x7ff7b00cfa90 legacy=0x7ff7b00d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.219+0000 7ff7af7fe700 1 -- 172.21.15.22:0/1872612067 >> v1:172.21.15.22:6789/0 conn(0x7ff7b00b8430 legacy=0x7ff7b00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.219+0000 7ff7af7fe700 1 -- 172.21.15.22:0/1872612067 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b00b4ee0 con 0x7ff7b00d3730 2023-07-11T00:31:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.219+0000 7ff7aeffd700 1 -- 172.21.15.22:0/1872612067 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250939045 0 0) 0x7ff7b00d0b20 con 0x7ff7b00b8430 2023-07-11T00:31:25.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.219+0000 7ff7af7fe700 1 --2- 172.21.15.22:0/1872612067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b00d3730 0x7ff7b00cf550 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40098f0 tx=0x7ff7a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2898bf71e621ea7 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:25.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.219+0000 7ff7aeffd700 1 -- 172.21.15.22:0/1872612067 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400b8a0 con 0x7ff7b00d3730 2023-07-11T00:31:25.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.219+0000 7ff7aeffd700 1 -- 172.21.15.22:0/1872612067 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a400ba00 con 0x7ff7b00d3730 2023-07-11T00:31:25.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.219+0000 7ff7aeffd700 1 -- 172.21.15.22:0/1872612067 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400bd90 con 0x7ff7b00d3730 2023-07-11T00:31:25.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.220+0000 7ff7b67ff700 1 -- 172.21.15.22:0/1872612067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b00d3730 msgr2=0x7ff7b00cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:25.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.220+0000 7ff7b67ff700 1 --2- 172.21.15.22:0/1872612067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b00d3730 0x7ff7b00cf550 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40098f0 tx=0x7ff7a4009c00 comp rx=0 tx=0).stop 2023-07-11T00:31:25.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.220+0000 7ff7b67ff700 1 -- 172.21.15.22:0/1872612067 shutdown_connections 2023-07-11T00:31:25.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.220+0000 7ff7b67ff700 1 --2- 172.21.15.22:0/1872612067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b00d3730 0x7ff7b00cf550 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:25.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.220+0000 7ff7b67ff700 1 -- 172.21.15.22:0/1872612067 >> 172.21.15.22:0/1872612067 conn(0x7ff7b006b3f0 msgr2=0x7ff7b006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:25.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.220+0000 7ff7b67ff700 1 -- 172.21.15.22:0/1872612067 shutdown_connections 2023-07-11T00:31:25.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.220+0000 7ff7b67ff700 1 -- 172.21.15.22:0/1872612067 wait complete. 2023-07-11T00:31:25.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.222+0000 7ff7b67ff700 1 Processor -- start 2023-07-11T00:31:25.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.222+0000 7ff7b67ff700 1 -- start start 2023-07-11T00:31:25.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7b67ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b00b8430 0x7ff7b00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:25.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7b67ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7b00cfa90 0x7ff7b00cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:25.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7b67ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7b00d3730 0x7ff7b00d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:25.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7b67ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b015e2c0 con 0x7ff7b00b8430 2023-07-11T00:31:25.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7b67ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00cb250 con 0x7ff7b00cfa90 2023-07-11T00:31:25.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7b67ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00ccf20 con 0x7ff7b00d3730 2023-07-11T00:31:25.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7affff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b00b8430 0x7ff7b00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:25.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7affff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b00b8430 0x7ff7b00c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46458/0 (socket says 172.21.15.22:46458) 2023-07-11T00:31:25.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7affff700 1 -- 172.21.15.22:0/3695028026 learned_addr learned my addr 172.21.15.22:0/3695028026 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:25.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7af7fe700 1 --2- 172.21.15.22:0/3695028026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7b00cfa90 0x7ff7b00cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:25.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7b4d9c700 1 --2- 172.21.15.22:0/3695028026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7b00d3730 0x7ff7b00d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:25.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7affff700 1 -- 172.21.15.22:0/3695028026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7b00d3730 msgr2=0x7ff7b00d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:25.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7affff700 1 --2- 172.21.15.22:0/3695028026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7b00d3730 0x7ff7b00d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:25.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7affff700 1 -- 172.21.15.22:0/3695028026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7b00cfa90 msgr2=0x7ff7b00cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:25.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7affff700 1 --2- 172.21.15.22:0/3695028026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7b00cfa90 0x7ff7b00cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:25.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7affff700 1 -- 172.21.15.22:0/3695028026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a4009550 con 0x7ff7b00b8430 2023-07-11T00:31:25.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7af7fe700 1 --2- 172.21.15.22:0/3695028026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7b00cfa90 0x7ff7b00cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:25.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.223+0000 7ff7b4d9c700 1 --2- 172.21.15.22:0/3695028026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7b00d3730 0x7ff7b00d29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:25.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.224+0000 7ff7affff700 1 --2- 172.21.15.22:0/3695028026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b00b8430 0x7ff7b00c9c10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000c550 tx=0x7ff7a000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:25.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.224+0000 7ff7acff9700 1 -- 172.21.15.22:0/3695028026 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0004c80 con 0x7ff7b00b8430 2023-07-11T00:31:25.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.224+0000 7ff7acff9700 1 -- 172.21.15.22:0/3695028026 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a0004e00 con 0x7ff7b00b8430 2023-07-11T00:31:25.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.224+0000 7ff7b67ff700 1 -- 172.21.15.22:0/3695028026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b00ccc40 con 0x7ff7b00b8430 2023-07-11T00:31:25.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.224+0000 7ff7acff9700 1 -- 172.21.15.22:0/3695028026 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0007310 con 0x7ff7b00b8430 2023-07-11T00:31:25.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.224+0000 7ff7b67ff700 1 -- 172.21.15.22:0/3695028026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b015dee0 con 0x7ff7b00b8430 2023-07-11T00:31:25.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.225+0000 7ff7b67ff700 1 -- 172.21.15.22:0/3695028026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b015e400 con 0x7ff7b00b8430 2023-07-11T00:31:25.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.226+0000 7ff7acff9700 1 -- 172.21.15.22:0/3695028026 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff7a0007470 con 0x7ff7b00b8430 2023-07-11T00:31:25.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.228+0000 7ff7acff9700 1 --2- 172.21.15.22:0/3695028026 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff79c06ace0 0x7ff79c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:25.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.228+0000 7ff7acff9700 1 -- 172.21.15.22:0/3695028026 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff7a00894e0 con 0x7ff7b00b8430 2023-07-11T00:31:25.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.228+0000 7ff7af7fe700 1 --2- 172.21.15.22:0/3695028026 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff79c06ace0 0x7ff79c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:25.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.229+0000 7ff7af7fe700 1 --2- 172.21.15.22:0/3695028026 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff79c06ace0 0x7ff79c06d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00ca150 tx=0x7ff7a4008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:25.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.233+0000 7ff7acff9700 1 -- 172.21.15.22:0/3695028026 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff7b015e400 con 0x7ff7b00b8430 2023-07-11T00:31:25.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.440+0000 7ff7b67ff700 1 -- 172.21.15.22:0/3695028026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff7b0066e80 con 0x7ff7b00b8430 2023-07-11T00:31:25.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.441+0000 7ff7acff9700 1 -- 172.21.15.22:0/3695028026 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff7a0054250 con 0x7ff7b00b8430 2023-07-11T00:31:25.443 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-07-11T00:31:25.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.443+0000 7ff7b67ff700 1 -- 172.21.15.22:0/3695028026 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff79c06ace0 msgr2=0x7ff79c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.443+0000 7ff7b67ff700 1 --2- 172.21.15.22:0/3695028026 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff79c06ace0 0x7ff79c06d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00ca150 tx=0x7ff7a4008030 comp rx=0 tx=0).stop 2023-07-11T00:31:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.443+0000 7ff7b67ff700 1 -- 172.21.15.22:0/3695028026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b00b8430 msgr2=0x7ff7b00c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.443+0000 7ff7b67ff700 1 --2- 172.21.15.22:0/3695028026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b00b8430 0x7ff7b00c9c10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000c550 tx=0x7ff7a000c910 comp rx=0 tx=0).stop 2023-07-11T00:31:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.443+0000 7ff7b67ff700 1 -- 172.21.15.22:0/3695028026 shutdown_connections 2023-07-11T00:31:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.443+0000 7ff7b67ff700 1 --2- 172.21.15.22:0/3695028026 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ff79c06ace0 0x7ff79c06d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.443+0000 7ff7b67ff700 1 --2- 172.21.15.22:0/3695028026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7b00d3730 0x7ff7b00d29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.443+0000 7ff7b67ff700 1 --2- 172.21.15.22:0/3695028026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7b00b8430 0x7ff7b00c9c10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.443+0000 7ff7b67ff700 1 --2- 172.21.15.22:0/3695028026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7b00cfa90 0x7ff7b00cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.443+0000 7ff7b67ff700 1 -- 172.21.15.22:0/3695028026 >> 172.21.15.22:0/3695028026 conn(0x7ff7b006b3f0 msgr2=0x7ff7b00d1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:25.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.443+0000 7ff7b67ff700 1 -- 172.21.15.22:0/3695028026 shutdown_connections 2023-07-11T00:31:25.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.443+0000 7ff7b67ff700 1 -- 172.21.15.22:0/3695028026 wait complete. 2023-07-11T00:31:25.464 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-11T00:31:25.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.667+0000 7fce643ff700 1 Processor -- start 2023-07-11T00:31:25.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.668+0000 7fce643ff700 1 -- start start 2023-07-11T00:31:25.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.669+0000 7fce643ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fce5c0d3730 0x7fce5c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:25.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.669+0000 7fce643ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce5c0cfa90 0x7fce5c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:25.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.669+0000 7fce643ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce5c0d0b20 con 0x7fce5c0b8430 2023-07-11T00:31:25.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.669+0000 7fce643ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce5c0cda30 con 0x7fce5c0d3730 2023-07-11T00:31:25.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.669+0000 7fce643ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c0b8800 con 0x7fce5c0cfa90 2023-07-11T00:31:25.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.669+0000 7fce6199a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fce5c0d3730 0x7fce5c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:25.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.669+0000 7fce6199a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fce5c0d3730 0x7fce5c0cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46464/0 (socket says 172.21.15.22:46464) 2023-07-11T00:31:25.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.669+0000 7fce6219b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fce5c0b8430 0x7fce5c0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42738/0 (socket says 172.21.15.22:42738) 2023-07-11T00:31:25.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.669+0000 7fce6199a700 1 -- 172.21.15.22:0/3755052617 learned_addr learned my addr 172.21.15.22:0/3755052617 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:25.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.669+0000 7fce6299c700 1 --2- 172.21.15.22:0/3755052617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce5c0cfa90 0x7fce5c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.669+0000 7fce6199a700 1 -- 172.21.15.22:0/3755052617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce5c0cfa90 msgr2=0x7fce5c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.669+0000 7fce6199a700 1 --2- 172.21.15.22:0/3755052617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce5c0cfa90 0x7fce5c0d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.669+0000 7fce6199a700 1 -- 172.21.15.22:0/3755052617 >> v1:172.21.15.22:6789/0 conn(0x7fce5c0b8430 legacy=0x7fce5c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.669+0000 7fce6199a700 1 -- 172.21.15.22:0/3755052617 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5c0cfeb0 con 0x7fce5c0d3730 2023-07-11T00:31:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.669+0000 7fce61199700 1 -- 172.21.15.22:0/3755052617 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629339164 0 0) 0x7fce5c0d0b20 con 0x7fce5c0b8430 2023-07-11T00:31:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.670+0000 7fce6199a700 1 --2- 172.21.15.22:0/3755052617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce5c0d3730 0x7fce5c0cf550 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0098f0 tx=0x7fce4c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54dae1ec88e3768 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.670+0000 7fce61199700 1 -- 172.21.15.22:0/3755052617 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c00b8a0 con 0x7fce5c0d3730 2023-07-11T00:31:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.670+0000 7fce61199700 1 -- 172.21.15.22:0/3755052617 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4c00ba00 con 0x7fce5c0d3730 2023-07-11T00:31:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.670+0000 7fce61199700 1 -- 172.21.15.22:0/3755052617 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c00bd90 con 0x7fce5c0d3730 2023-07-11T00:31:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.671+0000 7fce643ff700 1 -- 172.21.15.22:0/3755052617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce5c0d3730 msgr2=0x7fce5c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.671+0000 7fce643ff700 1 --2- 172.21.15.22:0/3755052617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce5c0d3730 0x7fce5c0cf550 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0098f0 tx=0x7fce4c009c00 comp rx=0 tx=0).stop 2023-07-11T00:31:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.671+0000 7fce643ff700 1 -- 172.21.15.22:0/3755052617 shutdown_connections 2023-07-11T00:31:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.671+0000 7fce643ff700 1 --2- 172.21.15.22:0/3755052617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce5c0cfa90 0x7fce5c0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.671+0000 7fce643ff700 1 --2- 172.21.15.22:0/3755052617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce5c0d3730 0x7fce5c0cf550 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:25.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.671+0000 7fce643ff700 1 -- 172.21.15.22:0/3755052617 >> 172.21.15.22:0/3755052617 conn(0x7fce5c06b3f0 msgr2=0x7fce5c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:25.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.671+0000 7fce643ff700 1 -- 172.21.15.22:0/3755052617 shutdown_connections 2023-07-11T00:31:25.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.671+0000 7fce643ff700 1 -- 172.21.15.22:0/3755052617 wait complete. 2023-07-11T00:31:25.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.672+0000 7fce643ff700 1 Processor -- start 2023-07-11T00:31:25.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.673+0000 7fce643ff700 1 -- start start 2023-07-11T00:31:25.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce643ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce5c0b8430 0x7fce5c15abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:25.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce643ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c0cfa90 0x7fce5c0c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:25.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce643ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce5c0d3730 0x7fce5c0cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:25.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce643ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c15b130 con 0x7fce5c0d3730 2023-07-11T00:31:25.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce643ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c15cc60 con 0x7fce5c0cfa90 2023-07-11T00:31:25.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce643ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c15cf40 con 0x7fce5c0b8430 2023-07-11T00:31:25.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce6299c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce5c0d3730 0x7fce5c0cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:25.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce6299c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce5c0d3730 0x7fce5c0cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46478/0 (socket says 172.21.15.22:46478) 2023-07-11T00:31:25.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce6299c700 1 -- 172.21.15.22:0/2563038642 learned_addr learned my addr 172.21.15.22:0/2563038642 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:25.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce6199a700 1 --2- 172.21.15.22:0/2563038642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c0cfa90 0x7fce5c0c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:25.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce6219b700 1 --2- 172.21.15.22:0/2563038642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce5c0b8430 0x7fce5c15abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:25.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce6299c700 1 -- 172.21.15.22:0/2563038642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce5c0b8430 msgr2=0x7fce5c15abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:25.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce6299c700 1 --2- 172.21.15.22:0/2563038642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce5c0b8430 0x7fce5c15abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:25.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce6299c700 1 -- 172.21.15.22:0/2563038642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c0cfa90 msgr2=0x7fce5c0c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:25.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce6299c700 1 --2- 172.21.15.22:0/2563038642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c0cfa90 0x7fce5c0c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:25.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce6299c700 1 -- 172.21.15.22:0/2563038642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c009550 con 0x7fce5c0d3730 2023-07-11T00:31:25.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce6219b700 1 --2- 172.21.15.22:0/2563038642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce5c0b8430 0x7fce5c15abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:25.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.674+0000 7fce6199a700 1 --2- 172.21.15.22:0/2563038642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c0cfa90 0x7fce5c0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:25.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.675+0000 7fce6299c700 1 --2- 172.21.15.22:0/2563038642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce5c0d3730 0x7fce5c0cbde0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fce54007e40 tx=0x7fce5400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:25.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.675+0000 7fce52ffd700 1 -- 172.21.15.22:0/2563038642 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5400eea0 con 0x7fce5c0d3730 2023-07-11T00:31:25.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.675+0000 7fce52ffd700 1 -- 172.21.15.22:0/2563038642 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce54014420 con 0x7fce5c0d3730 2023-07-11T00:31:25.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.675+0000 7fce52ffd700 1 -- 172.21.15.22:0/2563038642 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce540147b0 con 0x7fce5c0d3730 2023-07-11T00:31:25.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.675+0000 7fce643ff700 1 -- 172.21.15.22:0/2563038642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5c15d220 con 0x7fce5c0d3730 2023-07-11T00:31:25.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.675+0000 7fce643ff700 1 -- 172.21.15.22:0/2563038642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5c15d7e0 con 0x7fce5c0d3730 2023-07-11T00:31:25.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.676+0000 7fce643ff700 1 -- 172.21.15.22:0/2563038642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5c15d9d0 con 0x7fce5c0d3730 2023-07-11T00:31:25.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.677+0000 7fce52ffd700 1 -- 172.21.15.22:0/2563038642 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fce54014910 con 0x7fce5c0d3730 2023-07-11T00:31:25.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.678+0000 7fce52ffd700 1 --2- 172.21.15.22:0/2563038642 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fce4006ace0 0x7fce4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:25.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.678+0000 7fce52ffd700 1 -- 172.21.15.22:0/2563038642 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fce54089fe0 con 0x7fce5c0d3730 2023-07-11T00:31:25.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.679+0000 7fce6219b700 1 --2- 172.21.15.22:0/2563038642 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fce4006ace0 0x7fce4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:25.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.679+0000 7fce6219b700 1 --2- 172.21.15.22:0/2563038642 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fce4006ace0 0x7fce4006d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fce58007fd0 tx=0x7fce58009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:25.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.682+0000 7fce52ffd700 1 -- 172.21.15.22:0/2563038642 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fce54054d70 con 0x7fce5c0d3730 2023-07-11T00:31:25.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.888+0000 7fce643ff700 1 -- 172.21.15.22:0/2563038642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fce5c04ea60 con 0x7fce5c0d3730 2023-07-11T00:31:25.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.888+0000 7fce52ffd700 1 -- 172.21.15.22:0/2563038642 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fce54058390 con 0x7fce5c0d3730 2023-07-11T00:31:25.891 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.890+0000 7fce643ff700 1 -- 172.21.15.22:0/2563038642 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fce4006ace0 msgr2=0x7fce4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.890+0000 7fce643ff700 1 --2- 172.21.15.22:0/2563038642 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fce4006ace0 0x7fce4006d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fce58007fd0 tx=0x7fce58009040 comp rx=0 tx=0).stop 2023-07-11T00:31:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.890+0000 7fce643ff700 1 -- 172.21.15.22:0/2563038642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce5c0d3730 msgr2=0x7fce5c0cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.890+0000 7fce643ff700 1 --2- 172.21.15.22:0/2563038642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce5c0d3730 0x7fce5c0cbde0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fce54007e40 tx=0x7fce5400e3c0 comp rx=0 tx=0).stop 2023-07-11T00:31:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.891+0000 7fce643ff700 1 -- 172.21.15.22:0/2563038642 shutdown_connections 2023-07-11T00:31:25.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.891+0000 7fce643ff700 1 --2- 172.21.15.22:0/2563038642 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fce4006ace0 0x7fce4006d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:25.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.891+0000 7fce643ff700 1 --2- 172.21.15.22:0/2563038642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce5c0b8430 0x7fce5c15abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:25.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.891+0000 7fce643ff700 1 --2- 172.21.15.22:0/2563038642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce5c0d3730 0x7fce5c0cbde0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:25.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.891+0000 7fce643ff700 1 --2- 172.21.15.22:0/2563038642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c0cfa90 0x7fce5c0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:25.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.891+0000 7fce643ff700 1 -- 172.21.15.22:0/2563038642 >> 172.21.15.22:0/2563038642 conn(0x7fce5c06b3f0 msgr2=0x7fce5c0b6530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:25.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.891+0000 7fce643ff700 1 -- 172.21.15.22:0/2563038642 shutdown_connections 2023-07-11T00:31:25.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:25.891+0000 7fce643ff700 1 -- 172.21.15.22:0/2563038642 wait complete. 2023-07-11T00:31:25.913 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-11T00:31:26.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.115+0000 7f5faafff700 1 Processor -- start 2023-07-11T00:31:26.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.116+0000 7f5faafff700 1 -- start start 2023-07-11T00:31:26.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.117+0000 7f5faafff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5fa415c460 0x7f5fa40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:26.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.117+0000 7f5faafff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa40d1790 con 0x7f5fa40cf8f0 2023-07-11T00:31:26.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.117+0000 7f5faafff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa40cd950 con 0x7f5fa40d2640 2023-07-11T00:31:26.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.117+0000 7f5faafff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa40cedd0 con 0x7f5fa415c460 2023-07-11T00:31:26.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.117+0000 7f5fa8d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5fa415c460 0x7f5fa40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:26.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.117+0000 7f5fa8d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5fa415c460 0x7f5fa40b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46484/0 (socket says 172.21.15.22:46484) 2023-07-11T00:31:26.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.117+0000 7f5fa8d9b700 1 -- 172.21.15.22:0/368515670 learned_addr learned my addr 172.21.15.22:0/368515670 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:26.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.118+0000 7f5fa8d9b700 1 -- 172.21.15.22:0/368515670 >> v1:172.21.15.184:6789/0 conn(0x7f5fa40d2640 legacy=0x7f5fa40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:26.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.118+0000 7f5fa8d9b700 1 -- 172.21.15.22:0/368515670 >> v1:172.21.15.22:6789/0 conn(0x7f5fa40cf8f0 legacy=0x7f5fa415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:26.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.118+0000 7f5fa37fe700 1 -- 172.21.15.22:0/368515670 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823686424 0 0) 0x7f5fa40d1790 con 0x7f5fa40cf8f0 2023-07-11T00:31:26.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.118+0000 7f5fa8d9b700 1 -- 172.21.15.22:0/368515670 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa40d14b0 con 0x7f5fa415c460 2023-07-11T00:31:26.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.118+0000 7f5fa8d9b700 1 --2- 172.21.15.22:0/368515670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fa415c460 0x7f5fa40b59d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5f980098f0 tx=0x7f5f98009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93bdc15acf0b226 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:26.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.118+0000 7f5fa37fe700 1 -- 172.21.15.22:0/368515670 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f98004230 con 0x7f5fa415c460 2023-07-11T00:31:26.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.118+0000 7f5fa37fe700 1 -- 172.21.15.22:0/368515670 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f98004390 con 0x7f5fa415c460 2023-07-11T00:31:26.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.118+0000 7f5fa37fe700 1 -- 172.21.15.22:0/368515670 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f980036a0 con 0x7f5fa415c460 2023-07-11T00:31:26.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.119+0000 7f5faafff700 1 -- 172.21.15.22:0/368515670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fa415c460 msgr2=0x7f5fa40b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:26.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.119+0000 7f5faafff700 1 --2- 172.21.15.22:0/368515670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fa415c460 0x7f5fa40b59d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5f980098f0 tx=0x7f5f98009c00 comp rx=0 tx=0).stop 2023-07-11T00:31:26.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.119+0000 7f5faafff700 1 -- 172.21.15.22:0/368515670 shutdown_connections 2023-07-11T00:31:26.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.119+0000 7f5faafff700 1 --2- 172.21.15.22:0/368515670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fa415c460 0x7f5fa40b59d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:26.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.119+0000 7f5faafff700 1 -- 172.21.15.22:0/368515670 >> 172.21.15.22:0/368515670 conn(0x7f5fa4071660 msgr2=0x7f5fa4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:26.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.119+0000 7f5faafff700 1 -- 172.21.15.22:0/368515670 shutdown_connections 2023-07-11T00:31:26.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.119+0000 7f5faafff700 1 -- 172.21.15.22:0/368515670 wait complete. 2023-07-11T00:31:26.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.121+0000 7f5faafff700 1 Processor -- start 2023-07-11T00:31:26.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.121+0000 7f5faafff700 1 -- start start 2023-07-11T00:31:26.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.122+0000 7f5faafff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5fa40cf8f0 0x7f5fa4152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:26.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.122+0000 7f5faafff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fa40d2640 0x7f5fa415d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:26.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.122+0000 7f5faafff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fa415c460 0x7f5fa415ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:26.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.122+0000 7f5faafff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa40cca40 con 0x7f5fa415c460 2023-07-11T00:31:26.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.122+0000 7f5faafff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa40ccd20 con 0x7f5fa40d2640 2023-07-11T00:31:26.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.122+0000 7f5faafff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa40c7120 con 0x7f5fa40cf8f0 2023-07-11T00:31:26.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.122+0000 7f5fa959c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fa415c460 0x7f5fa415ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:26.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.123+0000 7f5fa959c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fa415c460 0x7f5fa415ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46492/0 (socket says 172.21.15.22:46492) 2023-07-11T00:31:26.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.123+0000 7f5fa959c700 1 -- 172.21.15.22:0/113940974 learned_addr learned my addr 172.21.15.22:0/113940974 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:26.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.123+0000 7f5fa8d9b700 1 --2- 172.21.15.22:0/113940974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5fa40cf8f0 0x7f5fa4152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:26.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.123+0000 7f5fa3fff700 1 --2- 172.21.15.22:0/113940974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fa40d2640 0x7f5fa415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:26.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.123+0000 7f5fa959c700 1 -- 172.21.15.22:0/113940974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5fa40cf8f0 msgr2=0x7f5fa4152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:26.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.123+0000 7f5fa959c700 1 --2- 172.21.15.22:0/113940974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5fa40cf8f0 0x7f5fa4152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:26.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.123+0000 7f5fa959c700 1 -- 172.21.15.22:0/113940974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fa40d2640 msgr2=0x7f5fa415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:26.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.123+0000 7f5fa959c700 1 --2- 172.21.15.22:0/113940974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fa40d2640 0x7f5fa415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:26.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.123+0000 7f5fa959c700 1 -- 172.21.15.22:0/113940974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f98009550 con 0x7f5fa415c460 2023-07-11T00:31:26.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.123+0000 7f5fa959c700 1 --2- 172.21.15.22:0/113940974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fa415c460 0x7f5fa415ecf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00c760 tx=0x7f5f9c00ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:26.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.124+0000 7f5fa17fa700 1 -- 172.21.15.22:0/113940974 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c003e30 con 0x7f5fa415c460 2023-07-11T00:31:26.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.124+0000 7f5fa17fa700 1 -- 172.21.15.22:0/113940974 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9c005070 con 0x7f5fa415c460 2023-07-11T00:31:26.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.124+0000 7f5fa17fa700 1 -- 172.21.15.22:0/113940974 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c005400 con 0x7f5fa415c460 2023-07-11T00:31:26.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.124+0000 7f5faafff700 1 -- 172.21.15.22:0/113940974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa40c7400 con 0x7f5fa415c460 2023-07-11T00:31:26.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.125+0000 7f5faafff700 1 -- 172.21.15.22:0/113940974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa4153cf0 con 0x7f5fa415c460 2023-07-11T00:31:26.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.126+0000 7f5faafff700 1 -- 172.21.15.22:0/113940974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa40c7920 con 0x7f5fa415c460 2023-07-11T00:31:26.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.127+0000 7f5fa17fa700 1 -- 172.21.15.22:0/113940974 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f9c005560 con 0x7f5fa415c460 2023-07-11T00:31:26.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.128+0000 7f5fa17fa700 1 --2- 172.21.15.22:0/113940974 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5f8806ace0 0x7f5f8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:26.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.128+0000 7f5fa17fa700 1 -- 172.21.15.22:0/113940974 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5f9c0893a0 con 0x7f5fa415c460 2023-07-11T00:31:26.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.128+0000 7f5fa8d9b700 1 --2- 172.21.15.22:0/113940974 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5f8806ace0 0x7f5f8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:26.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.129+0000 7f5fa8d9b700 1 --2- 172.21.15.22:0/113940974 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5f8806ace0 0x7f5f8806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5f98009130 tx=0x7f5f98008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:26.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.132+0000 7f5fa17fa700 1 -- 172.21.15.22:0/113940974 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5fa40c7920 con 0x7f5fa415c460 2023-07-11T00:31:26.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.352+0000 7f5faafff700 1 -- 172.21.15.22:0/113940974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5fa40c7920 con 0x7f5fa415c460 2023-07-11T00:31:26.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.353+0000 7f5fa17fa700 1 -- 172.21.15.22:0/113940974 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5fa40c7920 con 0x7f5fa415c460 2023-07-11T00:31:26.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.355+0000 7f5faafff700 1 -- 172.21.15.22:0/113940974 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5f8806ace0 msgr2=0x7f5f8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:26.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.355+0000 7f5faafff700 1 --2- 172.21.15.22:0/113940974 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5f8806ace0 0x7f5f8806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5f98009130 tx=0x7f5f98008030 comp rx=0 tx=0).stop 2023-07-11T00:31:26.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.355+0000 7f5faafff700 1 -- 172.21.15.22:0/113940974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fa415c460 msgr2=0x7f5fa415ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:26.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.355+0000 7f5faafff700 1 --2- 172.21.15.22:0/113940974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fa415c460 0x7f5fa415ecf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00c760 tx=0x7f5f9c00ca70 comp rx=0 tx=0).stop 2023-07-11T00:31:26.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.355+0000 7f5faafff700 1 -- 172.21.15.22:0/113940974 shutdown_connections 2023-07-11T00:31:26.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.355+0000 7f5faafff700 1 --2- 172.21.15.22:0/113940974 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5f8806ace0 0x7f5f8806d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:26.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.355+0000 7f5faafff700 1 --2- 172.21.15.22:0/113940974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5fa40cf8f0 0x7f5fa4152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:26.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.355+0000 7f5faafff700 1 --2- 172.21.15.22:0/113940974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fa415c460 0x7f5fa415ecf0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:26.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.355+0000 7f5faafff700 1 --2- 172.21.15.22:0/113940974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fa40d2640 0x7f5fa415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:26.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.355+0000 7f5faafff700 1 -- 172.21.15.22:0/113940974 >> 172.21.15.22:0/113940974 conn(0x7f5fa4071660 msgr2=0x7f5fa40cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:26.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.355+0000 7f5faafff700 1 -- 172.21.15.22:0/113940974 shutdown_connections 2023-07-11T00:31:26.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.355+0000 7f5faafff700 1 -- 172.21.15.22:0/113940974 wait complete. 2023-07-11T00:31:26.360 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-07-11T00:31:26.376 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-07-11T00:31:26.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:26.377 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-07-11T00:31:26.469 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-07-11T00:31:26.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:26.470 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-11T00:31:26.516 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:31:26.517 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:31:26.569 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:31:26.569 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:31:26.620 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:31:26.621 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:31:26.673 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:31:26.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.873+0000 7f32b11ff700 1 Processor -- start 2023-07-11T00:31:26.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.873+0000 7f32b11ff700 1 -- start start 2023-07-11T00:31:26.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.874+0000 7f32b11ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f32ac15c460 0x7f32ac0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:26.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.874+0000 7f32b11ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f32ac0d2640 0x7f32ac0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:26.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.874+0000 7f32b11ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ac0d1790 con 0x7f32ac0cf720 2023-07-11T00:31:26.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.874+0000 7f32b11ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ac0cedd0 con 0x7f32ac15c460 2023-07-11T00:31:26.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.874+0000 7f32b11ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ac0cd950 con 0x7f32ac0d2640 2023-07-11T00:31:26.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.874+0000 7f32aad9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f32ac15c460 0x7f32ac0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:26.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.875+0000 7f32aad9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f32ac15c460 0x7f32ac0b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46504/0 (socket says 172.21.15.22:46504) 2023-07-11T00:31:26.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.875+0000 7f32aad9d700 1 -- 172.21.15.22:0/1322076072 learned_addr learned my addr 172.21.15.22:0/1322076072 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.875+0000 7f32aa59c700 1 --2- 172.21.15.22:0/1322076072 >> v2:172.21.15.184:3300/0 conn(0x7f32ac0d2640 0x7f32ac0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.875+0000 7f32aad9d700 1 -- 172.21.15.22:0/1322076072 >> v2:172.21.15.184:3300/0 conn(0x7f32ac0d2640 msgr2=0x7f32ac0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.875+0000 7f32aad9d700 1 --2- 172.21.15.22:0/1322076072 >> v2:172.21.15.184:3300/0 conn(0x7f32ac0d2640 0x7f32ac0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.875+0000 7f32aad9d700 1 -- 172.21.15.22:0/1322076072 >> v1:172.21.15.184:6789/0 conn(0x7f32ac0cf720 legacy=0x7f32ac0d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.875+0000 7f32aad9d700 1 -- 172.21.15.22:0/1322076072 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac0d14b0 con 0x7f32ac15c460 2023-07-11T00:31:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.875+0000 7f32aad9d700 1 --2- 172.21.15.22:0/1322076072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ac15c460 0x7f32ac0b59d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f32ac15fd80 tx=0x7f329c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145ebf19df2de210 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.875+0000 7f32a9d9b700 1 -- 172.21.15.22:0/1322076072 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c004230 con 0x7f32ac15c460 2023-07-11T00:31:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.876+0000 7f32a9d9b700 1 -- 172.21.15.22:0/1322076072 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c004390 con 0x7f32ac15c460 2023-07-11T00:31:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.876+0000 7f32a9d9b700 1 -- 172.21.15.22:0/1322076072 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c0036a0 con 0x7f32ac15c460 2023-07-11T00:31:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.876+0000 7f32b11ff700 1 -- 172.21.15.22:0/1322076072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ac15c460 msgr2=0x7f32ac0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.876+0000 7f32b11ff700 1 --2- 172.21.15.22:0/1322076072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ac15c460 0x7f32ac0b59d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f32ac15fd80 tx=0x7f329c009bd0 comp rx=0 tx=0).stop 2023-07-11T00:31:26.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.876+0000 7f32b11ff700 1 -- 172.21.15.22:0/1322076072 shutdown_connections 2023-07-11T00:31:26.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.876+0000 7f32b11ff700 1 --2- 172.21.15.22:0/1322076072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ac15c460 0x7f32ac0b59d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:26.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.876+0000 7f32b11ff700 1 --2- 172.21.15.22:0/1322076072 >> v2:172.21.15.184:3300/0 conn(0x7f32ac0d2640 0x7f32ac0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:26.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.876+0000 7f32b11ff700 1 -- 172.21.15.22:0/1322076072 >> 172.21.15.22:0/1322076072 conn(0x7f32ac071660 msgr2=0x7f32ac071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:26.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.876+0000 7f32b11ff700 1 -- 172.21.15.22:0/1322076072 shutdown_connections 2023-07-11T00:31:26.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.876+0000 7f32b11ff700 1 -- 172.21.15.22:0/1322076072 wait complete. 2023-07-11T00:31:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.878+0000 7f32b11ff700 1 Processor -- start 2023-07-11T00:31:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.878+0000 7f32b11ff700 1 -- start start 2023-07-11T00:31:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.879+0000 7f32b11ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32ac0cf720 0x7f32ac14d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.879+0000 7f32b11ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ac0d2640 0x7f32ac0c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.879+0000 7f32b11ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32ac15c460 0x7f32ac15eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.879+0000 7f32b11ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac15da50 con 0x7f32ac0d2640 2023-07-11T00:31:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.879+0000 7f32b11ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac15d240 con 0x7f32ac0cf720 2023-07-11T00:31:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.879+0000 7f32b11ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0c6bf0 con 0x7f32ac15c460 2023-07-11T00:31:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.879+0000 7f32aa59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ac0d2640 0x7f32ac0c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.879+0000 7f32aa59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ac0d2640 0x7f32ac0c66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46520/0 (socket says 172.21.15.22:46520) 2023-07-11T00:31:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.879+0000 7f32aa59c700 1 -- 172.21.15.22:0/3327431535 learned_addr learned my addr 172.21.15.22:0/3327431535 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.880+0000 7f32ab59e700 1 --2- 172.21.15.22:0/3327431535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32ac15c460 0x7f32ac15eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:26.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.880+0000 7f32aad9d700 1 --2- 172.21.15.22:0/3327431535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32ac0cf720 0x7f32ac14d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.880+0000 7f32aa59c700 1 -- 172.21.15.22:0/3327431535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32ac15c460 msgr2=0x7f32ac15eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.880+0000 7f32aa59c700 1 --2- 172.21.15.22:0/3327431535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32ac15c460 0x7f32ac15eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.880+0000 7f32aa59c700 1 -- 172.21.15.22:0/3327431535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32ac0cf720 msgr2=0x7f32ac14d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.880+0000 7f32aa59c700 1 --2- 172.21.15.22:0/3327431535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32ac0cf720 0x7f32ac14d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.880+0000 7f32aa59c700 1 -- 172.21.15.22:0/3327431535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c009550 con 0x7f32ac0d2640 2023-07-11T00:31:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.880+0000 7f32aa59c700 1 --2- 172.21.15.22:0/3327431535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ac0d2640 0x7f32ac0c66b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f32a000d830 tx=0x7f32a000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.880+0000 7f32937fe700 1 -- 172.21.15.22:0/3327431535 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00125f0 con 0x7f32ac0d2640 2023-07-11T00:31:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.880+0000 7f32937fe700 1 -- 172.21.15.22:0/3327431535 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a0012750 con 0x7f32ac0d2640 2023-07-11T00:31:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.880+0000 7f32937fe700 1 -- 172.21.15.22:0/3327431535 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a0012b00 con 0x7f32ac0d2640 2023-07-11T00:31:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.880+0000 7f32b11ff700 1 -- 172.21.15.22:0/3327431535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ac15d490 con 0x7f32ac0d2640 2023-07-11T00:31:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.880+0000 7f32b11ff700 1 -- 172.21.15.22:0/3327431535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ac0cb560 con 0x7f32ac0d2640 2023-07-11T00:31:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.881+0000 7f32b11ff700 1 -- 172.21.15.22:0/3327431535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ac0cb720 con 0x7f32ac0d2640 2023-07-11T00:31:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.882+0000 7f32937fe700 1 -- 172.21.15.22:0/3327431535 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f32a0012c60 con 0x7f32ac0d2640 2023-07-11T00:31:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.883+0000 7f32937fe700 1 --2- 172.21.15.22:0/3327431535 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f329806ace0 0x7f329806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.883+0000 7f32937fe700 1 -- 172.21.15.22:0/3327431535 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f32a0089b50 con 0x7f32ac0d2640 2023-07-11T00:31:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.884+0000 7f32aad9d700 1 --2- 172.21.15.22:0/3327431535 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f329806ace0 0x7f329806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:26.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.884+0000 7f32aad9d700 1 --2- 172.21.15.22:0/3327431535 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f329806ace0 0x7f329806d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f329c009130 tx=0x7f329c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:26.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:26.887+0000 7f32937fe700 1 -- 172.21.15.22:0/3327431535 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f32a00548c0 con 0x7f32ac0d2640 2023-07-11T00:31:27.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.097+0000 7f32b11ff700 1 -- 172.21.15.22:0/3327431535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32ac0cb3c0 con 0x7f32ac0d2640 2023-07-11T00:31:27.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.099+0000 7f32937fe700 1 -- 172.21.15.22:0/3327431535 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f32ac0cb3c0 con 0x7f32ac0d2640 2023-07-11T00:31:27.101 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:27.102 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:54.208536+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:31:27.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.101+0000 7f32b11ff700 1 -- 172.21.15.22:0/3327431535 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f329806ace0 msgr2=0x7f329806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:27.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.101+0000 7f32b11ff700 1 --2- 172.21.15.22:0/3327431535 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f329806ace0 0x7f329806d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f329c009130 tx=0x7f329c008030 comp rx=0 tx=0).stop 2023-07-11T00:31:27.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.101+0000 7f32b11ff700 1 -- 172.21.15.22:0/3327431535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ac0d2640 msgr2=0x7f32ac0c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:27.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.101+0000 7f32b11ff700 1 --2- 172.21.15.22:0/3327431535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ac0d2640 0x7f32ac0c66b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f32a000d830 tx=0x7f32a000dbf0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.101+0000 7f32b11ff700 1 -- 172.21.15.22:0/3327431535 shutdown_connections 2023-07-11T00:31:27.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.101+0000 7f32b11ff700 1 --2- 172.21.15.22:0/3327431535 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f329806ace0 0x7f329806d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.101+0000 7f32b11ff700 1 --2- 172.21.15.22:0/3327431535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32ac15c460 0x7f32ac15eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.101+0000 7f32b11ff700 1 --2- 172.21.15.22:0/3327431535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32ac0cf720 0x7f32ac14d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.101+0000 7f32b11ff700 1 --2- 172.21.15.22:0/3327431535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32ac0d2640 0x7f32ac0c66b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.101+0000 7f32b11ff700 1 -- 172.21.15.22:0/3327431535 >> 172.21.15.22:0/3327431535 conn(0x7f32ac071660 msgr2=0x7f32ac156cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:27.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.101+0000 7f32b11ff700 1 -- 172.21.15.22:0/3327431535 shutdown_connections 2023-07-11T00:31:27.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.101+0000 7f32b11ff700 1 -- 172.21.15.22:0/3327431535 wait complete. 2023-07-11T00:31:27.122 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:29:57.631007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:29:58.547599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:30:03.826184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:30:04.383448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-11T00:30:08.075875+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-11T00:31:27.123 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:31:27.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.325+0000 7fab53dff700 1 Processor -- start 2023-07-11T00:31:27.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.325+0000 7fab53dff700 1 -- start start 2023-07-11T00:31:27.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.326+0000 7fab53dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c0b8430 0x7fab4c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:27.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.326+0000 7fab53dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fab4c0cfc60 0x7fab4c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:27.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.326+0000 7fab53dff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4c0d0b20 con 0x7fab4c0d3730 2023-07-11T00:31:27.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.326+0000 7fab53dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c0b8800 con 0x7fab4c0cfc60 2023-07-11T00:31:27.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.326+0000 7fab53dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0b4ee0 con 0x7fab4c0b8430 2023-07-11T00:31:27.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.326+0000 7fab5139a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fab4c0d3730 0x7fab4c0cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42750/0 (socket says 172.21.15.22:42750) 2023-07-11T00:31:27.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.326+0000 7fab5139a700 1 -- 172.21.15.22:0/3960405848 learned_addr learned my addr 172.21.15.22:0/3960405848 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:27.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab51b9b700 1 --2- 172.21.15.22:0/3960405848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c0b8430 0x7fab4c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:27.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab5239c700 1 --2- 172.21.15.22:0/3960405848 >> v2:172.21.15.184:3300/0 conn(0x7fab4c0cfc60 0x7fab4c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:27.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab50b99700 1 -- 172.21.15.22:0/3960405848 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781927490 0 0) 0x7fab4c0d0b20 con 0x7fab4c0d3730 2023-07-11T00:31:27.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab50b99700 1 -- 172.21.15.22:0/3960405848 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab380035b0 con 0x7fab4c0d3730 2023-07-11T00:31:27.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab50b99700 1 -- 172.21.15.22:0/3960405848 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3124601716 0 0) 0x7fab380035b0 con 0x7fab4c0d3730 2023-07-11T00:31:27.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab50b99700 1 -- 172.21.15.22:0/3960405848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c0b8430 msgr2=0x7fab4c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:27.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab50b99700 1 --2- 172.21.15.22:0/3960405848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c0b8430 0x7fab4c0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab50b99700 1 -- 172.21.15.22:0/3960405848 >> v2:172.21.15.184:3300/0 conn(0x7fab4c0cfc60 msgr2=0x7fab4c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:27.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab50b99700 1 --2- 172.21.15.22:0/3960405848 >> v2:172.21.15.184:3300/0 conn(0x7fab4c0cfc60 0x7fab4c0d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab50b99700 1 -- 172.21.15.22:0/3960405848 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c0b51c0 con 0x7fab4c0d3730 2023-07-11T00:31:27.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab50b99700 1 -- 172.21.15.22:0/3960405848 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7fab3c001670 con 0x7fab4c0d3730 2023-07-11T00:31:27.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab50b99700 1 -- 172.21.15.22:0/3960405848 >> v1:172.21.15.22:6789/0 conn(0x7fab4c0d3730 legacy=0x7fab4c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab50b99700 1 --2- 172.21.15.22:0/3960405848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c0b8430 0x7fab38003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab50b99700 1 --2- 172.21.15.22:0/3960405848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab38003f80 0x7fab38004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab50b99700 1 --2- 172.21.15.22:0/3960405848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab38004d90 0x7fab38005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab50b99700 1 -- 172.21.15.22:0/3960405848 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0b8800 con 0x7fab38004d90 2023-07-11T00:31:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab50b99700 1 -- 172.21.15.22:0/3960405848 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0b4ee0 con 0x7fab38003f80 2023-07-11T00:31:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.327+0000 7fab50b99700 1 -- 172.21.15.22:0/3960405848 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3800ba10 con 0x7fab4c0b8430 2023-07-11T00:31:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.328+0000 7fab5239c700 1 --2- 172.21.15.22:0/3960405848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab38004d90 0x7fab38005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:27.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.328+0000 7fab51b9b700 1 --2- 172.21.15.22:0/3960405848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c0b8430 0x7fab38003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:27.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.328+0000 7fab5139a700 1 --2- 172.21.15.22:0/3960405848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab38003f80 0x7fab38004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:27.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.328+0000 7fab5239c700 1 -- 172.21.15.22:0/3960405848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c0b8430 msgr2=0x7fab38003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:27.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.328+0000 7fab5239c700 1 --2- 172.21.15.22:0/3960405848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c0b8430 0x7fab38003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.328+0000 7fab5239c700 1 -- 172.21.15.22:0/3960405848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab38003f80 msgr2=0x7fab38004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:27.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.328+0000 7fab5239c700 1 --2- 172.21.15.22:0/3960405848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab38003f80 0x7fab38004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.328+0000 7fab5239c700 1 -- 172.21.15.22:0/3960405848 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab380035b0 con 0x7fab38004d90 2023-07-11T00:31:27.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.328+0000 7fab5239c700 1 --2- 172.21.15.22:0/3960405848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab38004d90 0x7fab38005200 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fab44009fc0 tx=0x7fab38005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da29c50cefec0d07 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:27.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.328+0000 7fab50b99700 1 -- 172.21.15.22:0/3960405848 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4400ec30 con 0x7fab38004d90 2023-07-11T00:31:27.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.328+0000 7fab50b99700 1 -- 172.21.15.22:0/3960405848 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4400f040 con 0x7fab38004d90 2023-07-11T00:31:27.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.328+0000 7fab50b99700 1 -- 172.21.15.22:0/3960405848 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44014480 con 0x7fab38004d90 2023-07-11T00:31:27.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.329+0000 7fab53dff700 1 -- 172.21.15.22:0/3960405848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab38004d90 msgr2=0x7fab38005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:27.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.329+0000 7fab53dff700 1 --2- 172.21.15.22:0/3960405848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab38004d90 0x7fab38005200 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fab44009fc0 tx=0x7fab38005880 comp rx=0 tx=0).stop 2023-07-11T00:31:27.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.329+0000 7fab5239c700 1 -- 172.21.15.22:0/3960405848 reap_dead start 2023-07-11T00:31:27.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.329+0000 7fab53dff700 1 -- 172.21.15.22:0/3960405848 shutdown_connections 2023-07-11T00:31:27.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.329+0000 7fab53dff700 1 -- 172.21.15.22:0/3960405848 >> 172.21.15.22:0/3960405848 conn(0x7fab4c06b3f0 msgr2=0x7fab4c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:27.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.329+0000 7fab53dff700 1 -- 172.21.15.22:0/3960405848 shutdown_connections 2023-07-11T00:31:27.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.329+0000 7fab53dff700 1 -- 172.21.15.22:0/3960405848 wait complete. 2023-07-11T00:31:27.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.331+0000 7fab53dff700 1 Processor -- start 2023-07-11T00:31:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.331+0000 7fab53dff700 1 -- start start 2023-07-11T00:31:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.332+0000 7fab53dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab38004d90 0x7fab4c0c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.332+0000 7fab53dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c155990 0x7fab4c155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.332+0000 7fab53dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab4c157ce0 0x7fab4c158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.332+0000 7fab53dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c156340 con 0x7fab4c157ce0 2023-07-11T00:31:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.332+0000 7fab53dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c158d30 con 0x7fab38004d90 2023-07-11T00:31:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.332+0000 7fab53dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0c5990 con 0x7fab4c155990 2023-07-11T00:31:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.332+0000 7fab5239c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab4c157ce0 0x7fab4c158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.332+0000 7fab5239c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab4c157ce0 0x7fab4c158180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46544/0 (socket says 172.21.15.22:46544) 2023-07-11T00:31:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.332+0000 7fab5239c700 1 -- 172.21.15.22:0/2721939520 learned_addr learned my addr 172.21.15.22:0/2721939520 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.332+0000 7fab51b9b700 1 --2- 172.21.15.22:0/2721939520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab38004d90 0x7fab4c0c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.332+0000 7fab5139a700 1 --2- 172.21.15.22:0/2721939520 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c155990 0x7fab4c155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.333+0000 7fab5239c700 1 -- 172.21.15.22:0/2721939520 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c155990 msgr2=0x7fab4c155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:27.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.333+0000 7fab5239c700 1 --2- 172.21.15.22:0/2721939520 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c155990 0x7fab4c155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.333+0000 7fab5239c700 1 -- 172.21.15.22:0/2721939520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab38004d90 msgr2=0x7fab4c0c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:27.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.333+0000 7fab5239c700 1 --2- 172.21.15.22:0/2721939520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab38004d90 0x7fab4c0c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.333+0000 7fab5239c700 1 -- 172.21.15.22:0/2721939520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c158a50 con 0x7fab4c157ce0 2023-07-11T00:31:27.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.333+0000 7fab5239c700 1 --2- 172.21.15.22:0/2721939520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab4c157ce0 0x7fab4c158180 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fab44016000 tx=0x7fab44009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:27.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.333+0000 7fab427fc700 1 -- 172.21.15.22:0/2721939520 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44007000 con 0x7fab4c157ce0 2023-07-11T00:31:27.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.333+0000 7fab427fc700 1 -- 172.21.15.22:0/2721939520 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab44003e50 con 0x7fab4c157ce0 2023-07-11T00:31:27.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.333+0000 7fab427fc700 1 -- 172.21.15.22:0/2721939520 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44014aa0 con 0x7fab4c157ce0 2023-07-11T00:31:27.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.333+0000 7fab53dff700 1 -- 172.21.15.22:0/2721939520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4c144950 con 0x7fab4c157ce0 2023-07-11T00:31:27.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.334+0000 7fab53dff700 1 -- 172.21.15.22:0/2721939520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4c144f10 con 0x7fab4c157ce0 2023-07-11T00:31:27.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.335+0000 7fab53dff700 1 -- 172.21.15.22:0/2721939520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4c04ea60 con 0x7fab4c157ce0 2023-07-11T00:31:27.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.335+0000 7fab427fc700 1 -- 172.21.15.22:0/2721939520 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab44024020 con 0x7fab4c157ce0 2023-07-11T00:31:27.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.336+0000 7fab427fc700 1 --2- 172.21.15.22:0/2721939520 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fab3006ace0 0x7fab3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:27.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.337+0000 7fab427fc700 1 -- 172.21.15.22:0/2721939520 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fab4408afc0 con 0x7fab4c157ce0 2023-07-11T00:31:27.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.337+0000 7fab51b9b700 1 --2- 172.21.15.22:0/2721939520 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fab3006ace0 0x7fab3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:27.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.338+0000 7fab51b9b700 1 --2- 172.21.15.22:0/2721939520 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fab3006ace0 0x7fab3006d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fab4c1f4f90 tx=0x7fab48009210 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:27.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.340+0000 7fab427fc700 1 -- 172.21.15.22:0/2721939520 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fab44055e50 con 0x7fab4c157ce0 2023-07-11T00:31:27.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.551+0000 7fab53dff700 1 -- 172.21.15.22:0/2721939520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fab4c1450d0 con 0x7fab4c157ce0 2023-07-11T00:31:27.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.551+0000 7fab427fc700 1 -- 172.21.15.22:0/2721939520 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fab44059470 con 0x7fab4c157ce0 2023-07-11T00:31:27.554 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2023-07-11T00:31:27.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.553+0000 7fab53dff700 1 -- 172.21.15.22:0/2721939520 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fab3006ace0 msgr2=0x7fab3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:27.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.553+0000 7fab53dff700 1 --2- 172.21.15.22:0/2721939520 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fab3006ace0 0x7fab3006d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fab4c1f4f90 tx=0x7fab48009210 comp rx=0 tx=0).stop 2023-07-11T00:31:27.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.553+0000 7fab53dff700 1 -- 172.21.15.22:0/2721939520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab4c157ce0 msgr2=0x7fab4c158180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:27.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.553+0000 7fab53dff700 1 --2- 172.21.15.22:0/2721939520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab4c157ce0 0x7fab4c158180 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fab44016000 tx=0x7fab44009750 comp rx=0 tx=0).stop 2023-07-11T00:31:27.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.553+0000 7fab53dff700 1 -- 172.21.15.22:0/2721939520 shutdown_connections 2023-07-11T00:31:27.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.553+0000 7fab53dff700 1 --2- 172.21.15.22:0/2721939520 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fab3006ace0 0x7fab3006d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.553+0000 7fab53dff700 1 --2- 172.21.15.22:0/2721939520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab4c157ce0 0x7fab4c158180 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.553+0000 7fab53dff700 1 --2- 172.21.15.22:0/2721939520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab38004d90 0x7fab4c0c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.553+0000 7fab53dff700 1 --2- 172.21.15.22:0/2721939520 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c155990 0x7fab4c155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.553+0000 7fab53dff700 1 -- 172.21.15.22:0/2721939520 >> 172.21.15.22:0/2721939520 conn(0x7fab4c06b3f0 msgr2=0x7fab4c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:27.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.554+0000 7fab53dff700 1 -- 172.21.15.22:0/2721939520 shutdown_connections 2023-07-11T00:31:27.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.554+0000 7fab53dff700 1 -- 172.21.15.22:0/2721939520 wait complete. 2023-07-11T00:31:27.576 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:31:27.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.777+0000 7fd18efff700 1 Processor -- start 2023-07-11T00:31:27.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.777+0000 7fd18efff700 1 -- start start 2023-07-11T00:31:27.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.778+0000 7fd18efff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd1880b8430 0x7fd1880cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:27.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.778+0000 7fd18efff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1880d3730 0x7fd1880cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:27.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.778+0000 7fd18efff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1880d0b20 con 0x7fd1880cfa90 2023-07-11T00:31:27.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.778+0000 7fd18efff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1880b8800 con 0x7fd1880b8430 2023-07-11T00:31:27.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.778+0000 7fd18efff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880cfeb0 con 0x7fd1880d3730 2023-07-11T00:31:27.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.779+0000 7fd18cd9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd1880b8430 0x7fd1880cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:27.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.779+0000 7fd18cd9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd1880b8430 0x7fd1880cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46554/0 (socket says 172.21.15.22:46554) 2023-07-11T00:31:27.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.779+0000 7fd18cd9b700 1 -- 172.21.15.22:0/2764141040 learned_addr learned my addr 172.21.15.22:0/2764141040 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:27.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.779+0000 7fd187fff700 1 --2- 172.21.15.22:0/2764141040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1880d3730 0x7fd1880cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:27.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.779+0000 7fd18cd9b700 1 -- 172.21.15.22:0/2764141040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1880d3730 msgr2=0x7fd1880cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:27.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.779+0000 7fd18cd9b700 1 --2- 172.21.15.22:0/2764141040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1880d3730 0x7fd1880cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.779+0000 7fd18cd9b700 1 -- 172.21.15.22:0/2764141040 >> v1:172.21.15.184:6789/0 conn(0x7fd1880cfa90 legacy=0x7fd18815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:27.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.779+0000 7fd18cd9b700 1 -- 172.21.15.22:0/2764141040 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1880b4ee0 con 0x7fd1880b8430 2023-07-11T00:31:27.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.779+0000 7fd187fff700 1 --2- 172.21.15.22:0/2764141040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1880d3730 0x7fd1880cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:27.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.780+0000 7fd18cd9b700 1 --2- 172.21.15.22:0/2764141040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1880b8430 0x7fd1880cd320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd17c0098f0 tx=0x7fd17c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a9359ac55b3968 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:27.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.780+0000 7fd1877fe700 1 -- 172.21.15.22:0/2764141040 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c00b8a0 con 0x7fd1880b8430 2023-07-11T00:31:27.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.780+0000 7fd1877fe700 1 -- 172.21.15.22:0/2764141040 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c00ba00 con 0x7fd1880b8430 2023-07-11T00:31:27.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.780+0000 7fd1877fe700 1 -- 172.21.15.22:0/2764141040 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c00bd90 con 0x7fd1880b8430 2023-07-11T00:31:27.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.780+0000 7fd18efff700 1 -- 172.21.15.22:0/2764141040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1880b8430 msgr2=0x7fd1880cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:27.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.780+0000 7fd18efff700 1 --2- 172.21.15.22:0/2764141040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1880b8430 0x7fd1880cd320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd17c0098f0 tx=0x7fd17c009c00 comp rx=0 tx=0).stop 2023-07-11T00:31:27.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.781+0000 7fd18efff700 1 -- 172.21.15.22:0/2764141040 shutdown_connections 2023-07-11T00:31:27.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.781+0000 7fd18efff700 1 --2- 172.21.15.22:0/2764141040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1880b8430 0x7fd1880cd320 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.781+0000 7fd18efff700 1 --2- 172.21.15.22:0/2764141040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1880d3730 0x7fd1880cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.781+0000 7fd18efff700 1 -- 172.21.15.22:0/2764141040 >> 172.21.15.22:0/2764141040 conn(0x7fd18806b3f0 msgr2=0x7fd18806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:27.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.781+0000 7fd18efff700 1 -- 172.21.15.22:0/2764141040 shutdown_connections 2023-07-11T00:31:27.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.781+0000 7fd18efff700 1 -- 172.21.15.22:0/2764141040 wait complete. 2023-07-11T00:31:27.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.782+0000 7fd18efff700 1 Processor -- start 2023-07-11T00:31:27.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.783+0000 7fd18efff700 1 -- start start 2023-07-11T00:31:27.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.783+0000 7fd18efff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1880b8430 0x7fd188154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:27.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.783+0000 7fd18efff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1880cfa90 0x7fd1880c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:27.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.784+0000 7fd18efff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1880d3730 0x7fd1880c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:27.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.784+0000 7fd18efff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880c95f0 con 0x7fd1880b8430 2023-07-11T00:31:27.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.784+0000 7fd18efff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18815da10 con 0x7fd1880d3730 2023-07-11T00:31:27.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.784+0000 7fd18efff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18815ce00 con 0x7fd1880cfa90 2023-07-11T00:31:27.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.784+0000 7fd18cd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1880b8430 0x7fd188154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:27.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.784+0000 7fd18cd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1880b8430 0x7fd188154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46560/0 (socket says 172.21.15.22:46560) 2023-07-11T00:31:27.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.784+0000 7fd18cd9b700 1 -- 172.21.15.22:0/1835880042 learned_addr learned my addr 172.21.15.22:0/1835880042 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:27.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.784+0000 7fd18d59c700 1 --2- 172.21.15.22:0/1835880042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1880d3730 0x7fd1880c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:27.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.784+0000 7fd187fff700 1 --2- 172.21.15.22:0/1835880042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1880cfa90 0x7fd1880c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:27.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.784+0000 7fd18cd9b700 1 -- 172.21.15.22:0/1835880042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1880cfa90 msgr2=0x7fd1880c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:27.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.784+0000 7fd18cd9b700 1 --2- 172.21.15.22:0/1835880042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1880cfa90 0x7fd1880c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.784+0000 7fd18cd9b700 1 -- 172.21.15.22:0/1835880042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1880d3730 msgr2=0x7fd1880c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:27.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.784+0000 7fd18cd9b700 1 --2- 172.21.15.22:0/1835880042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1880d3730 0x7fd1880c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:27.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.784+0000 7fd18cd9b700 1 -- 172.21.15.22:0/1835880042 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c009550 con 0x7fd1880b8430 2023-07-11T00:31:27.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.784+0000 7fd187fff700 1 --2- 172.21.15.22:0/1835880042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1880cfa90 0x7fd1880c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:27.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.785+0000 7fd18cd9b700 1 --2- 172.21.15.22:0/1835880042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1880b8430 0x7fd188154180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd17c009c40 tx=0x7fd17c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:27.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.785+0000 7fd1857fa700 1 -- 172.21.15.22:0/1835880042 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c004590 con 0x7fd1880b8430 2023-07-11T00:31:27.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.785+0000 7fd1857fa700 1 -- 172.21.15.22:0/1835880042 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c01e070 con 0x7fd1880b8430 2023-07-11T00:31:27.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.785+0000 7fd1857fa700 1 -- 172.21.15.22:0/1835880042 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c0038e0 con 0x7fd1880b8430 2023-07-11T00:31:27.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.785+0000 7fd18efff700 1 -- 172.21.15.22:0/1835880042 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18815d0e0 con 0x7fd1880b8430 2023-07-11T00:31:27.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.785+0000 7fd18efff700 1 -- 172.21.15.22:0/1835880042 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18815d6a0 con 0x7fd1880b8430 2023-07-11T00:31:27.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.786+0000 7fd18efff700 1 -- 172.21.15.22:0/1835880042 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18804ea60 con 0x7fd1880b8430 2023-07-11T00:31:27.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.787+0000 7fd1857fa700 1 -- 172.21.15.22:0/1835880042 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd17c003a40 con 0x7fd1880b8430 2023-07-11T00:31:27.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.788+0000 7fd1857fa700 1 --2- 172.21.15.22:0/1835880042 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd16c06ace0 0x7fd16c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:27.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.788+0000 7fd1857fa700 1 -- 172.21.15.22:0/1835880042 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd17c020070 con 0x7fd1880b8430 2023-07-11T00:31:27.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.789+0000 7fd187fff700 1 --2- 172.21.15.22:0/1835880042 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd16c06ace0 0x7fd16c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:27.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.790+0000 7fd187fff700 1 --2- 172.21.15.22:0/1835880042 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd16c06ace0 0x7fd16c06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd1880b63f0 tx=0x7fd174008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:27.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:27.792+0000 7fd1857fa700 1 -- 172.21.15.22:0/1835880042 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd17c0559f0 con 0x7fd1880b8430 2023-07-11T00:31:28.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.000+0000 7fd18efff700 1 -- 172.21.15.22:0/1835880042 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd18815d830 con 0x7fd1880b8430 2023-07-11T00:31:28.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.001+0000 7fd1857fa700 1 -- 172.21.15.22:0/1835880042 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd17c015020 con 0x7fd1880b8430 2023-07-11T00:31:28.003 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-07-11T00:31:28.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.003+0000 7fd18efff700 1 -- 172.21.15.22:0/1835880042 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd16c06ace0 msgr2=0x7fd16c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:28.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.003+0000 7fd18efff700 1 --2- 172.21.15.22:0/1835880042 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd16c06ace0 0x7fd16c06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd1880b63f0 tx=0x7fd174008040 comp rx=0 tx=0).stop 2023-07-11T00:31:28.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.003+0000 7fd18efff700 1 -- 172.21.15.22:0/1835880042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1880b8430 msgr2=0x7fd188154180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:28.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.003+0000 7fd18efff700 1 --2- 172.21.15.22:0/1835880042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1880b8430 0x7fd188154180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd17c009c40 tx=0x7fd17c004750 comp rx=0 tx=0).stop 2023-07-11T00:31:28.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.003+0000 7fd18efff700 1 -- 172.21.15.22:0/1835880042 shutdown_connections 2023-07-11T00:31:28.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.003+0000 7fd18efff700 1 --2- 172.21.15.22:0/1835880042 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd16c06ace0 0x7fd16c06d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.003+0000 7fd18efff700 1 --2- 172.21.15.22:0/1835880042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1880d3730 0x7fd1880c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.003+0000 7fd18efff700 1 --2- 172.21.15.22:0/1835880042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1880b8430 0x7fd188154180 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.003+0000 7fd18efff700 1 --2- 172.21.15.22:0/1835880042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1880cfa90 0x7fd1880c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.003+0000 7fd18efff700 1 -- 172.21.15.22:0/1835880042 >> 172.21.15.22:0/1835880042 conn(0x7fd18806b3f0 msgr2=0x7fd1880b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:28.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.003+0000 7fd18efff700 1 -- 172.21.15.22:0/1835880042 shutdown_connections 2023-07-11T00:31:28.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.003+0000 7fd18efff700 1 -- 172.21.15.22:0/1835880042 wait complete. 2023-07-11T00:31:28.024 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:31:28.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.226+0000 7f85239ff700 1 Processor -- start 2023-07-11T00:31:28.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.227+0000 7f85239ff700 1 -- start start 2023-07-11T00:31:28.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.228+0000 7f85239ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f851c0d3730 0x7f851c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:28.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.228+0000 7f85239ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f851c0cfa90 0x7f851c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:28.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.228+0000 7f85239ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851c0d0b20 con 0x7f851c0b8430 2023-07-11T00:31:28.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.228+0000 7f85239ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851c0cda30 con 0x7f851c0cfa90 2023-07-11T00:31:28.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.228+0000 7f85239ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851c0b8800 con 0x7f851c0d3730 2023-07-11T00:31:28.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.229+0000 7f852179b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f851c0b8430 0x7f851c0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42760/0 (socket says 172.21.15.22:42760) 2023-07-11T00:31:28.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.229+0000 7f852179b700 1 -- 172.21.15.22:0/1383175341 learned_addr learned my addr 172.21.15.22:0/1383175341 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:28.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.229+0000 7f8521f9c700 1 --2- 172.21.15.22:0/1383175341 >> v2:172.21.15.22:3300/0 conn(0x7f851c0cfa90 0x7f851c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:28.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.229+0000 7f8520f9a700 1 --2- 172.21.15.22:0/1383175341 >> v2:172.21.15.184:3300/0 conn(0x7f851c0d3730 0x7f851c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:28.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.229+0000 7f8513fff700 1 -- 172.21.15.22:0/1383175341 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150857244 0 0) 0x7f851c0d0b20 con 0x7f851c0b8430 2023-07-11T00:31:28.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.229+0000 7f8513fff700 1 -- 172.21.15.22:0/1383175341 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85080035b0 con 0x7f851c0b8430 2023-07-11T00:31:28.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.229+0000 7f8521f9c700 1 -- 172.21.15.22:0/1383175341 >> v2:172.21.15.184:3300/0 conn(0x7f851c0d3730 msgr2=0x7f851c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:28.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.229+0000 7f8521f9c700 1 --2- 172.21.15.22:0/1383175341 >> v2:172.21.15.184:3300/0 conn(0x7f851c0d3730 0x7f851c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.229+0000 7f8521f9c700 1 -- 172.21.15.22:0/1383175341 >> v1:172.21.15.22:6789/0 conn(0x7f851c0b8430 legacy=0x7f851c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:28.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.229+0000 7f8521f9c700 1 -- 172.21.15.22:0/1383175341 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c0cfe90 con 0x7f851c0cfa90 2023-07-11T00:31:28.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.229+0000 7f8521f9c700 1 --2- 172.21.15.22:0/1383175341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f851c0cfa90 0x7f851c0d0fb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f851c160f50 tx=0x7f851400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc52bfe5082119ae server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:28.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.230+0000 7f8513fff700 1 -- 172.21.15.22:0/1383175341 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851400e070 con 0x7f851c0cfa90 2023-07-11T00:31:28.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.230+0000 7f8513fff700 1 -- 172.21.15.22:0/1383175341 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851400bb20 con 0x7f851c0cfa90 2023-07-11T00:31:28.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.230+0000 7f8513fff700 1 -- 172.21.15.22:0/1383175341 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514012430 con 0x7f851c0cfa90 2023-07-11T00:31:28.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.230+0000 7f85239ff700 1 -- 172.21.15.22:0/1383175341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f851c0cfa90 msgr2=0x7f851c0d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:28.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.230+0000 7f85239ff700 1 --2- 172.21.15.22:0/1383175341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f851c0cfa90 0x7f851c0d0fb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f851c160f50 tx=0x7f851400b330 comp rx=0 tx=0).stop 2023-07-11T00:31:28.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.230+0000 7f85239ff700 1 -- 172.21.15.22:0/1383175341 shutdown_connections 2023-07-11T00:31:28.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.230+0000 7f85239ff700 1 --2- 172.21.15.22:0/1383175341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f851c0cfa90 0x7f851c0d0fb0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.230+0000 7f85239ff700 1 --2- 172.21.15.22:0/1383175341 >> v2:172.21.15.184:3300/0 conn(0x7f851c0d3730 0x7f851c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.230+0000 7f85239ff700 1 -- 172.21.15.22:0/1383175341 >> 172.21.15.22:0/1383175341 conn(0x7f851c06b3f0 msgr2=0x7f851c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:28.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.230+0000 7f85239ff700 1 -- 172.21.15.22:0/1383175341 shutdown_connections 2023-07-11T00:31:28.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.230+0000 7f85239ff700 1 -- 172.21.15.22:0/1383175341 wait complete. 2023-07-11T00:31:28.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.232+0000 7f85239ff700 1 Processor -- start 2023-07-11T00:31:28.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.232+0000 7f85239ff700 1 -- start start 2023-07-11T00:31:28.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.233+0000 7f85239ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f851c0b8430 0x7f851c14a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:28.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.233+0000 7f85239ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f851c0cfa90 0x7f851c0c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:28.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.233+0000 7f85239ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f851c0d3730 0x7f851c15e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:28.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.233+0000 7f85239ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c0c6bb0 con 0x7f851c0cfa90 2023-07-11T00:31:28.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.233+0000 7f85239ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c0c6e50 con 0x7f851c0b8430 2023-07-11T00:31:28.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.233+0000 7f85239ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c0c7130 con 0x7f851c0d3730 2023-07-11T00:31:28.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.233+0000 7f8520f9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f851c0cfa90 0x7f851c0c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:28.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.233+0000 7f8520f9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f851c0cfa90 0x7f851c0c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46578/0 (socket says 172.21.15.22:46578) 2023-07-11T00:31:28.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.233+0000 7f8520f9a700 1 -- 172.21.15.22:0/3982401313 learned_addr learned my addr 172.21.15.22:0/3982401313 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:28.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.234+0000 7f852179b700 1 --2- 172.21.15.22:0/3982401313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f851c0b8430 0x7f851c14a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:28.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.234+0000 7f8521f9c700 1 --2- 172.21.15.22:0/3982401313 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f851c0d3730 0x7f851c15e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:28.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.234+0000 7f8520f9a700 1 -- 172.21.15.22:0/3982401313 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f851c0d3730 msgr2=0x7f851c15e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:28.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.234+0000 7f8520f9a700 1 --2- 172.21.15.22:0/3982401313 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f851c0d3730 0x7f851c15e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.234+0000 7f8520f9a700 1 -- 172.21.15.22:0/3982401313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f851c0b8430 msgr2=0x7f851c14a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:28.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.234+0000 7f8520f9a700 1 --2- 172.21.15.22:0/3982401313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f851c0b8430 0x7f851c14a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.234+0000 7f8520f9a700 1 -- 172.21.15.22:0/3982401313 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8514009a70 con 0x7f851c0cfa90 2023-07-11T00:31:28.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.234+0000 7f8520f9a700 1 --2- 172.21.15.22:0/3982401313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f851c0cfa90 0x7f851c0c6670 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f850c00e870 tx=0x7f850c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:28.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.234+0000 7f8511ffb700 1 -- 172.21.15.22:0/3982401313 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c009590 con 0x7f851c0cfa90 2023-07-11T00:31:28.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.234+0000 7f8511ffb700 1 -- 172.21.15.22:0/3982401313 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c013680 con 0x7f851c0cfa90 2023-07-11T00:31:28.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.235+0000 7f8511ffb700 1 -- 172.21.15.22:0/3982401313 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c0139f0 con 0x7f851c0cfa90 2023-07-11T00:31:28.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.235+0000 7f85239ff700 1 -- 172.21.15.22:0/3982401313 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851c0c7410 con 0x7f851c0cfa90 2023-07-11T00:31:28.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.235+0000 7f85239ff700 1 -- 172.21.15.22:0/3982401313 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851c0c79d0 con 0x7f851c0cfa90 2023-07-11T00:31:28.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.236+0000 7f85239ff700 1 -- 172.21.15.22:0/3982401313 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851c0c7d40 con 0x7f851c0cfa90 2023-07-11T00:31:28.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.237+0000 7f8511ffb700 1 -- 172.21.15.22:0/3982401313 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f850c013b50 con 0x7f851c0cfa90 2023-07-11T00:31:28.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.238+0000 7f8511ffb700 1 --2- 172.21.15.22:0/3982401313 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f850006ace0 0x7f850006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:28.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.238+0000 7f8511ffb700 1 -- 172.21.15.22:0/3982401313 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f850c089710 con 0x7f851c0cfa90 2023-07-11T00:31:28.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.238+0000 7f852179b700 1 --2- 172.21.15.22:0/3982401313 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f850006ace0 0x7f850006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:28.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.239+0000 7f852179b700 1 --2- 172.21.15.22:0/3982401313 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f850006ace0 0x7f850006d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8518007fd0 tx=0x7f8518007dc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:28.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.242+0000 7f8511ffb700 1 -- 172.21.15.22:0/3982401313 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f850c057e80 con 0x7f851c0cfa90 2023-07-11T00:31:28.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.450+0000 7f85239ff700 1 -- 172.21.15.22:0/3982401313 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f851c04ea60 con 0x7f851c0cfa90 2023-07-11T00:31:28.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.450+0000 7f8511ffb700 1 -- 172.21.15.22:0/3982401313 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f850c057a10 con 0x7f851c0cfa90 2023-07-11T00:31:28.453 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:28.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.452+0000 7f85239ff700 1 -- 172.21.15.22:0/3982401313 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f850006ace0 msgr2=0x7f850006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:28.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.452+0000 7f85239ff700 1 --2- 172.21.15.22:0/3982401313 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f850006ace0 0x7f850006d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8518007fd0 tx=0x7f8518007dc0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.452+0000 7f85239ff700 1 -- 172.21.15.22:0/3982401313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f851c0cfa90 msgr2=0x7f851c0c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:28.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.452+0000 7f85239ff700 1 --2- 172.21.15.22:0/3982401313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f851c0cfa90 0x7f851c0c6670 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f850c00e870 tx=0x7f850c00eb80 comp rx=0 tx=0).stop 2023-07-11T00:31:28.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.453+0000 7f85239ff700 1 -- 172.21.15.22:0/3982401313 shutdown_connections 2023-07-11T00:31:28.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.453+0000 7f85239ff700 1 --2- 172.21.15.22:0/3982401313 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f850006ace0 0x7f850006d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.453+0000 7f85239ff700 1 --2- 172.21.15.22:0/3982401313 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f851c0d3730 0x7f851c15e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.453+0000 7f85239ff700 1 --2- 172.21.15.22:0/3982401313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f851c0b8430 0x7f851c14a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.453+0000 7f85239ff700 1 --2- 172.21.15.22:0/3982401313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f851c0cfa90 0x7f851c0c6670 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.453+0000 7f85239ff700 1 -- 172.21.15.22:0/3982401313 >> 172.21.15.22:0/3982401313 conn(0x7f851c06b3f0 msgr2=0x7f851c0d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:28.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.453+0000 7f85239ff700 1 -- 172.21.15.22:0/3982401313 shutdown_connections 2023-07-11T00:31:28.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.453+0000 7f85239ff700 1 -- 172.21.15.22:0/3982401313 wait complete. 2023-07-11T00:31:28.473 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:31:28.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.676+0000 7fc9035ff700 1 Processor -- start 2023-07-11T00:31:28.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.676+0000 7fc9035ff700 1 -- start start 2023-07-11T00:31:28.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.677+0000 7fc9035ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8fc0d3730 0x7fc8fc0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:28.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.677+0000 7fc9035ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc8fc0cfa90 0x7fc8fc0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:28.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.677+0000 7fc9035ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8fc0d0b20 con 0x7fc8fc0b8430 2023-07-11T00:31:28.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.677+0000 7fc9035ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8fc0cda30 con 0x7fc8fc0cfa90 2023-07-11T00:31:28.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.677+0000 7fc9035ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc0b8800 con 0x7fc8fc0d3730 2023-07-11T00:31:28.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.677+0000 7fc90139b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc8fc0b8430 0x7fc8fc0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42768/0 (socket says 172.21.15.22:42768) 2023-07-11T00:31:28.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.677+0000 7fc90139b700 1 -- 172.21.15.22:0/3480529050 learned_addr learned my addr 172.21.15.22:0/3480529050 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:28.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.677+0000 7fc900b9a700 1 --2- 172.21.15.22:0/3480529050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8fc0d3730 0x7fc8fc0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:28.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.677+0000 7fc901b9c700 1 --2- 172.21.15.22:0/3480529050 >> v2:172.21.15.184:3300/0 conn(0x7fc8fc0cfa90 0x7fc8fc0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:28.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.678+0000 7fc8f3fff700 1 -- 172.21.15.22:0/3480529050 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037846816 0 0) 0x7fc8fc0d0b20 con 0x7fc8fc0b8430 2023-07-11T00:31:28.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.678+0000 7fc8f3fff700 1 -- 172.21.15.22:0/3480529050 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8e80035b0 con 0x7fc8fc0b8430 2023-07-11T00:31:28.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.678+0000 7fc900b9a700 1 -- 172.21.15.22:0/3480529050 >> v2:172.21.15.184:3300/0 conn(0x7fc8fc0cfa90 msgr2=0x7fc8fc0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:28.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.678+0000 7fc900b9a700 1 --2- 172.21.15.22:0/3480529050 >> v2:172.21.15.184:3300/0 conn(0x7fc8fc0cfa90 0x7fc8fc0d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.678+0000 7fc900b9a700 1 -- 172.21.15.22:0/3480529050 >> v1:172.21.15.22:6789/0 conn(0x7fc8fc0b8430 legacy=0x7fc8fc0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:28.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.678+0000 7fc900b9a700 1 -- 172.21.15.22:0/3480529050 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc0cfeb0 con 0x7fc8fc0d3730 2023-07-11T00:31:28.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.678+0000 7fc900b9a700 1 --2- 172.21.15.22:0/3480529050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8fc0d3730 0x7fc8fc0cf550 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009840 tx=0x7fc8ec009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa7ac9edbcd6fbdd server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:28.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.678+0000 7fc8f3fff700 1 -- 172.21.15.22:0/3480529050 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec011830 con 0x7fc8fc0d3730 2023-07-11T00:31:28.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.678+0000 7fc8f3fff700 1 -- 172.21.15.22:0/3480529050 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec011990 con 0x7fc8fc0d3730 2023-07-11T00:31:28.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.678+0000 7fc8f3fff700 1 -- 172.21.15.22:0/3480529050 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec011d20 con 0x7fc8fc0d3730 2023-07-11T00:31:28.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.679+0000 7fc9035ff700 1 -- 172.21.15.22:0/3480529050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8fc0d3730 msgr2=0x7fc8fc0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:28.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.679+0000 7fc9035ff700 1 --2- 172.21.15.22:0/3480529050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8fc0d3730 0x7fc8fc0cf550 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009840 tx=0x7fc8ec009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:28.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.679+0000 7fc9035ff700 1 -- 172.21.15.22:0/3480529050 shutdown_connections 2023-07-11T00:31:28.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.679+0000 7fc9035ff700 1 --2- 172.21.15.22:0/3480529050 >> v2:172.21.15.184:3300/0 conn(0x7fc8fc0cfa90 0x7fc8fc0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.679+0000 7fc9035ff700 1 --2- 172.21.15.22:0/3480529050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8fc0d3730 0x7fc8fc0cf550 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.679+0000 7fc9035ff700 1 -- 172.21.15.22:0/3480529050 >> 172.21.15.22:0/3480529050 conn(0x7fc8fc06b3f0 msgr2=0x7fc8fc06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:28.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.679+0000 7fc9035ff700 1 -- 172.21.15.22:0/3480529050 shutdown_connections 2023-07-11T00:31:28.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.679+0000 7fc9035ff700 1 -- 172.21.15.22:0/3480529050 wait complete. 2023-07-11T00:31:28.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.681+0000 7fc9035ff700 1 Processor -- start 2023-07-11T00:31:28.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.681+0000 7fc9035ff700 1 -- start start 2023-07-11T00:31:28.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.682+0000 7fc9035ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8fc0b8430 0x7fc8fc1582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:28.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.682+0000 7fc9035ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8fc0cfa90 0x7fc8fc0c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:28.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.682+0000 7fc9035ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8fc0d3730 0x7fc8fc15eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:28.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.682+0000 7fc9035ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc0cce80 con 0x7fc8fc0b8430 2023-07-11T00:31:28.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.682+0000 7fc9035ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc158820 con 0x7fc8fc0d3730 2023-07-11T00:31:28.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.682+0000 7fc9035ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc0c7030 con 0x7fc8fc0cfa90 2023-07-11T00:31:28.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.682+0000 7fc90139b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8fc0b8430 0x7fc8fc1582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:28.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.682+0000 7fc90139b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8fc0b8430 0x7fc8fc1582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46582/0 (socket says 172.21.15.22:46582) 2023-07-11T00:31:28.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.682+0000 7fc90139b700 1 -- 172.21.15.22:0/1524269371 learned_addr learned my addr 172.21.15.22:0/1524269371 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:28.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.682+0000 7fc900b9a700 1 --2- 172.21.15.22:0/1524269371 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8fc0cfa90 0x7fc8fc0c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:28.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.683+0000 7fc901b9c700 1 --2- 172.21.15.22:0/1524269371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8fc0d3730 0x7fc8fc15eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:28.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.683+0000 7fc90139b700 1 -- 172.21.15.22:0/1524269371 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8fc0cfa90 msgr2=0x7fc8fc0c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:28.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.683+0000 7fc90139b700 1 --2- 172.21.15.22:0/1524269371 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8fc0cfa90 0x7fc8fc0c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.683+0000 7fc90139b700 1 -- 172.21.15.22:0/1524269371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8fc0d3730 msgr2=0x7fc8fc15eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:28.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.683+0000 7fc90139b700 1 --2- 172.21.15.22:0/1524269371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8fc0d3730 0x7fc8fc15eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.683+0000 7fc90139b700 1 -- 172.21.15.22:0/1524269371 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec0094a0 con 0x7fc8fc0b8430 2023-07-11T00:31:28.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.683+0000 7fc901b9c700 1 --2- 172.21.15.22:0/1524269371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8fc0d3730 0x7fc8fc15eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:28.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.683+0000 7fc90139b700 1 --2- 172.21.15.22:0/1524269371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8fc0b8430 0x7fc8fc1582e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800c700 tx=0x7fc8f800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:28.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.683+0000 7fc8f1ffb700 1 -- 172.21.15.22:0/1524269371 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8005d70 con 0x7fc8fc0b8430 2023-07-11T00:31:28.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.683+0000 7fc8f1ffb700 1 -- 172.21.15.22:0/1524269371 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f80070d0 con 0x7fc8fc0b8430 2023-07-11T00:31:28.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.683+0000 7fc8f1ffb700 1 -- 172.21.15.22:0/1524269371 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8007460 con 0x7fc8fc0b8430 2023-07-11T00:31:28.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.683+0000 7fc9035ff700 1 -- 172.21.15.22:0/1524269371 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8fc0c72d0 con 0x7fc8fc0b8430 2023-07-11T00:31:28.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.683+0000 7fc9035ff700 1 -- 172.21.15.22:0/1524269371 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8fc0c7890 con 0x7fc8fc0b8430 2023-07-11T00:31:28.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.684+0000 7fc9035ff700 1 -- 172.21.15.22:0/1524269371 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8fc04ea60 con 0x7fc8fc0b8430 2023-07-11T00:31:28.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.685+0000 7fc8f1ffb700 1 -- 172.21.15.22:0/1524269371 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc8f80075c0 con 0x7fc8fc0b8430 2023-07-11T00:31:28.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.687+0000 7fc8f1ffb700 1 --2- 172.21.15.22:0/1524269371 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc8e006ace0 0x7fc8e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:28.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.687+0000 7fc8f1ffb700 1 -- 172.21.15.22:0/1524269371 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc8f8088e20 con 0x7fc8fc0b8430 2023-07-11T00:31:28.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.687+0000 7fc900b9a700 1 --2- 172.21.15.22:0/1524269371 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc8e006ace0 0x7fc8e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:28.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.688+0000 7fc900b9a700 1 --2- 172.21.15.22:0/1524269371 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc8e006ace0 0x7fc8e006d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec000c00 tx=0x7fc8ec008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:28.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.691+0000 7fc8f1ffb700 1 -- 172.21.15.22:0/1524269371 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc8f8053b10 con 0x7fc8fc0b8430 2023-07-11T00:31:28.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.899+0000 7fc9035ff700 1 -- 172.21.15.22:0/1524269371 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc8fc06b8d0 con 0x7fc8fc0b8430 2023-07-11T00:31:28.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.900+0000 7fc8f1ffb700 1 -- 172.21.15.22:0/1524269371 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc8f8057130 con 0x7fc8fc0b8430 2023-07-11T00:31:28.902 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-07-11T00:31:28.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.902+0000 7fc9035ff700 1 -- 172.21.15.22:0/1524269371 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc8e006ace0 msgr2=0x7fc8e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:28.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.902+0000 7fc9035ff700 1 --2- 172.21.15.22:0/1524269371 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc8e006ace0 0x7fc8e006d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec000c00 tx=0x7fc8ec008030 comp rx=0 tx=0).stop 2023-07-11T00:31:28.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.902+0000 7fc9035ff700 1 -- 172.21.15.22:0/1524269371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8fc0b8430 msgr2=0x7fc8fc1582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:28.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.902+0000 7fc9035ff700 1 --2- 172.21.15.22:0/1524269371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8fc0b8430 0x7fc8fc1582e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800c700 tx=0x7fc8f800cac0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.902+0000 7fc9035ff700 1 -- 172.21.15.22:0/1524269371 shutdown_connections 2023-07-11T00:31:28.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.902+0000 7fc9035ff700 1 --2- 172.21.15.22:0/1524269371 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc8e006ace0 0x7fc8e006d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.902+0000 7fc9035ff700 1 --2- 172.21.15.22:0/1524269371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8fc0d3730 0x7fc8fc15eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.902+0000 7fc9035ff700 1 --2- 172.21.15.22:0/1524269371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8fc0b8430 0x7fc8fc1582e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.902+0000 7fc9035ff700 1 --2- 172.21.15.22:0/1524269371 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8fc0cfa90 0x7fc8fc0c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:28.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.902+0000 7fc9035ff700 1 -- 172.21.15.22:0/1524269371 >> 172.21.15.22:0/1524269371 conn(0x7fc8fc06b3f0 msgr2=0x7fc8fc0d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:28.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.902+0000 7fc9035ff700 1 -- 172.21.15.22:0/1524269371 shutdown_connections 2023-07-11T00:31:28.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:28.902+0000 7fc9035ff700 1 -- 172.21.15.22:0/1524269371 wait complete. 2023-07-11T00:31:28.923 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-11T00:31:29.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.124+0000 7f04975ff700 1 Processor -- start 2023-07-11T00:31:29.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.125+0000 7f04975ff700 1 -- start start 2023-07-11T00:31:29.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.126+0000 7f04975ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f049015c3e0 0x7f04900b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:29.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.126+0000 7f04975ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04900b0440 con 0x7f04900ccd30 2023-07-11T00:31:29.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.126+0000 7f04975ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04900cd1a0 con 0x7f04901605d0 2023-07-11T00:31:29.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.126+0000 7f04975ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049015c7b0 con 0x7f049015c3e0 2023-07-11T00:31:29.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.126+0000 7f0494b9a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f04900ccd30 0x7f049015fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42774/0 (socket says 172.21.15.22:42774) 2023-07-11T00:31:29.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.126+0000 7f0494b9a700 1 -- 172.21.15.22:0/2613785210 learned_addr learned my addr 172.21.15.22:0/2613785210 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:29.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.126+0000 7f049539b700 1 --2- 172.21.15.22:0/2613785210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f049015c3e0 0x7f04900b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:29.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f0487fff700 1 -- 172.21.15.22:0/2613785210 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823779334 0 0) 0x7f04900b0440 con 0x7f04900ccd30 2023-07-11T00:31:29.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f0487fff700 1 -- 172.21.15.22:0/2613785210 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f047c0035b0 con 0x7f04900ccd30 2023-07-11T00:31:29.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f0487fff700 1 -- 172.21.15.22:0/2613785210 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3657081108 0 0) 0x7f047c0035b0 con 0x7f04900ccd30 2023-07-11T00:31:29.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f0487fff700 1 -- 172.21.15.22:0/2613785210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f049015c3e0 msgr2=0x7f04900b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:29.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f0487fff700 1 --2- 172.21.15.22:0/2613785210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f049015c3e0 0x7f04900b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f0487fff700 1 -- 172.21.15.22:0/2613785210 >> v1:172.21.15.184:6789/0 conn(0x7f04901605d0 legacy=0x7f04900c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:29.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f0487fff700 1 -- 172.21.15.22:0/2613785210 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04900af830 con 0x7f04900ccd30 2023-07-11T00:31:29.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f0487fff700 1 -- 172.21.15.22:0/2613785210 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7f0480001670 con 0x7f04900ccd30 2023-07-11T00:31:29.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f0487fff700 1 -- 172.21.15.22:0/2613785210 >> v1:172.21.15.22:6789/0 conn(0x7f04900ccd30 legacy=0x7f049015fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:29.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f0487fff700 1 --2- 172.21.15.22:0/2613785210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f047c003a30 0x7f047c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:29.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f0487fff700 1 --2- 172.21.15.22:0/2613785210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f049015c3e0 0x7f047c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:29.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f0487fff700 1 --2- 172.21.15.22:0/2613785210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f047c004d90 0x7f047c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:29.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f0487fff700 1 -- 172.21.15.22:0/2613785210 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049015c7b0 con 0x7f047c003a30 2023-07-11T00:31:29.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f0487fff700 1 -- 172.21.15.22:0/2613785210 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047c00bac0 con 0x7f047c004d90 2023-07-11T00:31:29.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f0487fff700 1 -- 172.21.15.22:0/2613785210 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047c00bc00 con 0x7f049015c3e0 2023-07-11T00:31:29.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f049539b700 1 --2- 172.21.15.22:0/2613785210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f047c003a30 0x7f047c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:29.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f0494b9a700 1 --2- 172.21.15.22:0/2613785210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f049015c3e0 0x7f047c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:29.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.127+0000 7f0495b9c700 1 --2- 172.21.15.22:0/2613785210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f047c004d90 0x7f047c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:29.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.128+0000 7f049539b700 1 -- 172.21.15.22:0/2613785210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f049015c3e0 msgr2=0x7f047c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:29.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.128+0000 7f049539b700 1 --2- 172.21.15.22:0/2613785210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f049015c3e0 0x7f047c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.128+0000 7f049539b700 1 -- 172.21.15.22:0/2613785210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f047c004d90 msgr2=0x7f047c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:29.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.128+0000 7f049539b700 1 --2- 172.21.15.22:0/2613785210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f047c004d90 0x7f047c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.128+0000 7f049539b700 1 -- 172.21.15.22:0/2613785210 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c0035b0 con 0x7f047c003a30 2023-07-11T00:31:29.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.128+0000 7f049539b700 1 --2- 172.21.15.22:0/2613785210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f047c003a30 0x7f047c003e00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f048c009b40 tx=0x7f047c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f750db795db26d71 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:29.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.128+0000 7f0487fff700 1 -- 172.21.15.22:0/2613785210 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c005a20 con 0x7f047c003a30 2023-07-11T00:31:29.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.128+0000 7f0487fff700 1 -- 172.21.15.22:0/2613785210 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048c005b80 con 0x7f047c003a30 2023-07-11T00:31:29.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.128+0000 7f0487fff700 1 -- 172.21.15.22:0/2613785210 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c00e6c0 con 0x7f047c003a30 2023-07-11T00:31:29.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.129+0000 7f04975ff700 1 -- 172.21.15.22:0/2613785210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f047c003a30 msgr2=0x7f047c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:29.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.129+0000 7f04975ff700 1 --2- 172.21.15.22:0/2613785210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f047c003a30 0x7f047c003e00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f048c009b40 tx=0x7f047c005880 comp rx=0 tx=0).stop 2023-07-11T00:31:29.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.129+0000 7f0495b9c700 1 -- 172.21.15.22:0/2613785210 reap_dead start 2023-07-11T00:31:29.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.129+0000 7f04975ff700 1 -- 172.21.15.22:0/2613785210 shutdown_connections 2023-07-11T00:31:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.129+0000 7f04975ff700 1 -- 172.21.15.22:0/2613785210 >> 172.21.15.22:0/2613785210 conn(0x7f049006b960 msgr2=0x7f0490098a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.129+0000 7f04975ff700 1 -- 172.21.15.22:0/2613785210 shutdown_connections 2023-07-11T00:31:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.129+0000 7f04975ff700 1 -- 172.21.15.22:0/2613785210 wait complete. 2023-07-11T00:31:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.132+0000 7f04975ff700 1 Processor -- start 2023-07-11T00:31:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.132+0000 7f04975ff700 1 -- start start 2023-07-11T00:31:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.133+0000 7f04975ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f047c003a30 0x7f04900c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.133+0000 7f04975ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04900c8040 0x7f049015f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.133+0000 7f04975ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04900b3dd0 0x7f04900b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.133+0000 7f04975ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900c6fa0 con 0x7f04900b3dd0 2023-07-11T00:31:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.133+0000 7f04975ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900c7280 con 0x7f04900c8040 2023-07-11T00:31:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.133+0000 7f04975ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04900c7560 con 0x7f047c003a30 2023-07-11T00:31:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.133+0000 7f0495b9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04900b3dd0 0x7f04900b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.133+0000 7f049539b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f047c003a30 0x7f04900c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.133+0000 7f0495b9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04900b3dd0 0x7f04900b4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46598/0 (socket says 172.21.15.22:46598) 2023-07-11T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.133+0000 7f0495b9c700 1 -- 172.21.15.22:0/3846392165 learned_addr learned my addr 172.21.15.22:0/3846392165 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.134+0000 7f0494b9a700 1 --2- 172.21.15.22:0/3846392165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04900c8040 0x7f049015f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.134+0000 7f0495b9c700 1 -- 172.21.15.22:0/3846392165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f047c003a30 msgr2=0x7f04900c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.134+0000 7f0495b9c700 1 --2- 172.21.15.22:0/3846392165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f047c003a30 0x7f04900c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.134+0000 7f0495b9c700 1 -- 172.21.15.22:0/3846392165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04900c8040 msgr2=0x7f049015f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.134+0000 7f0495b9c700 1 --2- 172.21.15.22:0/3846392165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04900c8040 0x7f049015f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.134+0000 7f0495b9c700 1 -- 172.21.15.22:0/3846392165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04900c7840 con 0x7f04900b3dd0 2023-07-11T00:31:29.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.134+0000 7f049539b700 1 --2- 172.21.15.22:0/3846392165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f047c003a30 0x7f04900c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:29.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.134+0000 7f0495b9c700 1 --2- 172.21.15.22:0/3846392165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04900b3dd0 0x7f04900b4220 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f049006d320 tx=0x7f048800e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:29.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.136+0000 7f0485ffb700 1 -- 172.21.15.22:0/3846392165 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488003c10 con 0x7f04900b3dd0 2023-07-11T00:31:29.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.136+0000 7f04975ff700 1 -- 172.21.15.22:0/3846392165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04900c7b20 con 0x7f04900b3dd0 2023-07-11T00:31:29.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.136+0000 7f0485ffb700 1 -- 172.21.15.22:0/3846392165 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0488003d70 con 0x7f04900b3dd0 2023-07-11T00:31:29.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.136+0000 7f0485ffb700 1 -- 172.21.15.22:0/3846392165 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488005310 con 0x7f04900b3dd0 2023-07-11T00:31:29.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.136+0000 7f04975ff700 1 -- 172.21.15.22:0/3846392165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04900b4760 con 0x7f04900b3dd0 2023-07-11T00:31:29.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.137+0000 7f04975ff700 1 -- 172.21.15.22:0/3846392165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04900cd650 con 0x7f04900b3dd0 2023-07-11T00:31:29.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.138+0000 7f0485ffb700 1 -- 172.21.15.22:0/3846392165 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0488005470 con 0x7f04900b3dd0 2023-07-11T00:31:29.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.140+0000 7f0485ffb700 1 --2- 172.21.15.22:0/3846392165 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f047406ace0 0x7f047406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:29.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.140+0000 7f0485ffb700 1 -- 172.21.15.22:0/3846392165 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0488088ff0 con 0x7f04900b3dd0 2023-07-11T00:31:29.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.140+0000 7f049539b700 1 --2- 172.21.15.22:0/3846392165 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f047406ace0 0x7f047406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:29.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.141+0000 7f049539b700 1 --2- 172.21.15.22:0/3846392165 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f047406ace0 0x7f047406d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f048c00a010 tx=0x7f048c01d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:29.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.144+0000 7f0485ffb700 1 -- 172.21.15.22:0/3846392165 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f04880bb380 con 0x7f04900b3dd0 2023-07-11T00:31:29.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.348+0000 7f04975ff700 1 -- 172.21.15.22:0/3846392165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f04900c7d10 con 0x7f04900b3dd0 2023-07-11T00:31:29.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.349+0000 7f0485ffb700 1 -- 172.21.15.22:0/3846392165 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0488019020 con 0x7f04900b3dd0 2023-07-11T00:31:29.351 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:29.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.351+0000 7f04975ff700 1 -- 172.21.15.22:0/3846392165 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f047406ace0 msgr2=0x7f047406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:29.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.351+0000 7f04975ff700 1 --2- 172.21.15.22:0/3846392165 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f047406ace0 0x7f047406d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f048c00a010 tx=0x7f048c01d040 comp rx=0 tx=0).stop 2023-07-11T00:31:29.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.351+0000 7f04975ff700 1 -- 172.21.15.22:0/3846392165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04900b3dd0 msgr2=0x7f04900b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:29.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.351+0000 7f04975ff700 1 --2- 172.21.15.22:0/3846392165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04900b3dd0 0x7f04900b4220 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f049006d320 tx=0x7f048800e9e0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.351+0000 7f04975ff700 1 -- 172.21.15.22:0/3846392165 shutdown_connections 2023-07-11T00:31:29.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.351+0000 7f04975ff700 1 --2- 172.21.15.22:0/3846392165 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f047406ace0 0x7f047406d190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.351+0000 7f04975ff700 1 --2- 172.21.15.22:0/3846392165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f047c003a30 0x7f04900c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.351+0000 7f04975ff700 1 --2- 172.21.15.22:0/3846392165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04900b3dd0 0x7f04900b4220 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.351+0000 7f04975ff700 1 --2- 172.21.15.22:0/3846392165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04900c8040 0x7f049015f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.351+0000 7f04975ff700 1 -- 172.21.15.22:0/3846392165 >> 172.21.15.22:0/3846392165 conn(0x7f049006b960 msgr2=0x7f049006d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:29.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.351+0000 7f04975ff700 1 -- 172.21.15.22:0/3846392165 shutdown_connections 2023-07-11T00:31:29.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.351+0000 7f04975ff700 1 -- 172.21.15.22:0/3846392165 wait complete. 2023-07-11T00:31:29.372 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-11T00:31:29.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.570+0000 7fd5249ff700 1 Processor -- start 2023-07-11T00:31:29.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.570+0000 7fd5249ff700 1 -- start start 2023-07-11T00:31:29.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.572+0000 7fd5249ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd52015c460 0x7fd5200b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:29.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.572+0000 7fd5249ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd5200cf8f0 0x7fd52015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:29.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.572+0000 7fd5249ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5200d1790 con 0x7fd5200d2640 2023-07-11T00:31:29.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.572+0000 7fd5249ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5200cedd0 con 0x7fd52015c460 2023-07-11T00:31:29.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.572+0000 7fd5249ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5200cd950 con 0x7fd5200cf8f0 2023-07-11T00:31:29.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.572+0000 7fd51e59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd52015c460 0x7fd5200b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:29.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.572+0000 7fd517fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd5200d2640 0x7fd5200cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42776/0 (socket says 172.21.15.22:42776) 2023-07-11T00:31:29.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.572+0000 7fd517fff700 1 -- 172.21.15.22:0/4125890774 learned_addr learned my addr 172.21.15.22:0/4125890774 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:29.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.572+0000 7fd51ed9d700 1 --2- 172.21.15.22:0/4125890774 >> v2:172.21.15.184:3300/0 conn(0x7fd5200cf8f0 0x7fd52015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:29.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.572+0000 7fd51e59c700 1 -- 172.21.15.22:0/4125890774 >> v2:172.21.15.184:3300/0 conn(0x7fd5200cf8f0 msgr2=0x7fd52015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:29.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.572+0000 7fd51e59c700 1 --2- 172.21.15.22:0/4125890774 >> v2:172.21.15.184:3300/0 conn(0x7fd5200cf8f0 0x7fd52015fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.572+0000 7fd51e59c700 1 -- 172.21.15.22:0/4125890774 >> v1:172.21.15.22:6789/0 conn(0x7fd5200d2640 legacy=0x7fd5200cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:29.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.572+0000 7fd51e59c700 1 -- 172.21.15.22:0/4125890774 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5200d14b0 con 0x7fd52015c460 2023-07-11T00:31:29.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.572+0000 7fd51dd9b700 1 -- 172.21.15.22:0/4125890774 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993244785 0 0) 0x7fd5200d1790 con 0x7fd5200d2640 2023-07-11T00:31:29.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.573+0000 7fd51e59c700 1 --2- 172.21.15.22:0/4125890774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd52015c460 0x7fd5200b59d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd520072140 tx=0x7fd510009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286841608797f424 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:29.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.573+0000 7fd51dd9b700 1 -- 172.21.15.22:0/4125890774 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510011830 con 0x7fd52015c460 2023-07-11T00:31:29.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.573+0000 7fd51dd9b700 1 -- 172.21.15.22:0/4125890774 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd510011990 con 0x7fd52015c460 2023-07-11T00:31:29.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.573+0000 7fd51dd9b700 1 -- 172.21.15.22:0/4125890774 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510011d20 con 0x7fd52015c460 2023-07-11T00:31:29.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.573+0000 7fd5249ff700 1 -- 172.21.15.22:0/4125890774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd52015c460 msgr2=0x7fd5200b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:29.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.573+0000 7fd5249ff700 1 --2- 172.21.15.22:0/4125890774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd52015c460 0x7fd5200b59d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd520072140 tx=0x7fd510009b20 comp rx=0 tx=0).stop 2023-07-11T00:31:29.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.574+0000 7fd5249ff700 1 -- 172.21.15.22:0/4125890774 shutdown_connections 2023-07-11T00:31:29.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.574+0000 7fd5249ff700 1 --2- 172.21.15.22:0/4125890774 >> v2:172.21.15.184:3300/0 conn(0x7fd5200cf8f0 0x7fd52015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.574+0000 7fd5249ff700 1 --2- 172.21.15.22:0/4125890774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd52015c460 0x7fd5200b59d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.574+0000 7fd5249ff700 1 -- 172.21.15.22:0/4125890774 >> 172.21.15.22:0/4125890774 conn(0x7fd520071660 msgr2=0x7fd520071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:29.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.574+0000 7fd5249ff700 1 -- 172.21.15.22:0/4125890774 shutdown_connections 2023-07-11T00:31:29.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.574+0000 7fd5249ff700 1 -- 172.21.15.22:0/4125890774 wait complete. 2023-07-11T00:31:29.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.575+0000 7fd5249ff700 1 Processor -- start 2023-07-11T00:31:29.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.576+0000 7fd5249ff700 1 -- start start 2023-07-11T00:31:29.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.576+0000 7fd5249ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5200cf8f0 0x7fd52015e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:29.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.577+0000 7fd5249ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5200d2640 0x7fd520155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:29.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.577+0000 7fd5249ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd52015c460 0x7fd5200c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:29.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.577+0000 7fd5249ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52015dec0 con 0x7fd5200cf8f0 2023-07-11T00:31:29.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.577+0000 7fd5249ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5201557a0 con 0x7fd52015c460 2023-07-11T00:31:29.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.577+0000 7fd5249ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52015d240 con 0x7fd5200d2640 2023-07-11T00:31:29.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.577+0000 7fd51e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5200cf8f0 0x7fd52015e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:29.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.577+0000 7fd51e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5200cf8f0 0x7fd52015e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46620/0 (socket says 172.21.15.22:46620) 2023-07-11T00:31:29.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.577+0000 7fd51e59c700 1 -- 172.21.15.22:0/3195946025 learned_addr learned my addr 172.21.15.22:0/3195946025 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:29.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.577+0000 7fd517fff700 1 --2- 172.21.15.22:0/3195946025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5200d2640 0x7fd520155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:29.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.577+0000 7fd51ed9d700 1 --2- 172.21.15.22:0/3195946025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd52015c460 0x7fd5200c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:29.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.577+0000 7fd51e59c700 1 -- 172.21.15.22:0/3195946025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5200d2640 msgr2=0x7fd520155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:29.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.577+0000 7fd51e59c700 1 --2- 172.21.15.22:0/3195946025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5200d2640 0x7fd520155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.577+0000 7fd51e59c700 1 -- 172.21.15.22:0/3195946025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd52015c460 msgr2=0x7fd5200c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:29.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.577+0000 7fd51e59c700 1 --2- 172.21.15.22:0/3195946025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd52015c460 0x7fd5200c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.577+0000 7fd51e59c700 1 -- 172.21.15.22:0/3195946025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5100094a0 con 0x7fd5200cf8f0 2023-07-11T00:31:29.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.577+0000 7fd51e59c700 1 --2- 172.21.15.22:0/3195946025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5200cf8f0 0x7fd52015e2e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd5100090b0 tx=0x7fd510004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:29.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.578+0000 7fd516ffd700 1 -- 172.21.15.22:0/3195946025 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5100038a0 con 0x7fd5200cf8f0 2023-07-11T00:31:29.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.578+0000 7fd516ffd700 1 -- 172.21.15.22:0/3195946025 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51001f070 con 0x7fd5200cf8f0 2023-07-11T00:31:29.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.578+0000 7fd5249ff700 1 -- 172.21.15.22:0/3195946025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52015d520 con 0x7fd5200cf8f0 2023-07-11T00:31:29.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.578+0000 7fd516ffd700 1 -- 172.21.15.22:0/3195946025 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510003c20 con 0x7fd5200cf8f0 2023-07-11T00:31:29.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.578+0000 7fd5249ff700 1 -- 172.21.15.22:0/3195946025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52015dae0 con 0x7fd5200cf8f0 2023-07-11T00:31:29.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.579+0000 7fd5249ff700 1 -- 172.21.15.22:0/3195946025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52004ea60 con 0x7fd5200cf8f0 2023-07-11T00:31:29.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.580+0000 7fd516ffd700 1 -- 172.21.15.22:0/3195946025 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd51001a430 con 0x7fd5200cf8f0 2023-07-11T00:31:29.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.581+0000 7fd516ffd700 1 --2- 172.21.15.22:0/3195946025 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd50006ace0 0x7fd50006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:29.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.582+0000 7fd516ffd700 1 -- 172.21.15.22:0/3195946025 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd510021070 con 0x7fd5200cf8f0 2023-07-11T00:31:29.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.582+0000 7fd517fff700 1 --2- 172.21.15.22:0/3195946025 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd50006ace0 0x7fd50006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:29.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.583+0000 7fd517fff700 1 --2- 172.21.15.22:0/3195946025 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd50006ace0 0x7fd50006d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd52015f950 tx=0x7fd508007c90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:29.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.586+0000 7fd516ffd700 1 -- 172.21.15.22:0/3195946025 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd5100bd380 con 0x7fd5200cf8f0 2023-07-11T00:31:29.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.809+0000 7fd5249ff700 1 -- 172.21.15.22:0/3195946025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd5200b4fa0 con 0x7fd5200cf8f0 2023-07-11T00:31:29.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.810+0000 7fd516ffd700 1 -- 172.21.15.22:0/3195946025 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd51005de60 con 0x7fd5200cf8f0 2023-07-11T00:31:29.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.812+0000 7fd5249ff700 1 -- 172.21.15.22:0/3195946025 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd50006ace0 msgr2=0x7fd50006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:29.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.812+0000 7fd5249ff700 1 --2- 172.21.15.22:0/3195946025 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd50006ace0 0x7fd50006d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd52015f950 tx=0x7fd508007c90 comp rx=0 tx=0).stop 2023-07-11T00:31:29.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.812+0000 7fd5249ff700 1 -- 172.21.15.22:0/3195946025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5200cf8f0 msgr2=0x7fd52015e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:29.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.812+0000 7fd5249ff700 1 --2- 172.21.15.22:0/3195946025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5200cf8f0 0x7fd52015e2e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd5100090b0 tx=0x7fd510004750 comp rx=0 tx=0).stop 2023-07-11T00:31:29.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.812+0000 7fd5249ff700 1 -- 172.21.15.22:0/3195946025 shutdown_connections 2023-07-11T00:31:29.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.812+0000 7fd5249ff700 1 --2- 172.21.15.22:0/3195946025 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd50006ace0 0x7fd50006d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.812+0000 7fd5249ff700 1 --2- 172.21.15.22:0/3195946025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd52015c460 0x7fd5200c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.812+0000 7fd5249ff700 1 --2- 172.21.15.22:0/3195946025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5200cf8f0 0x7fd52015e2e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.812+0000 7fd5249ff700 1 --2- 172.21.15.22:0/3195946025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5200d2640 0x7fd520155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.812+0000 7fd5249ff700 1 -- 172.21.15.22:0/3195946025 >> 172.21.15.22:0/3195946025 conn(0x7fd520071660 msgr2=0x7fd52015fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.812+0000 7fd5249ff700 1 -- 172.21.15.22:0/3195946025 shutdown_connections 2023-07-11T00:31:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:29.812+0000 7fd5249ff700 1 -- 172.21.15.22:0/3195946025 wait complete. 2023-07-11T00:31:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2023-07-11T00:31:29.832 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-07-11T00:31:29.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:29.833 DEBUG:teuthology.orchestra.run.smithi184:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-07-11T00:31:29.928 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-07-11T00:31:29.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:31:29.929 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-11T00:31:29.983 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-11T00:31:29.985 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:31:30.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.189+0000 7f349d7ff700 1 Processor -- start 2023-07-11T00:31:30.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.189+0000 7f349d7ff700 1 -- start start 2023-07-11T00:31:30.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.190+0000 7f349d7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34980d2640 0x7f34980b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:30.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.190+0000 7f349d7ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f34980cf8f0 0x7f349815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:30.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.190+0000 7f349d7ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34980d1790 con 0x7f349815c460 2023-07-11T00:31:30.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.190+0000 7f349d7ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34980cedd0 con 0x7f34980cf8f0 2023-07-11T00:31:30.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.190+0000 7f349d7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34980cd950 con 0x7f34980d2640 2023-07-11T00:31:30.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.190+0000 7f3496ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f349815c460 0x7f34980cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55380/0 (socket says 172.21.15.22:55380) 2023-07-11T00:31:30.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.190+0000 7f3496ffd700 1 -- 172.21.15.22:0/511680726 learned_addr learned my addr 172.21.15.22:0/511680726 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:30.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.191+0000 7f34967fc700 1 --2- 172.21.15.22:0/511680726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34980d2640 0x7f34980b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:30.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.191+0000 7f34977fe700 1 --2- 172.21.15.22:0/511680726 >> v2:172.21.15.184:3300/0 conn(0x7f34980cf8f0 0x7f349815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:30.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.191+0000 7f3495ffb700 1 -- 172.21.15.22:0/511680726 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104456232 0 0) 0x7f34980d1790 con 0x7f349815c460 2023-07-11T00:31:30.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.191+0000 7f3495ffb700 1 -- 172.21.15.22:0/511680726 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34800035b0 con 0x7f349815c460 2023-07-11T00:31:30.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.191+0000 7f34977fe700 1 -- 172.21.15.22:0/511680726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34980d2640 msgr2=0x7f34980b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:30.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.191+0000 7f34977fe700 1 --2- 172.21.15.22:0/511680726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34980d2640 0x7f34980b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:30.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.191+0000 7f34977fe700 1 -- 172.21.15.22:0/511680726 >> v1:172.21.15.22:6789/0 conn(0x7f349815c460 legacy=0x7f34980cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:30.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.191+0000 7f34977fe700 1 -- 172.21.15.22:0/511680726 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34980d14b0 con 0x7f34980cf8f0 2023-07-11T00:31:30.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.191+0000 7f34977fe700 1 --2- 172.21.15.22:0/511680726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34980cf8f0 0x7f349815fe20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3490009d90 tx=0x7f349000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=369ddab0108a0232 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:30.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.192+0000 7f3495ffb700 1 -- 172.21.15.22:0/511680726 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349000e070 con 0x7f34980cf8f0 2023-07-11T00:31:30.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.192+0000 7f3495ffb700 1 -- 172.21.15.22:0/511680726 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349000bb20 con 0x7f34980cf8f0 2023-07-11T00:31:30.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.192+0000 7f3495ffb700 1 -- 172.21.15.22:0/511680726 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490012430 con 0x7f34980cf8f0 2023-07-11T00:31:30.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.192+0000 7f349d7ff700 1 -- 172.21.15.22:0/511680726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34980cf8f0 msgr2=0x7f349815fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:30.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.192+0000 7f349d7ff700 1 --2- 172.21.15.22:0/511680726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34980cf8f0 0x7f349815fe20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3490009d90 tx=0x7f349000b330 comp rx=0 tx=0).stop 2023-07-11T00:31:30.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.192+0000 7f349d7ff700 1 -- 172.21.15.22:0/511680726 shutdown_connections 2023-07-11T00:31:30.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.192+0000 7f349d7ff700 1 --2- 172.21.15.22:0/511680726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34980cf8f0 0x7f349815fe20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:30.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.192+0000 7f349d7ff700 1 --2- 172.21.15.22:0/511680726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34980d2640 0x7f34980b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:30.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.192+0000 7f349d7ff700 1 -- 172.21.15.22:0/511680726 >> 172.21.15.22:0/511680726 conn(0x7f3498071660 msgr2=0x7f3498071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:30.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.192+0000 7f349d7ff700 1 -- 172.21.15.22:0/511680726 shutdown_connections 2023-07-11T00:31:30.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.192+0000 7f349d7ff700 1 -- 172.21.15.22:0/511680726 wait complete. 2023-07-11T00:31:30.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.194+0000 7f349d7ff700 1 Processor -- start 2023-07-11T00:31:30.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.194+0000 7f349d7ff700 1 -- start start 2023-07-11T00:31:30.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.195+0000 7f349d7ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34980cf8f0 0x7f349814e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:30.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.195+0000 7f349d7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34980d2640 0x7f34980c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:30.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.195+0000 7f349d7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f349815c460 0x7f34980c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:30.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.195+0000 7f349d7ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3498150fb0 con 0x7f34980cf8f0 2023-07-11T00:31:30.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.195+0000 7f349d7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34981509f0 con 0x7f349815c460 2023-07-11T00:31:30.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.195+0000 7f349d7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3498150cd0 con 0x7f34980d2640 2023-07-11T00:31:30.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.195+0000 7f3496ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34980cf8f0 0x7f349814e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:30.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.196+0000 7f3496ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34980cf8f0 0x7f349814e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55612/0 (socket says 172.21.15.22:55612) 2023-07-11T00:31:30.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.196+0000 7f3496ffd700 1 -- 172.21.15.22:0/2259564918 learned_addr learned my addr 172.21.15.22:0/2259564918 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:30.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.196+0000 7f34967fc700 1 --2- 172.21.15.22:0/2259564918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34980d2640 0x7f34980c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:30.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.196+0000 7f34977fe700 1 --2- 172.21.15.22:0/2259564918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f349815c460 0x7f34980c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:30.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.196+0000 7f3496ffd700 1 -- 172.21.15.22:0/2259564918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34980d2640 msgr2=0x7f34980c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:30.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.196+0000 7f3496ffd700 1 --2- 172.21.15.22:0/2259564918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34980d2640 0x7f34980c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:30.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.196+0000 7f3496ffd700 1 -- 172.21.15.22:0/2259564918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f349815c460 msgr2=0x7f34980c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:30.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.196+0000 7f3496ffd700 1 --2- 172.21.15.22:0/2259564918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f349815c460 0x7f34980c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:30.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.196+0000 7f3496ffd700 1 -- 172.21.15.22:0/2259564918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3490009a70 con 0x7f34980cf8f0 2023-07-11T00:31:30.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.196+0000 7f3496ffd700 1 --2- 172.21.15.22:0/2259564918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34980cf8f0 0x7f349814e160 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f348800c700 tx=0x7f348800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:30.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.196+0000 7f347f7fe700 1 -- 172.21.15.22:0/2259564918 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3488005d70 con 0x7f34980cf8f0 2023-07-11T00:31:30.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.196+0000 7f347f7fe700 1 -- 172.21.15.22:0/2259564918 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34880070d0 con 0x7f34980cf8f0 2023-07-11T00:31:30.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.196+0000 7f347f7fe700 1 -- 172.21.15.22:0/2259564918 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3488007460 con 0x7f34980cf8f0 2023-07-11T00:31:30.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.196+0000 7f349d7ff700 1 -- 172.21.15.22:0/2259564918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34980c67e0 con 0x7f34980cf8f0 2023-07-11T00:31:30.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.197+0000 7f349d7ff700 1 -- 172.21.15.22:0/2259564918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34980c9c50 con 0x7f34980cf8f0 2023-07-11T00:31:30.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.198+0000 7f349d7ff700 1 -- 172.21.15.22:0/2259564918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349804ea60 con 0x7f34980cf8f0 2023-07-11T00:31:30.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.199+0000 7f347f7fe700 1 -- 172.21.15.22:0/2259564918 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f34880075c0 con 0x7f34980cf8f0 2023-07-11T00:31:30.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.199+0000 7f347f7fe700 1 --2- 172.21.15.22:0/2259564918 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f348406ace0 0x7f348406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:30.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.200+0000 7f347f7fe700 1 -- 172.21.15.22:0/2259564918 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3488088c40 con 0x7f34980cf8f0 2023-07-11T00:31:30.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.200+0000 7f34967fc700 1 --2- 172.21.15.22:0/2259564918 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f348406ace0 0x7f348406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:30.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.201+0000 7f34967fc700 1 --2- 172.21.15.22:0/2259564918 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f348406ace0 0x7f348406d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f34980cf7e0 tx=0x7f348c009210 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:30.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.204+0000 7f347f7fe700 1 -- 172.21.15.22:0/2259564918 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f34880539b0 con 0x7f34980cf8f0 2023-07-11T00:31:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.454+0000 7f349d7ff700 1 -- 172.21.15.22:0/2259564918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34980b4fa0 con 0x7f34980cf8f0 2023-07-11T00:31:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.455+0000 7f347f7fe700 1 -- 172.21.15.22:0/2259564918 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f3488017090 con 0x7f34980cf8f0 2023-07-11T00:31:30.457 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:30.458 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3244868368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3244868368},{"type":"v1","addr":"172.21.15.22:6833","nonce":3244868368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/907204261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":907204261},{"type":"v1","addr":"172.21.15.184:6836","nonce":907204261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/1214375050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1214375050},{"type":"v1","addr":"172.21.15.22:6835","nonce":1214375050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:30:05.408970+0000","modified":"2023-07-11T00:30:33.631426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3376322541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3376322541},{"type":"v1","addr":"172.21.15.184:6837","nonce":3376322541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-11T00:31:30.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.457+0000 7f349d7ff700 1 -- 172.21.15.22:0/2259564918 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f348406ace0 msgr2=0x7f348406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:30.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.457+0000 7f349d7ff700 1 --2- 172.21.15.22:0/2259564918 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f348406ace0 0x7f348406d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f34980cf7e0 tx=0x7f348c009210 comp rx=0 tx=0).stop 2023-07-11T00:31:30.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.457+0000 7f349d7ff700 1 -- 172.21.15.22:0/2259564918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34980cf8f0 msgr2=0x7f349814e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:30.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.457+0000 7f349d7ff700 1 --2- 172.21.15.22:0/2259564918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34980cf8f0 0x7f349814e160 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f348800c700 tx=0x7f348800ca10 comp rx=0 tx=0).stop 2023-07-11T00:31:30.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.458+0000 7f349d7ff700 1 -- 172.21.15.22:0/2259564918 shutdown_connections 2023-07-11T00:31:30.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.458+0000 7f349d7ff700 1 --2- 172.21.15.22:0/2259564918 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f348406ace0 0x7f348406d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:30.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.458+0000 7f349d7ff700 1 --2- 172.21.15.22:0/2259564918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f349815c460 0x7f34980c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:30.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.458+0000 7f349d7ff700 1 --2- 172.21.15.22:0/2259564918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34980cf8f0 0x7f349814e160 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:30.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.458+0000 7f349d7ff700 1 --2- 172.21.15.22:0/2259564918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34980d2640 0x7f34980c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:30.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.458+0000 7f349d7ff700 1 -- 172.21.15.22:0/2259564918 >> 172.21.15.22:0/2259564918 conn(0x7f3498071660 msgr2=0x7f349815c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:30.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.458+0000 7f349d7ff700 1 -- 172.21.15.22:0/2259564918 shutdown_connections 2023-07-11T00:31:30.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.458+0000 7f349d7ff700 1 -- 172.21.15.22:0/2259564918 wait complete. 2023-07-11T00:31:30.465 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 9 2023-07-11T00:31:30.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:31:30.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.677+0000 7f6a721ff700 1 Processor -- start 2023-07-11T00:31:30.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.677+0000 7f6a721ff700 1 -- start start 2023-07-11T00:31:30.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.678+0000 7f6a721ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6a6c0b59d0 0x7f6a6c1671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:30.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.678+0000 7f6a721ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6c0d1790 con 0x7f6a6c15c460 2023-07-11T00:31:30.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.678+0000 7f6a721ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6c0cd950 con 0x7f6a6c0d2640 2023-07-11T00:31:30.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.679+0000 7f6a721ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6c0b5e10 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.679+0000 7f6a6b7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6a6c15c460 0x7f6a6c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55382/0 (socket says 172.21.15.22:55382) 2023-07-11T00:31:30.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.679+0000 7f6a6b7fe700 1 -- 172.21.15.22:0/1946271240 learned_addr learned my addr 172.21.15.22:0/1946271240 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:30.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.679+0000 7f6a6bfff700 1 --2- 172.21.15.22:0/1946271240 >> v2:172.21.15.22:3300/0 conn(0x7f6a6c0b59d0 0x7f6a6c1671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:30.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.679+0000 7f6a6a7fc700 1 -- 172.21.15.22:0/1946271240 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983497982 0 0) 0x7f6a6c0d1790 con 0x7f6a6c15c460 2023-07-11T00:31:30.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.679+0000 7f6a6a7fc700 1 -- 172.21.15.22:0/1946271240 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a540035b0 con 0x7f6a6c15c460 2023-07-11T00:31:30.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.679+0000 7f6a6bfff700 1 -- 172.21.15.22:0/1946271240 >> v1:172.21.15.184:6789/0 conn(0x7f6a6c0d2640 legacy=0x7f6a6c0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:30.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.679+0000 7f6a6bfff700 1 -- 172.21.15.22:0/1946271240 >> v1:172.21.15.22:6789/0 conn(0x7f6a6c15c460 legacy=0x7f6a6c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:30.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.679+0000 7f6a6bfff700 1 -- 172.21.15.22:0/1946271240 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c0d14b0 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.680+0000 7f6a6bfff700 1 --2- 172.21.15.22:0/1946271240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a6c0b59d0 0x7f6a6c1671b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009d90 tx=0x7f6a6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb0c4bdfdc97e73 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:30.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.680+0000 7f6a6a7fc700 1 -- 172.21.15.22:0/1946271240 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6400e070 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.680+0000 7f6a6a7fc700 1 -- 172.21.15.22:0/1946271240 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6400bb20 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.680+0000 7f6a6a7fc700 1 -- 172.21.15.22:0/1946271240 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64012430 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.680+0000 7f6a721ff700 1 -- 172.21.15.22:0/1946271240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a6c0b59d0 msgr2=0x7f6a6c1671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:30.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.680+0000 7f6a721ff700 1 --2- 172.21.15.22:0/1946271240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a6c0b59d0 0x7f6a6c1671b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009d90 tx=0x7f6a6400b330 comp rx=0 tx=0).stop 2023-07-11T00:31:30.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.680+0000 7f6a721ff700 1 -- 172.21.15.22:0/1946271240 shutdown_connections 2023-07-11T00:31:30.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.680+0000 7f6a721ff700 1 --2- 172.21.15.22:0/1946271240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a6c0b59d0 0x7f6a6c1671b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:30.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.680+0000 7f6a721ff700 1 -- 172.21.15.22:0/1946271240 >> 172.21.15.22:0/1946271240 conn(0x7f6a6c071660 msgr2=0x7f6a6c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:30.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.681+0000 7f6a721ff700 1 -- 172.21.15.22:0/1946271240 shutdown_connections 2023-07-11T00:31:30.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.681+0000 7f6a721ff700 1 -- 172.21.15.22:0/1946271240 wait complete. 2023-07-11T00:31:30.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.682+0000 7f6a721ff700 1 Processor -- start 2023-07-11T00:31:30.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.682+0000 7f6a721ff700 1 -- start start 2023-07-11T00:31:30.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.683+0000 7f6a721ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a6c0b59d0 0x7f6a6c14c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:30.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.683+0000 7f6a721ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a6c0d2640 0x7f6a6c0cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:30.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.683+0000 7f6a721ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a6c15c460 0x7f6a6c0cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:30.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.683+0000 7f6a721ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c0c9450 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.683+0000 7f6a721ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c0c8880 con 0x7f6a6c15c460 2023-07-11T00:31:30.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.683+0000 7f6a721ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c0c8b20 con 0x7f6a6c0d2640 2023-07-11T00:31:30.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.684+0000 7f6a6b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a6c0b59d0 0x7f6a6c14c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:30.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.684+0000 7f6a6b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a6c0b59d0 0x7f6a6c14c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55632/0 (socket says 172.21.15.22:55632) 2023-07-11T00:31:30.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.684+0000 7f6a6b7fe700 1 -- 172.21.15.22:0/2388669424 learned_addr learned my addr 172.21.15.22:0/2388669424 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:30.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.684+0000 7f6a6b7fe700 1 -- 172.21.15.22:0/2388669424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a6c0d2640 msgr2=0x7f6a6c0cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:30.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.684+0000 7f6a6b7fe700 1 --2- 172.21.15.22:0/2388669424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a6c0d2640 0x7f6a6c0cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:30.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.684+0000 7f6a6b7fe700 1 -- 172.21.15.22:0/2388669424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a6c15c460 msgr2=0x7f6a6c0cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:30.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.684+0000 7f6a6b7fe700 1 --2- 172.21.15.22:0/2388669424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a6c15c460 0x7f6a6c0cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:30.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.684+0000 7f6a6b7fe700 1 -- 172.21.15.22:0/2388669424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a64009a70 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.684+0000 7f6a6b7fe700 1 --2- 172.21.15.22:0/2388669424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a6c0b59d0 0x7f6a6c14c9c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00c700 tx=0x7f6a5c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:30.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.685+0000 7f6a53fff700 1 -- 172.21.15.22:0/2388669424 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c005d70 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.685+0000 7f6a53fff700 1 -- 172.21.15.22:0/2388669424 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c0070d0 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.685+0000 7f6a721ff700 1 -- 172.21.15.22:0/2388669424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6c0c8e00 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.685+0000 7f6a53fff700 1 -- 172.21.15.22:0/2388669424 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c007460 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.685+0000 7f6a721ff700 1 -- 172.21.15.22:0/2388669424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6c14d0d0 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.686+0000 7f6a721ff700 1 -- 172.21.15.22:0/2388669424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6c14d290 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.687+0000 7f6a53fff700 1 -- 172.21.15.22:0/2388669424 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a5c0075c0 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.688+0000 7f6a53fff700 1 --2- 172.21.15.22:0/2388669424 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6a5806ace0 0x7f6a5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:30.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.688+0000 7f6a53fff700 1 -- 172.21.15.22:0/2388669424 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6a5c088e20 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.688+0000 7f6a6affd700 1 --2- 172.21.15.22:0/2388669424 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6a5806ace0 0x7f6a5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:30.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.689+0000 7f6a6affd700 1 --2- 172.21.15.22:0/2388669424 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6a5806ace0 0x7f6a5806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6a60000f60 tx=0x7f6a60007a40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:30.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.693+0000 7f6a53fff700 1 -- 172.21.15.22:0/2388669424 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6a5c053b10 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.900+0000 7f6a721ff700 1 -- 172.21.15.22:0/2388669424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a6c04ea60 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.901+0000 7f6a53fff700 1 -- 172.21.15.22:0/2388669424 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f6a5c057130 con 0x7f6a6c0b59d0 2023-07-11T00:31:30.910 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:30.910 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:54.208536+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:31:30.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.904+0000 7f6a721ff700 1 -- 172.21.15.22:0/2388669424 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6a5806ace0 msgr2=0x7f6a5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:30.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.904+0000 7f6a721ff700 1 --2- 172.21.15.22:0/2388669424 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6a5806ace0 0x7f6a5806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6a60000f60 tx=0x7f6a60007a40 comp rx=0 tx=0).stop 2023-07-11T00:31:30.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.904+0000 7f6a721ff700 1 -- 172.21.15.22:0/2388669424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a6c0b59d0 msgr2=0x7f6a6c14c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:30.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.904+0000 7f6a721ff700 1 --2- 172.21.15.22:0/2388669424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a6c0b59d0 0x7f6a6c14c9c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00c700 tx=0x7f6a5c00cac0 comp rx=0 tx=0).stop 2023-07-11T00:31:30.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.904+0000 7f6a721ff700 1 -- 172.21.15.22:0/2388669424 shutdown_connections 2023-07-11T00:31:30.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.904+0000 7f6a721ff700 1 --2- 172.21.15.22:0/2388669424 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f6a5806ace0 0x7f6a5806d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:30.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.904+0000 7f6a721ff700 1 --2- 172.21.15.22:0/2388669424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a6c15c460 0x7f6a6c0cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:30.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.904+0000 7f6a721ff700 1 --2- 172.21.15.22:0/2388669424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a6c0b59d0 0x7f6a6c14c9c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:30.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.904+0000 7f6a721ff700 1 --2- 172.21.15.22:0/2388669424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a6c0d2640 0x7f6a6c0cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:30.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.904+0000 7f6a721ff700 1 -- 172.21.15.22:0/2388669424 >> 172.21.15.22:0/2388669424 conn(0x7f6a6c071660 msgr2=0x7f6a6c0d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:30.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.904+0000 7f6a721ff700 1 -- 172.21.15.22:0/2388669424 shutdown_connections 2023-07-11T00:31:30.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:30.904+0000 7f6a721ff700 1 -- 172.21.15.22:0/2388669424 wait complete. 2023-07-11T00:31:30.925 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:29:57.631007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:29:58.547599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:30:03.826184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:30:04.383448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-11T00:30:08.075875+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-11T00:31:30.926 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:31:31.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.128+0000 7f87e55ff700 1 Processor -- start 2023-07-11T00:31:31.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.129+0000 7f87e55ff700 1 -- start start 2023-07-11T00:31:31.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.130+0000 7f87e55ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f87e00b8430 0x7f87e00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:31.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.130+0000 7f87e55ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f87e00cfc60 0x7f87e00d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:31.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.130+0000 7f87e55ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e00d0b20 con 0x7f87e00d3730 2023-07-11T00:31:31.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.130+0000 7f87e55ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e00b8800 con 0x7f87e00cfc60 2023-07-11T00:31:31.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.130+0000 7f87e55ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e00b4ee0 con 0x7f87e00b8430 2023-07-11T00:31:31.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.130+0000 7f87de7fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f87e00d3730 0x7f87e00cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55388/0 (socket says 172.21.15.22:55388) 2023-07-11T00:31:31.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.130+0000 7f87de7fc700 1 -- 172.21.15.22:0/1444333483 learned_addr learned my addr 172.21.15.22:0/1444333483 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:31.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.130+0000 7f87df7fe700 1 --2- 172.21.15.22:0/1444333483 >> v2:172.21.15.22:3300/0 conn(0x7f87e00cfc60 0x7f87e00d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:31.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.130+0000 7f87deffd700 1 --2- 172.21.15.22:0/1444333483 >> v2:172.21.15.184:3300/0 conn(0x7f87e00b8430 0x7f87e00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:31.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.131+0000 7f87df7fe700 1 -- 172.21.15.22:0/1444333483 >> v2:172.21.15.184:3300/0 conn(0x7f87e00b8430 msgr2=0x7f87e00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:31.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.131+0000 7f87df7fe700 1 --2- 172.21.15.22:0/1444333483 >> v2:172.21.15.184:3300/0 conn(0x7f87e00b8430 0x7f87e00cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.131+0000 7f87df7fe700 1 -- 172.21.15.22:0/1444333483 >> v1:172.21.15.22:6789/0 conn(0x7f87e00d3730 legacy=0x7f87e00cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:31.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.131+0000 7f87ddffb700 1 -- 172.21.15.22:0/1444333483 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944902915 0 0) 0x7f87e00d0b20 con 0x7f87e00d3730 2023-07-11T00:31:31.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.131+0000 7f87df7fe700 1 -- 172.21.15.22:0/1444333483 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e00b51c0 con 0x7f87e00cfc60 2023-07-11T00:31:31.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.131+0000 7f87df7fe700 1 --2- 172.21.15.22:0/1444333483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87e00cfc60 0x7f87e00d0fb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f87e00cf520 tx=0x7f87d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa0c15115681738 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:31.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.131+0000 7f87ddffb700 1 -- 172.21.15.22:0/1444333483 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d800e070 con 0x7f87e00cfc60 2023-07-11T00:31:31.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.131+0000 7f87ddffb700 1 -- 172.21.15.22:0/1444333483 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d800bb20 con 0x7f87e00cfc60 2023-07-11T00:31:31.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.131+0000 7f87ddffb700 1 -- 172.21.15.22:0/1444333483 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8012430 con 0x7f87e00cfc60 2023-07-11T00:31:31.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.132+0000 7f87e55ff700 1 -- 172.21.15.22:0/1444333483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87e00cfc60 msgr2=0x7f87e00d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:31.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.132+0000 7f87e55ff700 1 --2- 172.21.15.22:0/1444333483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87e00cfc60 0x7f87e00d0fb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f87e00cf520 tx=0x7f87d800b330 comp rx=0 tx=0).stop 2023-07-11T00:31:31.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.132+0000 7f87e55ff700 1 -- 172.21.15.22:0/1444333483 shutdown_connections 2023-07-11T00:31:31.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.132+0000 7f87e55ff700 1 --2- 172.21.15.22:0/1444333483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87e00cfc60 0x7f87e00d0fb0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.132+0000 7f87e55ff700 1 --2- 172.21.15.22:0/1444333483 >> v2:172.21.15.184:3300/0 conn(0x7f87e00b8430 0x7f87e00cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.132+0000 7f87e55ff700 1 -- 172.21.15.22:0/1444333483 >> 172.21.15.22:0/1444333483 conn(0x7f87e006b3f0 msgr2=0x7f87e006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:31.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.132+0000 7f87e55ff700 1 -- 172.21.15.22:0/1444333483 shutdown_connections 2023-07-11T00:31:31.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.132+0000 7f87e55ff700 1 -- 172.21.15.22:0/1444333483 wait complete. 2023-07-11T00:31:31.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.134+0000 7f87e55ff700 1 Processor -- start 2023-07-11T00:31:31.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.134+0000 7f87e55ff700 1 -- start start 2023-07-11T00:31:31.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.135+0000 7f87e55ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e00b8430 0x7f87e00c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:31.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.135+0000 7f87e55ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87e00cfc60 0x7f87e015d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:31.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.135+0000 7f87e55ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e00d3730 0x7f87e015dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:31.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.135+0000 7f87e55ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e015e6d0 con 0x7f87e00cfc60 2023-07-11T00:31:31.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.135+0000 7f87e55ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e015cc10 con 0x7f87e00d3730 2023-07-11T00:31:31.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.135+0000 7f87e55ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e015e3f0 con 0x7f87e00b8430 2023-07-11T00:31:31.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.135+0000 7f87de7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87e00cfc60 0x7f87e015d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:31.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.135+0000 7f87de7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87e00cfc60 0x7f87e015d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55652/0 (socket says 172.21.15.22:55652) 2023-07-11T00:31:31.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.135+0000 7f87de7fc700 1 -- 172.21.15.22:0/3103564238 learned_addr learned my addr 172.21.15.22:0/3103564238 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:31.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.135+0000 7f87deffd700 1 --2- 172.21.15.22:0/3103564238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e00b8430 0x7f87e00c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:31.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.135+0000 7f87df7fe700 1 --2- 172.21.15.22:0/3103564238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e00d3730 0x7f87e015dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:31.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.136+0000 7f87de7fc700 1 -- 172.21.15.22:0/3103564238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e00b8430 msgr2=0x7f87e00c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:31.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.136+0000 7f87de7fc700 1 --2- 172.21.15.22:0/3103564238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e00b8430 0x7f87e00c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.136+0000 7f87de7fc700 1 -- 172.21.15.22:0/3103564238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e00d3730 msgr2=0x7f87e015dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:31.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.136+0000 7f87de7fc700 1 --2- 172.21.15.22:0/3103564238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e00d3730 0x7f87e015dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.136+0000 7f87de7fc700 1 -- 172.21.15.22:0/3103564238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d8009a70 con 0x7f87e00cfc60 2023-07-11T00:31:31.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.136+0000 7f87deffd700 1 --2- 172.21.15.22:0/3103564238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e00b8430 0x7f87e00c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:31.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.136+0000 7f87de7fc700 1 --2- 172.21.15.22:0/3103564238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87e00cfc60 0x7f87e015d7b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f87d400c550 tx=0x7f87d400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:31.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.136+0000 7f87c77fe700 1 -- 172.21.15.22:0/3103564238 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4004c80 con 0x7f87e00cfc60 2023-07-11T00:31:31.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.136+0000 7f87c77fe700 1 -- 172.21.15.22:0/3103564238 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d4004e00 con 0x7f87e00cfc60 2023-07-11T00:31:31.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.136+0000 7f87c77fe700 1 -- 172.21.15.22:0/3103564238 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4007310 con 0x7f87e00cfc60 2023-07-11T00:31:31.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.136+0000 7f87e55ff700 1 -- 172.21.15.22:0/3103564238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e00c6810 con 0x7f87e00cfc60 2023-07-11T00:31:31.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.136+0000 7f87e55ff700 1 -- 172.21.15.22:0/3103564238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e00c6dd0 con 0x7f87e00cfc60 2023-07-11T00:31:31.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.138+0000 7f87e55ff700 1 -- 172.21.15.22:0/3103564238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e00c6670 con 0x7f87e00cfc60 2023-07-11T00:31:31.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.138+0000 7f87c77fe700 1 -- 172.21.15.22:0/3103564238 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f87d4007470 con 0x7f87e00cfc60 2023-07-11T00:31:31.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.140+0000 7f87c77fe700 1 --2- 172.21.15.22:0/3103564238 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87cc06ace0 0x7f87cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:31.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.140+0000 7f87c77fe700 1 -- 172.21.15.22:0/3103564238 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f87d4089490 con 0x7f87e00cfc60 2023-07-11T00:31:31.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.140+0000 7f87deffd700 1 --2- 172.21.15.22:0/3103564238 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87cc06ace0 0x7f87cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:31.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.141+0000 7f87deffd700 1 --2- 172.21.15.22:0/3103564238 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87cc06ace0 0x7f87cc06d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009c30 tx=0x7f87d0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:31.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.145+0000 7f87c77fe700 1 -- 172.21.15.22:0/3103564238 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f87e00c6670 con 0x7f87e00cfc60 2023-07-11T00:31:31.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.350+0000 7f87e55ff700 1 -- 172.21.15.22:0/3103564238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f87e00c6670 con 0x7f87e00cfc60 2023-07-11T00:31:31.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.350+0000 7f87c77fe700 1 -- 172.21.15.22:0/3103564238 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f87e00c6670 con 0x7f87e00cfc60 2023-07-11T00:31:31.353 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2023-07-11T00:31:31.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.353+0000 7f87e55ff700 1 -- 172.21.15.22:0/3103564238 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87cc06ace0 msgr2=0x7f87cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:31.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.353+0000 7f87e55ff700 1 --2- 172.21.15.22:0/3103564238 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87cc06ace0 0x7f87cc06d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009c30 tx=0x7f87d0008040 comp rx=0 tx=0).stop 2023-07-11T00:31:31.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.353+0000 7f87e55ff700 1 -- 172.21.15.22:0/3103564238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87e00cfc60 msgr2=0x7f87e015d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:31.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.353+0000 7f87e55ff700 1 --2- 172.21.15.22:0/3103564238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87e00cfc60 0x7f87e015d7b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f87d400c550 tx=0x7f87d400c910 comp rx=0 tx=0).stop 2023-07-11T00:31:31.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.353+0000 7f87e55ff700 1 -- 172.21.15.22:0/3103564238 shutdown_connections 2023-07-11T00:31:31.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.353+0000 7f87e55ff700 1 --2- 172.21.15.22:0/3103564238 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f87cc06ace0 0x7f87cc06d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.353+0000 7f87e55ff700 1 --2- 172.21.15.22:0/3103564238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e00b8430 0x7f87e00c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.353+0000 7f87e55ff700 1 --2- 172.21.15.22:0/3103564238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e00d3730 0x7f87e015dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.353+0000 7f87e55ff700 1 --2- 172.21.15.22:0/3103564238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87e00cfc60 0x7f87e015d7b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.353+0000 7f87e55ff700 1 -- 172.21.15.22:0/3103564238 >> 172.21.15.22:0/3103564238 conn(0x7f87e006b3f0 msgr2=0x7f87e00b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:31.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.353+0000 7f87e55ff700 1 -- 172.21.15.22:0/3103564238 shutdown_connections 2023-07-11T00:31:31.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.353+0000 7f87e55ff700 1 -- 172.21.15.22:0/3103564238 wait complete. 2023-07-11T00:31:31.373 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:31:31.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.576+0000 7fbc19fff700 1 Processor -- start 2023-07-11T00:31:31.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.576+0000 7fbc19fff700 1 -- start start 2023-07-11T00:31:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.577+0000 7fbc19fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbc140b8430 0x7fbc140cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.577+0000 7fbc19fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbc140d3730 0x7fbc140cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.577+0000 7fbc19fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc140cfa90 0x7fbc1415feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.577+0000 7fbc19fff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc140b8800 con 0x7fbc140d3730 2023-07-11T00:31:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.577+0000 7fbc19fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc140d0b20 con 0x7fbc140b8430 2023-07-11T00:31:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.577+0000 7fbc19fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc140cfeb0 con 0x7fbc140cfa90 2023-07-11T00:31:31.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.578+0000 7fbc12ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbc140d3730 0x7fbc140cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:31.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.578+0000 7fbc12ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbc140d3730 0x7fbc140cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55658/0 (socket says 172.21.15.22:55658) 2023-07-11T00:31:31.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.578+0000 7fbc12ffd700 1 -- 172.21.15.22:0/1540985550 learned_addr learned my addr 172.21.15.22:0/1540985550 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:31.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.578+0000 7fbc137fe700 1 --2- 172.21.15.22:0/1540985550 >> v2:172.21.15.184:3300/0 conn(0x7fbc140b8430 0x7fbc140cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:31.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.578+0000 7fbc12ffd700 1 -- 172.21.15.22:0/1540985550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc140cfa90 msgr2=0x7fbc1415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:31.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.578+0000 7fbc13fff700 1 --2- 172.21.15.22:0/1540985550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc140cfa90 0x7fbc1415feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:31.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.578+0000 7fbc12ffd700 1 --2- 172.21.15.22:0/1540985550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc140cfa90 0x7fbc1415feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.578+0000 7fbc12ffd700 1 -- 172.21.15.22:0/1540985550 >> v2:172.21.15.184:3300/0 conn(0x7fbc140b8430 msgr2=0x7fbc140cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:31.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.578+0000 7fbc12ffd700 1 --2- 172.21.15.22:0/1540985550 >> v2:172.21.15.184:3300/0 conn(0x7fbc140b8430 0x7fbc140cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.578+0000 7fbc12ffd700 1 -- 172.21.15.22:0/1540985550 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc140b4ee0 con 0x7fbc140d3730 2023-07-11T00:31:31.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.578+0000 7fbc137fe700 1 --2- 172.21.15.22:0/1540985550 >> v2:172.21.15.184:3300/0 conn(0x7fbc140b8430 0x7fbc140cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:31.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.578+0000 7fbc13fff700 1 --2- 172.21.15.22:0/1540985550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc140cfa90 0x7fbc1415feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:31.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.578+0000 7fbc12ffd700 1 --2- 172.21.15.22:0/1540985550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc140d3730 0x7fbc140cf550 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbc140cf520 tx=0x7fbc08009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90adffeadc759c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:31.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.579+0000 7fbc127fc700 1 -- 172.21.15.22:0/1540985550 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0800b870 con 0x7fbc140d3730 2023-07-11T00:31:31.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.579+0000 7fbc127fc700 1 -- 172.21.15.22:0/1540985550 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0800b9d0 con 0x7fbc140d3730 2023-07-11T00:31:31.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.579+0000 7fbc127fc700 1 -- 172.21.15.22:0/1540985550 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0800bd60 con 0x7fbc140d3730 2023-07-11T00:31:31.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.579+0000 7fbc19fff700 1 -- 172.21.15.22:0/1540985550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc140d3730 msgr2=0x7fbc140cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:31.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.579+0000 7fbc19fff700 1 --2- 172.21.15.22:0/1540985550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc140d3730 0x7fbc140cf550 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbc140cf520 tx=0x7fbc08009bd0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.579+0000 7fbc19fff700 1 -- 172.21.15.22:0/1540985550 shutdown_connections 2023-07-11T00:31:31.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.579+0000 7fbc19fff700 1 --2- 172.21.15.22:0/1540985550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc140cfa90 0x7fbc1415feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.579+0000 7fbc19fff700 1 --2- 172.21.15.22:0/1540985550 >> v2:172.21.15.184:3300/0 conn(0x7fbc140b8430 0x7fbc140cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.579+0000 7fbc19fff700 1 --2- 172.21.15.22:0/1540985550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc140d3730 0x7fbc140cf550 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.579+0000 7fbc19fff700 1 -- 172.21.15.22:0/1540985550 >> 172.21.15.22:0/1540985550 conn(0x7fbc1406b3f0 msgr2=0x7fbc1406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:31.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.579+0000 7fbc19fff700 1 -- 172.21.15.22:0/1540985550 shutdown_connections 2023-07-11T00:31:31.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.579+0000 7fbc19fff700 1 -- 172.21.15.22:0/1540985550 wait complete. 2023-07-11T00:31:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.581+0000 7fbc19fff700 1 Processor -- start 2023-07-11T00:31:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.581+0000 7fbc19fff700 1 -- start start 2023-07-11T00:31:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.582+0000 7fbc19fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc140b8430 0x7fbc140c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.582+0000 7fbc19fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc140cfa90 0x7fbc140c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.582+0000 7fbc19fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc140d3730 0x7fbc140c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.582+0000 7fbc19fff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc141f3070 con 0x7fbc140d3730 2023-07-11T00:31:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.582+0000 7fbc19fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc140c95f0 con 0x7fbc140cfa90 2023-07-11T00:31:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.582+0000 7fbc19fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc141f23f0 con 0x7fbc140b8430 2023-07-11T00:31:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.582+0000 7fbc13fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc140d3730 0x7fbc140c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.582+0000 7fbc13fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc140d3730 0x7fbc140c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55674/0 (socket says 172.21.15.22:55674) 2023-07-11T00:31:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.582+0000 7fbc13fff700 1 -- 172.21.15.22:0/1442165521 learned_addr learned my addr 172.21.15.22:0/1442165521 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.583+0000 7fbc137fe700 1 --2- 172.21.15.22:0/1442165521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc140b8430 0x7fbc140c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.583+0000 7fbc12ffd700 1 --2- 172.21.15.22:0/1442165521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc140cfa90 0x7fbc140c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.583+0000 7fbc13fff700 1 -- 172.21.15.22:0/1442165521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc140b8430 msgr2=0x7fbc140c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:31.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.583+0000 7fbc13fff700 1 --2- 172.21.15.22:0/1442165521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc140b8430 0x7fbc140c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.583+0000 7fbc13fff700 1 -- 172.21.15.22:0/1442165521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc140cfa90 msgr2=0x7fbc140c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:31.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.583+0000 7fbc13fff700 1 --2- 172.21.15.22:0/1442165521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc140cfa90 0x7fbc140c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.583+0000 7fbc13fff700 1 -- 172.21.15.22:0/1442165521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc08009550 con 0x7fbc140d3730 2023-07-11T00:31:31.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.583+0000 7fbc13fff700 1 --2- 172.21.15.22:0/1442165521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc140d3730 0x7fbc140c7530 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c00cd50 tx=0x7fbc0c00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:31.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.583+0000 7fbbfbfff700 1 -- 172.21.15.22:0/1442165521 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c00cea0 con 0x7fbc140d3730 2023-07-11T00:31:31.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.583+0000 7fbbfbfff700 1 -- 172.21.15.22:0/1442165521 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0c00f480 con 0x7fbc140d3730 2023-07-11T00:31:31.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.583+0000 7fbc19fff700 1 -- 172.21.15.22:0/1442165521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc141f26d0 con 0x7fbc140d3730 2023-07-11T00:31:31.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.583+0000 7fbbfbfff700 1 -- 172.21.15.22:0/1442165521 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c00f830 con 0x7fbc140d3730 2023-07-11T00:31:31.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.584+0000 7fbc19fff700 1 -- 172.21.15.22:0/1442165521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc141f2c90 con 0x7fbc140d3730 2023-07-11T00:31:31.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.584+0000 7fbc19fff700 1 -- 172.21.15.22:0/1442165521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc140cf880 con 0x7fbc140d3730 2023-07-11T00:31:31.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.586+0000 7fbbfbfff700 1 -- 172.21.15.22:0/1442165521 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc0c00b040 con 0x7fbc140d3730 2023-07-11T00:31:31.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.587+0000 7fbbfbfff700 1 --2- 172.21.15.22:0/1442165521 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbc0006ace0 0x7fbc0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:31.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.587+0000 7fbbfbfff700 1 -- 172.21.15.22:0/1442165521 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbc0c089e60 con 0x7fbc140d3730 2023-07-11T00:31:31.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.587+0000 7fbc137fe700 1 --2- 172.21.15.22:0/1442165521 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbc0006ace0 0x7fbc0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:31.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.588+0000 7fbc137fe700 1 --2- 172.21.15.22:0/1442165521 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbc0006ace0 0x7fbc0006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbc140d25a0 tx=0x7fbc04008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:31.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.591+0000 7fbbfbfff700 1 -- 172.21.15.22:0/1442165521 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbc0c054bd0 con 0x7fbc140d3730 2023-07-11T00:31:31.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.798+0000 7fbc19fff700 1 -- 172.21.15.22:0/1442165521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbc1404ea60 con 0x7fbc140d3730 2023-07-11T00:31:31.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.799+0000 7fbbfbfff700 1 -- 172.21.15.22:0/1442165521 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbc0c0581f0 con 0x7fbc140d3730 2023-07-11T00:31:31.802 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-07-11T00:31:31.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.801+0000 7fbc19fff700 1 -- 172.21.15.22:0/1442165521 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbc0006ace0 msgr2=0x7fbc0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:31.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.801+0000 7fbc19fff700 1 --2- 172.21.15.22:0/1442165521 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbc0006ace0 0x7fbc0006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbc140d25a0 tx=0x7fbc04008040 comp rx=0 tx=0).stop 2023-07-11T00:31:31.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.801+0000 7fbc19fff700 1 -- 172.21.15.22:0/1442165521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc140d3730 msgr2=0x7fbc140c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:31.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.801+0000 7fbc19fff700 1 --2- 172.21.15.22:0/1442165521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc140d3730 0x7fbc140c7530 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c00cd50 tx=0x7fbc0c00a560 comp rx=0 tx=0).stop 2023-07-11T00:31:31.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.801+0000 7fbc19fff700 1 -- 172.21.15.22:0/1442165521 shutdown_connections 2023-07-11T00:31:31.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.801+0000 7fbc19fff700 1 --2- 172.21.15.22:0/1442165521 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbc0006ace0 0x7fbc0006d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.801+0000 7fbc19fff700 1 --2- 172.21.15.22:0/1442165521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc140b8430 0x7fbc140c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.801+0000 7fbc19fff700 1 --2- 172.21.15.22:0/1442165521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc140d3730 0x7fbc140c7530 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.801+0000 7fbc19fff700 1 --2- 172.21.15.22:0/1442165521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc140cfa90 0x7fbc140c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:31.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.801+0000 7fbc19fff700 1 -- 172.21.15.22:0/1442165521 >> 172.21.15.22:0/1442165521 conn(0x7fbc1406b3f0 msgr2=0x7fbc140b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:31.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.801+0000 7fbc19fff700 1 -- 172.21.15.22:0/1442165521 shutdown_connections 2023-07-11T00:31:31.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:31.801+0000 7fbc19fff700 1 -- 172.21.15.22:0/1442165521 wait complete. 2023-07-11T00:31:31.821 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:31:32.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.026+0000 7f13cebff700 1 Processor -- start 2023-07-11T00:31:32.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.026+0000 7f13cebff700 1 -- start start 2023-07-11T00:31:32.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.027+0000 7f13cebff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13c80d3730 0x7f13c80cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:32.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.027+0000 7f13cebff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f13c80cfa90 0x7f13c80d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:32.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.027+0000 7f13cebff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c80d0b20 con 0x7f13c80b8430 2023-07-11T00:31:32.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.027+0000 7f13cebff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c80cda30 con 0x7f13c80cfa90 2023-07-11T00:31:32.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.027+0000 7f13cebff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c80b8800 con 0x7f13c80d3730 2023-07-11T00:31:32.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.027+0000 7f13cd19c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f13c80cfa90 0x7f13c80d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:32.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.027+0000 7f13cd19c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f13c80cfa90 0x7f13c80d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55682/0 (socket says 172.21.15.22:55682) 2023-07-11T00:31:32.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.027+0000 7f13cd19c700 1 -- 172.21.15.22:0/1331376505 learned_addr learned my addr 172.21.15.22:0/1331376505 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:32.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.028+0000 7f13c7fff700 1 --2- 172.21.15.22:0/1331376505 >> v2:172.21.15.184:3300/0 conn(0x7f13c80d3730 0x7f13c80cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:32.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.028+0000 7f13cd19c700 1 -- 172.21.15.22:0/1331376505 >> v2:172.21.15.184:3300/0 conn(0x7f13c80d3730 msgr2=0x7f13c80cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:32.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.028+0000 7f13cd19c700 1 --2- 172.21.15.22:0/1331376505 >> v2:172.21.15.184:3300/0 conn(0x7f13c80d3730 0x7f13c80cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.028+0000 7f13cd19c700 1 -- 172.21.15.22:0/1331376505 >> v1:172.21.15.184:6789/0 conn(0x7f13c80b8430 legacy=0x7f13c80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:32.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.028+0000 7f13cd19c700 1 -- 172.21.15.22:0/1331376505 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c80cfe90 con 0x7f13c80cfa90 2023-07-11T00:31:32.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.028+0000 7f13cd19c700 1 --2- 172.21.15.22:0/1331376505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c80cfa90 0x7f13c80d0fb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f13c8160f50 tx=0x7f13c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b88255ec07bdf5c server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:32.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.028+0000 7f13c77fe700 1 -- 172.21.15.22:0/1331376505 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c000e070 con 0x7f13c80cfa90 2023-07-11T00:31:32.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.028+0000 7f13c77fe700 1 -- 172.21.15.22:0/1331376505 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c000b910 con 0x7f13c80cfa90 2023-07-11T00:31:32.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.028+0000 7f13c77fe700 1 -- 172.21.15.22:0/1331376505 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c000bcc0 con 0x7f13c80cfa90 2023-07-11T00:31:32.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.029+0000 7f13cebff700 1 -- 172.21.15.22:0/1331376505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c80cfa90 msgr2=0x7f13c80d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:32.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.029+0000 7f13cebff700 1 --2- 172.21.15.22:0/1331376505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c80cfa90 0x7f13c80d0fb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f13c8160f50 tx=0x7f13c000b330 comp rx=0 tx=0).stop 2023-07-11T00:31:32.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.029+0000 7f13cebff700 1 -- 172.21.15.22:0/1331376505 shutdown_connections 2023-07-11T00:31:32.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.029+0000 7f13cebff700 1 --2- 172.21.15.22:0/1331376505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c80cfa90 0x7f13c80d0fb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.029+0000 7f13cebff700 1 --2- 172.21.15.22:0/1331376505 >> v2:172.21.15.184:3300/0 conn(0x7f13c80d3730 0x7f13c80cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.029+0000 7f13cebff700 1 -- 172.21.15.22:0/1331376505 >> 172.21.15.22:0/1331376505 conn(0x7f13c806b3f0 msgr2=0x7f13c806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:32.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.029+0000 7f13cebff700 1 -- 172.21.15.22:0/1331376505 shutdown_connections 2023-07-11T00:31:32.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.029+0000 7f13cebff700 1 -- 172.21.15.22:0/1331376505 wait complete. 2023-07-11T00:31:32.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.031+0000 7f13cebff700 1 Processor -- start 2023-07-11T00:31:32.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.031+0000 7f13cebff700 1 -- start start 2023-07-11T00:31:32.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.032+0000 7f13cebff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13c80b8430 0x7f13c815b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:32.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.032+0000 7f13cebff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c80cfa90 0x7f13c80c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:32.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.032+0000 7f13cebff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13c80d3730 0x7f13c80b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:32.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.032+0000 7f13cebff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c815d390 con 0x7f13c80cfa90 2023-07-11T00:31:32.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.032+0000 7f13cebff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c815b7c0 con 0x7f13c80b8430 2023-07-11T00:31:32.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.032+0000 7f13cebff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c80c6fe0 con 0x7f13c80d3730 2023-07-11T00:31:32.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.032+0000 7f13c7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c80cfa90 0x7f13c80c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:32.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.032+0000 7f13c7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c80cfa90 0x7f13c80c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55690/0 (socket says 172.21.15.22:55690) 2023-07-11T00:31:32.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.032+0000 7f13c7fff700 1 -- 172.21.15.22:0/955518035 learned_addr learned my addr 172.21.15.22:0/955518035 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:32.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.033+0000 7f13cd19c700 1 --2- 172.21.15.22:0/955518035 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13c80d3730 0x7f13c80b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:32.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.033+0000 7f13cc99b700 1 --2- 172.21.15.22:0/955518035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13c80b8430 0x7f13c815b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:32.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.033+0000 7f13c7fff700 1 -- 172.21.15.22:0/955518035 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13c80d3730 msgr2=0x7f13c80b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:32.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.033+0000 7f13c7fff700 1 --2- 172.21.15.22:0/955518035 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13c80d3730 0x7f13c80b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.033+0000 7f13c7fff700 1 -- 172.21.15.22:0/955518035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13c80b8430 msgr2=0x7f13c815b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:32.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.033+0000 7f13c7fff700 1 --2- 172.21.15.22:0/955518035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13c80b8430 0x7f13c815b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.033+0000 7f13c7fff700 1 -- 172.21.15.22:0/955518035 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c0009b30 con 0x7f13c80cfa90 2023-07-11T00:31:32.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.033+0000 7f13cc99b700 1 --2- 172.21.15.22:0/955518035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13c80b8430 0x7f13c815b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:32.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.033+0000 7f13c7fff700 1 --2- 172.21.15.22:0/955518035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c80cfa90 0x7f13c80c6670 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f13b400e8a0 tx=0x7f13b400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:32.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.033+0000 7f13c57fa700 1 -- 172.21.15.22:0/955518035 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b4009590 con 0x7f13c80cfa90 2023-07-11T00:31:32.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.033+0000 7f13c57fa700 1 -- 172.21.15.22:0/955518035 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b400eea0 con 0x7f13c80cfa90 2023-07-11T00:31:32.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.033+0000 7f13c57fa700 1 -- 172.21.15.22:0/955518035 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b400ca50 con 0x7f13c80cfa90 2023-07-11T00:31:32.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.033+0000 7f13cebff700 1 -- 172.21.15.22:0/955518035 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c815ca60 con 0x7f13c80cfa90 2023-07-11T00:31:32.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.034+0000 7f13cebff700 1 -- 172.21.15.22:0/955518035 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c815d020 con 0x7f13c80cfa90 2023-07-11T00:31:32.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.035+0000 7f13cebff700 1 -- 172.21.15.22:0/955518035 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c804ea60 con 0x7f13c80cfa90 2023-07-11T00:31:32.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.035+0000 7f13c57fa700 1 -- 172.21.15.22:0/955518035 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f13b400cbb0 con 0x7f13c80cfa90 2023-07-11T00:31:32.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.037+0000 7f13c57fa700 1 --2- 172.21.15.22:0/955518035 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f13ac06ace0 0x7f13ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:32.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.037+0000 7f13c57fa700 1 -- 172.21.15.22:0/955518035 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f13b4089700 con 0x7f13c80cfa90 2023-07-11T00:31:32.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.037+0000 7f13cc99b700 1 --2- 172.21.15.22:0/955518035 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f13ac06ace0 0x7f13ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:32.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.038+0000 7f13cc99b700 1 --2- 172.21.15.22:0/955518035 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f13ac06ace0 0x7f13ac06d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f13bc000f60 tx=0x7f13bc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:32.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.040+0000 7f13c57fa700 1 -- 172.21.15.22:0/955518035 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f13b4057fa0 con 0x7f13c80cfa90 2023-07-11T00:31:32.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.248+0000 7f13cebff700 1 -- 172.21.15.22:0/955518035 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13c80d1f20 con 0x7f13c80cfa90 2023-07-11T00:31:32.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.248+0000 7f13c57fa700 1 -- 172.21.15.22:0/955518035 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f13b4057b30 con 0x7f13c80cfa90 2023-07-11T00:31:32.251 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:32.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.251+0000 7f13cebff700 1 -- 172.21.15.22:0/955518035 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f13ac06ace0 msgr2=0x7f13ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:32.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.251+0000 7f13cebff700 1 --2- 172.21.15.22:0/955518035 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f13ac06ace0 0x7f13ac06d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f13bc000f60 tx=0x7f13bc009040 comp rx=0 tx=0).stop 2023-07-11T00:31:32.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.251+0000 7f13cebff700 1 -- 172.21.15.22:0/955518035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c80cfa90 msgr2=0x7f13c80c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:32.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.251+0000 7f13cebff700 1 --2- 172.21.15.22:0/955518035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c80cfa90 0x7f13c80c6670 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f13b400e8a0 tx=0x7f13b400ec60 comp rx=0 tx=0).stop 2023-07-11T00:31:32.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.251+0000 7f13cebff700 1 -- 172.21.15.22:0/955518035 shutdown_connections 2023-07-11T00:31:32.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.251+0000 7f13cebff700 1 --2- 172.21.15.22:0/955518035 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f13ac06ace0 0x7f13ac06d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.251+0000 7f13cebff700 1 --2- 172.21.15.22:0/955518035 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13c80d3730 0x7f13c80b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.251+0000 7f13cebff700 1 --2- 172.21.15.22:0/955518035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13c80b8430 0x7f13c815b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.251+0000 7f13cebff700 1 --2- 172.21.15.22:0/955518035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c80cfa90 0x7f13c80c6670 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.251+0000 7f13cebff700 1 -- 172.21.15.22:0/955518035 >> 172.21.15.22:0/955518035 conn(0x7f13c806b3f0 msgr2=0x7f13c80b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:32.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.251+0000 7f13cebff700 1 -- 172.21.15.22:0/955518035 shutdown_connections 2023-07-11T00:31:32.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.251+0000 7f13cebff700 1 -- 172.21.15.22:0/955518035 wait complete. 2023-07-11T00:31:32.271 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:31:32.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.471+0000 7f05537ff700 1 Processor -- start 2023-07-11T00:31:32.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.472+0000 7f05537ff700 1 -- start start 2023-07-11T00:31:32.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.473+0000 7f05537ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f054c0d3730 0x7f054c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:32.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.473+0000 7f05537ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f054c0cfa90 0x7f054c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:32.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.473+0000 7f05537ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054c0d0b20 con 0x7f054c0b8430 2023-07-11T00:31:32.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.473+0000 7f05537ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054c0cda30 con 0x7f054c0d3730 2023-07-11T00:31:32.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.473+0000 7f05537ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054c0b8800 con 0x7f054c0cfa90 2023-07-11T00:31:32.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.473+0000 7f0550d9a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f054c0d3730 0x7f054c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:32.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.473+0000 7f055159b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f054c0b8430 0x7f054c0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55398/0 (socket says 172.21.15.22:55398) 2023-07-11T00:31:32.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.473+0000 7f055159b700 1 -- 172.21.15.22:0/2504979551 learned_addr learned my addr 172.21.15.22:0/2504979551 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:32.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.473+0000 7f0551d9c700 1 --2- 172.21.15.22:0/2504979551 >> v2:172.21.15.184:3300/0 conn(0x7f054c0cfa90 0x7f054c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:32.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.474+0000 7f0550d9a700 1 -- 172.21.15.22:0/2504979551 >> v2:172.21.15.184:3300/0 conn(0x7f054c0cfa90 msgr2=0x7f054c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:32.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.474+0000 7f0550d9a700 1 --2- 172.21.15.22:0/2504979551 >> v2:172.21.15.184:3300/0 conn(0x7f054c0cfa90 0x7f054c0d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.474+0000 7f0550d9a700 1 -- 172.21.15.22:0/2504979551 >> v1:172.21.15.22:6789/0 conn(0x7f054c0b8430 legacy=0x7f054c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:32.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.474+0000 7f0550d9a700 1 -- 172.21.15.22:0/2504979551 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c0cfe90 con 0x7f054c0d3730 2023-07-11T00:31:32.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.474+0000 7f0543fff700 1 -- 172.21.15.22:0/2504979551 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100667640 0 0) 0x7f054c0d0b20 con 0x7f054c0b8430 2023-07-11T00:31:32.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.474+0000 7f0551d9c700 1 --2- 172.21.15.22:0/2504979551 >> v2:172.21.15.184:3300/0 conn(0x7f054c0cfa90 0x7f054c0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:32.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.474+0000 7f0550d9a700 1 --2- 172.21.15.22:0/2504979551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c0d3730 0x7f054c0cf550 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f054c0b2100 tx=0x7f053c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9c1a7ebcaf76a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:32.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.474+0000 7f0543fff700 1 -- 172.21.15.22:0/2504979551 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c011830 con 0x7f054c0d3730 2023-07-11T00:31:32.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.474+0000 7f0543fff700 1 -- 172.21.15.22:0/2504979551 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c011990 con 0x7f054c0d3730 2023-07-11T00:31:32.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.474+0000 7f0543fff700 1 -- 172.21.15.22:0/2504979551 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c011d20 con 0x7f054c0d3730 2023-07-11T00:31:32.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.475+0000 7f05537ff700 1 -- 172.21.15.22:0/2504979551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c0d3730 msgr2=0x7f054c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:32.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.475+0000 7f05537ff700 1 --2- 172.21.15.22:0/2504979551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c0d3730 0x7f054c0cf550 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f054c0b2100 tx=0x7f053c009b20 comp rx=0 tx=0).stop 2023-07-11T00:31:32.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.475+0000 7f05537ff700 1 -- 172.21.15.22:0/2504979551 shutdown_connections 2023-07-11T00:31:32.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.475+0000 7f05537ff700 1 --2- 172.21.15.22:0/2504979551 >> v2:172.21.15.184:3300/0 conn(0x7f054c0cfa90 0x7f054c0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.475+0000 7f05537ff700 1 --2- 172.21.15.22:0/2504979551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c0d3730 0x7f054c0cf550 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.475+0000 7f05537ff700 1 -- 172.21.15.22:0/2504979551 >> 172.21.15.22:0/2504979551 conn(0x7f054c06b3f0 msgr2=0x7f054c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:32.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.475+0000 7f05537ff700 1 -- 172.21.15.22:0/2504979551 shutdown_connections 2023-07-11T00:31:32.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.475+0000 7f05537ff700 1 -- 172.21.15.22:0/2504979551 wait complete. 2023-07-11T00:31:32.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.477+0000 7f05537ff700 1 Processor -- start 2023-07-11T00:31:32.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.477+0000 7f05537ff700 1 -- start start 2023-07-11T00:31:32.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.478+0000 7f05537ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f054c0b8430 0x7f054c0c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:32.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.478+0000 7f05537ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c0cfa90 0x7f054c15a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:32.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.478+0000 7f05537ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054c0d3730 0x7f054c15ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:32.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.478+0000 7f05537ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054c15d310 con 0x7f054c0cfa90 2023-07-11T00:31:32.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.478+0000 7f05537ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054c1f6040 con 0x7f054c0d3730 2023-07-11T00:31:32.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.478+0000 7f05537ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054c1f5150 con 0x7f054c0b8430 2023-07-11T00:31:32.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.478+0000 7f0550d9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c0cfa90 0x7f054c15a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:32.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.478+0000 7f0550d9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c0cfa90 0x7f054c15a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55704/0 (socket says 172.21.15.22:55704) 2023-07-11T00:31:32.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.478+0000 7f0550d9a700 1 -- 172.21.15.22:0/2510991316 learned_addr learned my addr 172.21.15.22:0/2510991316 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:32.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.478+0000 7f055159b700 1 --2- 172.21.15.22:0/2510991316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f054c0b8430 0x7f054c0c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:32.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.478+0000 7f0551d9c700 1 --2- 172.21.15.22:0/2510991316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054c0d3730 0x7f054c15ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:32.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.479+0000 7f0550d9a700 1 -- 172.21.15.22:0/2510991316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f054c0b8430 msgr2=0x7f054c0c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:32.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.479+0000 7f0550d9a700 1 --2- 172.21.15.22:0/2510991316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f054c0b8430 0x7f054c0c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.479+0000 7f0550d9a700 1 -- 172.21.15.22:0/2510991316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054c0d3730 msgr2=0x7f054c15ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:32.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.479+0000 7f0550d9a700 1 --2- 172.21.15.22:0/2510991316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054c0d3730 0x7f054c15ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.479+0000 7f0550d9a700 1 -- 172.21.15.22:0/2510991316 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c0094a0 con 0x7f054c0cfa90 2023-07-11T00:31:32.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.479+0000 7f055159b700 1 --2- 172.21.15.22:0/2510991316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f054c0b8430 0x7f054c0c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:32.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.479+0000 7f0550d9a700 1 --2- 172.21.15.22:0/2510991316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c0cfa90 0x7f054c15a730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f053c014040 tx=0x7f053c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:32.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.479+0000 7f0541ffb700 1 -- 172.21.15.22:0/2510991316 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c0038a0 con 0x7f054c0cfa90 2023-07-11T00:31:32.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.479+0000 7f0541ffb700 1 -- 172.21.15.22:0/2510991316 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c01e070 con 0x7f054c0cfa90 2023-07-11T00:31:32.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.479+0000 7f0541ffb700 1 -- 172.21.15.22:0/2510991316 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c003c20 con 0x7f054c0cfa90 2023-07-11T00:31:32.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.479+0000 7f05537ff700 1 -- 172.21.15.22:0/2510991316 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f054c1f5430 con 0x7f054c0cfa90 2023-07-11T00:31:32.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.479+0000 7f05537ff700 1 -- 172.21.15.22:0/2510991316 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054c1f59f0 con 0x7f054c0cfa90 2023-07-11T00:31:32.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.480+0000 7f05537ff700 1 -- 172.21.15.22:0/2510991316 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f054c0cae30 con 0x7f054c0cfa90 2023-07-11T00:31:32.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.481+0000 7f0541ffb700 1 -- 172.21.15.22:0/2510991316 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f053c02d450 con 0x7f054c0cfa90 2023-07-11T00:31:32.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.482+0000 7f0541ffb700 1 --2- 172.21.15.22:0/2510991316 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f053006ace0 0x7f053006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:32.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.482+0000 7f0541ffb700 1 -- 172.21.15.22:0/2510991316 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f053c08a8c0 con 0x7f054c0cfa90 2023-07-11T00:31:32.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.483+0000 7f055159b700 1 --2- 172.21.15.22:0/2510991316 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f053006ace0 0x7f053006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:32.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.483+0000 7f055159b700 1 --2- 172.21.15.22:0/2510991316 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f053006ace0 0x7f053006d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0548000f60 tx=0x7f0548007ca0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:32.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.486+0000 7f0541ffb700 1 -- 172.21.15.22:0/2510991316 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f054c0cae30 con 0x7f054c0cfa90 2023-07-11T00:31:32.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.692+0000 7f05537ff700 1 -- 172.21.15.22:0/2510991316 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f054c0cae30 con 0x7f054c0cfa90 2023-07-11T00:31:32.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.692+0000 7f0541ffb700 1 -- 172.21.15.22:0/2510991316 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f054c0cae30 con 0x7f054c0cfa90 2023-07-11T00:31:32.695 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-07-11T00:31:32.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.695+0000 7f05537ff700 1 -- 172.21.15.22:0/2510991316 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f053006ace0 msgr2=0x7f053006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:32.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.695+0000 7f05537ff700 1 --2- 172.21.15.22:0/2510991316 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f053006ace0 0x7f053006d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0548000f60 tx=0x7f0548007ca0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.695+0000 7f05537ff700 1 -- 172.21.15.22:0/2510991316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c0cfa90 msgr2=0x7f054c15a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:32.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.695+0000 7f05537ff700 1 --2- 172.21.15.22:0/2510991316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c0cfa90 0x7f054c15a730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f053c014040 tx=0x7f053c004750 comp rx=0 tx=0).stop 2023-07-11T00:31:32.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.695+0000 7f05537ff700 1 -- 172.21.15.22:0/2510991316 shutdown_connections 2023-07-11T00:31:32.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.695+0000 7f05537ff700 1 --2- 172.21.15.22:0/2510991316 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f053006ace0 0x7f053006d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.695+0000 7f05537ff700 1 --2- 172.21.15.22:0/2510991316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f054c0b8430 0x7f054c0c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.695+0000 7f05537ff700 1 --2- 172.21.15.22:0/2510991316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054c0d3730 0x7f054c15ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.695+0000 7f05537ff700 1 --2- 172.21.15.22:0/2510991316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c0cfa90 0x7f054c15a730 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.695+0000 7f05537ff700 1 -- 172.21.15.22:0/2510991316 >> 172.21.15.22:0/2510991316 conn(0x7f054c06b3f0 msgr2=0x7f054c06b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:32.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.695+0000 7f05537ff700 1 -- 172.21.15.22:0/2510991316 shutdown_connections 2023-07-11T00:31:32.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.695+0000 7f05537ff700 1 -- 172.21.15.22:0/2510991316 wait complete. 2023-07-11T00:31:32.715 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-11T00:31:32.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.918+0000 7fd7b87ff700 1 Processor -- start 2023-07-11T00:31:32.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.918+0000 7fd7b87ff700 1 -- start start 2023-07-11T00:31:32.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.919+0000 7fd7b87ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7b00d3730 0x7fd7b00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:32.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.919+0000 7fd7b87ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b00d0b20 con 0x7fd7b00b8430 2023-07-11T00:31:32.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.919+0000 7fd7b87ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b00cfe90 con 0x7fd7b00cfa90 2023-07-11T00:31:32.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.919+0000 7fd7b87ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b00cda30 con 0x7fd7b00d3730 2023-07-11T00:31:32.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.919+0000 7fd7b659b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd7b00b8430 0x7fd7b00cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55412/0 (socket says 172.21.15.22:55412) 2023-07-11T00:31:32.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.919+0000 7fd7b659b700 1 -- 172.21.15.22:0/3002697002 learned_addr learned my addr 172.21.15.22:0/3002697002 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:32.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.919+0000 7fd7b5d9a700 1 --2- 172.21.15.22:0/3002697002 >> v2:172.21.15.22:3300/0 conn(0x7fd7b00d3730 0x7fd7b00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:32.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.920+0000 7fd7b5599700 1 -- 172.21.15.22:0/3002697002 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718950392 0 0) 0x7fd7b00d0b20 con 0x7fd7b00b8430 2023-07-11T00:31:32.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.920+0000 7fd7b5599700 1 -- 172.21.15.22:0/3002697002 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd79c0035b0 con 0x7fd7b00b8430 2023-07-11T00:31:32.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.920+0000 7fd7b5d9a700 1 -- 172.21.15.22:0/3002697002 >> v1:172.21.15.184:6789/0 conn(0x7fd7b00cfa90 legacy=0x7fd7b00d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:32.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.920+0000 7fd7b5d9a700 1 -- 172.21.15.22:0/3002697002 >> v1:172.21.15.22:6789/0 conn(0x7fd7b00b8430 legacy=0x7fd7b00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:32.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.920+0000 7fd7b5d9a700 1 -- 172.21.15.22:0/3002697002 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b00b4ee0 con 0x7fd7b00d3730 2023-07-11T00:31:32.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.920+0000 7fd7b5d9a700 1 --2- 172.21.15.22:0/3002697002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00d3730 0x7fd7b00cf550 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009840 tx=0x7fd7a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f34a28614624074 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:32.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.920+0000 7fd7b5599700 1 -- 172.21.15.22:0/3002697002 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0004230 con 0x7fd7b00d3730 2023-07-11T00:31:32.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.920+0000 7fd7b5599700 1 -- 172.21.15.22:0/3002697002 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a0004390 con 0x7fd7b00d3730 2023-07-11T00:31:32.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.920+0000 7fd7b5599700 1 -- 172.21.15.22:0/3002697002 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a00036c0 con 0x7fd7b00d3730 2023-07-11T00:31:32.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.921+0000 7fd7b87ff700 1 -- 172.21.15.22:0/3002697002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00d3730 msgr2=0x7fd7b00cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:32.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.921+0000 7fd7b87ff700 1 --2- 172.21.15.22:0/3002697002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00d3730 0x7fd7b00cf550 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009840 tx=0x7fd7a0009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:32.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.921+0000 7fd7b87ff700 1 -- 172.21.15.22:0/3002697002 shutdown_connections 2023-07-11T00:31:32.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.921+0000 7fd7b87ff700 1 --2- 172.21.15.22:0/3002697002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00d3730 0x7fd7b00cf550 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.921+0000 7fd7b87ff700 1 -- 172.21.15.22:0/3002697002 >> 172.21.15.22:0/3002697002 conn(0x7fd7b006b3f0 msgr2=0x7fd7b006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:32.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.921+0000 7fd7b87ff700 1 -- 172.21.15.22:0/3002697002 shutdown_connections 2023-07-11T00:31:32.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.921+0000 7fd7b87ff700 1 -- 172.21.15.22:0/3002697002 wait complete. 2023-07-11T00:31:32.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.923+0000 7fd7b87ff700 1 Processor -- start 2023-07-11T00:31:32.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.923+0000 7fd7b87ff700 1 -- start start 2023-07-11T00:31:32.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.924+0000 7fd7b87ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00b8430 0x7fd7b00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:32.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.924+0000 7fd7b87ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7b00cfa90 0x7fd7b01f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:32.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.924+0000 7fd7b87ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7b00d3730 0x7fd7b00b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:32.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.924+0000 7fd7b87ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b00c8430 con 0x7fd7b00b8430 2023-07-11T00:31:32.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.924+0000 7fd7b87ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b00ca150 con 0x7fd7b00d3730 2023-07-11T00:31:32.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.924+0000 7fd7b87ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b01f5590 con 0x7fd7b00cfa90 2023-07-11T00:31:32.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.924+0000 7fd7b659b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00b8430 0x7fd7b00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.924+0000 7fd7b659b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00b8430 0x7fd7b00c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55716/0 (socket says 172.21.15.22:55716) 2023-07-11T00:31:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.924+0000 7fd7b659b700 1 -- 172.21.15.22:0/775312627 learned_addr learned my addr 172.21.15.22:0/775312627 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.924+0000 7fd7b6d9c700 1 --2- 172.21.15.22:0/775312627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7b00d3730 0x7fd7b00b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.924+0000 7fd7b5d9a700 1 --2- 172.21.15.22:0/775312627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7b00cfa90 0x7fd7b01f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.924+0000 7fd7b659b700 1 -- 172.21.15.22:0/775312627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7b00cfa90 msgr2=0x7fd7b01f5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.924+0000 7fd7b659b700 1 --2- 172.21.15.22:0/775312627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7b00cfa90 0x7fd7b01f5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.924+0000 7fd7b659b700 1 -- 172.21.15.22:0/775312627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7b00d3730 msgr2=0x7fd7b00b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.924+0000 7fd7b659b700 1 --2- 172.21.15.22:0/775312627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7b00d3730 0x7fd7b00b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.925+0000 7fd7b659b700 1 -- 172.21.15.22:0/775312627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a00094a0 con 0x7fd7b00b8430 2023-07-11T00:31:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.925+0000 7fd7b659b700 1 --2- 172.21.15.22:0/775312627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00b8430 0x7fd7b00c9c10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00c450 tx=0x7fd7ac00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.925+0000 7fd7a6ffd700 1 -- 172.21.15.22:0/775312627 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac005d70 con 0x7fd7b00b8430 2023-07-11T00:31:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.925+0000 7fd7a6ffd700 1 -- 172.21.15.22:0/775312627 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac0070d0 con 0x7fd7b00b8430 2023-07-11T00:31:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.925+0000 7fd7b87ff700 1 -- 172.21.15.22:0/775312627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b01f5860 con 0x7fd7b00b8430 2023-07-11T00:31:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.925+0000 7fd7a6ffd700 1 -- 172.21.15.22:0/775312627 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac007440 con 0x7fd7b00b8430 2023-07-11T00:31:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.925+0000 7fd7b87ff700 1 -- 172.21.15.22:0/775312627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b01f5e20 con 0x7fd7b00b8430 2023-07-11T00:31:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.926+0000 7fd7b87ff700 1 -- 172.21.15.22:0/775312627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b004ea60 con 0x7fd7b00b8430 2023-07-11T00:31:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.927+0000 7fd7a6ffd700 1 -- 172.21.15.22:0/775312627 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd7ac0075a0 con 0x7fd7b00b8430 2023-07-11T00:31:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.928+0000 7fd7a6ffd700 1 --2- 172.21.15.22:0/775312627 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd79406ace0 0x7fd79406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.928+0000 7fd7a6ffd700 1 -- 172.21.15.22:0/775312627 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd7ac088b20 con 0x7fd7b00b8430 2023-07-11T00:31:32.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.929+0000 7fd7b5d9a700 1 --2- 172.21.15.22:0/775312627 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd79406ace0 0x7fd79406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:32.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.929+0000 7fd7b5d9a700 1 --2- 172.21.15.22:0/775312627 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd79406ace0 0x7fd79406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd7a00090b0 tx=0x7fd7a0010000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:32.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:32.932+0000 7fd7a6ffd700 1 -- 172.21.15.22:0/775312627 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd7ac053950 con 0x7fd7b00b8430 2023-07-11T00:31:33.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.138+0000 7fd7b87ff700 1 -- 172.21.15.22:0/775312627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd7b006b960 con 0x7fd7b00b8430 2023-07-11T00:31:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.139+0000 7fd7a6ffd700 1 -- 172.21.15.22:0/775312627 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd7ac017020 con 0x7fd7b00b8430 2023-07-11T00:31:33.141 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:31:33.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.141+0000 7fd7b87ff700 1 -- 172.21.15.22:0/775312627 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd79406ace0 msgr2=0x7fd79406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.141+0000 7fd7b87ff700 1 --2- 172.21.15.22:0/775312627 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd79406ace0 0x7fd79406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd7a00090b0 tx=0x7fd7a0010000 comp rx=0 tx=0).stop 2023-07-11T00:31:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.141+0000 7fd7b87ff700 1 -- 172.21.15.22:0/775312627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00b8430 msgr2=0x7fd7b00c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.141+0000 7fd7b87ff700 1 --2- 172.21.15.22:0/775312627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00b8430 0x7fd7b00c9c10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00c450 tx=0x7fd7ac00c810 comp rx=0 tx=0).stop 2023-07-11T00:31:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.141+0000 7fd7b87ff700 1 -- 172.21.15.22:0/775312627 shutdown_connections 2023-07-11T00:31:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.141+0000 7fd7b87ff700 1 --2- 172.21.15.22:0/775312627 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd79406ace0 0x7fd79406d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.141+0000 7fd7b87ff700 1 --2- 172.21.15.22:0/775312627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7b00d3730 0x7fd7b00b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.141+0000 7fd7b87ff700 1 --2- 172.21.15.22:0/775312627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7b00b8430 0x7fd7b00c9c10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.141+0000 7fd7b87ff700 1 --2- 172.21.15.22:0/775312627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7b00cfa90 0x7fd7b01f5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.141+0000 7fd7b87ff700 1 -- 172.21.15.22:0/775312627 >> 172.21.15.22:0/775312627 conn(0x7fd7b006b3f0 msgr2=0x7fd7b00d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:33.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.141+0000 7fd7b87ff700 1 -- 172.21.15.22:0/775312627 shutdown_connections 2023-07-11T00:31:33.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.141+0000 7fd7b87ff700 1 -- 172.21.15.22:0/775312627 wait complete. 2023-07-11T00:31:33.162 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:31:33.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.361+0000 7fbdfd1ff700 1 Processor -- start 2023-07-11T00:31:33.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.361+0000 7fbdfd1ff700 1 -- start start 2023-07-11T00:31:33.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.362+0000 7fbdfd1ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbdf80d2640 0x7fbdf80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:33.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.362+0000 7fbdfd1ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf80d1790 con 0x7fbdf80cf8f0 2023-07-11T00:31:33.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.362+0000 7fbdfd1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf80cd950 con 0x7fbdf815c460 2023-07-11T00:31:33.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.362+0000 7fbdfd1ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf80cedd0 con 0x7fbdf80d2640 2023-07-11T00:31:33.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.363+0000 7fbdf759e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbdf80cf8f0 0x7fbdf815fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55422/0 (socket says 172.21.15.22:55422) 2023-07-11T00:31:33.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.363+0000 7fbdf759e700 1 -- 172.21.15.22:0/678809454 learned_addr learned my addr 172.21.15.22:0/678809454 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:33.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.363+0000 7fbdf659c700 1 --2- 172.21.15.22:0/678809454 >> v2:172.21.15.184:3300/0 conn(0x7fbdf80d2640 0x7fbdf80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:33.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.363+0000 7fbdf5d9b700 1 -- 172.21.15.22:0/678809454 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435912854 0 0) 0x7fbdf80d1790 con 0x7fbdf80cf8f0 2023-07-11T00:31:33.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.363+0000 7fbdf5d9b700 1 -- 172.21.15.22:0/678809454 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbde00035b0 con 0x7fbdf80cf8f0 2023-07-11T00:31:33.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.363+0000 7fbdf5d9b700 1 -- 172.21.15.22:0/678809454 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1405824435 0 0) 0x7fbde00035b0 con 0x7fbdf80cf8f0 2023-07-11T00:31:33.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.363+0000 7fbdf5d9b700 1 -- 172.21.15.22:0/678809454 >> v2:172.21.15.184:3300/0 conn(0x7fbdf80d2640 msgr2=0x7fbdf80b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:33.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.363+0000 7fbdf5d9b700 1 --2- 172.21.15.22:0/678809454 >> v2:172.21.15.184:3300/0 conn(0x7fbdf80d2640 0x7fbdf80b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.363+0000 7fbdf5d9b700 1 -- 172.21.15.22:0/678809454 >> v1:172.21.15.184:6789/0 conn(0x7fbdf815c460 legacy=0x7fbdf80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:33.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.363+0000 7fbdf5d9b700 1 -- 172.21.15.22:0/678809454 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf80d14b0 con 0x7fbdf80cf8f0 2023-07-11T00:31:33.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.363+0000 7fbdf5d9b700 1 -- 172.21.15.22:0/678809454 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7fbdf00019f0 con 0x7fbdf80cf8f0 2023-07-11T00:31:33.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.363+0000 7fbdf5d9b700 1 -- 172.21.15.22:0/678809454 >> v1:172.21.15.22:6789/0 conn(0x7fbdf80cf8f0 legacy=0x7fbdf815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:33.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.364+0000 7fbdf5d9b700 1 --2- 172.21.15.22:0/678809454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbde0003a00 0x7fbde0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:33.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.364+0000 7fbdf5d9b700 1 --2- 172.21.15.22:0/678809454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbde0004850 0x7fbde0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:33.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.364+0000 7fbdf5d9b700 1 --2- 172.21.15.22:0/678809454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbde0005200 0x7fbde000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:33.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.364+0000 7fbdf5d9b700 1 -- 172.21.15.22:0/678809454 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf80cedd0 con 0x7fbde0005200 2023-07-11T00:31:33.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.364+0000 7fbdf5d9b700 1 -- 172.21.15.22:0/678809454 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde000c190 con 0x7fbde0003a00 2023-07-11T00:31:33.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.364+0000 7fbdf5d9b700 1 -- 172.21.15.22:0/678809454 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde000c350 con 0x7fbde0004850 2023-07-11T00:31:33.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.364+0000 7fbdf759e700 1 --2- 172.21.15.22:0/678809454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbde0005200 0x7fbde000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:33.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.364+0000 7fbdf6d9d700 1 --2- 172.21.15.22:0/678809454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbde0003a00 0x7fbde0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:33.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.364+0000 7fbdf659c700 1 --2- 172.21.15.22:0/678809454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbde0004850 0x7fbde0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:33.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.364+0000 7fbdf759e700 1 -- 172.21.15.22:0/678809454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbde0004850 msgr2=0x7fbde0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:33.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.364+0000 7fbdf759e700 1 --2- 172.21.15.22:0/678809454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbde0004850 0x7fbde0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.364+0000 7fbdf759e700 1 -- 172.21.15.22:0/678809454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbde0003a00 msgr2=0x7fbde0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:33.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.364+0000 7fbdf759e700 1 --2- 172.21.15.22:0/678809454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbde0003a00 0x7fbde0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.364+0000 7fbdf759e700 1 -- 172.21.15.22:0/678809454 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde00035b0 con 0x7fbde0005200 2023-07-11T00:31:33.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.364+0000 7fbdf759e700 1 -- 172.21.15.22:0/678809454 reap_dead start 2023-07-11T00:31:33.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.365+0000 7fbdf759e700 1 --2- 172.21.15.22:0/678809454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbde0005200 0x7fbde000ba10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000a7a0 tx=0x7fbde0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565289052ffacb3c server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:33.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.365+0000 7fbdf5d9b700 1 -- 172.21.15.22:0/678809454 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0012600 con 0x7fbde0005200 2023-07-11T00:31:33.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.365+0000 7fbdf5d9b700 1 -- 172.21.15.22:0/678809454 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf0012760 con 0x7fbde0005200 2023-07-11T00:31:33.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.365+0000 7fbdf5d9b700 1 -- 172.21.15.22:0/678809454 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0012b10 con 0x7fbde0005200 2023-07-11T00:31:33.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.365+0000 7fbdfd1ff700 1 -- 172.21.15.22:0/678809454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbde0005200 msgr2=0x7fbde000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:33.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.365+0000 7fbdfd1ff700 1 --2- 172.21.15.22:0/678809454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbde0005200 0x7fbde000ba10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000a7a0 tx=0x7fbde0005880 comp rx=0 tx=0).stop 2023-07-11T00:31:33.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.365+0000 7fbdfd1ff700 1 -- 172.21.15.22:0/678809454 shutdown_connections 2023-07-11T00:31:33.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.365+0000 7fbdfd1ff700 1 --2- 172.21.15.22:0/678809454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbde0005200 0x7fbde000ba10 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.365+0000 7fbdfd1ff700 1 -- 172.21.15.22:0/678809454 >> 172.21.15.22:0/678809454 conn(0x7fbdf8071660 msgr2=0x7fbdf8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:33.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.365+0000 7fbdfd1ff700 1 -- 172.21.15.22:0/678809454 shutdown_connections 2023-07-11T00:31:33.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.366+0000 7fbdfd1ff700 1 -- 172.21.15.22:0/678809454 wait complete. 2023-07-11T00:31:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.367+0000 7fbdfd1ff700 1 Processor -- start 2023-07-11T00:31:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.368+0000 7fbdfd1ff700 1 -- start start 2023-07-11T00:31:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.368+0000 7fbdfd1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbde0005200 0x7fbdf81f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.369+0000 7fbdfd1ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdf80c7290 0x7fbdf814f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.369+0000 7fbdfd1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbdf80c8a90 0x7fbdf80c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.369+0000 7fbdfd1ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf815d680 con 0x7fbdf80c7290 2023-07-11T00:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.369+0000 7fbdfd1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf814ffc0 con 0x7fbde0005200 2023-07-11T00:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.369+0000 7fbdfd1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf81502a0 con 0x7fbdf80c8a90 2023-07-11T00:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.369+0000 7fbdf659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdf80c7290 0x7fbdf814f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.369+0000 7fbdf659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdf80c7290 0x7fbdf814f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55734/0 (socket says 172.21.15.22:55734) 2023-07-11T00:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.369+0000 7fbdf659c700 1 -- 172.21.15.22:0/2156236208 learned_addr learned my addr 172.21.15.22:0/2156236208 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.369+0000 7fbdf759e700 1 --2- 172.21.15.22:0/2156236208 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbdf80c8a90 0x7fbdf80c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.369+0000 7fbdf6d9d700 1 --2- 172.21.15.22:0/2156236208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbde0005200 0x7fbdf81f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.369+0000 7fbdf659c700 1 -- 172.21.15.22:0/2156236208 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbdf80c8a90 msgr2=0x7fbdf80c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.369+0000 7fbdf659c700 1 --2- 172.21.15.22:0/2156236208 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbdf80c8a90 0x7fbdf80c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.369+0000 7fbdf659c700 1 -- 172.21.15.22:0/2156236208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbde0005200 msgr2=0x7fbdf81f1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.369+0000 7fbdf659c700 1 --2- 172.21.15.22:0/2156236208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbde0005200 0x7fbdf81f1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.369+0000 7fbdf659c700 1 -- 172.21.15.22:0/2156236208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf8150580 con 0x7fbdf80c7290 2023-07-11T00:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.369+0000 7fbdf6d9d700 1 --2- 172.21.15.22:0/2156236208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbde0005200 0x7fbdf81f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.370+0000 7fbdf659c700 1 --2- 172.21.15.22:0/2156236208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdf80c7290 0x7fbdf814f6c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0119a0 tx=0x7fbdec011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.370+0000 7fbddf7fe700 1 -- 172.21.15.22:0/2156236208 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec00f940 con 0x7fbdf80c7290 2023-07-11T00:31:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.370+0000 7fbddf7fe700 1 -- 172.21.15.22:0/2156236208 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdec00faa0 con 0x7fbdf80c7290 2023-07-11T00:31:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.370+0000 7fbddf7fe700 1 -- 172.21.15.22:0/2156236208 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec00fe30 con 0x7fbdf80c7290 2023-07-11T00:31:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.370+0000 7fbdfd1ff700 1 -- 172.21.15.22:0/2156236208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf815d310 con 0x7fbdf80c7290 2023-07-11T00:31:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.370+0000 7fbdfd1ff700 1 -- 172.21.15.22:0/2156236208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf814fc00 con 0x7fbdf80c7290 2023-07-11T00:31:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.371+0000 7fbdfd1ff700 1 -- 172.21.15.22:0/2156236208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf815d4a0 con 0x7fbdf80c7290 2023-07-11T00:31:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.372+0000 7fbddf7fe700 1 -- 172.21.15.22:0/2156236208 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbdec014440 con 0x7fbdf80c7290 2023-07-11T00:31:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.373+0000 7fbddf7fe700 1 --2- 172.21.15.22:0/2156236208 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbde406ace0 0x7fbde406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.373+0000 7fbddf7fe700 1 -- 172.21.15.22:0/2156236208 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbdec089e60 con 0x7fbdf80c7290 2023-07-11T00:31:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.373+0000 7fbdf6d9d700 1 --2- 172.21.15.22:0/2156236208 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbde406ace0 0x7fbde406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:33.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.374+0000 7fbdf6d9d700 1 --2- 172.21.15.22:0/2156236208 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbde406ace0 0x7fbde406d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbde8007fd0 tx=0x7fbde8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:33.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.377+0000 7fbddf7fe700 1 -- 172.21.15.22:0/2156236208 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbdec054c80 con 0x7fbdf80c7290 2023-07-11T00:31:33.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.627+0000 7fbdfd1ff700 1 -- 172.21.15.22:0/2156236208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdf804ea60 con 0x7fbdf80c7290 2023-07-11T00:31:33.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.628+0000 7fbddf7fe700 1 -- 172.21.15.22:0/2156236208 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fbdec022070 con 0x7fbdf80c7290 2023-07-11T00:31:33.631 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:33.631 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3244868368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3244868368},{"type":"v1","addr":"172.21.15.22:6833","nonce":3244868368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/907204261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":907204261},{"type":"v1","addr":"172.21.15.184:6836","nonce":907204261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/1214375050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1214375050},{"type":"v1","addr":"172.21.15.22:6835","nonce":1214375050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:30:05.408970+0000","modified":"2023-07-11T00:30:33.631426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3376322541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3376322541},{"type":"v1","addr":"172.21.15.184:6837","nonce":3376322541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-11T00:31:33.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.630+0000 7fbdfd1ff700 1 -- 172.21.15.22:0/2156236208 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbde406ace0 msgr2=0x7fbde406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:33.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.630+0000 7fbdfd1ff700 1 --2- 172.21.15.22:0/2156236208 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbde406ace0 0x7fbde406d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbde8007fd0 tx=0x7fbde8009040 comp rx=0 tx=0).stop 2023-07-11T00:31:33.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.630+0000 7fbdfd1ff700 1 -- 172.21.15.22:0/2156236208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdf80c7290 msgr2=0x7fbdf814f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:33.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.630+0000 7fbdfd1ff700 1 --2- 172.21.15.22:0/2156236208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdf80c7290 0x7fbdf814f6c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0119a0 tx=0x7fbdec011cb0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.630+0000 7fbdfd1ff700 1 -- 172.21.15.22:0/2156236208 shutdown_connections 2023-07-11T00:31:33.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.630+0000 7fbdfd1ff700 1 --2- 172.21.15.22:0/2156236208 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fbde406ace0 0x7fbde406d190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.630+0000 7fbdfd1ff700 1 --2- 172.21.15.22:0/2156236208 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbdf80c8a90 0x7fbdf80c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.630+0000 7fbdfd1ff700 1 --2- 172.21.15.22:0/2156236208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbde0005200 0x7fbdf81f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.630+0000 7fbdfd1ff700 1 --2- 172.21.15.22:0/2156236208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbdf80c7290 0x7fbdf814f6c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.630+0000 7fbdfd1ff700 1 -- 172.21.15.22:0/2156236208 >> 172.21.15.22:0/2156236208 conn(0x7fbdf8071660 msgr2=0x7fbdf80b6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:33.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.630+0000 7fbdfd1ff700 1 -- 172.21.15.22:0/2156236208 shutdown_connections 2023-07-11T00:31:33.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.630+0000 7fbdfd1ff700 1 -- 172.21.15.22:0/2156236208 wait complete. 2023-07-11T00:31:33.634 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 9 2023-07-11T00:31:33.651 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:31:33.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.850+0000 7fb5d0bff700 1 Processor -- start 2023-07-11T00:31:33.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.850+0000 7fb5d0bff700 1 -- start start 2023-07-11T00:31:33.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.851+0000 7fb5d0bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb5cc15c460 0x7fb5cc0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:33.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.851+0000 7fb5d0bff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb5cc0cf8f0 0x7fb5cc15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:33.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.851+0000 7fb5d0bff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5cc0d1790 con 0x7fb5cc0d2640 2023-07-11T00:31:33.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.851+0000 7fb5d0bff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5cc0cedd0 con 0x7fb5cc0cf8f0 2023-07-11T00:31:33.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.851+0000 7fb5d0bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5cc0cd950 con 0x7fb5cc15c460 2023-07-11T00:31:33.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.851+0000 7fb5c9d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb5cc0d2640 0x7fb5cc0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55428/0 (socket says 172.21.15.22:55428) 2023-07-11T00:31:33.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.851+0000 7fb5cad9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb5cc0cf8f0 0x7fb5cc15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:33.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.851+0000 7fb5c9d9b700 1 -- 172.21.15.22:0/498415953 learned_addr learned my addr 172.21.15.22:0/498415953 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:33.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.852+0000 7fb5ca59c700 1 --2- 172.21.15.22:0/498415953 >> v2:172.21.15.184:3300/0 conn(0x7fb5cc15c460 0x7fb5cc0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:33.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.852+0000 7fb5cad9d700 1 -- 172.21.15.22:0/498415953 >> v2:172.21.15.184:3300/0 conn(0x7fb5cc15c460 msgr2=0x7fb5cc0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:33.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.852+0000 7fb5cad9d700 1 --2- 172.21.15.22:0/498415953 >> v2:172.21.15.184:3300/0 conn(0x7fb5cc15c460 0x7fb5cc0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.852+0000 7fb5cad9d700 1 -- 172.21.15.22:0/498415953 >> v1:172.21.15.22:6789/0 conn(0x7fb5cc0d2640 legacy=0x7fb5cc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:33.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.852+0000 7fb5cad9d700 1 -- 172.21.15.22:0/498415953 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc0d14b0 con 0x7fb5cc0cf8f0 2023-07-11T00:31:33.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.852+0000 7fb5c959a700 1 -- 172.21.15.22:0/498415953 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949220914 0 0) 0x7fb5cc0d1790 con 0x7fb5cc0d2640 2023-07-11T00:31:33.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.852+0000 7fb5cad9d700 1 --2- 172.21.15.22:0/498415953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc0cf8f0 0x7fb5cc15fe20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc0b4f00 tx=0x7fb5c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f509fd76719ab53d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:33.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.852+0000 7fb5c959a700 1 -- 172.21.15.22:0/498415953 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c400e070 con 0x7fb5cc0cf8f0 2023-07-11T00:31:33.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.853+0000 7fb5c959a700 1 -- 172.21.15.22:0/498415953 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c400bb20 con 0x7fb5cc0cf8f0 2023-07-11T00:31:33.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.853+0000 7fb5c959a700 1 -- 172.21.15.22:0/498415953 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4012430 con 0x7fb5cc0cf8f0 2023-07-11T00:31:33.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.853+0000 7fb5d0bff700 1 -- 172.21.15.22:0/498415953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc0cf8f0 msgr2=0x7fb5cc15fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:33.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.853+0000 7fb5d0bff700 1 --2- 172.21.15.22:0/498415953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc0cf8f0 0x7fb5cc15fe20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc0b4f00 tx=0x7fb5c400b330 comp rx=0 tx=0).stop 2023-07-11T00:31:33.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.853+0000 7fb5d0bff700 1 -- 172.21.15.22:0/498415953 shutdown_connections 2023-07-11T00:31:33.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.853+0000 7fb5d0bff700 1 --2- 172.21.15.22:0/498415953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc0cf8f0 0x7fb5cc15fe20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.853+0000 7fb5d0bff700 1 --2- 172.21.15.22:0/498415953 >> v2:172.21.15.184:3300/0 conn(0x7fb5cc15c460 0x7fb5cc0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.853+0000 7fb5d0bff700 1 -- 172.21.15.22:0/498415953 >> 172.21.15.22:0/498415953 conn(0x7fb5cc071660 msgr2=0x7fb5cc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:33.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.853+0000 7fb5d0bff700 1 -- 172.21.15.22:0/498415953 shutdown_connections 2023-07-11T00:31:33.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.853+0000 7fb5d0bff700 1 -- 172.21.15.22:0/498415953 wait complete. 2023-07-11T00:31:33.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.855+0000 7fb5d0bff700 1 Processor -- start 2023-07-11T00:31:33.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.855+0000 7fb5d0bff700 1 -- start start 2023-07-11T00:31:33.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.856+0000 7fb5d0bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5cc0cf8f0 0x7fb5cc15d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:33.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.856+0000 7fb5d0bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc0d2640 0x7fb5cc0cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:33.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.856+0000 7fb5d0bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5cc15c460 0x7fb5cc0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:33.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.856+0000 7fb5d0bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc150940 con 0x7fb5cc0d2640 2023-07-11T00:31:33.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.856+0000 7fb5d0bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc0c6a20 con 0x7fb5cc15c460 2023-07-11T00:31:33.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.856+0000 7fb5d0bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc15f7d0 con 0x7fb5cc0cf8f0 2023-07-11T00:31:33.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.856+0000 7fb5c9d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc0d2640 0x7fb5cc0cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:33.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.856+0000 7fb5c9d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc0d2640 0x7fb5cc0cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55754/0 (socket says 172.21.15.22:55754) 2023-07-11T00:31:33.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.856+0000 7fb5c9d9b700 1 -- 172.21.15.22:0/1517350913 learned_addr learned my addr 172.21.15.22:0/1517350913 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:33.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.856+0000 7fb5cad9d700 1 --2- 172.21.15.22:0/1517350913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5cc15c460 0x7fb5cc0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:33.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.856+0000 7fb5ca59c700 1 --2- 172.21.15.22:0/1517350913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5cc0cf8f0 0x7fb5cc15d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:33.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.857+0000 7fb5c9d9b700 1 -- 172.21.15.22:0/1517350913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5cc0cf8f0 msgr2=0x7fb5cc15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:33.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.857+0000 7fb5c9d9b700 1 --2- 172.21.15.22:0/1517350913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5cc0cf8f0 0x7fb5cc15d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.857+0000 7fb5c9d9b700 1 -- 172.21.15.22:0/1517350913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5cc15c460 msgr2=0x7fb5cc0cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:33.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.857+0000 7fb5c9d9b700 1 --2- 172.21.15.22:0/1517350913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5cc15c460 0x7fb5cc0cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:33.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.857+0000 7fb5c9d9b700 1 -- 172.21.15.22:0/1517350913 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c4009a70 con 0x7fb5cc0d2640 2023-07-11T00:31:33.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.857+0000 7fb5c9d9b700 1 --2- 172.21.15.22:0/1517350913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc0d2640 0x7fb5cc0cbe20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000c550 tx=0x7fb5c000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:33.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.857+0000 7fb5baffd700 1 -- 172.21.15.22:0/1517350913 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0004c80 con 0x7fb5cc0d2640 2023-07-11T00:31:33.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.857+0000 7fb5baffd700 1 -- 172.21.15.22:0/1517350913 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c0004e00 con 0x7fb5cc0d2640 2023-07-11T00:31:33.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.857+0000 7fb5d0bff700 1 -- 172.21.15.22:0/1517350913 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5cc15c8d0 con 0x7fb5cc0d2640 2023-07-11T00:31:33.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.857+0000 7fb5baffd700 1 -- 172.21.15.22:0/1517350913 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0007310 con 0x7fb5cc0d2640 2023-07-11T00:31:33.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.857+0000 7fb5d0bff700 1 -- 172.21.15.22:0/1517350913 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5cc15cb40 con 0x7fb5cc0d2640 2023-07-11T00:31:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.858+0000 7fb5d0bff700 1 -- 172.21.15.22:0/1517350913 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5cc04ea60 con 0x7fb5cc0d2640 2023-07-11T00:31:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.859+0000 7fb5baffd700 1 -- 172.21.15.22:0/1517350913 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb5c0007470 con 0x7fb5cc0d2640 2023-07-11T00:31:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.860+0000 7fb5baffd700 1 --2- 172.21.15.22:0/1517350913 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb5ac06ace0 0x7fb5ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.860+0000 7fb5baffd700 1 -- 172.21.15.22:0/1517350913 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb5c00893d0 con 0x7fb5cc0d2640 2023-07-11T00:31:33.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.861+0000 7fb5ca59c700 1 --2- 172.21.15.22:0/1517350913 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb5ac06ace0 0x7fb5ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:33.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.862+0000 7fb5ca59c700 1 --2- 172.21.15.22:0/1517350913 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb5ac06ace0 0x7fb5ac06d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009be0 tx=0x7fb5bc009210 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:33.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:33.865+0000 7fb5baffd700 1 -- 172.21.15.22:0/1517350913 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb5c0054140 con 0x7fb5cc0d2640 2023-07-11T00:31:34.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.077+0000 7fb5d0bff700 1 -- 172.21.15.22:0/1517350913 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5cc0b4fa0 con 0x7fb5cc0d2640 2023-07-11T00:31:34.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.078+0000 7fb5baffd700 1 -- 172.21.15.22:0/1517350913 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20158 (secure 0 0 0) 0x7fb5c0057760 con 0x7fb5cc0d2640 2023-07-11T00:31:34.081 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:34.081 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:54.208536+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:31:34.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.080+0000 7fb5d0bff700 1 -- 172.21.15.22:0/1517350913 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb5ac06ace0 msgr2=0x7fb5ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:34.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.080+0000 7fb5d0bff700 1 --2- 172.21.15.22:0/1517350913 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb5ac06ace0 0x7fb5ac06d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009be0 tx=0x7fb5bc009210 comp rx=0 tx=0).stop 2023-07-11T00:31:34.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.080+0000 7fb5d0bff700 1 -- 172.21.15.22:0/1517350913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc0d2640 msgr2=0x7fb5cc0cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:34.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.080+0000 7fb5d0bff700 1 --2- 172.21.15.22:0/1517350913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc0d2640 0x7fb5cc0cbe20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000c550 tx=0x7fb5c000c860 comp rx=0 tx=0).stop 2023-07-11T00:31:34.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.080+0000 7fb5d0bff700 1 -- 172.21.15.22:0/1517350913 shutdown_connections 2023-07-11T00:31:34.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.080+0000 7fb5d0bff700 1 --2- 172.21.15.22:0/1517350913 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb5ac06ace0 0x7fb5ac06d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:34.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.080+0000 7fb5d0bff700 1 --2- 172.21.15.22:0/1517350913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5cc0cf8f0 0x7fb5cc15d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:34.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.080+0000 7fb5d0bff700 1 --2- 172.21.15.22:0/1517350913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5cc15c460 0x7fb5cc0cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.080+0000 7fb5d0bff700 1 --2- 172.21.15.22:0/1517350913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5cc0d2640 0x7fb5cc0cbe20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.080+0000 7fb5d0bff700 1 -- 172.21.15.22:0/1517350913 >> 172.21.15.22:0/1517350913 conn(0x7fb5cc071660 msgr2=0x7fb5cc0b8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.080+0000 7fb5d0bff700 1 -- 172.21.15.22:0/1517350913 shutdown_connections 2023-07-11T00:31:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.080+0000 7fb5d0bff700 1 -- 172.21.15.22:0/1517350913 wait complete. 2023-07-11T00:31:34.101 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-11T00:31:34.102 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:31:34.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.301+0000 7f0751dff700 1 Processor -- start 2023-07-11T00:31:34.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.301+0000 7f0751dff700 1 -- start start 2023-07-11T00:31:34.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.302+0000 7f0751dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f074c15c460 0x7f074c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:34.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.302+0000 7f0751dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f074c0d2640 0x7f074c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:34.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.302+0000 7f0751dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074c0d1790 con 0x7f074c0cf720 2023-07-11T00:31:34.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.302+0000 7f0751dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074c0cedd0 con 0x7f074c0d2640 2023-07-11T00:31:34.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.302+0000 7f0751dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0cd950 con 0x7f074c15c460 2023-07-11T00:31:34.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.303+0000 7f074b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f074c15c460 0x7f074c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:34.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.303+0000 7f074b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f074c15c460 0x7f074c0b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:41260/0 (socket says 172.21.15.22:41260) 2023-07-11T00:31:34.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.303+0000 7f074b7fe700 1 -- 172.21.15.22:0/3745103403 learned_addr learned my addr 172.21.15.22:0/3745103403 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:34.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.303+0000 7f074affd700 1 --2- 172.21.15.22:0/3745103403 >> v2:172.21.15.184:3300/0 conn(0x7f074c0d2640 0x7f074c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:34.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.303+0000 7f074b7fe700 1 -- 172.21.15.22:0/3745103403 >> v2:172.21.15.184:3300/0 conn(0x7f074c0d2640 msgr2=0x7f074c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:34.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.303+0000 7f074b7fe700 1 --2- 172.21.15.22:0/3745103403 >> v2:172.21.15.184:3300/0 conn(0x7f074c0d2640 0x7f074c0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:34.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.303+0000 7f074b7fe700 1 -- 172.21.15.22:0/3745103403 >> v1:172.21.15.184:6789/0 conn(0x7f074c0cf720 legacy=0x7f074c0d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:34.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.303+0000 7f074b7fe700 1 -- 172.21.15.22:0/3745103403 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c0d14b0 con 0x7f074c15c460 2023-07-11T00:31:34.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.303+0000 7f074a7fc700 1 -- 172.21.15.22:0/3745103403 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361440348 0 0) 0x7f074c0d1790 con 0x7f074c0cf720 2023-07-11T00:31:34.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.303+0000 7f074b7fe700 1 --2- 172.21.15.22:0/3745103403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f074c15c460 0x7f074c0b59d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f073c0098f0 tx=0x7f073c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=379aab6c3870178 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:34.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.304+0000 7f074a7fc700 1 -- 172.21.15.22:0/3745103403 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c011830 con 0x7f074c15c460 2023-07-11T00:31:34.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.304+0000 7f074a7fc700 1 -- 172.21.15.22:0/3745103403 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c011990 con 0x7f074c15c460 2023-07-11T00:31:34.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.304+0000 7f074a7fc700 1 -- 172.21.15.22:0/3745103403 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c011d20 con 0x7f074c15c460 2023-07-11T00:31:34.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.304+0000 7f0751dff700 1 -- 172.21.15.22:0/3745103403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f074c15c460 msgr2=0x7f074c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:34.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.304+0000 7f0751dff700 1 --2- 172.21.15.22:0/3745103403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f074c15c460 0x7f074c0b59d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f073c0098f0 tx=0x7f073c009c00 comp rx=0 tx=0).stop 2023-07-11T00:31:34.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.304+0000 7f0751dff700 1 -- 172.21.15.22:0/3745103403 shutdown_connections 2023-07-11T00:31:34.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.304+0000 7f0751dff700 1 --2- 172.21.15.22:0/3745103403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f074c15c460 0x7f074c0b59d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:34.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.304+0000 7f0751dff700 1 --2- 172.21.15.22:0/3745103403 >> v2:172.21.15.184:3300/0 conn(0x7f074c0d2640 0x7f074c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:34.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.304+0000 7f0751dff700 1 -- 172.21.15.22:0/3745103403 >> 172.21.15.22:0/3745103403 conn(0x7f074c071660 msgr2=0x7f074c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:34.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.304+0000 7f0751dff700 1 -- 172.21.15.22:0/3745103403 shutdown_connections 2023-07-11T00:31:34.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.304+0000 7f0751dff700 1 -- 172.21.15.22:0/3745103403 wait complete. 2023-07-11T00:31:34.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.306+0000 7f0751dff700 1 Processor -- start 2023-07-11T00:31:34.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.306+0000 7f0751dff700 1 -- start start 2023-07-11T00:31:34.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.307+0000 7f0751dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f074c0cf720 0x7f074c0cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:34.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.307+0000 7f0751dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f074c0d2640 0x7f074c146f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:34.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.307+0000 7f0751dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f074c15c460 0x7f074c1e7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:34.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.307+0000 7f0751dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0cbe70 con 0x7f074c0cf720 2023-07-11T00:31:34.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.307+0000 7f0751dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c1474a0 con 0x7f074c15c460 2023-07-11T00:31:34.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.307+0000 7f0751dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0cb540 con 0x7f074c0d2640 2023-07-11T00:31:34.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.307+0000 7f074b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f074c0cf720 0x7f074c0cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:34.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.307+0000 7f074b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f074c0cf720 0x7f074c0cc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55768/0 (socket says 172.21.15.22:55768) 2023-07-11T00:31:34.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.308+0000 7f074b7fe700 1 -- 172.21.15.22:0/977339322 learned_addr learned my addr 172.21.15.22:0/977339322 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:34.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.308+0000 7f074affd700 1 --2- 172.21.15.22:0/977339322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f074c0d2640 0x7f074c146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:34.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.308+0000 7f074bfff700 1 --2- 172.21.15.22:0/977339322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f074c15c460 0x7f074c1e7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:34.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.308+0000 7f074b7fe700 1 -- 172.21.15.22:0/977339322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f074c0d2640 msgr2=0x7f074c146f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:34.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.308+0000 7f074b7fe700 1 --2- 172.21.15.22:0/977339322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f074c0d2640 0x7f074c146f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:34.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.308+0000 7f074b7fe700 1 -- 172.21.15.22:0/977339322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f074c15c460 msgr2=0x7f074c1e7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:34.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.308+0000 7f074b7fe700 1 --2- 172.21.15.22:0/977339322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f074c15c460 0x7f074c1e7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:34.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.308+0000 7f074b7fe700 1 -- 172.21.15.22:0/977339322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c009550 con 0x7f074c0cf720 2023-07-11T00:31:34.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.308+0000 7f074affd700 1 --2- 172.21.15.22:0/977339322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f074c0d2640 0x7f074c146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:34.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.308+0000 7f074b7fe700 1 --2- 172.21.15.22:0/977339322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f074c0cf720 0x7f074c0cc300 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f073c009f50 tx=0x7f073c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:34.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.308+0000 7f0733fff700 1 -- 172.21.15.22:0/977339322 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c004480 con 0x7f074c0cf720 2023-07-11T00:31:34.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.309+0000 7f0733fff700 1 -- 172.21.15.22:0/977339322 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c01f070 con 0x7f074c0cf720 2023-07-11T00:31:34.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.309+0000 7f0751dff700 1 -- 172.21.15.22:0/977339322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074c0cb820 con 0x7f074c0cf720 2023-07-11T00:31:34.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.309+0000 7f0733fff700 1 -- 172.21.15.22:0/977339322 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c0038e0 con 0x7f074c0cf720 2023-07-11T00:31:34.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.309+0000 7f0751dff700 1 -- 172.21.15.22:0/977339322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074c1e8350 con 0x7f074c0cf720 2023-07-11T00:31:34.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.310+0000 7f0751dff700 1 -- 172.21.15.22:0/977339322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074c0cc150 con 0x7f074c0cf720 2023-07-11T00:31:34.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.311+0000 7f0733fff700 1 -- 172.21.15.22:0/977339322 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f073c021030 con 0x7f074c0cf720 2023-07-11T00:31:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.311+0000 7f0733fff700 1 --2- 172.21.15.22:0/977339322 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f073806ace0 0x7f073806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.312+0000 7f0733fff700 1 -- 172.21.15.22:0/977339322 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f073c08ad10 con 0x7f074c0cf720 2023-07-11T00:31:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.312+0000 7f074affd700 1 --2- 172.21.15.22:0/977339322 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f073806ace0 0x7f073806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.313+0000 7f074affd700 1 --2- 172.21.15.22:0/977339322 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f073806ace0 0x7f073806d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f074c14aa60 tx=0x7f0740008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.316+0000 7f0733fff700 1 -- 172.21.15.22:0/977339322 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f073c090020 con 0x7f074c0cf720 2023-07-11T00:31:34.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.567+0000 7f0751dff700 1 -- 172.21.15.22:0/977339322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f074c04ea60 con 0x7f074c0cf720 2023-07-11T00:31:34.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.567+0000 7f0733fff700 1 -- 172.21.15.22:0/977339322 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f073c055ba0 con 0x7f074c0cf720 2023-07-11T00:31:34.570 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:34.571 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3244868368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3244868368},{"type":"v1","addr":"172.21.15.22:6833","nonce":3244868368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/907204261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":907204261},{"type":"v1","addr":"172.21.15.184:6836","nonce":907204261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/1214375050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1214375050},{"type":"v1","addr":"172.21.15.22:6835","nonce":1214375050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:30:05.408970+0000","modified":"2023-07-11T00:30:33.631426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3376322541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3376322541},{"type":"v1","addr":"172.21.15.184:6837","nonce":3376322541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-11T00:31:34.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.569+0000 7f0751dff700 1 -- 172.21.15.22:0/977339322 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f073806ace0 msgr2=0x7f073806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:34.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.569+0000 7f0751dff700 1 --2- 172.21.15.22:0/977339322 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f073806ace0 0x7f073806d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f074c14aa60 tx=0x7f0740008040 comp rx=0 tx=0).stop 2023-07-11T00:31:34.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.569+0000 7f0751dff700 1 -- 172.21.15.22:0/977339322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f074c0cf720 msgr2=0x7f074c0cc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:34.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.569+0000 7f0751dff700 1 --2- 172.21.15.22:0/977339322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f074c0cf720 0x7f074c0cc300 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f073c009f50 tx=0x7f073c004750 comp rx=0 tx=0).stop 2023-07-11T00:31:34.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.570+0000 7f0751dff700 1 -- 172.21.15.22:0/977339322 shutdown_connections 2023-07-11T00:31:34.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.570+0000 7f0751dff700 1 --2- 172.21.15.22:0/977339322 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f073806ace0 0x7f073806d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:34.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.570+0000 7f0751dff700 1 --2- 172.21.15.22:0/977339322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f074c15c460 0x7f074c1e7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:34.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.570+0000 7f0751dff700 1 --2- 172.21.15.22:0/977339322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f074c0cf720 0x7f074c0cc300 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:34.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.570+0000 7f0751dff700 1 --2- 172.21.15.22:0/977339322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f074c0d2640 0x7f074c146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:34.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.570+0000 7f0751dff700 1 -- 172.21.15.22:0/977339322 >> 172.21.15.22:0/977339322 conn(0x7f074c071660 msgr2=0x7f074c15e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:34.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.570+0000 7f0751dff700 1 -- 172.21.15.22:0/977339322 shutdown_connections 2023-07-11T00:31:34.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.570+0000 7f0751dff700 1 -- 172.21.15.22:0/977339322 wait complete. 2023-07-11T00:31:34.575 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 9 2023-07-11T00:31:34.591 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:31:34.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.790+0000 7f2498fff700 1 Processor -- start 2023-07-11T00:31:34.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.791+0000 7f2498fff700 1 -- start start 2023-07-11T00:31:34.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.792+0000 7f2498fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2494070340 0x7f249406a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:34.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.792+0000 7f2498fff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f249415e210 con 0x7f2494157f10 2023-07-11T00:31:34.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.792+0000 7f2498fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f249415dee0 con 0x7f2494070a50 2023-07-11T00:31:34.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.792+0000 7f2498fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f249406d900 con 0x7f2494070340 2023-07-11T00:31:34.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.792+0000 7f249259c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2494157f10 0x7f249415e6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55442/0 (socket says 172.21.15.22:55442) 2023-07-11T00:31:34.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.792+0000 7f249259c700 1 -- 172.21.15.22:0/1315329892 learned_addr learned my addr 172.21.15.22:0/1315329892 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:34.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.792+0000 7f2491d9b700 1 --2- 172.21.15.22:0/1315329892 >> v2:172.21.15.184:3300/0 conn(0x7f2494070340 0x7f249406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:34.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.793+0000 7f249159a700 1 -- 172.21.15.22:0/1315329892 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806277679 0 0) 0x7f249415e210 con 0x7f2494157f10 2023-07-11T00:31:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.793+0000 7f249159a700 1 -- 172.21.15.22:0/1315329892 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f247c0035b0 con 0x7f2494157f10 2023-07-11T00:31:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.793+0000 7f2491d9b700 1 -- 172.21.15.22:0/1315329892 >> v1:172.21.15.184:6789/0 conn(0x7f2494070a50 legacy=0x7f2494070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.793+0000 7f249159a700 1 -- 172.21.15.22:0/1315329892 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608685087 0 0) 0x7f249415dee0 con 0x7f2494070a50 2023-07-11T00:31:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.793+0000 7f2491d9b700 1 -- 172.21.15.22:0/1315329892 >> v1:172.21.15.22:6789/0 conn(0x7f2494157f10 legacy=0x7f249415e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.793+0000 7f2491d9b700 1 -- 172.21.15.22:0/1315329892 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24940c8f40 con 0x7f2494070340 2023-07-11T00:31:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.793+0000 7f2491d9b700 1 --2- 172.21.15.22:0/1315329892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2494070340 0x7f249406a940 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2488009840 tx=0x7f2488009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d229885e00e7156 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.793+0000 7f249159a700 1 -- 172.21.15.22:0/1315329892 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2488011830 con 0x7f2494070340 2023-07-11T00:31:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.793+0000 7f249159a700 1 -- 172.21.15.22:0/1315329892 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2488011990 con 0x7f2494070340 2023-07-11T00:31:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.793+0000 7f249159a700 1 -- 172.21.15.22:0/1315329892 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2488011d20 con 0x7f2494070340 2023-07-11T00:31:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.794+0000 7f2498fff700 1 -- 172.21.15.22:0/1315329892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2494070340 msgr2=0x7f249406a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.794+0000 7f2498fff700 1 --2- 172.21.15.22:0/1315329892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2494070340 0x7f249406a940 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2488009840 tx=0x7f2488009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.794+0000 7f2498fff700 1 -- 172.21.15.22:0/1315329892 shutdown_connections 2023-07-11T00:31:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.794+0000 7f2498fff700 1 --2- 172.21.15.22:0/1315329892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2494070340 0x7f249406a940 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.794+0000 7f2498fff700 1 -- 172.21.15.22:0/1315329892 >> 172.21.15.22:0/1315329892 conn(0x7f24940b0390 msgr2=0x7f24940b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.794+0000 7f2498fff700 1 -- 172.21.15.22:0/1315329892 shutdown_connections 2023-07-11T00:31:34.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.794+0000 7f2498fff700 1 -- 172.21.15.22:0/1315329892 wait complete. 2023-07-11T00:31:34.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.796+0000 7f2498fff700 1 Processor -- start 2023-07-11T00:31:34.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.796+0000 7f2498fff700 1 -- start start 2023-07-11T00:31:34.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.797+0000 7f2498fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2494070340 0x7f2494159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:34.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.797+0000 7f2498fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2494070a50 0x7f24940b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:34.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.797+0000 7f2498fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2494157f10 0x7f24940b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:34.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.797+0000 7f2498fff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2494159010 con 0x7f2494070a50 2023-07-11T00:31:34.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.797+0000 7f2498fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24940b45a0 con 0x7f2494070340 2023-07-11T00:31:34.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.797+0000 7f2498fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24940b42c0 con 0x7f2494157f10 2023-07-11T00:31:34.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.797+0000 7f2491d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2494070a50 0x7f24940b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:34.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.797+0000 7f2491d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2494070a50 0x7f24940b3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55782/0 (socket says 172.21.15.22:55782) 2023-07-11T00:31:34.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.797+0000 7f2491d9b700 1 -- 172.21.15.22:0/3276544049 learned_addr learned my addr 172.21.15.22:0/3276544049 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:34.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.797+0000 7f249259c700 1 --2- 172.21.15.22:0/3276544049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2494070340 0x7f2494159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:34.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.798+0000 7f2492d9d700 1 --2- 172.21.15.22:0/3276544049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2494157f10 0x7f24940b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:34.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.798+0000 7f2491d9b700 1 -- 172.21.15.22:0/3276544049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2494157f10 msgr2=0x7f24940b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:34.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.798+0000 7f2491d9b700 1 --2- 172.21.15.22:0/3276544049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2494157f10 0x7f24940b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:34.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.798+0000 7f2491d9b700 1 -- 172.21.15.22:0/3276544049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2494070340 msgr2=0x7f2494159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:34.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.798+0000 7f2491d9b700 1 --2- 172.21.15.22:0/3276544049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2494070340 0x7f2494159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:34.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.798+0000 7f2491d9b700 1 -- 172.21.15.22:0/3276544049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24880094a0 con 0x7f2494070a50 2023-07-11T00:31:34.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.798+0000 7f2491d9b700 1 --2- 172.21.15.22:0/3276544049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2494070a50 0x7f24940b3be0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f24880090b0 tx=0x7f2488004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:34.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.798+0000 7f2482ffd700 1 -- 172.21.15.22:0/3276544049 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248801a7e0 con 0x7f2494070a50 2023-07-11T00:31:34.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.798+0000 7f2482ffd700 1 -- 172.21.15.22:0/3276544049 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248801a940 con 0x7f2494070a50 2023-07-11T00:31:34.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.798+0000 7f2498fff700 1 -- 172.21.15.22:0/3276544049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24941591f0 con 0x7f2494070a50 2023-07-11T00:31:34.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.799+0000 7f2482ffd700 1 -- 172.21.15.22:0/3276544049 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248801acd0 con 0x7f2494070a50 2023-07-11T00:31:34.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.799+0000 7f2498fff700 1 -- 172.21.15.22:0/3276544049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2494159580 con 0x7f2494070a50 2023-07-11T00:31:34.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.799+0000 7f2498fff700 1 -- 172.21.15.22:0/3276544049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24941599f0 con 0x7f2494070a50 2023-07-11T00:31:34.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.801+0000 7f2482ffd700 1 -- 172.21.15.22:0/3276544049 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2488022070 con 0x7f2494070a50 2023-07-11T00:31:34.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.801+0000 7f2482ffd700 1 --2- 172.21.15.22:0/3276544049 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f247406ace0 0x7f247406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:34.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.802+0000 7f2482ffd700 1 -- 172.21.15.22:0/3276544049 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f248808a6e0 con 0x7f2494070a50 2023-07-11T00:31:34.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.802+0000 7f249259c700 1 --2- 172.21.15.22:0/3276544049 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f247406ace0 0x7f247406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:34.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.803+0000 7f249259c700 1 --2- 172.21.15.22:0/3276544049 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f247406ace0 0x7f247406d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2484007fd0 tx=0x7f2484009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:34.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:34.806+0000 7f2482ffd700 1 -- 172.21.15.22:0/3276544049 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f24941599f0 con 0x7f2494070a50 2023-07-11T00:31:35.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.057+0000 7f2498fff700 1 -- 172.21.15.22:0/3276544049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24941599f0 con 0x7f2494070a50 2023-07-11T00:31:35.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.058+0000 7f2482ffd700 1 -- 172.21.15.22:0/3276544049 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f24941599f0 con 0x7f2494070a50 2023-07-11T00:31:35.291 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:35.291 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3244868368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3244868368},{"type":"v1","addr":"172.21.15.22:6833","nonce":3244868368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/907204261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":907204261},{"type":"v1","addr":"172.21.15.184:6836","nonce":907204261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/1214375050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":1214375050},{"type":"v1","addr":"172.21.15.22:6835","nonce":1214375050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:30:05.408970+0000","modified":"2023-07-11T00:30:33.631426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3376322541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3376322541},{"type":"v1","addr":"172.21.15.184:6837","nonce":3376322541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-11T00:31:35.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.060+0000 7f2498fff700 1 -- 172.21.15.22:0/3276544049 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f247406ace0 msgr2=0x7f247406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:35.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.060+0000 7f2498fff700 1 --2- 172.21.15.22:0/3276544049 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f247406ace0 0x7f247406d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2484007fd0 tx=0x7f2484009040 comp rx=0 tx=0).stop 2023-07-11T00:31:35.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.060+0000 7f2498fff700 1 -- 172.21.15.22:0/3276544049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2494070a50 msgr2=0x7f24940b3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:35.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.060+0000 7f2498fff700 1 --2- 172.21.15.22:0/3276544049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2494070a50 0x7f24940b3be0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f24880090b0 tx=0x7f2488004750 comp rx=0 tx=0).stop 2023-07-11T00:31:35.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.060+0000 7f2498fff700 1 -- 172.21.15.22:0/3276544049 shutdown_connections 2023-07-11T00:31:35.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.060+0000 7f2498fff700 1 --2- 172.21.15.22:0/3276544049 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f247406ace0 0x7f247406d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:35.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.061+0000 7f2498fff700 1 --2- 172.21.15.22:0/3276544049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2494157f10 0x7f24940b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:35.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.061+0000 7f2498fff700 1 --2- 172.21.15.22:0/3276544049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2494070340 0x7f2494159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:35.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.061+0000 7f2498fff700 1 --2- 172.21.15.22:0/3276544049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2494070a50 0x7f24940b3be0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:35.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.061+0000 7f2498fff700 1 -- 172.21.15.22:0/3276544049 >> 172.21.15.22:0/3276544049 conn(0x7f24940b0390 msgr2=0x7f249415ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:35.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.061+0000 7f2498fff700 1 -- 172.21.15.22:0/3276544049 shutdown_connections 2023-07-11T00:31:35.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.061+0000 7f2498fff700 1 -- 172.21.15.22:0/3276544049 wait complete. 2023-07-11T00:31:35.294 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 9 2023-07-11T00:31:35.295 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:31:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.499+0000 7fac7f1ff700 1 Processor -- start 2023-07-11T00:31:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.499+0000 7fac7f1ff700 1 -- start start 2023-07-11T00:31:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.500+0000 7fac7f1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac780b59d0 0x7fac781671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.500+0000 7fac7f1ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac780d1790 con 0x7fac7815c460 2023-07-11T00:31:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.500+0000 7fac7f1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac780cd950 con 0x7fac780d2640 2023-07-11T00:31:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.500+0000 7fac7f1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac780cedd0 con 0x7fac780b59d0 2023-07-11T00:31:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.501+0000 7fac7cf9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fac7815c460 0x7fac780cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55444/0 (socket says 172.21.15.22:55444) 2023-07-11T00:31:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.501+0000 7fac7cf9b700 1 -- 172.21.15.22:0/404014797 learned_addr learned my addr 172.21.15.22:0/404014797 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.501+0000 7fac7d79c700 1 --2- 172.21.15.22:0/404014797 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac780b59d0 0x7fac781671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.501+0000 7fac777fe700 1 -- 172.21.15.22:0/404014797 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662395177 0 0) 0x7fac780d1790 con 0x7fac7815c460 2023-07-11T00:31:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.501+0000 7fac777fe700 1 -- 172.21.15.22:0/404014797 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac680035b0 con 0x7fac7815c460 2023-07-11T00:31:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.501+0000 7fac777fe700 1 -- 172.21.15.22:0/404014797 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1590243190 0 0) 0x7fac780cd950 con 0x7fac780d2640 2023-07-11T00:31:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.501+0000 7fac777fe700 1 -- 172.21.15.22:0/404014797 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac780d1790 con 0x7fac780d2640 2023-07-11T00:31:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.501+0000 7fac7d79c700 1 -- 172.21.15.22:0/404014797 >> v1:172.21.15.184:6789/0 conn(0x7fac780d2640 legacy=0x7fac780cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.501+0000 7fac7d79c700 1 -- 172.21.15.22:0/404014797 >> v1:172.21.15.22:6789/0 conn(0x7fac7815c460 legacy=0x7fac780cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.501+0000 7fac7d79c700 1 -- 172.21.15.22:0/404014797 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac780d14b0 con 0x7fac780b59d0 2023-07-11T00:31:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.502+0000 7fac7d79c700 1 --2- 172.21.15.22:0/404014797 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac780b59d0 0x7fac781671b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fac70009dc0 tx=0x7fac7000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22ddadb703f982f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.502+0000 7fac777fe700 1 -- 172.21.15.22:0/404014797 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7000e070 con 0x7fac780b59d0 2023-07-11T00:31:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.502+0000 7fac777fe700 1 -- 172.21.15.22:0/404014797 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7000bb20 con 0x7fac780b59d0 2023-07-11T00:31:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.502+0000 7fac777fe700 1 -- 172.21.15.22:0/404014797 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7000be90 con 0x7fac780b59d0 2023-07-11T00:31:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.503+0000 7fac7f1ff700 1 -- 172.21.15.22:0/404014797 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac780b59d0 msgr2=0x7fac781671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.503+0000 7fac7f1ff700 1 --2- 172.21.15.22:0/404014797 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac780b59d0 0x7fac781671b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fac70009dc0 tx=0x7fac7000b330 comp rx=0 tx=0).stop 2023-07-11T00:31:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.503+0000 7fac7f1ff700 1 -- 172.21.15.22:0/404014797 shutdown_connections 2023-07-11T00:31:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.503+0000 7fac7f1ff700 1 --2- 172.21.15.22:0/404014797 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac780b59d0 0x7fac781671b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.503+0000 7fac7f1ff700 1 -- 172.21.15.22:0/404014797 >> 172.21.15.22:0/404014797 conn(0x7fac78071660 msgr2=0x7fac78071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:35.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.503+0000 7fac7f1ff700 1 -- 172.21.15.22:0/404014797 shutdown_connections 2023-07-11T00:31:35.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.503+0000 7fac7f1ff700 1 -- 172.21.15.22:0/404014797 wait complete. 2023-07-11T00:31:35.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.504+0000 7fac7f1ff700 1 Processor -- start 2023-07-11T00:31:35.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.505+0000 7fac7f1ff700 1 -- start start 2023-07-11T00:31:35.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.505+0000 7fac7f1ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac780b59d0 0x7fac7815ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:35.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.505+0000 7fac7f1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac780d2640 0x7fac7815b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:35.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.505+0000 7fac7f1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac7815c460 0x7fac7815b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:35.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.506+0000 7fac7f1ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7815bcd0 con 0x7fac780b59d0 2023-07-11T00:31:35.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.506+0000 7fac7f1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac780cbc00 con 0x7fac780d2640 2023-07-11T00:31:35.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.506+0000 7fac7f1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac780cbee0 con 0x7fac7815c460 2023-07-11T00:31:35.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.506+0000 7fac7cf9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac780b59d0 0x7fac7815ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:35.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.506+0000 7fac7cf9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac780b59d0 0x7fac7815ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55792/0 (socket says 172.21.15.22:55792) 2023-07-11T00:31:35.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.506+0000 7fac7cf9b700 1 -- 172.21.15.22:0/2845660675 learned_addr learned my addr 172.21.15.22:0/2845660675 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:35.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.506+0000 7fac77fff700 1 --2- 172.21.15.22:0/2845660675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac780d2640 0x7fac7815b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:35.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.506+0000 7fac7d79c700 1 --2- 172.21.15.22:0/2845660675 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac7815c460 0x7fac7815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:35.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.506+0000 7fac7cf9b700 1 -- 172.21.15.22:0/2845660675 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac7815c460 msgr2=0x7fac7815b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:35.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.506+0000 7fac7cf9b700 1 --2- 172.21.15.22:0/2845660675 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac7815c460 0x7fac7815b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:35.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.506+0000 7fac7cf9b700 1 -- 172.21.15.22:0/2845660675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac780d2640 msgr2=0x7fac7815b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:35.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.506+0000 7fac7cf9b700 1 --2- 172.21.15.22:0/2845660675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac780d2640 0x7fac7815b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:35.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.506+0000 7fac7cf9b700 1 -- 172.21.15.22:0/2845660675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac70009a70 con 0x7fac780b59d0 2023-07-11T00:31:35.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.506+0000 7fac7cf9b700 1 --2- 172.21.15.22:0/2845660675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac780b59d0 0x7fac7815ccb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00c6e0 tx=0x7fac6c00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:35.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.507+0000 7fac757fa700 1 -- 172.21.15.22:0/2845660675 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c005d70 con 0x7fac780b59d0 2023-07-11T00:31:35.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.507+0000 7fac757fa700 1 -- 172.21.15.22:0/2845660675 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6c0070d0 con 0x7fac780b59d0 2023-07-11T00:31:35.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.507+0000 7fac7f1ff700 1 -- 172.21.15.22:0/2845660675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac780cc1c0 con 0x7fac780b59d0 2023-07-11T00:31:35.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.507+0000 7fac757fa700 1 -- 172.21.15.22:0/2845660675 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c007480 con 0x7fac780b59d0 2023-07-11T00:31:35.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.507+0000 7fac7f1ff700 1 -- 172.21.15.22:0/2845660675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac781f2de0 con 0x7fac780b59d0 2023-07-11T00:31:35.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.508+0000 7fac7f1ff700 1 -- 172.21.15.22:0/2845660675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac781f3000 con 0x7fac780b59d0 2023-07-11T00:31:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.509+0000 7fac757fa700 1 -- 172.21.15.22:0/2845660675 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac6c0075e0 con 0x7fac780b59d0 2023-07-11T00:31:35.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.510+0000 7fac757fa700 1 --2- 172.21.15.22:0/2845660675 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fac5c06ad10 0x7fac5c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.510+0000 7fac757fa700 1 -- 172.21.15.22:0/2845660675 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fac6c088e60 con 0x7fac780b59d0 2023-07-11T00:31:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.511+0000 7fac77fff700 1 --2- 172.21.15.22:0/2845660675 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fac5c06ad10 0x7fac5c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.511+0000 7fac77fff700 1 --2- 172.21.15.22:0/2845660675 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fac5c06ad10 0x7fac5c06d1c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac781f5170 tx=0x7fac64009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.514+0000 7fac757fa700 1 -- 172.21.15.22:0/2845660675 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fac6c053b40 con 0x7fac780b59d0 2023-07-11T00:31:35.710 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:31:35.718 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:31:35.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.722+0000 7fac7f1ff700 1 -- 172.21.15.22:0/2845660675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac7804ea60 con 0x7fac780b59d0 2023-07-11T00:31:35.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.724+0000 7fac757fa700 1 -- 172.21.15.22:0/2845660675 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20158 (secure 0 0 0) 0x7fac6c057160 con 0x7fac780b59d0 2023-07-11T00:31:35.729 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:35.731 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":26,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:30:54.208536+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:30:03.826184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:30:04.383448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-11T00:30:08.075875+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:31:35.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.727+0000 7fac7f1ff700 1 -- 172.21.15.22:0/2845660675 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fac5c06ad10 msgr2=0x7fac5c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:35.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.727+0000 7fac7f1ff700 1 --2- 172.21.15.22:0/2845660675 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fac5c06ad10 0x7fac5c06d1c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac781f5170 tx=0x7fac64009040 comp rx=0 tx=0).stop 2023-07-11T00:31:35.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.727+0000 7fac7f1ff700 1 -- 172.21.15.22:0/2845660675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac780b59d0 msgr2=0x7fac7815ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:35.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.727+0000 7fac7f1ff700 1 --2- 172.21.15.22:0/2845660675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac780b59d0 0x7fac7815ccb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00c6e0 tx=0x7fac6c00caa0 comp rx=0 tx=0).stop 2023-07-11T00:31:35.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.727+0000 7fac7f1ff700 1 -- 172.21.15.22:0/2845660675 shutdown_connections 2023-07-11T00:31:35.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.727+0000 7fac7f1ff700 1 --2- 172.21.15.22:0/2845660675 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fac5c06ad10 0x7fac5c06d1c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:35.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.727+0000 7fac7f1ff700 1 --2- 172.21.15.22:0/2845660675 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac7815c460 0x7fac7815b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:35.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.727+0000 7fac7f1ff700 1 --2- 172.21.15.22:0/2845660675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac780b59d0 0x7fac7815ccb0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:35.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.727+0000 7fac7f1ff700 1 --2- 172.21.15.22:0/2845660675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac780d2640 0x7fac7815b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:35.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.727+0000 7fac7f1ff700 1 -- 172.21.15.22:0/2845660675 >> 172.21.15.22:0/2845660675 conn(0x7fac78071660 msgr2=0x7fac780d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:35.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.727+0000 7fac7f1ff700 1 -- 172.21.15.22:0/2845660675 shutdown_connections 2023-07-11T00:31:35.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.727+0000 7fac7f1ff700 1 -- 172.21.15.22:0/2845660675 wait complete. 2023-07-11T00:31:35.748 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-11T00:31:35.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.990+0000 7f46f01ff700 1 Processor -- start 2023-07-11T00:31:35.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.990+0000 7f46f01ff700 1 -- start start 2023-07-11T00:31:35.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.991+0000 7f46f01ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e815fe00 0x7f46e80cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:35.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.992+0000 7f46f01ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f46e80d0dd0 0x7f46e80d1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:35.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.992+0000 7f46f01ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e80cd120 con 0x7f46e81601d0 2023-07-11T00:31:35.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.992+0000 7f46f01ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e80cd930 con 0x7f46e80d0dd0 2023-07-11T00:31:35.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.992+0000 7f46f01ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e80d06a0 con 0x7f46e815fe00 2023-07-11T00:31:35.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.992+0000 7f46ed79a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f46e81601d0 0x7f46e8160640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55456/0 (socket says 172.21.15.22:55456) 2023-07-11T00:31:35.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.992+0000 7f46ed79a700 1 -- 172.21.15.22:0/849503043 learned_addr learned my addr 172.21.15.22:0/849503043 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:35.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.992+0000 7f46edf9b700 1 --2- 172.21.15.22:0/849503043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e815fe00 0x7f46e80cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:35.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.992+0000 7f46ee79c700 1 --2- 172.21.15.22:0/849503043 >> v2:172.21.15.184:3300/0 conn(0x7f46e80d0dd0 0x7f46e80d1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:35.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.992+0000 7f46ecf99700 1 -- 172.21.15.22:0/849503043 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1908350041 0 0) 0x7f46e80cd120 con 0x7f46e81601d0 2023-07-11T00:31:35.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.992+0000 7f46ecf99700 1 -- 172.21.15.22:0/849503043 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46d40035b0 con 0x7f46e81601d0 2023-07-11T00:31:35.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.993+0000 7f46edf9b700 1 -- 172.21.15.22:0/849503043 >> v2:172.21.15.184:3300/0 conn(0x7f46e80d0dd0 msgr2=0x7f46e80d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:35.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.993+0000 7f46edf9b700 1 --2- 172.21.15.22:0/849503043 >> v2:172.21.15.184:3300/0 conn(0x7f46e80d0dd0 0x7f46e80d1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:35.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.993+0000 7f46edf9b700 1 -- 172.21.15.22:0/849503043 >> v1:172.21.15.22:6789/0 conn(0x7f46e81601d0 legacy=0x7f46e8160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:35.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.993+0000 7f46edf9b700 1 -- 172.21.15.22:0/849503043 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e80d0940 con 0x7f46e815fe00 2023-07-11T00:31:35.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.993+0000 7f46ee79c700 1 --2- 172.21.15.22:0/849503043 >> v2:172.21.15.184:3300/0 conn(0x7f46e80d0dd0 0x7f46e80d1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:35.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.993+0000 7f46edf9b700 1 --2- 172.21.15.22:0/849503043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e815fe00 0x7f46e80cf810 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009840 tx=0x7f46e4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=282bd07388560864 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:35.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.993+0000 7f46ecf99700 1 -- 172.21.15.22:0/849503043 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4011830 con 0x7f46e815fe00 2023-07-11T00:31:35.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.993+0000 7f46ecf99700 1 -- 172.21.15.22:0/849503043 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e4011990 con 0x7f46e815fe00 2023-07-11T00:31:35.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.993+0000 7f46ecf99700 1 -- 172.21.15.22:0/849503043 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4011d20 con 0x7f46e815fe00 2023-07-11T00:31:35.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.994+0000 7f46f01ff700 1 -- 172.21.15.22:0/849503043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e815fe00 msgr2=0x7f46e80cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:35.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.994+0000 7f46f01ff700 1 --2- 172.21.15.22:0/849503043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e815fe00 0x7f46e80cf810 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009840 tx=0x7f46e4009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:35.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.994+0000 7f46f01ff700 1 -- 172.21.15.22:0/849503043 shutdown_connections 2023-07-11T00:31:35.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.994+0000 7f46f01ff700 1 --2- 172.21.15.22:0/849503043 >> v2:172.21.15.184:3300/0 conn(0x7f46e80d0dd0 0x7f46e80d1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:35.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.994+0000 7f46f01ff700 1 --2- 172.21.15.22:0/849503043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e815fe00 0x7f46e80cf810 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:35.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.994+0000 7f46f01ff700 1 -- 172.21.15.22:0/849503043 >> 172.21.15.22:0/849503043 conn(0x7f46e8071660 msgr2=0x7f46e8071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:35.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.994+0000 7f46f01ff700 1 -- 172.21.15.22:0/849503043 shutdown_connections 2023-07-11T00:31:35.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.994+0000 7f46f01ff700 1 -- 172.21.15.22:0/849503043 wait complete. 2023-07-11T00:31:36.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.996+0000 7f46f01ff700 1 Processor -- start 2023-07-11T00:31:36.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.997+0000 7f46f01ff700 1 -- start start 2023-07-11T00:31:36.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.998+0000 7f46f01ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e80d0dd0 0x7f46e8159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:36.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.998+0000 7f46f01ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46e815fe00 0x7f46e81597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:36.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.998+0000 7f46f01ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46e81601d0 0x7f46e81e64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:36.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.998+0000 7f46f01ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e81e6300 con 0x7f46e815fe00 2023-07-11T00:31:36.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.998+0000 7f46f01ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e80c82c0 con 0x7f46e81601d0 2023-07-11T00:31:36.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.998+0000 7f46f01ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e81e6bb0 con 0x7f46e80d0dd0 2023-07-11T00:31:36.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.998+0000 7f46ed79a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46e815fe00 0x7f46e81597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:36.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.998+0000 7f46ed79a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46e815fe00 0x7f46e81597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55794/0 (socket says 172.21.15.22:55794) 2023-07-11T00:31:36.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.998+0000 7f46ed79a700 1 -- 172.21.15.22:0/429534585 learned_addr learned my addr 172.21.15.22:0/429534585 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:36.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.998+0000 7f46edf9b700 1 --2- 172.21.15.22:0/429534585 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e80d0dd0 0x7f46e8159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:36.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.998+0000 7f46ee79c700 1 --2- 172.21.15.22:0/429534585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46e81601d0 0x7f46e81e64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:36.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.998+0000 7f46ed79a700 1 -- 172.21.15.22:0/429534585 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e80d0dd0 msgr2=0x7f46e8159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:36.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.998+0000 7f46ed79a700 1 --2- 172.21.15.22:0/429534585 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e80d0dd0 0x7f46e8159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:36.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.998+0000 7f46ed79a700 1 -- 172.21.15.22:0/429534585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46e81601d0 msgr2=0x7f46e81e64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:36.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.998+0000 7f46ed79a700 1 --2- 172.21.15.22:0/429534585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46e81601d0 0x7f46e81e64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:36.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.998+0000 7f46ed79a700 1 -- 172.21.15.22:0/429534585 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e0009a70 con 0x7f46e815fe00 2023-07-11T00:31:36.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.999+0000 7f46ed79a700 1 --2- 172.21.15.22:0/429534585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46e815fe00 0x7f46e81597b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f46d800c4d0 tx=0x7f46d800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:36.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.999+0000 7f46de7fc700 1 -- 172.21.15.22:0/429534585 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8005d70 con 0x7f46e815fe00 2023-07-11T00:31:36.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.999+0000 7f46de7fc700 1 -- 172.21.15.22:0/429534585 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d80070d0 con 0x7f46e815fe00 2023-07-11T00:31:36.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.999+0000 7f46f01ff700 1 -- 172.21.15.22:0/429534585 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e40094a0 con 0x7f46e815fe00 2023-07-11T00:31:36.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.999+0000 7f46de7fc700 1 -- 172.21.15.22:0/429534585 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8007460 con 0x7f46e815fe00 2023-07-11T00:31:36.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:35.999+0000 7f46f01ff700 1 -- 172.21.15.22:0/429534585 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e81e5af0 con 0x7f46e815fe00 2023-07-11T00:31:36.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.000+0000 7f46f01ff700 1 -- 172.21.15.22:0/429534585 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e815a5e0 con 0x7f46e815fe00 2023-07-11T00:31:36.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.001+0000 7f46de7fc700 1 -- 172.21.15.22:0/429534585 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f46d80075c0 con 0x7f46e815fe00 2023-07-11T00:31:36.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.002+0000 7f46de7fc700 1 --2- 172.21.15.22:0/429534585 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f46cc06ace0 0x7f46cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:36.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.003+0000 7f46de7fc700 1 -- 172.21.15.22:0/429534585 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f46d8088c40 con 0x7f46e815fe00 2023-07-11T00:31:36.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.003+0000 7f46edf9b700 1 --2- 172.21.15.22:0/429534585 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f46cc06ace0 0x7f46cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:36.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.003+0000 7f46edf9b700 1 --2- 172.21.15.22:0/429534585 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f46cc06ace0 0x7f46cc06d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f46e4000c00 tx=0x7f46e401c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:36.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.007+0000 7f46de7fc700 1 -- 172.21.15.22:0/429534585 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f46d8053a50 con 0x7f46e815fe00 2023-07-11T00:31:36.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.259+0000 7f46f01ff700 1 -- 172.21.15.22:0/429534585 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f46e80c7ff0 con 0x7f46e815fe00 2023-07-11T00:31:36.262 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-07-11T00:31:36.260+0000 7fe5bf7f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-11T00:31:36.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.264+0000 7f46de7fc700 1 -- 172.21.15.22:0/429534585 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f46d8057070 con 0x7f46e815fe00 2023-07-11T00:31:36.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.267+0000 7f46f01ff700 1 -- 172.21.15.22:0/429534585 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f46cc06ace0 msgr2=0x7f46cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:36.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.267+0000 7f46f01ff700 1 --2- 172.21.15.22:0/429534585 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f46cc06ace0 0x7f46cc06d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f46e4000c00 tx=0x7f46e401c040 comp rx=0 tx=0).stop 2023-07-11T00:31:36.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.267+0000 7f46f01ff700 1 -- 172.21.15.22:0/429534585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46e815fe00 msgr2=0x7f46e81597b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:36.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.267+0000 7f46f01ff700 1 --2- 172.21.15.22:0/429534585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46e815fe00 0x7f46e81597b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f46d800c4d0 tx=0x7f46d800c890 comp rx=0 tx=0).stop 2023-07-11T00:31:36.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.267+0000 7f46f01ff700 1 -- 172.21.15.22:0/429534585 shutdown_connections 2023-07-11T00:31:36.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.267+0000 7f46f01ff700 1 --2- 172.21.15.22:0/429534585 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f46cc06ace0 0x7f46cc06d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:36.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.267+0000 7f46f01ff700 1 --2- 172.21.15.22:0/429534585 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e80d0dd0 0x7f46e8159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:36.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.267+0000 7f46f01ff700 1 --2- 172.21.15.22:0/429534585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46e81601d0 0x7f46e81e64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:36.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.267+0000 7f46f01ff700 1 --2- 172.21.15.22:0/429534585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46e815fe00 0x7f46e81597b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:36.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.267+0000 7f46f01ff700 1 -- 172.21.15.22:0/429534585 >> 172.21.15.22:0/429534585 conn(0x7f46e8071660 msgr2=0x7f46e8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:36.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.267+0000 7f46f01ff700 1 -- 172.21.15.22:0/429534585 shutdown_connections 2023-07-11T00:31:36.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.267+0000 7f46f01ff700 1 -- 172.21.15.22:0/429534585 wait complete. 2023-07-11T00:31:36.272 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-11T00:31:36.280 INFO:tasks.ceph.mds.d.smithi184.stderr: -6733> 2023-07-11T00:30:10.813+0000 7f8dcbdf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-11T00:31:36.288 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-11T00:31:36.337 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-07-11T00:31:36.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.489+0000 7f51b3fff700 1 Processor -- start 2023-07-11T00:31:36.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.490+0000 7f51b3fff700 1 -- start start 2023-07-11T00:31:36.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.491+0000 7f51b3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f51ac0b8260 0x7f51ac0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:36.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.491+0000 7f51b3fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51ac0b4d20 0x7f51ac0d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:36.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.491+0000 7f51b3fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac160a00 con 0x7f51ac0d25c0 2023-07-11T00:31:36.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.491+0000 7f51b3fff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ac160ce0 con 0x7f51ac0b8260 2023-07-11T00:31:36.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.491+0000 7f51b3fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac0cd280 con 0x7f51ac0b4d20 2023-07-11T00:31:36.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.491+0000 7f51b1d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f51ac0b8260 0x7f51ac0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:36.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.491+0000 7f51b159a700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f51ac0d25c0 0x7f51ac0b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:46010/0 (socket says 172.21.15.22:46010) 2023-07-11T00:31:36.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.491+0000 7f51b159a700 1 -- 172.21.15.22:0/2206655958 learned_addr learned my addr 172.21.15.22:0/2206655958 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:36.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.491+0000 7f51b259c700 1 --2- 172.21.15.22:0/2206655958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51ac0b4d20 0x7f51ac0d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:36.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.491+0000 7f51b1d9b700 1 -- 172.21.15.22:0/2206655958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51ac0b4d20 msgr2=0x7f51ac0d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.491+0000 7f51b1d9b700 1 --2- 172.21.15.22:0/2206655958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51ac0b4d20 0x7f51ac0d0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.491+0000 7f51b1d9b700 1 -- 172.21.15.22:0/2206655958 >> v1:172.21.15.184:6789/0 conn(0x7f51ac0d25c0 legacy=0x7f51ac0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.492+0000 7f51b1d9b700 1 -- 172.21.15.22:0/2206655958 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac0cd560 con 0x7f51ac0b8260 2023-07-11T00:31:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.492+0000 7f51b1d9b700 1 --2- 172.21.15.22:0/2206655958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51ac0b8260 0x7f51ac0cede0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009840 tx=0x7f51a8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504cbf667c21de8 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.492+0000 7f51b0d99700 1 -- 172.21.15.22:0/2206655958 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8011830 con 0x7f51ac0b8260 2023-07-11T00:31:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.492+0000 7f51b0d99700 1 -- 172.21.15.22:0/2206655958 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a8011990 con 0x7f51ac0b8260 2023-07-11T00:31:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.492+0000 7f51b0d99700 1 -- 172.21.15.22:0/2206655958 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8011d20 con 0x7f51ac0b8260 2023-07-11T00:31:36.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.493+0000 7f51b3fff700 1 -- 172.21.15.22:0/2206655958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51ac0b8260 msgr2=0x7f51ac0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:36.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.493+0000 7f51b3fff700 1 --2- 172.21.15.22:0/2206655958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51ac0b8260 0x7f51ac0cede0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009840 tx=0x7f51a8009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:36.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.493+0000 7f51b3fff700 1 -- 172.21.15.22:0/2206655958 shutdown_connections 2023-07-11T00:31:36.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.493+0000 7f51b3fff700 1 --2- 172.21.15.22:0/2206655958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51ac0b4d20 0x7f51ac0d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:36.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.493+0000 7f51b3fff700 1 --2- 172.21.15.22:0/2206655958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51ac0b8260 0x7f51ac0cede0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:36.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.493+0000 7f51b3fff700 1 -- 172.21.15.22:0/2206655958 >> 172.21.15.22:0/2206655958 conn(0x7f51ac0722b0 msgr2=0x7f51ac0cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:36.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.493+0000 7f51b3fff700 1 -- 172.21.15.22:0/2206655958 shutdown_connections 2023-07-11T00:31:36.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.493+0000 7f51b3fff700 1 -- 172.21.15.22:0/2206655958 wait complete. 2023-07-11T00:31:36.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.494+0000 7f51b3fff700 1 Processor -- start 2023-07-11T00:31:36.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.495+0000 7f51b3fff700 1 -- start start 2023-07-11T00:31:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b3fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51ac0b8260 0x7f51ac156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b3fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51ac0d25c0 0x7f51ac0ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b3fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51ac15a280 0x7f51ac0cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b3fff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac0ccc20 con 0x7f51ac0d25c0 2023-07-11T00:31:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b3fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac1e79c0 con 0x7f51ac0b8260 2023-07-11T00:31:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b3fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac1e7c60 con 0x7f51ac15a280 2023-07-11T00:31:36.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b159a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51ac0d25c0 0x7f51ac0ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:36.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b159a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51ac0d25c0 0x7f51ac0ca6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55802/0 (socket says 172.21.15.22:55802) 2023-07-11T00:31:36.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b159a700 1 -- 172.21.15.22:0/3831325315 learned_addr learned my addr 172.21.15.22:0/3831325315 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:36.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b1d9b700 1 --2- 172.21.15.22:0/3831325315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51ac0b8260 0x7f51ac156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:36.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b259c700 1 --2- 172.21.15.22:0/3831325315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51ac15a280 0x7f51ac0cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:36.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b159a700 1 -- 172.21.15.22:0/3831325315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51ac15a280 msgr2=0x7f51ac0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:36.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b159a700 1 --2- 172.21.15.22:0/3831325315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51ac15a280 0x7f51ac0cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:36.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b159a700 1 -- 172.21.15.22:0/3831325315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51ac0b8260 msgr2=0x7f51ac156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:36.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b159a700 1 --2- 172.21.15.22:0/3831325315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51ac0b8260 0x7f51ac156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:36.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b159a700 1 -- 172.21.15.22:0/3831325315 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a80094a0 con 0x7f51ac0d25c0 2023-07-11T00:31:36.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b259c700 1 --2- 172.21.15.22:0/3831325315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51ac15a280 0x7f51ac0cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:36.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.496+0000 7f51b1d9b700 1 --2- 172.21.15.22:0/3831325315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51ac0b8260 0x7f51ac156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:36.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.497+0000 7f51b159a700 1 --2- 172.21.15.22:0/3831325315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51ac0d25c0 0x7f51ac0ca6f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f519c00c520 tx=0x7f519c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:36.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.497+0000 7f51a27fc700 1 -- 172.21.15.22:0/3831325315 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c005d70 con 0x7f51ac0d25c0 2023-07-11T00:31:36.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.497+0000 7f51a27fc700 1 -- 172.21.15.22:0/3831325315 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c0070d0 con 0x7f51ac0d25c0 2023-07-11T00:31:36.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.497+0000 7f51a27fc700 1 -- 172.21.15.22:0/3831325315 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c007440 con 0x7f51ac0d25c0 2023-07-11T00:31:36.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.497+0000 7f51b3fff700 1 -- 172.21.15.22:0/3831325315 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ac1e7f40 con 0x7f51ac0d25c0 2023-07-11T00:31:36.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.497+0000 7f51b3fff700 1 -- 172.21.15.22:0/3831325315 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac0c9450 con 0x7f51ac0d25c0 2023-07-11T00:31:36.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.498+0000 7f51b3fff700 1 -- 172.21.15.22:0/3831325315 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ac1e8460 con 0x7f51ac0d25c0 2023-07-11T00:31:36.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.499+0000 7f51a27fc700 1 -- 172.21.15.22:0/3831325315 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f519c0075a0 con 0x7f51ac0d25c0 2023-07-11T00:31:36.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.500+0000 7f51a27fc700 1 --2- 172.21.15.22:0/3831325315 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f519006ace0 0x7f519006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:36.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.500+0000 7f51a27fc700 1 -- 172.21.15.22:0/3831325315 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f519c088c10 con 0x7f51ac0d25c0 2023-07-11T00:31:36.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.501+0000 7f51b1d9b700 1 --2- 172.21.15.22:0/3831325315 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f519006ace0 0x7f519006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:36.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.502+0000 7f51b1d9b700 1 --2- 172.21.15.22:0/3831325315 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f519006ace0 0x7f519006d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f51a8000c00 tx=0x7f51a8008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:36.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.505+0000 7f51a27fc700 1 -- 172.21.15.22:0/3831325315 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f51ac1e8460 con 0x7f51ac0d25c0 2023-07-11T00:31:36.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:36.755+0000 7f51b3fff700 1 -- 172.21.15.22:0/3831325315 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f51ac1e8460 con 0x7f51ac0d25c0 2023-07-11T00:31:37.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.269+0000 7f51a27fc700 1 -- 172.21.15.22:0/3831325315 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f51ac1e8460 con 0x7f51ac0d25c0 2023-07-11T00:31:37.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.271+0000 7f51b3fff700 1 -- 172.21.15.22:0/3831325315 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f519006ace0 msgr2=0x7f519006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:37.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.271+0000 7f51b3fff700 1 --2- 172.21.15.22:0/3831325315 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f519006ace0 0x7f519006d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f51a8000c00 tx=0x7f51a8008030 comp rx=0 tx=0).stop 2023-07-11T00:31:37.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.271+0000 7f51b3fff700 1 -- 172.21.15.22:0/3831325315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51ac0d25c0 msgr2=0x7f51ac0ca6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.271+0000 7f51b3fff700 1 --2- 172.21.15.22:0/3831325315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51ac0d25c0 0x7f51ac0ca6f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f519c00c520 tx=0x7f519c00c830 comp rx=0 tx=0).stop 2023-07-11T00:31:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.271+0000 7f51b3fff700 1 -- 172.21.15.22:0/3831325315 shutdown_connections 2023-07-11T00:31:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.271+0000 7f51b3fff700 1 --2- 172.21.15.22:0/3831325315 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f519006ace0 0x7f519006d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.272+0000 7f51b3fff700 1 --2- 172.21.15.22:0/3831325315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51ac15a280 0x7f51ac0cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.272+0000 7f51b3fff700 1 --2- 172.21.15.22:0/3831325315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51ac0b8260 0x7f51ac156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.272+0000 7f51b3fff700 1 --2- 172.21.15.22:0/3831325315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51ac0d25c0 0x7f51ac0ca6f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.272+0000 7f51b3fff700 1 -- 172.21.15.22:0/3831325315 >> 172.21.15.22:0/3831325315 conn(0x7f51ac0b4d20 msgr2=0x7f51ac0b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.272+0000 7f51b3fff700 1 -- 172.21.15.22:0/3831325315 shutdown_connections 2023-07-11T00:31:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.272+0000 7f51b3fff700 1 -- 172.21.15.22:0/3831325315 wait complete. 2023-07-11T00:31:37.295 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-11T00:31:37.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.502+0000 7f32381ff700 1 Processor -- start 2023-07-11T00:31:37.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.502+0000 7f32381ff700 1 -- start start 2023-07-11T00:31:37.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.503+0000 7f32381ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32300b82c0 0x7f3230160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:37.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.503+0000 7f32381ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f32300cf4d0 0x7f32300cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:37.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.503+0000 7f32381ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3230160db0 con 0x7f32300b1f00 2023-07-11T00:31:37.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.503+0000 7f32381ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32300b8690 con 0x7f32300cf4d0 2023-07-11T00:31:37.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.503+0000 7f32381ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32300cfe90 con 0x7f32300b82c0 2023-07-11T00:31:37.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.503+0000 7f323679c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f32300cf4d0 0x7f32300cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:37.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.503+0000 7f323579a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f32300b1f00 0x7f32300ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55466/0 (socket says 172.21.15.22:55466) 2023-07-11T00:31:37.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.503+0000 7f323579a700 1 -- 172.21.15.22:0/3963660036 learned_addr learned my addr 172.21.15.22:0/3963660036 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:37.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.504+0000 7f3235f9b700 1 --2- 172.21.15.22:0/3963660036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32300b82c0 0x7f3230160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:37.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.504+0000 7f323679c700 1 -- 172.21.15.22:0/3963660036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32300b82c0 msgr2=0x7f3230160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:37.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.504+0000 7f323679c700 1 --2- 172.21.15.22:0/3963660036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32300b82c0 0x7f3230160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:37.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.504+0000 7f323679c700 1 -- 172.21.15.22:0/3963660036 >> v1:172.21.15.22:6789/0 conn(0x7f32300b1f00 legacy=0x7f32300ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:37.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.504+0000 7f323679c700 1 -- 172.21.15.22:0/3963660036 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323015fe20 con 0x7f32300cf4d0 2023-07-11T00:31:37.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.504+0000 7f3234f99700 1 -- 172.21.15.22:0/3963660036 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830693577 0 0) 0x7f3220001110 con 0x7f32300b1f00 2023-07-11T00:31:37.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.504+0000 7f323679c700 1 --2- 172.21.15.22:0/3963660036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32300cf4d0 0x7f32300cf950 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3228009d90 tx=0x7f322800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda0e7a8a711418e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:37.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.504+0000 7f3234f99700 1 -- 172.21.15.22:0/3963660036 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322800e070 con 0x7f32300cf4d0 2023-07-11T00:31:37.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.504+0000 7f3234f99700 1 -- 172.21.15.22:0/3963660036 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322800bbd0 con 0x7f32300cf4d0 2023-07-11T00:31:37.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.504+0000 7f3234f99700 1 -- 172.21.15.22:0/3963660036 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228012430 con 0x7f32300cf4d0 2023-07-11T00:31:37.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.505+0000 7f32381ff700 1 -- 172.21.15.22:0/3963660036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32300cf4d0 msgr2=0x7f32300cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:37.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.505+0000 7f32381ff700 1 --2- 172.21.15.22:0/3963660036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32300cf4d0 0x7f32300cf950 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3228009d90 tx=0x7f322800b330 comp rx=0 tx=0).stop 2023-07-11T00:31:37.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.505+0000 7f32381ff700 1 -- 172.21.15.22:0/3963660036 shutdown_connections 2023-07-11T00:31:37.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.505+0000 7f32381ff700 1 --2- 172.21.15.22:0/3963660036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32300cf4d0 0x7f32300cf950 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:37.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.505+0000 7f32381ff700 1 --2- 172.21.15.22:0/3963660036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32300b82c0 0x7f3230160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:37.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.505+0000 7f32381ff700 1 -- 172.21.15.22:0/3963660036 >> 172.21.15.22:0/3963660036 conn(0x7f3230071660 msgr2=0x7f3230071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:37.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.505+0000 7f32381ff700 1 -- 172.21.15.22:0/3963660036 shutdown_connections 2023-07-11T00:31:37.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.505+0000 7f32381ff700 1 -- 172.21.15.22:0/3963660036 wait complete. 2023-07-11T00:31:37.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.507+0000 7f32381ff700 1 Processor -- start 2023-07-11T00:31:37.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.507+0000 7f32381ff700 1 -- start start 2023-07-11T00:31:37.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.508+0000 7f32381ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32300b1f00 0x7f32300c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:37.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.508+0000 7f32381ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32300b82c0 0x7f323015ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:37.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.508+0000 7f32381ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32300cf4d0 0x7f323015cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:37.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.508+0000 7f32381ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3230149000 con 0x7f32300b82c0 2023-07-11T00:31:37.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.508+0000 7f32381ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32301492e0 con 0x7f32300b1f00 2023-07-11T00:31:37.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.508+0000 7f32381ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32301495c0 con 0x7f32300cf4d0 2023-07-11T00:31:37.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.508+0000 7f323579a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32300b82c0 0x7f323015ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:37.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.508+0000 7f323579a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32300b82c0 0x7f323015ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55826/0 (socket says 172.21.15.22:55826) 2023-07-11T00:31:37.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.508+0000 7f323579a700 1 -- 172.21.15.22:0/3350717856 learned_addr learned my addr 172.21.15.22:0/3350717856 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:37.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.508+0000 7f3235f9b700 1 --2- 172.21.15.22:0/3350717856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32300b1f00 0x7f32300c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:37.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.508+0000 7f323679c700 1 --2- 172.21.15.22:0/3350717856 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32300cf4d0 0x7f323015cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:37.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.509+0000 7f323579a700 1 -- 172.21.15.22:0/3350717856 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32300cf4d0 msgr2=0x7f323015cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:37.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.509+0000 7f323579a700 1 --2- 172.21.15.22:0/3350717856 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32300cf4d0 0x7f323015cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:37.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.509+0000 7f323579a700 1 -- 172.21.15.22:0/3350717856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32300b1f00 msgr2=0x7f32300c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:37.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.509+0000 7f323579a700 1 --2- 172.21.15.22:0/3350717856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32300b1f00 0x7f32300c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:37.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.509+0000 7f323579a700 1 -- 172.21.15.22:0/3350717856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3228009a70 con 0x7f32300b82c0 2023-07-11T00:31:37.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.509+0000 7f323579a700 1 --2- 172.21.15.22:0/3350717856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32300b82c0 0x7f323015ca60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f322000c550 tx=0x7f322000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:37.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.509+0000 7f32267fc700 1 -- 172.21.15.22:0/3350717856 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220004c80 con 0x7f32300b82c0 2023-07-11T00:31:37.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.509+0000 7f32267fc700 1 -- 172.21.15.22:0/3350717856 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3220004e00 con 0x7f32300b82c0 2023-07-11T00:31:37.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.509+0000 7f32267fc700 1 -- 172.21.15.22:0/3350717856 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220007310 con 0x7f32300b82c0 2023-07-11T00:31:37.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.509+0000 7f32381ff700 1 -- 172.21.15.22:0/3350717856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32301498a0 con 0x7f32300b82c0 2023-07-11T00:31:37.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.509+0000 7f32381ff700 1 -- 172.21.15.22:0/3350717856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3230148d50 con 0x7f32300b82c0 2023-07-11T00:31:37.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.510+0000 7f32381ff700 1 -- 172.21.15.22:0/3350717856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3230074180 con 0x7f32300b82c0 2023-07-11T00:31:37.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.511+0000 7f32267fc700 1 -- 172.21.15.22:0/3350717856 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3220007470 con 0x7f32300b82c0 2023-07-11T00:31:37.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.513+0000 7f32267fc700 1 --2- 172.21.15.22:0/3350717856 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f321406ace0 0x7f321406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:37.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.513+0000 7f32267fc700 1 -- 172.21.15.22:0/3350717856 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f3220089390 con 0x7f32300b82c0 2023-07-11T00:31:37.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.513+0000 7f3235f9b700 1 --2- 172.21.15.22:0/3350717856 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f321406ace0 0x7f321406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:37.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.514+0000 7f3235f9b700 1 --2- 172.21.15.22:0/3350717856 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f321406ace0 0x7f321406d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f322c00b9b0 tx=0x7f322c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:37.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.517+0000 7f32267fc700 1 -- 172.21.15.22:0/3350717856 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f32200540b0 con 0x7f32300b82c0 2023-07-11T00:31:37.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:37.727+0000 7f32381ff700 1 -- 172.21.15.22:0/3350717856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3230160db0 con 0x7f32300b82c0 2023-07-11T00:31:38.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.272+0000 7f32267fc700 1 -- 172.21.15.22:0/3350717856 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3230160db0 con 0x7f32300b82c0 2023-07-11T00:31:38.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.276+0000 7f32381ff700 1 -- 172.21.15.22:0/3350717856 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f321406ace0 msgr2=0x7f321406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:38.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.276+0000 7f32381ff700 1 --2- 172.21.15.22:0/3350717856 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f321406ace0 0x7f321406d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f322c00b9b0 tx=0x7f322c008040 comp rx=0 tx=0).stop 2023-07-11T00:31:38.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.276+0000 7f32381ff700 1 -- 172.21.15.22:0/3350717856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32300b82c0 msgr2=0x7f323015ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:38.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.276+0000 7f32381ff700 1 --2- 172.21.15.22:0/3350717856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32300b82c0 0x7f323015ca60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f322000c550 tx=0x7f322000c910 comp rx=0 tx=0).stop 2023-07-11T00:31:38.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.276+0000 7f32381ff700 1 -- 172.21.15.22:0/3350717856 shutdown_connections 2023-07-11T00:31:38.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.276+0000 7f32381ff700 1 --2- 172.21.15.22:0/3350717856 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f321406ace0 0x7f321406d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:38.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.276+0000 7f32381ff700 1 --2- 172.21.15.22:0/3350717856 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32300cf4d0 0x7f323015cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:38.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.276+0000 7f32381ff700 1 --2- 172.21.15.22:0/3350717856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32300b1f00 0x7f32300c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:38.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.276+0000 7f32381ff700 1 --2- 172.21.15.22:0/3350717856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32300b82c0 0x7f323015ca60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:38.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.276+0000 7f32381ff700 1 -- 172.21.15.22:0/3350717856 >> 172.21.15.22:0/3350717856 conn(0x7f3230071660 msgr2=0x7f32300b7930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:38.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.276+0000 7f32381ff700 1 -- 172.21.15.22:0/3350717856 shutdown_connections 2023-07-11T00:31:38.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.277+0000 7f32381ff700 1 -- 172.21.15.22:0/3350717856 wait complete. 2023-07-11T00:31:38.284 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2023-07-11T00:31:38.304 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-11T00:31:38.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.510+0000 7f0605fff700 1 Processor -- start 2023-07-11T00:31:38.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.510+0000 7f0605fff700 1 -- start start 2023-07-11T00:31:38.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.511+0000 7f0605fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f060015a0c0 0x7f06000b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:38.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.511+0000 7f0605fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f06000cbb10 0x7f060006d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:38.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.511+0000 7f0605fff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06000c8e10 con 0x7f0600071030 2023-07-11T00:31:38.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.511+0000 7f0605fff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0600070750 con 0x7f06000cbb10 2023-07-11T00:31:38.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.511+0000 7f0605fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0600070a30 con 0x7f060015a0c0 2023-07-11T00:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.512+0000 7f05feffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f06000cbb10 0x7f060006d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.512+0000 7f05fffff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0600071030 0x7f0600069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55482/0 (socket says 172.21.15.22:55482) 2023-07-11T00:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.512+0000 7f05fffff700 1 -- 172.21.15.22:0/3196409548 learned_addr learned my addr 172.21.15.22:0/3196409548 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.512+0000 7f05ff7fe700 1 --2- 172.21.15.22:0/3196409548 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f060015a0c0 0x7f06000b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:38.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.512+0000 7f05fe7fc700 1 -- 172.21.15.22:0/3196409548 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745202259 0 0) 0x7f06000c8e10 con 0x7f0600071030 2023-07-11T00:31:38.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.512+0000 7f05fe7fc700 1 -- 172.21.15.22:0/3196409548 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05e80035b0 con 0x7f0600071030 2023-07-11T00:31:38.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.512+0000 7f05ff7fe700 1 -- 172.21.15.22:0/3196409548 >> v2:172.21.15.22:3300/0 conn(0x7f06000cbb10 msgr2=0x7f060006d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:38.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.512+0000 7f05ff7fe700 1 --2- 172.21.15.22:0/3196409548 >> v2:172.21.15.22:3300/0 conn(0x7f06000cbb10 0x7f060006d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:38.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.512+0000 7f05ff7fe700 1 -- 172.21.15.22:0/3196409548 >> v1:172.21.15.22:6789/0 conn(0x7f0600071030 legacy=0x7f0600069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:38.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.512+0000 7f05ff7fe700 1 -- 172.21.15.22:0/3196409548 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06000c9060 con 0x7f060015a0c0 2023-07-11T00:31:38.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.513+0000 7f05ff7fe700 1 --2- 172.21.15.22:0/3196409548 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f060015a0c0 0x7f06000b1690 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009840 tx=0x7f05f0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23c0b832f3f7ffb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:38.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.513+0000 7f05fe7fc700 1 -- 172.21.15.22:0/3196409548 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0011830 con 0x7f060015a0c0 2023-07-11T00:31:38.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.513+0000 7f05fe7fc700 1 -- 172.21.15.22:0/3196409548 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f0011990 con 0x7f060015a0c0 2023-07-11T00:31:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.513+0000 7f05fe7fc700 1 -- 172.21.15.22:0/3196409548 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0011d20 con 0x7f060015a0c0 2023-07-11T00:31:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.513+0000 7f0605fff700 1 -- 172.21.15.22:0/3196409548 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f060015a0c0 msgr2=0x7f06000b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.514+0000 7f0605fff700 1 --2- 172.21.15.22:0/3196409548 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f060015a0c0 0x7f06000b1690 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009840 tx=0x7f05f0009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.514+0000 7f0605fff700 1 -- 172.21.15.22:0/3196409548 shutdown_connections 2023-07-11T00:31:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.514+0000 7f0605fff700 1 --2- 172.21.15.22:0/3196409548 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f060015a0c0 0x7f06000b1690 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.514+0000 7f0605fff700 1 --2- 172.21.15.22:0/3196409548 >> v2:172.21.15.22:3300/0 conn(0x7f06000cbb10 0x7f060006d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:38.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.514+0000 7f0605fff700 1 -- 172.21.15.22:0/3196409548 >> 172.21.15.22:0/3196409548 conn(0x7f06000b0390 msgr2=0x7f06000b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.514+0000 7f0605fff700 1 -- 172.21.15.22:0/3196409548 shutdown_connections 2023-07-11T00:31:38.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.514+0000 7f0605fff700 1 -- 172.21.15.22:0/3196409548 wait complete. 2023-07-11T00:31:38.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.515+0000 7f0605fff700 1 Processor -- start 2023-07-11T00:31:38.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.516+0000 7f0605fff700 1 -- start start 2023-07-11T00:31:38.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.516+0000 7f0605fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0600071030 0x7f0600158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:38.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.516+0000 7f0605fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06000cbb10 0x7f06000aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:38.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.517+0000 7f0605fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060015a0c0 0x7f06000af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:38.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.517+0000 7f0605fff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06001f5ef0 con 0x7f060015a0c0 2023-07-11T00:31:38.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.517+0000 7f0605fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0600156670 con 0x7f06000cbb10 2023-07-11T00:31:38.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.517+0000 7f0605fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0600158e60 con 0x7f0600071030 2023-07-11T00:31:38.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.517+0000 7f05fffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060015a0c0 0x7f06000af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.517+0000 7f05fffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060015a0c0 0x7f06000af430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55844/0 (socket says 172.21.15.22:55844) 2023-07-11T00:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.517+0000 7f05fffff700 1 -- 172.21.15.22:0/2150843845 learned_addr learned my addr 172.21.15.22:0/2150843845 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.517+0000 7f05ff7fe700 1 --2- 172.21.15.22:0/2150843845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0600071030 0x7f0600158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.517+0000 7f05feffd700 1 --2- 172.21.15.22:0/2150843845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06000cbb10 0x7f06000aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.517+0000 7f05fffff700 1 -- 172.21.15.22:0/2150843845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0600071030 msgr2=0x7f0600158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.517+0000 7f05fffff700 1 --2- 172.21.15.22:0/2150843845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0600071030 0x7f0600158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.517+0000 7f05fffff700 1 -- 172.21.15.22:0/2150843845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06000cbb10 msgr2=0x7f06000aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:38.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.517+0000 7f05fffff700 1 --2- 172.21.15.22:0/2150843845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06000cbb10 0x7f06000aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:38.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.517+0000 7f05fffff700 1 -- 172.21.15.22:0/2150843845 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f00094a0 con 0x7f060015a0c0 2023-07-11T00:31:38.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.518+0000 7f05fffff700 1 --2- 172.21.15.22:0/2150843845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060015a0c0 0x7f06000af430 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f05f800cbb0 tx=0x7f05f800cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:38.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.518+0000 7f05e7fff700 1 -- 172.21.15.22:0/2150843845 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f800a9e0 con 0x7f060015a0c0 2023-07-11T00:31:38.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.518+0000 7f05e7fff700 1 -- 172.21.15.22:0/2150843845 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f800ab40 con 0x7f060015a0c0 2023-07-11T00:31:38.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.518+0000 7f05e7fff700 1 -- 172.21.15.22:0/2150843845 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8012400 con 0x7f060015a0c0 2023-07-11T00:31:38.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.518+0000 7f0605fff700 1 -- 172.21.15.22:0/2150843845 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06001f5130 con 0x7f060015a0c0 2023-07-11T00:31:38.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.518+0000 7f0605fff700 1 -- 172.21.15.22:0/2150843845 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06001f56f0 con 0x7f060015a0c0 2023-07-11T00:31:38.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.519+0000 7f0605fff700 1 -- 172.21.15.22:0/2150843845 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0600074180 con 0x7f060015a0c0 2023-07-11T00:31:38.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.520+0000 7f05e7fff700 1 -- 172.21.15.22:0/2150843845 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f05f801b3b0 con 0x7f060015a0c0 2023-07-11T00:31:38.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.521+0000 7f05e7fff700 1 --2- 172.21.15.22:0/2150843845 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f05ec06ace0 0x7f05ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:38.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.521+0000 7f05e7fff700 1 -- 172.21.15.22:0/2150843845 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f05f8089380 con 0x7f060015a0c0 2023-07-11T00:31:38.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.521+0000 7f05ff7fe700 1 --2- 172.21.15.22:0/2150843845 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f05ec06ace0 0x7f05ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:38.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.522+0000 7f05ff7fe700 1 --2- 172.21.15.22:0/2150843845 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f05ec06ace0 0x7f05ec06d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05f0000c00 tx=0x7f05f001c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:38.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.525+0000 7f05e7fff700 1 -- 172.21.15.22:0/2150843845 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f05f8054270 con 0x7f060015a0c0 2023-07-11T00:31:38.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:38.729+0000 7f0605fff700 1 -- 172.21.15.22:0/2150843845 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0600159090 con 0x7f060015a0c0 2023-07-11T00:31:39.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.278+0000 7f05e7fff700 1 -- 172.21.15.22:0/2150843845 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f05f8057890 con 0x7f060015a0c0 2023-07-11T00:31:39.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.282+0000 7f0605fff700 1 -- 172.21.15.22:0/2150843845 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f05ec06ace0 msgr2=0x7f05ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:39.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.282+0000 7f0605fff700 1 --2- 172.21.15.22:0/2150843845 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f05ec06ace0 0x7f05ec06d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05f0000c00 tx=0x7f05f001c040 comp rx=0 tx=0).stop 2023-07-11T00:31:39.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.282+0000 7f0605fff700 1 -- 172.21.15.22:0/2150843845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060015a0c0 msgr2=0x7f06000af430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:39.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.282+0000 7f0605fff700 1 --2- 172.21.15.22:0/2150843845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060015a0c0 0x7f06000af430 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f05f800cbb0 tx=0x7f05f800cec0 comp rx=0 tx=0).stop 2023-07-11T00:31:39.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.282+0000 7f0605fff700 1 -- 172.21.15.22:0/2150843845 shutdown_connections 2023-07-11T00:31:39.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.282+0000 7f0605fff700 1 --2- 172.21.15.22:0/2150843845 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f05ec06ace0 0x7f05ec06d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:39.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.282+0000 7f0605fff700 1 --2- 172.21.15.22:0/2150843845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0600071030 0x7f0600158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:39.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.282+0000 7f0605fff700 1 --2- 172.21.15.22:0/2150843845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060015a0c0 0x7f06000af430 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:39.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.282+0000 7f0605fff700 1 --2- 172.21.15.22:0/2150843845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06000cbb10 0x7f06000aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:39.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.282+0000 7f0605fff700 1 -- 172.21.15.22:0/2150843845 >> 172.21.15.22:0/2150843845 conn(0x7f06000b0390 msgr2=0x7f06000cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:39.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.283+0000 7f0605fff700 1 -- 172.21.15.22:0/2150843845 shutdown_connections 2023-07-11T00:31:39.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.284+0000 7f0605fff700 1 -- 172.21.15.22:0/2150843845 wait complete. 2023-07-11T00:31:39.289 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2023-07-11T00:31:39.310 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-07-11T00:31:39.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.521+0000 7efc2f5ff700 1 Processor -- start 2023-07-11T00:31:39.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.521+0000 7efc2f5ff700 1 -- start start 2023-07-11T00:31:39.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.523+0000 7efc2f5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc280b82c0 0x7efc28160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:39.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.523+0000 7efc2f5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efc280b1f00 0x7efc280ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:39.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.523+0000 7efc2f5ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc28160db0 con 0x7efc280cf4d0 2023-07-11T00:31:39.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.523+0000 7efc2f5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc280b8690 con 0x7efc280b1f00 2023-07-11T00:31:39.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.523+0000 7efc2f5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2815fe20 con 0x7efc280b82c0 2023-07-11T00:31:39.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.523+0000 7efc2db9c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efc280cf4d0 0x7efc280d06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55484/0 (socket says 172.21.15.22:55484) 2023-07-11T00:31:39.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.523+0000 7efc2db9c700 1 -- 172.21.15.22:0/1499127213 learned_addr learned my addr 172.21.15.22:0/1499127213 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:39.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.523+0000 7efc2d39b700 1 --2- 172.21.15.22:0/1499127213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc280b82c0 0x7efc28160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:39.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.523+0000 7efc2cb9a700 1 --2- 172.21.15.22:0/1499127213 >> v2:172.21.15.184:3300/0 conn(0x7efc280b1f00 0x7efc280ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:39.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.523+0000 7efc1ffff700 1 -- 172.21.15.22:0/1499127213 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025872000 0 0) 0x7efc20001490 con 0x7efc280cf4d0 2023-07-11T00:31:39.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.523+0000 7efc1ffff700 1 -- 172.21.15.22:0/1499127213 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc140035b0 con 0x7efc280cf4d0 2023-07-11T00:31:39.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.524+0000 7efc1ffff700 1 -- 172.21.15.22:0/1499127213 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1284572294 0 0) 0x7efc140035b0 con 0x7efc280cf4d0 2023-07-11T00:31:39.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.524+0000 7efc1ffff700 1 -- 172.21.15.22:0/1499127213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc280b82c0 msgr2=0x7efc28160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:39.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.524+0000 7efc1ffff700 1 --2- 172.21.15.22:0/1499127213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc280b82c0 0x7efc28160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:39.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.524+0000 7efc1ffff700 1 -- 172.21.15.22:0/1499127213 >> v2:172.21.15.184:3300/0 conn(0x7efc280b1f00 msgr2=0x7efc280ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:39.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.524+0000 7efc1ffff700 1 --2- 172.21.15.22:0/1499127213 >> v2:172.21.15.184:3300/0 conn(0x7efc280b1f00 0x7efc280ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:39.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.524+0000 7efc1ffff700 1 -- 172.21.15.22:0/1499127213 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc281603e0 con 0x7efc280cf4d0 2023-07-11T00:31:39.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.524+0000 7efc1ffff700 1 -- 172.21.15.22:0/1499127213 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7efc20001b80 con 0x7efc280cf4d0 2023-07-11T00:31:39.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.524+0000 7efc1ffff700 1 -- 172.21.15.22:0/1499127213 >> v1:172.21.15.22:6789/0 conn(0x7efc280cf4d0 legacy=0x7efc280d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.524+0000 7efc1ffff700 1 --2- 172.21.15.22:0/1499127213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc14003a00 0x7efc14003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.524+0000 7efc1ffff700 1 --2- 172.21.15.22:0/1499127213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc14004430 0x7efc140048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.524+0000 7efc1ffff700 1 --2- 172.21.15.22:0/1499127213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc280b82c0 0x7efc14005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.524+0000 7efc1ffff700 1 -- 172.21.15.22:0/1499127213 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc280b8690 con 0x7efc14004430 2023-07-11T00:31:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.524+0000 7efc1ffff700 1 -- 172.21.15.22:0/1499127213 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2815fe20 con 0x7efc14003a00 2023-07-11T00:31:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.524+0000 7efc1ffff700 1 -- 172.21.15.22:0/1499127213 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1400ba10 con 0x7efc280b82c0 2023-07-11T00:31:39.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.524+0000 7efc2cb9a700 1 --2- 172.21.15.22:0/1499127213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc14004430 0x7efc140048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.524+0000 7efc2d39b700 1 --2- 172.21.15.22:0/1499127213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc14003a00 0x7efc14003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.524+0000 7efc2db9c700 1 --2- 172.21.15.22:0/1499127213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc280b82c0 0x7efc14005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.525+0000 7efc2d39b700 1 -- 172.21.15.22:0/1499127213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc280b82c0 msgr2=0x7efc14005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.525+0000 7efc2d39b700 1 --2- 172.21.15.22:0/1499127213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc280b82c0 0x7efc14005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:39.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.525+0000 7efc2d39b700 1 -- 172.21.15.22:0/1499127213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc14004430 msgr2=0x7efc140048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:39.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.525+0000 7efc2d39b700 1 --2- 172.21.15.22:0/1499127213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc14004430 0x7efc140048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:39.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.525+0000 7efc2d39b700 1 -- 172.21.15.22:0/1499127213 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc140035b0 con 0x7efc14003a00 2023-07-11T00:31:39.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.525+0000 7efc2db9c700 1 --2- 172.21.15.22:0/1499127213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc280b82c0 0x7efc14005060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:39.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.525+0000 7efc2d39b700 1 --2- 172.21.15.22:0/1499127213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc14003a00 0x7efc14003e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efc24009b90 tx=0x7efc14005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0c082d07a98f234 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:39.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.525+0000 7efc1ffff700 1 -- 172.21.15.22:0/1499127213 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400e6c0 con 0x7efc14003a00 2023-07-11T00:31:39.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.525+0000 7efc1ffff700 1 -- 172.21.15.22:0/1499127213 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2400e820 con 0x7efc14003a00 2023-07-11T00:31:39.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.525+0000 7efc1ffff700 1 -- 172.21.15.22:0/1499127213 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400eb90 con 0x7efc14003a00 2023-07-11T00:31:39.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.526+0000 7efc2f5ff700 1 -- 172.21.15.22:0/1499127213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc14003a00 msgr2=0x7efc14003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:39.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.526+0000 7efc2f5ff700 1 --2- 172.21.15.22:0/1499127213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc14003a00 0x7efc14003e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efc24009b90 tx=0x7efc14005880 comp rx=0 tx=0).stop 2023-07-11T00:31:39.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.526+0000 7efc2db9c700 1 -- 172.21.15.22:0/1499127213 reap_dead start 2023-07-11T00:31:39.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.526+0000 7efc2f5ff700 1 -- 172.21.15.22:0/1499127213 shutdown_connections 2023-07-11T00:31:39.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.526+0000 7efc2f5ff700 1 -- 172.21.15.22:0/1499127213 >> 172.21.15.22:0/1499127213 conn(0x7efc28071660 msgr2=0x7efc28071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:39.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.526+0000 7efc2f5ff700 1 -- 172.21.15.22:0/1499127213 shutdown_connections 2023-07-11T00:31:39.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.526+0000 7efc2f5ff700 1 -- 172.21.15.22:0/1499127213 wait complete. 2023-07-11T00:31:39.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.528+0000 7efc2f5ff700 1 Processor -- start 2023-07-11T00:31:39.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.528+0000 7efc2f5ff700 1 -- start start 2023-07-11T00:31:39.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.529+0000 7efc2f5ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc14003a00 0x7efc281e76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:39.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.529+0000 7efc2f5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc281490f0 0x7efc28159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:39.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.529+0000 7efc2f5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc28155fd0 0x7efc2815a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:39.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.529+0000 7efc2f5ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc280ca8c0 con 0x7efc14003a00 2023-07-11T00:31:39.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.529+0000 7efc2f5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc280c93f0 con 0x7efc281490f0 2023-07-11T00:31:39.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.529+0000 7efc2f5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc280ca590 con 0x7efc28155fd0 2023-07-11T00:31:39.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.529+0000 7efc2d39b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc14003a00 0x7efc281e76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:39.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.529+0000 7efc2d39b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc14003a00 0x7efc281e76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55868/0 (socket says 172.21.15.22:55868) 2023-07-11T00:31:39.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.529+0000 7efc2d39b700 1 -- 172.21.15.22:0/4272975579 learned_addr learned my addr 172.21.15.22:0/4272975579 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:39.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.529+0000 7efc2cb9a700 1 --2- 172.21.15.22:0/4272975579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc281490f0 0x7efc28159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:39.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.529+0000 7efc2db9c700 1 --2- 172.21.15.22:0/4272975579 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc28155fd0 0x7efc2815a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:39.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.529+0000 7efc2d39b700 1 -- 172.21.15.22:0/4272975579 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc28155fd0 msgr2=0x7efc2815a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:39.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.529+0000 7efc2d39b700 1 --2- 172.21.15.22:0/4272975579 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc28155fd0 0x7efc2815a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:39.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.529+0000 7efc2d39b700 1 -- 172.21.15.22:0/4272975579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc281490f0 msgr2=0x7efc28159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:39.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.529+0000 7efc2d39b700 1 --2- 172.21.15.22:0/4272975579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc281490f0 0x7efc28159f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:39.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.529+0000 7efc2d39b700 1 -- 172.21.15.22:0/4272975579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc281e7f10 con 0x7efc14003a00 2023-07-11T00:31:39.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.530+0000 7efc2d39b700 1 --2- 172.21.15.22:0/4272975579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc14003a00 0x7efc281e76c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efc140057f0 tx=0x7efc240047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:39.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.530+0000 7efc1dffb700 1 -- 172.21.15.22:0/4272975579 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24021070 con 0x7efc14003a00 2023-07-11T00:31:39.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.530+0000 7efc1dffb700 1 -- 172.21.15.22:0/4272975579 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc24004550 con 0x7efc14003a00 2023-07-11T00:31:39.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.530+0000 7efc1dffb700 1 -- 172.21.15.22:0/4272975579 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400e6c0 con 0x7efc14003a00 2023-07-11T00:31:39.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.530+0000 7efc2f5ff700 1 -- 172.21.15.22:0/4272975579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc280ca8c0 con 0x7efc14003a00 2023-07-11T00:31:39.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.530+0000 7efc2f5ff700 1 -- 172.21.15.22:0/4272975579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc281e84d0 con 0x7efc14003a00 2023-07-11T00:31:39.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.531+0000 7efc2f5ff700 1 -- 172.21.15.22:0/4272975579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc280caba0 con 0x7efc14003a00 2023-07-11T00:31:39.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.532+0000 7efc1dffb700 1 -- 172.21.15.22:0/4272975579 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efc24025070 con 0x7efc14003a00 2023-07-11T00:31:39.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.533+0000 7efc1dffb700 1 --2- 172.21.15.22:0/4272975579 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efc0c06ace0 0x7efc0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:39.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.533+0000 7efc1dffb700 1 -- 172.21.15.22:0/4272975579 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6047+0+0 (secure 0 0 0) 0x7efc2408a770 con 0x7efc14003a00 2023-07-11T00:31:39.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.533+0000 7efc2cb9a700 1 --2- 172.21.15.22:0/4272975579 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efc0c06ace0 0x7efc0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:39.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.534+0000 7efc2cb9a700 1 --2- 172.21.15.22:0/4272975579 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efc0c06ace0 0x7efc0c06d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efc280b7330 tx=0x7efc18008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:39.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.537+0000 7efc1dffb700 1 -- 172.21.15.22:0/4272975579 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7efc240593d0 con 0x7efc14003a00 2023-07-11T00:31:39.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:39.746+0000 7efc2f5ff700 1 -- 172.21.15.22:0/4272975579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efc28074180 con 0x7efc14003a00 2023-07-11T00:31:40.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.279+0000 7efc1dffb700 1 -- 172.21.15.22:0/4272975579 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7efc24058f60 con 0x7efc14003a00 2023-07-11T00:31:40.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.286+0000 7efc2f5ff700 1 -- 172.21.15.22:0/4272975579 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efc0c06ace0 msgr2=0x7efc0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:40.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.286+0000 7efc2f5ff700 1 --2- 172.21.15.22:0/4272975579 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efc0c06ace0 0x7efc0c06d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efc280b7330 tx=0x7efc18008040 comp rx=0 tx=0).stop 2023-07-11T00:31:40.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.286+0000 7efc2f5ff700 1 -- 172.21.15.22:0/4272975579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc14003a00 msgr2=0x7efc281e76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:40.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.286+0000 7efc2f5ff700 1 --2- 172.21.15.22:0/4272975579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc14003a00 0x7efc281e76c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efc140057f0 tx=0x7efc240047c0 comp rx=0 tx=0).stop 2023-07-11T00:31:40.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.286+0000 7efc2f5ff700 1 -- 172.21.15.22:0/4272975579 shutdown_connections 2023-07-11T00:31:40.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.286+0000 7efc2f5ff700 1 --2- 172.21.15.22:0/4272975579 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efc0c06ace0 0x7efc0c06d190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:40.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.286+0000 7efc2f5ff700 1 --2- 172.21.15.22:0/4272975579 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc28155fd0 0x7efc2815a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:40.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.286+0000 7efc2f5ff700 1 --2- 172.21.15.22:0/4272975579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc14003a00 0x7efc281e76c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:40.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.286+0000 7efc2f5ff700 1 --2- 172.21.15.22:0/4272975579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc281490f0 0x7efc28159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:40.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.286+0000 7efc2f5ff700 1 -- 172.21.15.22:0/4272975579 >> 172.21.15.22:0/4272975579 conn(0x7efc28071660 msgr2=0x7efc280b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:40.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.287+0000 7efc2f5ff700 1 -- 172.21.15.22:0/4272975579 shutdown_connections 2023-07-11T00:31:40.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.287+0000 7efc2f5ff700 1 -- 172.21.15.22:0/4272975579 wait complete. 2023-07-11T00:31:40.293 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data_ec' removed 2023-07-11T00:31:40.314 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-11T00:31:40.314 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-11T00:31:40.314 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-11T00:31:40.315 INFO:teuthology.orchestra.run:waiting for 300 2023-07-11T00:31:40.315 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-11T00:31:40.315 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-11T00:31:40.315 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-11T00:31:40.316 INFO:teuthology.orchestra.run:waiting for 300 2023-07-11T00:31:40.316 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-11T00:31:40.316 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-11T00:31:40.316 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-11T00:31:40.317 INFO:teuthology.orchestra.run:waiting for 300 2023-07-11T00:31:40.317 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-11T00:31:40.317 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-11T00:31:40.317 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-11T00:31:40.317 INFO:teuthology.orchestra.run:waiting for 300 2023-07-11T00:31:40.334 INFO:tasks.ceph.mds.a:Stopped 2023-07-11T00:31:40.334 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-11T00:31:40.335 INFO:tasks.ceph.mds.c:Stopped 2023-07-11T00:31:40.336 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-11T00:31:40.338 INFO:tasks.ceph.mds.b:Stopped 2023-07-11T00:31:40.338 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-11T00:31:40.339 INFO:tasks.ceph.mds.d:Stopped 2023-07-11T00:31:40.339 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-11T00:31:40.379 INFO:tasks.ceph.mds.a:Started 2023-07-11T00:31:40.379 DEBUG:teuthology.parallel:result is None 2023-07-11T00:31:40.381 INFO:tasks.ceph.mds.c:Started 2023-07-11T00:31:40.382 DEBUG:teuthology.parallel:result is None 2023-07-11T00:31:40.383 INFO:tasks.ceph.mds.b:Started 2023-07-11T00:31:40.383 DEBUG:teuthology.parallel:result is None 2023-07-11T00:31:40.384 INFO:tasks.ceph.mds.d:Started 2023-07-11T00:31:40.385 DEBUG:teuthology.parallel:result is None 2023-07-11T00:31:40.385 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-11T00:31:40.535 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-07-11T00:31:40.536 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-07-11T00:31:40.536 INFO:tasks.ceph.mds.c.smithi022.stderr:2023-07-11T00:31:40.534+0000 7fdb823fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-07-11T00:31:40.537 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-07-11T00:31:40.538 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-07-11T00:31:40.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.599+0000 7fd7df9ff700 1 Processor -- start 2023-07-11T00:31:40.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.599+0000 7fd7df9ff700 1 -- start start 2023-07-11T00:31:40.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.600+0000 7fd7df9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7d80b8320 0x7fd7d80cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:40.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.600+0000 7fd7df9ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd7d80d1cd0 0x7fd7d81608e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:40.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.600+0000 7fd7df9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d80cf3b0 con 0x7fd7d80b45b0 2023-07-11T00:31:40.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.600+0000 7fd7df9ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d8160e20 con 0x7fd7d80d1cd0 2023-07-11T00:31:40.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.600+0000 7fd7df9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80b86f0 con 0x7fd7d80b8320 2023-07-11T00:31:40.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.601+0000 7fd7dd79b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7d80b8320 0x7fd7d80cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:40.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.601+0000 7fd7ddf9c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fd7d80b45b0 0x7fd7d80d0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:46222/0 (socket says 172.21.15.22:46222) 2023-07-11T00:31:40.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.601+0000 7fd7dd79b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7d80b8320 0x7fd7d80cd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:36200/0 (socket says 172.21.15.22:36200) 2023-07-11T00:31:40.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.601+0000 7fd7ddf9c700 1 -- 172.21.15.22:0/248778617 learned_addr learned my addr 172.21.15.22:0/248778617 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:40.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.601+0000 7fd7dcf9a700 1 --2- 172.21.15.22:0/248778617 >> v2:172.21.15.184:3300/0 conn(0x7fd7d80d1cd0 0x7fd7d81608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:40.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.601+0000 7fd7dcf9a700 1 -- 172.21.15.22:0/248778617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7d80b8320 msgr2=0x7fd7d80cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:40.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.601+0000 7fd7dcf9a700 1 --2- 172.21.15.22:0/248778617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7d80b8320 0x7fd7d80cd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:40.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.601+0000 7fd7dcf9a700 1 -- 172.21.15.22:0/248778617 >> v1:172.21.15.184:6789/0 conn(0x7fd7d80b45b0 legacy=0x7fd7d80d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:40.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.601+0000 7fd7dcf9a700 1 -- 172.21.15.22:0/248778617 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d80cf0d0 con 0x7fd7d80d1cd0 2023-07-11T00:31:40.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.601+0000 7fd7dd79b700 1 --2- 172.21.15.22:0/248778617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7d80b8320 0x7fd7d80cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:40.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.601+0000 7fd7cffff700 1 -- 172.21.15.22:0/248778617 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129565415 0 0) 0x7fd7d80cf3b0 con 0x7fd7d80b45b0 2023-07-11T00:31:40.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.602+0000 7fd7dcf9a700 1 --2- 172.21.15.22:0/248778617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d80d1cd0 0x7fd7d81608e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009840 tx=0x7fd7c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef5325afba557ada server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:40.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.602+0000 7fd7cffff700 1 -- 172.21.15.22:0/248778617 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8011830 con 0x7fd7d80d1cd0 2023-07-11T00:31:40.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.602+0000 7fd7cffff700 1 -- 172.21.15.22:0/248778617 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c8011990 con 0x7fd7d80d1cd0 2023-07-11T00:31:40.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.602+0000 7fd7cffff700 1 -- 172.21.15.22:0/248778617 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8011d20 con 0x7fd7d80d1cd0 2023-07-11T00:31:40.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.602+0000 7fd7df9ff700 1 -- 172.21.15.22:0/248778617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d80d1cd0 msgr2=0x7fd7d81608e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:40.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.602+0000 7fd7df9ff700 1 --2- 172.21.15.22:0/248778617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d80d1cd0 0x7fd7d81608e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009840 tx=0x7fd7c8009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:40.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.602+0000 7fd7df9ff700 1 -- 172.21.15.22:0/248778617 shutdown_connections 2023-07-11T00:31:40.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.602+0000 7fd7df9ff700 1 --2- 172.21.15.22:0/248778617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7d80b8320 0x7fd7d80cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:40.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.602+0000 7fd7df9ff700 1 --2- 172.21.15.22:0/248778617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d80d1cd0 0x7fd7d81608e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:40.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.602+0000 7fd7df9ff700 1 -- 172.21.15.22:0/248778617 >> 172.21.15.22:0/248778617 conn(0x7fd7d80722b0 msgr2=0x7fd7d80cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:40.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.603+0000 7fd7df9ff700 1 -- 172.21.15.22:0/248778617 shutdown_connections 2023-07-11T00:31:40.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.603+0000 7fd7df9ff700 1 -- 172.21.15.22:0/248778617 wait complete. 2023-07-11T00:31:40.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.604+0000 7fd7df9ff700 1 Processor -- start 2023-07-11T00:31:40.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.604+0000 7fd7df9ff700 1 -- start start 2023-07-11T00:31:40.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.605+0000 7fd7df9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7d80b8320 0x7fd7d815c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:40.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.605+0000 7fd7df9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d80d1cd0 0x7fd7d8146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:40.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.605+0000 7fd7df9ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7d80b7790 0x7fd7d815d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:40.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.605+0000 7fd7df9ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d81473c0 con 0x7fd7d80b7790 2023-07-11T00:31:40.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.605+0000 7fd7df9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80b66f0 con 0x7fd7d80d1cd0 2023-07-11T00:31:40.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.605+0000 7fd7df9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80b69d0 con 0x7fd7d80b8320 2023-07-11T00:31:40.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.606+0000 7fd7ddf9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7d80b7790 0x7fd7d815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:40.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.606+0000 7fd7dd79b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7d80b8320 0x7fd7d815c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:40.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.606+0000 7fd7dcf9a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d80d1cd0 0x7fd7d8146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:40.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.606+0000 7fd7ddf9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7d80b7790 0x7fd7d815d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55054/0 (socket says 172.21.15.22:55054) 2023-07-11T00:31:40.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.606+0000 7fd7ddf9c700 1 -- 172.21.15.22:0/2787250060 learned_addr learned my addr 172.21.15.22:0/2787250060 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:40.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.606+0000 7fd7dd79b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7d80b8320 0x7fd7d815c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:36208/0 (socket says 172.21.15.22:36208) 2023-07-11T00:31:40.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.606+0000 7fd7ddf9c700 1 -- 172.21.15.22:0/2787250060 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7d80b8320 msgr2=0x7fd7d815c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:40.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.606+0000 7fd7ddf9c700 1 --2- 172.21.15.22:0/2787250060 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7d80b8320 0x7fd7d815c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:40.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.606+0000 7fd7ddf9c700 1 -- 172.21.15.22:0/2787250060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d80d1cd0 msgr2=0x7fd7d8146e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:40.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.606+0000 7fd7ddf9c700 1 --2- 172.21.15.22:0/2787250060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d80d1cd0 0x7fd7d8146e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:40.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.606+0000 7fd7ddf9c700 1 -- 172.21.15.22:0/2787250060 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d40094a0 con 0x7fd7d80b7790 2023-07-11T00:31:40.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.606+0000 7fd7dcf9a700 1 --2- 172.21.15.22:0/2787250060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d80d1cd0 0x7fd7d8146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:40.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.606+0000 7fd7ddf9c700 1 --2- 172.21.15.22:0/2787250060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7d80b7790 0x7fd7d815d600 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0002230 tx=0x7fd7d000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:40.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.607+0000 7fd7cdffb700 1 -- 172.21.15.22:0/2787250060 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d000aac0 con 0x7fd7d80b7790 2023-07-11T00:31:40.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.607+0000 7fd7cdffb700 1 -- 172.21.15.22:0/2787250060 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d000ac40 con 0x7fd7d80b7790 2023-07-11T00:31:40.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.607+0000 7fd7cdffb700 1 -- 172.21.15.22:0/2787250060 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d00070d0 con 0x7fd7d80b7790 2023-07-11T00:31:40.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.607+0000 7fd7df9ff700 1 -- 172.21.15.22:0/2787250060 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c80094a0 con 0x7fd7d80b7790 2023-07-11T00:31:40.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.607+0000 7fd7df9ff700 1 -- 172.21.15.22:0/2787250060 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d80b6f90 con 0x7fd7d80b7790 2023-07-11T00:31:40.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.608+0000 7fd7df9ff700 1 -- 172.21.15.22:0/2787250060 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d804ea60 con 0x7fd7d80b7790 2023-07-11T00:31:40.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.609+0000 7fd7cdffb700 1 -- 172.21.15.22:0/2787250060 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd7d0007250 con 0x7fd7d80b7790 2023-07-11T00:31:40.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.610+0000 7fd7cdffb700 1 --2- 172.21.15.22:0/2787250060 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd7bc06ace0 0x7fd7bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:40.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.610+0000 7fd7cdffb700 1 -- 172.21.15.22:0/2787250060 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fd7d0088fe0 con 0x7fd7d80b7790 2023-07-11T00:31:40.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.610+0000 7fd7dd79b700 1 --2- 172.21.15.22:0/2787250060 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd7bc06ace0 0x7fd7bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:40.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.611+0000 7fd7dd79b700 1 --2- 172.21.15.22:0/2787250060 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd7bc06ace0 0x7fd7bc06d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009d70 tx=0x7fd7d4009210 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:40.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.614+0000 7fd7cdffb700 1 -- 172.21.15.22:0/2787250060 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd7d0054320 con 0x7fd7d80b7790 2023-07-11T00:31:40.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:40.838+0000 7fd7df9ff700 1 -- 172.21.15.22:0/2787250060 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd7d815a640 con 0x7fd7d80b7790 2023-07-11T00:31:41.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.297+0000 7fd7cdffb700 1 -- 172.21.15.22:0/2787250060 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd7d0018020 con 0x7fd7d80b7790 2023-07-11T00:31:41.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.302+0000 7fd7df9ff700 1 -- 172.21.15.22:0/2787250060 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd7bc06ace0 msgr2=0x7fd7bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:41.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.302+0000 7fd7df9ff700 1 --2- 172.21.15.22:0/2787250060 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd7bc06ace0 0x7fd7bc06d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009d70 tx=0x7fd7d4009210 comp rx=0 tx=0).stop 2023-07-11T00:31:41.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.302+0000 7fd7df9ff700 1 -- 172.21.15.22:0/2787250060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7d80b7790 msgr2=0x7fd7d815d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:41.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.302+0000 7fd7df9ff700 1 --2- 172.21.15.22:0/2787250060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7d80b7790 0x7fd7d815d600 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0002230 tx=0x7fd7d000cf50 comp rx=0 tx=0).stop 2023-07-11T00:31:41.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.304+0000 7fd7df9ff700 1 -- 172.21.15.22:0/2787250060 shutdown_connections 2023-07-11T00:31:41.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.304+0000 7fd7df9ff700 1 --2- 172.21.15.22:0/2787250060 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fd7bc06ace0 0x7fd7bc06d190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:41.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.304+0000 7fd7df9ff700 1 --2- 172.21.15.22:0/2787250060 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7d80b8320 0x7fd7d815c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:41.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.304+0000 7fd7df9ff700 1 --2- 172.21.15.22:0/2787250060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7d80b7790 0x7fd7d815d600 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:41.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.304+0000 7fd7df9ff700 1 --2- 172.21.15.22:0/2787250060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d80d1cd0 0x7fd7d8146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:41.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.304+0000 7fd7df9ff700 1 -- 172.21.15.22:0/2787250060 >> 172.21.15.22:0/2787250060 conn(0x7fd7d80b45b0 msgr2=0x7fd7d806b260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:41.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.305+0000 7fd7df9ff700 1 -- 172.21.15.22:0/2787250060 shutdown_connections 2023-07-11T00:31:41.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.306+0000 7fd7df9ff700 1 -- 172.21.15.22:0/2787250060 wait complete. 2023-07-11T00:31:41.311 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2023-07-11T00:31:41.332 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-11T00:31:41.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.533+0000 7fe0c5dff700 1 Processor -- start 2023-07-11T00:31:41.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.533+0000 7fe0c5dff700 1 -- start start 2023-07-11T00:31:41.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.534+0000 7fe0c5dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0c00d2640 0x7fe0c00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:41.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.534+0000 7fe0c5dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe0c00cf8f0 0x7fe0c015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:41.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.534+0000 7fe0c5dff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c00d1790 con 0x7fe0c015c460 2023-07-11T00:31:41.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.534+0000 7fe0c5dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c00cedd0 con 0x7fe0c00cf8f0 2023-07-11T00:31:41.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.534+0000 7fe0c5dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00cd950 con 0x7fe0c00d2640 2023-07-11T00:31:41.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.535+0000 7fe0bf7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe0c015c460 0x7fe0c00cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46894/0 (socket says 172.21.15.22:46894) 2023-07-11T00:31:41.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.535+0000 7fe0bf7fe700 1 -- 172.21.15.22:0/705156411 learned_addr learned my addr 172.21.15.22:0/705156411 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:41.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.535+0000 7fe0beffd700 1 --2- 172.21.15.22:0/705156411 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0c00d2640 0x7fe0c00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:41.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.535+0000 7fe0bffff700 1 --2- 172.21.15.22:0/705156411 >> v2:172.21.15.184:3300/0 conn(0x7fe0c00cf8f0 0x7fe0c015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:41.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.535+0000 7fe0be7fc700 1 -- 172.21.15.22:0/705156411 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867729189 0 0) 0x7fe0c00d1790 con 0x7fe0c015c460 2023-07-11T00:31:41.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.535+0000 7fe0be7fc700 1 -- 172.21.15.22:0/705156411 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0a80035b0 con 0x7fe0c015c460 2023-07-11T00:31:41.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.535+0000 7fe0be7fc700 1 -- 172.21.15.22:0/705156411 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3626271007 0 0) 0x7fe0a80035b0 con 0x7fe0c015c460 2023-07-11T00:31:41.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.535+0000 7fe0beffd700 1 -- 172.21.15.22:0/705156411 >> v2:172.21.15.184:3300/0 conn(0x7fe0c00cf8f0 msgr2=0x7fe0c015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:41.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.535+0000 7fe0beffd700 1 --2- 172.21.15.22:0/705156411 >> v2:172.21.15.184:3300/0 conn(0x7fe0c00cf8f0 0x7fe0c015fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:41.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.535+0000 7fe0beffd700 1 -- 172.21.15.22:0/705156411 >> v1:172.21.15.22:6789/0 conn(0x7fe0c015c460 legacy=0x7fe0c00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:41.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.535+0000 7fe0beffd700 1 -- 172.21.15.22:0/705156411 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00d14b0 con 0x7fe0c00d2640 2023-07-11T00:31:41.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.535+0000 7fe0bffff700 1 --2- 172.21.15.22:0/705156411 >> v2:172.21.15.184:3300/0 conn(0x7fe0c00cf8f0 0x7fe0c015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:41.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.536+0000 7fe0beffd700 1 --2- 172.21.15.22:0/705156411 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0c00d2640 0x7fe0c00b59d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4009840 tx=0x7fe0b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b57edd51e1efb710 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:41.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.536+0000 7fe0be7fc700 1 -- 172.21.15.22:0/705156411 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0001670 con 0x7fe0c00d2640 2023-07-11T00:31:41.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.536+0000 7fe0be7fc700 1 -- 172.21.15.22:0/705156411 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b4004030 con 0x7fe0c00d2640 2023-07-11T00:31:41.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.536+0000 7fe0be7fc700 1 -- 172.21.15.22:0/705156411 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b40043c0 con 0x7fe0c00d2640 2023-07-11T00:31:41.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.536+0000 7fe0c5dff700 1 -- 172.21.15.22:0/705156411 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0c00d2640 msgr2=0x7fe0c00b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:41.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.536+0000 7fe0c5dff700 1 --2- 172.21.15.22:0/705156411 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0c00d2640 0x7fe0c00b59d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4009840 tx=0x7fe0b4009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:41.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.537+0000 7fe0c5dff700 1 -- 172.21.15.22:0/705156411 shutdown_connections 2023-07-11T00:31:41.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.537+0000 7fe0c5dff700 1 --2- 172.21.15.22:0/705156411 >> v2:172.21.15.184:3300/0 conn(0x7fe0c00cf8f0 0x7fe0c015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:41.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.537+0000 7fe0c5dff700 1 --2- 172.21.15.22:0/705156411 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0c00d2640 0x7fe0c00b59d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:41.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.537+0000 7fe0c5dff700 1 -- 172.21.15.22:0/705156411 >> 172.21.15.22:0/705156411 conn(0x7fe0c0071660 msgr2=0x7fe0c0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:41.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.537+0000 7fe0c5dff700 1 -- 172.21.15.22:0/705156411 shutdown_connections 2023-07-11T00:31:41.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.537+0000 7fe0c5dff700 1 -- 172.21.15.22:0/705156411 wait complete. 2023-07-11T00:31:41.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.538+0000 7fe0c5dff700 1 Processor -- start 2023-07-11T00:31:41.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.539+0000 7fe0c5dff700 1 -- start start 2023-07-11T00:31:41.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0c5dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0c00cf8f0 0x7fe0c00cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:41.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0c5dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0c00d2640 0x7fe0c0155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:41.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0c5dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0c015c460 0x7fe0c01563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:41.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0c5dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00c95b0 con 0x7fe0c00d2640 2023-07-11T00:31:41.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0c5dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00c89a0 con 0x7fe0c00cf8f0 2023-07-11T00:31:41.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0c5dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00c8c80 con 0x7fe0c015c460 2023-07-11T00:31:41.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0beffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0c00d2640 0x7fe0c0155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:41.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0beffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0c00d2640 0x7fe0c0155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55070/0 (socket says 172.21.15.22:55070) 2023-07-11T00:31:41.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0beffd700 1 -- 172.21.15.22:0/759182000 learned_addr learned my addr 172.21.15.22:0/759182000 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:41.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0bf7fe700 1 --2- 172.21.15.22:0/759182000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0c00cf8f0 0x7fe0c00cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:41.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0bffff700 1 --2- 172.21.15.22:0/759182000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0c015c460 0x7fe0c01563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:41.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0beffd700 1 -- 172.21.15.22:0/759182000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0c015c460 msgr2=0x7fe0c01563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:41.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0beffd700 1 --2- 172.21.15.22:0/759182000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0c015c460 0x7fe0c01563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:41.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0beffd700 1 -- 172.21.15.22:0/759182000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0c00cf8f0 msgr2=0x7fe0c00cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:41.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0beffd700 1 --2- 172.21.15.22:0/759182000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0c00cf8f0 0x7fe0c00cc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:41.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0beffd700 1 -- 172.21.15.22:0/759182000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b8009a70 con 0x7fe0c00d2640 2023-07-11T00:31:41.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0bf7fe700 1 --2- 172.21.15.22:0/759182000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0c00cf8f0 0x7fe0c00cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:41.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.540+0000 7fe0bffff700 1 --2- 172.21.15.22:0/759182000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0c015c460 0x7fe0c01563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:41.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.541+0000 7fe0beffd700 1 --2- 172.21.15.22:0/759182000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0c00d2640 0x7fe0c0155e70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400a010 tx=0x7fe0b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:41.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.541+0000 7fe0a7fff700 1 -- 172.21.15.22:0/759182000 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4003c40 con 0x7fe0c00d2640 2023-07-11T00:31:41.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.541+0000 7fe0a7fff700 1 -- 172.21.15.22:0/759182000 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b401f070 con 0x7fe0c00d2640 2023-07-11T00:31:41.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.541+0000 7fe0c5dff700 1 -- 172.21.15.22:0/759182000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b40094a0 con 0x7fe0c00d2640 2023-07-11T00:31:41.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.541+0000 7fe0a7fff700 1 -- 172.21.15.22:0/759182000 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4011630 con 0x7fe0c00d2640 2023-07-11T00:31:41.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.541+0000 7fe0c5dff700 1 -- 172.21.15.22:0/759182000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c00c9240 con 0x7fe0c00d2640 2023-07-11T00:31:41.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.542+0000 7fe0c5dff700 1 -- 172.21.15.22:0/759182000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c004ea60 con 0x7fe0c00d2640 2023-07-11T00:31:41.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.543+0000 7fe0a7fff700 1 -- 172.21.15.22:0/759182000 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe0b4021030 con 0x7fe0c00d2640 2023-07-11T00:31:41.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.544+0000 7fe0a7fff700 1 --2- 172.21.15.22:0/759182000 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe0ac06ace0 0x7fe0ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:41.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.544+0000 7fe0a7fff700 1 -- 172.21.15.22:0/759182000 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe0b408a5d0 con 0x7fe0c00d2640 2023-07-11T00:31:41.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.545+0000 7fe0bf7fe700 1 --2- 172.21.15.22:0/759182000 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe0ac06ace0 0x7fe0ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:41.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.545+0000 7fe0bf7fe700 1 --2- 172.21.15.22:0/759182000 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe0ac06ace0 0x7fe0ac06d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0001860 tx=0x7fe0b0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:41.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.548+0000 7fe0a7fff700 1 -- 172.21.15.22:0/759182000 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe0b4055880 con 0x7fe0c00d2640 2023-07-11T00:31:41.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.841+0000 7fe0c5dff700 1 -- 172.21.15.22:0/759182000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe0c006c160 con 0x7fe0c00d2640 2023-07-11T00:31:41.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.841+0000 7fe0a7fff700 1 -- 172.21.15.22:0/759182000 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fe0b4058ea0 con 0x7fe0c00d2640 2023-07-11T00:31:41.844 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:41.844 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-07-11T00:31:41.845 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2023-07-11T00:31:41.845 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.845 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2023-07-11T00:31:41.846 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBVoqxkcr9IIBAAqKIJX9ebddhQKcwNMjXIww==", 2023-07-11T00:31:41.846 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.846 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-07-11T00:31:41.846 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-07-11T00:31:41.847 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-07-11T00:31:41.847 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-07-11T00:31:41.847 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.847 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.848 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.848 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2023-07-11T00:31:41.848 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBVoqxkhOd0OBAApX3sp19vAM1rQA71VBpj4Q==", 2023-07-11T00:31:41.849 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.849 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-07-11T00:31:41.849 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-07-11T00:31:41.850 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-07-11T00:31:41.851 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-07-11T00:31:41.851 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.852 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.852 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.852 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2023-07-11T00:31:41.853 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBVoqxk/bU7LBAAKC6KUWaNWvqFpv3AKrwtnQ==", 2023-07-11T00:31:41.853 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.853 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-07-11T00:31:41.854 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-07-11T00:31:41.854 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-07-11T00:31:41.854 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-07-11T00:31:41.854 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.855 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.855 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2023-07-11T00:31:41.856 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBWoqxkEAl0CBAAVl//C25jJlXrH3H+5c6ezA==", 2023-07-11T00:31:41.856 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.856 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-07-11T00:31:41.856 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-07-11T00:31:41.857 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-07-11T00:31:41.857 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-07-11T00:31:41.857 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.857 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.857 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.857 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2023-07-11T00:31:41.857 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBYoqxkTCGgDxAAMG0ukMoXlziubvhE21b5UA==", 2023-07-11T00:31:41.858 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.858 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-07-11T00:31:41.858 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-07-11T00:31:41.858 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-07-11T00:31:41.858 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.858 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.858 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.858 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2023-07-11T00:31:41.859 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBboqxkwSojFBAANmcZAYcHo5ms91KeZWaQbg==", 2023-07-11T00:31:41.859 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.859 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-07-11T00:31:41.859 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-07-11T00:31:41.859 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-07-11T00:31:41.859 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.859 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.860 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.860 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2023-07-11T00:31:41.860 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBeoqxkGNjLGBAAUda/8QAOLpFCARS36ldkPA==", 2023-07-11T00:31:41.860 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.860 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-07-11T00:31:41.860 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-07-11T00:31:41.860 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-07-11T00:31:41.861 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.861 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.861 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.861 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2023-07-11T00:31:41.861 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBhoqxkEe1jHRAAnpiNgcbSMPnF9FTm8ac5Nw==", 2023-07-11T00:31:41.861 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.861 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-07-11T00:31:41.862 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-07-11T00:31:41.862 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-07-11T00:31:41.862 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.862 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.862 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2023-07-11T00:31:41.863 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBnoqxkhREdNhAAjkVt+mjdFkq0PJ+sMeHb0Q==", 2023-07-11T00:31:41.863 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.863 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-07-11T00:31:41.863 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-07-11T00:31:41.863 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-07-11T00:31:41.864 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.864 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.864 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2023-07-11T00:31:41.864 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBqoqxk261HORAAJJ1AZ3GTUT/gLpUUY2tKJA==", 2023-07-11T00:31:41.865 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.865 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-07-11T00:31:41.865 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-07-11T00:31:41.865 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-07-11T00:31:41.865 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.865 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.865 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.866 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2023-07-11T00:31:41.866 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBuoqxkHtRdABAASL66oeSUw5Z9uDNoCe9aQA==", 2023-07-11T00:31:41.866 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.866 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-07-11T00:31:41.866 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-07-11T00:31:41.866 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-07-11T00:31:41.866 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.866 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.867 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.867 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2023-07-11T00:31:41.867 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBxoqxkUbsTBBAAlowrIlbptumsnh/2Iq8FOg==", 2023-07-11T00:31:41.867 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.867 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-07-11T00:31:41.867 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-07-11T00:31:41.867 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-07-11T00:31:41.868 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.868 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.868 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2023-07-11T00:31:41.868 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBWoqxkYp7gEhAAkay8GXLqeoGhPULEEnwHBw==", 2023-07-11T00:31:41.868 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.868 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-07-11T00:31:41.868 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-07-11T00:31:41.869 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-07-11T00:31:41.869 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-07-11T00:31:41.869 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.869 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.869 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2023-07-11T00:31:41.869 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBWoqxkFf9pIhAAL8QYQeU/JEpI5IPKrvoWgA==", 2023-07-11T00:31:41.870 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.870 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-07-11T00:31:41.870 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-07-11T00:31:41.870 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-07-11T00:31:41.870 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-07-11T00:31:41.870 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.870 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.871 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.871 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2023-07-11T00:31:41.871 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBWoqxkiADkGhAA+trkhPA5iVs+gWxE2E/OJA==", 2023-07-11T00:31:41.871 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.871 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-07-11T00:31:41.871 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-07-11T00:31:41.871 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-07-11T00:31:41.872 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-07-11T00:31:41.872 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.872 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.872 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2023-07-11T00:31:41.872 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBWoqxkc0TeKRAAv1RuG03Ynt7zvyqG5UHj9A==", 2023-07-11T00:31:41.872 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.873 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-07-11T00:31:41.873 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-07-11T00:31:41.873 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-07-11T00:31:41.873 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-07-11T00:31:41.873 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.873 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.874 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2023-07-11T00:31:41.874 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g==", 2023-07-11T00:31:41.874 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.874 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-07-11T00:31:41.875 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-07-11T00:31:41.875 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-07-11T00:31:41.875 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-07-11T00:31:41.875 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.875 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.875 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-mds", 2023-07-11T00:31:41.876 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQB4oqxkqtUwOhAA93hHTtgc9b93JlbDAfEFRw==", 2023-07-11T00:31:41.876 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.876 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-mds" 2023-07-11T00:31:41.876 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.876 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.877 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-mgr", 2023-07-11T00:31:41.877 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQB4oqxkrN8wOhAAD5XJaSWxDDCEHOsW1sesJA==", 2023-07-11T00:31:41.877 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.878 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-11T00:31:41.878 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.878 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.878 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.879 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-osd", 2023-07-11T00:31:41.879 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQB4oqxkn+gwOhAAIq/+W6txmmzIiCvhzaHKLQ==", 2023-07-11T00:31:41.879 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.880 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-osd" 2023-07-11T00:31:41.880 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.880 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.880 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.881 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-rbd", 2023-07-11T00:31:41.881 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQB4oqxkwPMwOhAACp2c31X5lu/Uzrf79SMLpw==", 2023-07-11T00:31:41.881 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.882 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-11T00:31:41.882 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.883 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.883 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-11T00:31:41.883 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQB4oqxkFP0wOhAABpCMTBE3nhC2jGSerEedRA==", 2023-07-11T00:31:41.883 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.884 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-11T00:31:41.884 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.885 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.885 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-rgw", 2023-07-11T00:31:41.885 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQB4oqxkVwYxOhAANvTJZRdDG4dH0kPgdnJbWg==", 2023-07-11T00:31:41.885 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.886 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-11T00:31:41.886 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.886 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.886 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2023-07-11T00:31:41.887 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBVoqxkx4lHGBAAHVaHNFYD0IuPzwzaJHuh7g==", 2023-07-11T00:31:41.887 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.887 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-07-11T00:31:41.887 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-07-11T00:31:41.888 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-07-11T00:31:41.888 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:41.889 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:41.889 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2023-07-11T00:31:41.889 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQBUoqxkaKyKIhAAYpRtjFhpOYFaTsYgHLptDg==", 2023-07-11T00:31:41.889 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-07-11T00:31:41.889 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-07-11T00:31:41.890 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-07-11T00:31:41.890 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-07-11T00:31:41.890 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.890 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:41.890 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-07-11T00:31:41.890 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-07-11T00:31:41.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.844+0000 7fe0c5dff700 1 -- 172.21.15.22:0/759182000 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe0ac06ace0 msgr2=0x7fe0ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:41.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.844+0000 7fe0c5dff700 1 --2- 172.21.15.22:0/759182000 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe0ac06ace0 0x7fe0ac06d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0001860 tx=0x7fe0b0009040 comp rx=0 tx=0).stop 2023-07-11T00:31:41.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.844+0000 7fe0c5dff700 1 -- 172.21.15.22:0/759182000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0c00d2640 msgr2=0x7fe0c0155e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:41.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.844+0000 7fe0c5dff700 1 --2- 172.21.15.22:0/759182000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0c00d2640 0x7fe0c0155e70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400a010 tx=0x7fe0b4004750 comp rx=0 tx=0).stop 2023-07-11T00:31:41.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.844+0000 7fe0c5dff700 1 -- 172.21.15.22:0/759182000 shutdown_connections 2023-07-11T00:31:41.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.844+0000 7fe0c5dff700 1 --2- 172.21.15.22:0/759182000 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe0ac06ace0 0x7fe0ac06d190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:41.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.844+0000 7fe0c5dff700 1 --2- 172.21.15.22:0/759182000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0c015c460 0x7fe0c01563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:41.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.844+0000 7fe0c5dff700 1 --2- 172.21.15.22:0/759182000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0c00cf8f0 0x7fe0c00cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:41.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.844+0000 7fe0c5dff700 1 --2- 172.21.15.22:0/759182000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0c00d2640 0x7fe0c0155e70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:41.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.844+0000 7fe0c5dff700 1 -- 172.21.15.22:0/759182000 >> 172.21.15.22:0/759182000 conn(0x7fe0c0071660 msgr2=0x7fe0c00b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:41.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.844+0000 7fe0c5dff700 1 -- 172.21.15.22:0/759182000 shutdown_connections 2023-07-11T00:31:41.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:41.844+0000 7fe0c5dff700 1 -- 172.21.15.22:0/759182000 wait complete. 2023-07-11T00:31:41.897 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-11T00:31:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.098+0000 7fa545dff700 1 Processor -- start 2023-07-11T00:31:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.099+0000 7fa545dff700 1 -- start start 2023-07-11T00:31:42.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.100+0000 7fa545dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa5400cd7d0 0x7fa5400cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:42.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.100+0000 7fa545dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5400cb4f0 0x7fa5401595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:42.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.100+0000 7fa545dff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5400cbc00 con 0x7fa540156be0 2023-07-11T00:31:42.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.100+0000 7fa545dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa540156fb0 con 0x7fa5400cd7d0 2023-07-11T00:31:42.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.100+0000 7fa545dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54015da40 con 0x7fa5400cb4f0 2023-07-11T00:31:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.100+0000 7fa53f7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa540156be0 0x7fa5400cd0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46898/0 (socket says 172.21.15.22:46898) 2023-07-11T00:31:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.100+0000 7fa53f7fe700 1 -- 172.21.15.22:0/2141376852 learned_addr learned my addr 172.21.15.22:0/2141376852 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.100+0000 7fa53effd700 1 --2- 172.21.15.22:0/2141376852 >> v2:172.21.15.184:3300/0 conn(0x7fa5400cd7d0 0x7fa5400cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.100+0000 7fa53ffff700 1 --2- 172.21.15.22:0/2141376852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5400cb4f0 0x7fa5401595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.101+0000 7fa53e7fc700 1 -- 172.21.15.22:0/2141376852 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253007376 0 0) 0x7fa5400cbc00 con 0x7fa540156be0 2023-07-11T00:31:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.101+0000 7fa53e7fc700 1 -- 172.21.15.22:0/2141376852 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5280035b0 con 0x7fa540156be0 2023-07-11T00:31:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.101+0000 7fa53effd700 1 -- 172.21.15.22:0/2141376852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5400cb4f0 msgr2=0x7fa5401595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.101+0000 7fa53effd700 1 --2- 172.21.15.22:0/2141376852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5400cb4f0 0x7fa5401595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.101+0000 7fa53effd700 1 -- 172.21.15.22:0/2141376852 >> v1:172.21.15.22:6789/0 conn(0x7fa540156be0 legacy=0x7fa5400cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.101+0000 7fa53effd700 1 -- 172.21.15.22:0/2141376852 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5400cb990 con 0x7fa5400cd7d0 2023-07-11T00:31:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.101+0000 7fa53ffff700 1 --2- 172.21.15.22:0/2141376852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5400cb4f0 0x7fa5401595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.101+0000 7fa53effd700 1 --2- 172.21.15.22:0/2141376852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5400cd7d0 0x7fa5400cafb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa534009870 tx=0x7fa534009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9ede48c5abbb834 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.101+0000 7fa53e7fc700 1 -- 172.21.15.22:0/2141376852 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa534011830 con 0x7fa5400cd7d0 2023-07-11T00:31:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.101+0000 7fa53e7fc700 1 -- 172.21.15.22:0/2141376852 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa534011990 con 0x7fa5400cd7d0 2023-07-11T00:31:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.101+0000 7fa53e7fc700 1 -- 172.21.15.22:0/2141376852 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa534011d00 con 0x7fa5400cd7d0 2023-07-11T00:31:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.102+0000 7fa545dff700 1 -- 172.21.15.22:0/2141376852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5400cd7d0 msgr2=0x7fa5400cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:42.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.102+0000 7fa545dff700 1 --2- 172.21.15.22:0/2141376852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5400cd7d0 0x7fa5400cafb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa534009870 tx=0x7fa534009b80 comp rx=0 tx=0).stop 2023-07-11T00:31:42.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.102+0000 7fa545dff700 1 -- 172.21.15.22:0/2141376852 shutdown_connections 2023-07-11T00:31:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.102+0000 7fa545dff700 1 --2- 172.21.15.22:0/2141376852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5400cb4f0 0x7fa5401595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.102+0000 7fa545dff700 1 --2- 172.21.15.22:0/2141376852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5400cd7d0 0x7fa5400cafb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.102+0000 7fa545dff700 1 -- 172.21.15.22:0/2141376852 >> 172.21.15.22:0/2141376852 conn(0x7fa5400b0390 msgr2=0x7fa5400b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.102+0000 7fa545dff700 1 -- 172.21.15.22:0/2141376852 shutdown_connections 2023-07-11T00:31:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.102+0000 7fa545dff700 1 -- 172.21.15.22:0/2141376852 wait complete. 2023-07-11T00:31:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.104+0000 7fa545dff700 1 Processor -- start 2023-07-11T00:31:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.104+0000 7fa545dff700 1 -- start start 2023-07-11T00:31:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.105+0000 7fa545dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5400cb4f0 0x7fa540148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.105+0000 7fa545dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5400cd7d0 0x7fa5400c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.105+0000 7fa545dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa540156be0 0x7fa5400c2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.105+0000 7fa545dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa540155db0 con 0x7fa540156be0 2023-07-11T00:31:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.105+0000 7fa545dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400c2e60 con 0x7fa5400cd7d0 2023-07-11T00:31:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.105+0000 7fa545dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400c3140 con 0x7fa5400cb4f0 2023-07-11T00:31:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.105+0000 7fa53ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa540156be0 0x7fa5400c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:42.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.105+0000 7fa53ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa540156be0 0x7fa5400c2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55074/0 (socket says 172.21.15.22:55074) 2023-07-11T00:31:42.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.105+0000 7fa53ffff700 1 -- 172.21.15.22:0/1375232983 learned_addr learned my addr 172.21.15.22:0/1375232983 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:42.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.106+0000 7fa53effd700 1 --2- 172.21.15.22:0/1375232983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5400cd7d0 0x7fa5400c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:42.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.106+0000 7fa53f7fe700 1 --2- 172.21.15.22:0/1375232983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5400cb4f0 0x7fa540148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:42.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.106+0000 7fa53ffff700 1 -- 172.21.15.22:0/1375232983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5400cb4f0 msgr2=0x7fa540148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:42.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.106+0000 7fa53ffff700 1 --2- 172.21.15.22:0/1375232983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5400cb4f0 0x7fa540148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.106+0000 7fa53ffff700 1 -- 172.21.15.22:0/1375232983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5400cd7d0 msgr2=0x7fa5400c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:42.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.106+0000 7fa53ffff700 1 --2- 172.21.15.22:0/1375232983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5400cd7d0 0x7fa5400c22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.106+0000 7fa53ffff700 1 -- 172.21.15.22:0/1375232983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa538009a70 con 0x7fa540156be0 2023-07-11T00:31:42.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.106+0000 7fa53ffff700 1 --2- 172.21.15.22:0/1375232983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa540156be0 0x7fa5400c2830 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa53800efc0 tx=0x7fa53800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:42.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.106+0000 7fa527fff700 1 -- 172.21.15.22:0/1375232983 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538003a20 con 0x7fa540156be0 2023-07-11T00:31:42.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.106+0000 7fa527fff700 1 -- 172.21.15.22:0/1375232983 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53800f040 con 0x7fa540156be0 2023-07-11T00:31:42.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.106+0000 7fa527fff700 1 -- 172.21.15.22:0/1375232983 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538003da0 con 0x7fa540156be0 2023-07-11T00:31:42.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.106+0000 7fa545dff700 1 -- 172.21.15.22:0/1375232983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5340094a0 con 0x7fa540156be0 2023-07-11T00:31:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.107+0000 7fa545dff700 1 -- 172.21.15.22:0/1375232983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5400c3700 con 0x7fa540156be0 2023-07-11T00:31:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.108+0000 7fa545dff700 1 -- 172.21.15.22:0/1375232983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54004ea60 con 0x7fa540156be0 2023-07-11T00:31:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.109+0000 7fa527fff700 1 -- 172.21.15.22:0/1375232983 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa53800ca10 con 0x7fa540156be0 2023-07-11T00:31:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.110+0000 7fa527fff700 1 --2- 172.21.15.22:0/1375232983 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa52c06ace0 0x7fa52c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.110+0000 7fa527fff700 1 -- 172.21.15.22:0/1375232983 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa538089a40 con 0x7fa540156be0 2023-07-11T00:31:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.110+0000 7fa53f7fe700 1 --2- 172.21.15.22:0/1375232983 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa52c06ace0 0x7fa52c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.111+0000 7fa53f7fe700 1 --2- 172.21.15.22:0/1375232983 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa52c06ace0 0x7fa52c06d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa530005910 tx=0x7fa530000bc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.114+0000 7fa527fff700 1 -- 172.21.15.22:0/1375232983 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa53808be60 con 0x7fa540156be0 2023-07-11T00:31:42.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.409+0000 7fa545dff700 1 -- 172.21.15.22:0/1375232983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fa5400cab80 con 0x7fa540156be0 2023-07-11T00:31:42.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.413+0000 7fa527fff700 1 -- 172.21.15.22:0/1375232983 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa538058820 con 0x7fa540156be0 2023-07-11T00:31:42.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.416+0000 7fa545dff700 1 -- 172.21.15.22:0/1375232983 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa52c06ace0 msgr2=0x7fa52c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.416+0000 7fa545dff700 1 --2- 172.21.15.22:0/1375232983 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa52c06ace0 0x7fa52c06d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa530005910 tx=0x7fa530000bc0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.416+0000 7fa545dff700 1 -- 172.21.15.22:0/1375232983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa540156be0 msgr2=0x7fa5400c2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.416+0000 7fa545dff700 1 --2- 172.21.15.22:0/1375232983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa540156be0 0x7fa5400c2830 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa53800efc0 tx=0x7fa53800c3a0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.416+0000 7fa545dff700 1 -- 172.21.15.22:0/1375232983 shutdown_connections 2023-07-11T00:31:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.416+0000 7fa545dff700 1 --2- 172.21.15.22:0/1375232983 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa52c06ace0 0x7fa52c06d190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.416+0000 7fa545dff700 1 --2- 172.21.15.22:0/1375232983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5400cb4f0 0x7fa540148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.416+0000 7fa545dff700 1 --2- 172.21.15.22:0/1375232983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa540156be0 0x7fa5400c2830 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.416+0000 7fa545dff700 1 --2- 172.21.15.22:0/1375232983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5400cd7d0 0x7fa5400c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.416+0000 7fa545dff700 1 -- 172.21.15.22:0/1375232983 >> 172.21.15.22:0/1375232983 conn(0x7fa5400b0390 msgr2=0x7fa5400b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.416+0000 7fa545dff700 1 -- 172.21.15.22:0/1375232983 shutdown_connections 2023-07-11T00:31:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.416+0000 7fa545dff700 1 -- 172.21.15.22:0/1375232983 wait complete. 2023-07-11T00:31:42.436 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-11T00:31:42.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.636+0000 7fe0493ff700 1 Processor -- start 2023-07-11T00:31:42.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.636+0000 7fe0493ff700 1 -- start start 2023-07-11T00:31:42.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.637+0000 7fe0493ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe04415c460 0x7fe0440b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:42.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.637+0000 7fe0493ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe0440d2640 0x7fe0440cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:42.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.637+0000 7fe0493ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe0440cf720 0x7fe0440cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:42.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.637+0000 7fe0493ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0440cedd0 con 0x7fe0440d2640 2023-07-11T00:31:42.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.637+0000 7fe0493ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0440d1790 con 0x7fe0440cf720 2023-07-11T00:31:42.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.637+0000 7fe0493ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440cd950 con 0x7fe04415c460 2023-07-11T00:31:42.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.637+0000 7fe0427fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe0440d2640 0x7fe0440cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:42.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.637+0000 7fe0427fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe0440d2640 0x7fe0440cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55086/0 (socket says 172.21.15.22:55086) 2023-07-11T00:31:42.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.637+0000 7fe0427fc700 1 -- 172.21.15.22:0/2204954247 learned_addr learned my addr 172.21.15.22:0/2204954247 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:42.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.638+0000 7fe0437fe700 1 --2- 172.21.15.22:0/2204954247 >> v2:172.21.15.184:3300/0 conn(0x7fe0440cf720 0x7fe0440cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:42.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.638+0000 7fe042ffd700 1 --2- 172.21.15.22:0/2204954247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe04415c460 0x7fe0440b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:42.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.638+0000 7fe0427fc700 1 -- 172.21.15.22:0/2204954247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe04415c460 msgr2=0x7fe0440b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:42.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.638+0000 7fe0427fc700 1 --2- 172.21.15.22:0/2204954247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe04415c460 0x7fe0440b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.638+0000 7fe0427fc700 1 -- 172.21.15.22:0/2204954247 >> v2:172.21.15.184:3300/0 conn(0x7fe0440cf720 msgr2=0x7fe0440cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:42.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.638+0000 7fe0427fc700 1 --2- 172.21.15.22:0/2204954247 >> v2:172.21.15.184:3300/0 conn(0x7fe0440cf720 0x7fe0440cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.638+0000 7fe0427fc700 1 -- 172.21.15.22:0/2204954247 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0440d14b0 con 0x7fe0440d2640 2023-07-11T00:31:42.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.638+0000 7fe042ffd700 1 --2- 172.21.15.22:0/2204954247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe04415c460 0x7fe0440b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:42.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.638+0000 7fe0427fc700 1 --2- 172.21.15.22:0/2204954247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0440d2640 0x7fe0440cf1e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe04408bf90 tx=0x7fe038009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66f5abd77a29fb9 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:42.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.638+0000 7fe041ffb700 1 -- 172.21.15.22:0/2204954247 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038011830 con 0x7fe0440d2640 2023-07-11T00:31:42.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.638+0000 7fe041ffb700 1 -- 172.21.15.22:0/2204954247 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe038011990 con 0x7fe0440d2640 2023-07-11T00:31:42.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.638+0000 7fe041ffb700 1 -- 172.21.15.22:0/2204954247 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038011d20 con 0x7fe0440d2640 2023-07-11T00:31:42.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.639+0000 7fe0493ff700 1 -- 172.21.15.22:0/2204954247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0440d2640 msgr2=0x7fe0440cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:42.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.639+0000 7fe0493ff700 1 --2- 172.21.15.22:0/2204954247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0440d2640 0x7fe0440cf1e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe04408bf90 tx=0x7fe038009bd0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.639+0000 7fe0493ff700 1 -- 172.21.15.22:0/2204954247 shutdown_connections 2023-07-11T00:31:42.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.639+0000 7fe0493ff700 1 --2- 172.21.15.22:0/2204954247 >> v2:172.21.15.184:3300/0 conn(0x7fe0440cf720 0x7fe0440cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.639+0000 7fe0493ff700 1 --2- 172.21.15.22:0/2204954247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe04415c460 0x7fe0440b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.639+0000 7fe0493ff700 1 --2- 172.21.15.22:0/2204954247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0440d2640 0x7fe0440cf1e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.639+0000 7fe0493ff700 1 -- 172.21.15.22:0/2204954247 >> 172.21.15.22:0/2204954247 conn(0x7fe044071660 msgr2=0x7fe044071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:42.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.639+0000 7fe0493ff700 1 -- 172.21.15.22:0/2204954247 shutdown_connections 2023-07-11T00:31:42.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.639+0000 7fe0493ff700 1 -- 172.21.15.22:0/2204954247 wait complete. 2023-07-11T00:31:42.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.641+0000 7fe0493ff700 1 Processor -- start 2023-07-11T00:31:42.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.641+0000 7fe0493ff700 1 -- start start 2023-07-11T00:31:42.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.642+0000 7fe0493ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0440cf720 0x7fe0440cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:42.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.642+0000 7fe0493ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0440d2640 0x7fe0441e6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:42.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.642+0000 7fe0493ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe04415c460 0x7fe0441523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:42.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.642+0000 7fe0493ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0441e6d50 con 0x7fe0440cf720 2023-07-11T00:31:42.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.642+0000 7fe0493ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0441528e0 con 0x7fe04415c460 2023-07-11T00:31:42.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.642+0000 7fe0493ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440ccc80 con 0x7fe0440d2640 2023-07-11T00:31:42.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.642+0000 7fe042ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0440cf720 0x7fe0440cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:42.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.642+0000 7fe042ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0440cf720 0x7fe0440cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55092/0 (socket says 172.21.15.22:55092) 2023-07-11T00:31:42.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.642+0000 7fe042ffd700 1 -- 172.21.15.22:0/4167201953 learned_addr learned my addr 172.21.15.22:0/4167201953 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.642+0000 7fe0437fe700 1 --2- 172.21.15.22:0/4167201953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe04415c460 0x7fe0441523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.642+0000 7fe0427fc700 1 --2- 172.21.15.22:0/4167201953 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0440d2640 0x7fe0441e6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.643+0000 7fe042ffd700 1 -- 172.21.15.22:0/4167201953 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0440d2640 msgr2=0x7fe0441e6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.643+0000 7fe042ffd700 1 --2- 172.21.15.22:0/4167201953 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0440d2640 0x7fe0441e6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.643+0000 7fe042ffd700 1 -- 172.21.15.22:0/4167201953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe04415c460 msgr2=0x7fe0441523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.643+0000 7fe042ffd700 1 --2- 172.21.15.22:0/4167201953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe04415c460 0x7fe0441523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.643+0000 7fe042ffd700 1 -- 172.21.15.22:0/4167201953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe038009550 con 0x7fe0440cf720 2023-07-11T00:31:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.643+0000 7fe042ffd700 1 --2- 172.21.15.22:0/4167201953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0440cf720 0x7fe0440cc610 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe03400e810 tx=0x7fe03400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.643+0000 7fe02b7fe700 1 -- 172.21.15.22:0/4167201953 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03400c020 con 0x7fe0440cf720 2023-07-11T00:31:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.643+0000 7fe02b7fe700 1 -- 172.21.15.22:0/4167201953 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe034004250 con 0x7fe0440cf720 2023-07-11T00:31:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.643+0000 7fe0493ff700 1 -- 172.21.15.22:0/4167201953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0440c9c50 con 0x7fe0440cf720 2023-07-11T00:31:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.643+0000 7fe02b7fe700 1 -- 172.21.15.22:0/4167201953 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0340036a0 con 0x7fe0440cf720 2023-07-11T00:31:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.643+0000 7fe0493ff700 1 -- 172.21.15.22:0/4167201953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0440ca210 con 0x7fe0440cf720 2023-07-11T00:31:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.644+0000 7fe0493ff700 1 -- 172.21.15.22:0/4167201953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0440ca860 con 0x7fe0440cf720 2023-07-11T00:31:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.645+0000 7fe02b7fe700 1 -- 172.21.15.22:0/4167201953 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe034003800 con 0x7fe0440cf720 2023-07-11T00:31:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.646+0000 7fe02b7fe700 1 --2- 172.21.15.22:0/4167201953 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe03006ace0 0x7fe03006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.646+0000 7fe02b7fe700 1 -- 172.21.15.22:0/4167201953 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe034088c10 con 0x7fe0440cf720 2023-07-11T00:31:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.647+0000 7fe0427fc700 1 --2- 172.21.15.22:0/4167201953 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe03006ace0 0x7fe03006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.648+0000 7fe0427fc700 1 --2- 172.21.15.22:0/4167201953 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe03006ace0 0x7fe03006d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe038014040 tx=0x7fe038008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:42.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.651+0000 7fe02b7fe700 1 -- 172.21.15.22:0/4167201953 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe034053ec0 con 0x7fe0440cf720 2023-07-11T00:31:42.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.935+0000 7fe0493ff700 1 -- 172.21.15.22:0/4167201953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fe04404ea60 con 0x7fe0440cf720 2023-07-11T00:31:42.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.939+0000 7fe02b7fe700 1 -- 172.21.15.22:0/4167201953 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe0340574e0 con 0x7fe0440cf720 2023-07-11T00:31:42.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.941+0000 7fe0493ff700 1 -- 172.21.15.22:0/4167201953 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe03006ace0 msgr2=0x7fe03006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:42.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.941+0000 7fe0493ff700 1 --2- 172.21.15.22:0/4167201953 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe03006ace0 0x7fe03006d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe038014040 tx=0x7fe038008030 comp rx=0 tx=0).stop 2023-07-11T00:31:42.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.941+0000 7fe0493ff700 1 -- 172.21.15.22:0/4167201953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0440cf720 msgr2=0x7fe0440cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:42.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.941+0000 7fe0493ff700 1 --2- 172.21.15.22:0/4167201953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0440cf720 0x7fe0440cc610 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe03400e810 tx=0x7fe03400eb20 comp rx=0 tx=0).stop 2023-07-11T00:31:42.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.941+0000 7fe0493ff700 1 -- 172.21.15.22:0/4167201953 shutdown_connections 2023-07-11T00:31:42.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.941+0000 7fe0493ff700 1 --2- 172.21.15.22:0/4167201953 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe03006ace0 0x7fe03006d190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.941+0000 7fe0493ff700 1 --2- 172.21.15.22:0/4167201953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe04415c460 0x7fe0441523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.941+0000 7fe0493ff700 1 --2- 172.21.15.22:0/4167201953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0440cf720 0x7fe0440cc610 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.941+0000 7fe0493ff700 1 --2- 172.21.15.22:0/4167201953 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0440d2640 0x7fe0441e6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:42.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.941+0000 7fe0493ff700 1 -- 172.21.15.22:0/4167201953 >> 172.21.15.22:0/4167201953 conn(0x7fe044071660 msgr2=0x7fe0440b63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:42.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.942+0000 7fe0493ff700 1 -- 172.21.15.22:0/4167201953 shutdown_connections 2023-07-11T00:31:42.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:42.942+0000 7fe0493ff700 1 -- 172.21.15.22:0/4167201953 wait complete. 2023-07-11T00:31:42.961 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-11T00:31:43.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.163+0000 7efe707ff700 1 Processor -- start 2023-07-11T00:31:43.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.163+0000 7efe707ff700 1 -- start start 2023-07-11T00:31:43.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe707ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efe680d2640 0x7efe680b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:43.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe707ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe680cf8f0 0x7efe6815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:43.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe707ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe680d1790 con 0x7efe6815c460 2023-07-11T00:31:43.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe707ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe680cedd0 con 0x7efe680d2640 2023-07-11T00:31:43.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe707ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe680cd950 con 0x7efe680cf8f0 2023-07-11T00:31:43.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6e59b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efe6815c460 0x7efe680cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46912/0 (socket says 172.21.15.22:46912) 2023-07-11T00:31:43.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6e59b700 1 -- 172.21.15.22:0/1331937852 learned_addr learned my addr 172.21.15.22:0/1331937852 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6ed9c700 1 --2- 172.21.15.22:0/1331937852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe680cf8f0 0x7efe6815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6dd9a700 1 --2- 172.21.15.22:0/1331937852 >> v2:172.21.15.184:3300/0 conn(0x7efe680d2640 0x7efe680b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6d599700 1 -- 172.21.15.22:0/1331937852 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849099148 0 0) 0x7efe680d1790 con 0x7efe6815c460 2023-07-11T00:31:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6d599700 1 -- 172.21.15.22:0/1331937852 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe540035b0 con 0x7efe6815c460 2023-07-11T00:31:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6d599700 1 -- 172.21.15.22:0/1331937852 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1750216258 0 0) 0x7efe540035b0 con 0x7efe6815c460 2023-07-11T00:31:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6d599700 1 -- 172.21.15.22:0/1331937852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe680cf8f0 msgr2=0x7efe6815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6d599700 1 --2- 172.21.15.22:0/1331937852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe680cf8f0 0x7efe6815fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6d599700 1 -- 172.21.15.22:0/1331937852 >> v2:172.21.15.184:3300/0 conn(0x7efe680d2640 msgr2=0x7efe680b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6d599700 1 --2- 172.21.15.22:0/1331937852 >> v2:172.21.15.184:3300/0 conn(0x7efe680d2640 0x7efe680b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6d599700 1 -- 172.21.15.22:0/1331937852 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe680d14b0 con 0x7efe6815c460 2023-07-11T00:31:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6d599700 1 -- 172.21.15.22:0/1331937852 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7efe64001670 con 0x7efe6815c460 2023-07-11T00:31:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6d599700 1 -- 172.21.15.22:0/1331937852 >> v1:172.21.15.22:6789/0 conn(0x7efe6815c460 legacy=0x7efe680cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6d599700 1 --2- 172.21.15.22:0/1331937852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe54003a00 0x7efe54003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6d599700 1 --2- 172.21.15.22:0/1331937852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe54004850 0x7efe54004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:43.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6d599700 1 --2- 172.21.15.22:0/1331937852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe680cf8f0 0x7efe54005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:43.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6d599700 1 -- 172.21.15.22:0/1331937852 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe680cedd0 con 0x7efe54003a00 2023-07-11T00:31:43.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6d599700 1 -- 172.21.15.22:0/1331937852 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe680cd950 con 0x7efe54004850 2023-07-11T00:31:43.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6d599700 1 -- 172.21.15.22:0/1331937852 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5400baf0 con 0x7efe680cf8f0 2023-07-11T00:31:43.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6e59b700 1 --2- 172.21.15.22:0/1331937852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe54003a00 0x7efe54003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:43.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6ed9c700 1 --2- 172.21.15.22:0/1331937852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe680cf8f0 0x7efe54005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:43.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.165+0000 7efe6dd9a700 1 --2- 172.21.15.22:0/1331937852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe54004850 0x7efe54004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:43.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.166+0000 7efe6e59b700 1 -- 172.21.15.22:0/1331937852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe680cf8f0 msgr2=0x7efe54005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:43.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.166+0000 7efe6e59b700 1 --2- 172.21.15.22:0/1331937852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe680cf8f0 0x7efe54005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:43.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.166+0000 7efe6e59b700 1 -- 172.21.15.22:0/1331937852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe54004850 msgr2=0x7efe54004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:43.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.166+0000 7efe6e59b700 1 --2- 172.21.15.22:0/1331937852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe54004850 0x7efe54004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:43.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.166+0000 7efe6e59b700 1 -- 172.21.15.22:0/1331937852 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe540035b0 con 0x7efe54003a00 2023-07-11T00:31:43.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.166+0000 7efe6dd9a700 1 --2- 172.21.15.22:0/1331937852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe54004850 0x7efe54004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:43.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.166+0000 7efe6e59b700 1 --2- 172.21.15.22:0/1331937852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe54003a00 0x7efe54003e10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7efe6400c210 tx=0x7efe54005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba48092cb5be5b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.166+0000 7efe6d599700 1 -- 172.21.15.22:0/1331937852 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6400ccf0 con 0x7efe54003a00 2023-07-11T00:31:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.166+0000 7efe6d599700 1 -- 172.21.15.22:0/1331937852 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6400ce50 con 0x7efe54003a00 2023-07-11T00:31:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.166+0000 7efe6d599700 1 -- 172.21.15.22:0/1331937852 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64005ba0 con 0x7efe54003a00 2023-07-11T00:31:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.167+0000 7efe707ff700 1 -- 172.21.15.22:0/1331937852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe54003a00 msgr2=0x7efe54003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.167+0000 7efe707ff700 1 --2- 172.21.15.22:0/1331937852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe54003a00 0x7efe54003e10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7efe6400c210 tx=0x7efe54005880 comp rx=0 tx=0).stop 2023-07-11T00:31:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.167+0000 7efe6ed9c700 1 -- 172.21.15.22:0/1331937852 reap_dead start 2023-07-11T00:31:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.167+0000 7efe707ff700 1 -- 172.21.15.22:0/1331937852 shutdown_connections 2023-07-11T00:31:43.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.167+0000 7efe707ff700 1 -- 172.21.15.22:0/1331937852 >> 172.21.15.22:0/1331937852 conn(0x7efe68071660 msgr2=0x7efe68071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:43.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.167+0000 7efe707ff700 1 -- 172.21.15.22:0/1331937852 shutdown_connections 2023-07-11T00:31:43.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.167+0000 7efe707ff700 1 -- 172.21.15.22:0/1331937852 wait complete. 2023-07-11T00:31:43.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.169+0000 7efe707ff700 1 Processor -- start 2023-07-11T00:31:43.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.169+0000 7efe707ff700 1 -- start start 2023-07-11T00:31:43.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.170+0000 7efe707ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe54003a00 0x7efe680c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:43.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.170+0000 7efe707ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe681598c0 0x7efe6814dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:43.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.170+0000 7efe707ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe68159fd0 0x7efe6815a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:43.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.170+0000 7efe707ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6815a980 con 0x7efe54003a00 2023-07-11T00:31:43.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.170+0000 7efe707ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe680cb100 con 0x7efe681598c0 2023-07-11T00:31:43.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.170+0000 7efe707ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe680ca4f0 con 0x7efe68159fd0 2023-07-11T00:31:43.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.170+0000 7efe6e59b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe54003a00 0x7efe680c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:43.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.170+0000 7efe6e59b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe54003a00 0x7efe680c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55108/0 (socket says 172.21.15.22:55108) 2023-07-11T00:31:43.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.170+0000 7efe6e59b700 1 -- 172.21.15.22:0/104400273 learned_addr learned my addr 172.21.15.22:0/104400273 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:43.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.170+0000 7efe6dd9a700 1 --2- 172.21.15.22:0/104400273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe681598c0 0x7efe6814dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:43.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.170+0000 7efe6ed9c700 1 --2- 172.21.15.22:0/104400273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe68159fd0 0x7efe6815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:43.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.170+0000 7efe6e59b700 1 -- 172.21.15.22:0/104400273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe68159fd0 msgr2=0x7efe6815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:43.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.170+0000 7efe6e59b700 1 --2- 172.21.15.22:0/104400273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe68159fd0 0x7efe6815a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:43.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.170+0000 7efe6e59b700 1 -- 172.21.15.22:0/104400273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe681598c0 msgr2=0x7efe6814dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:43.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.170+0000 7efe6e59b700 1 --2- 172.21.15.22:0/104400273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe681598c0 0x7efe6814dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:43.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.170+0000 7efe6e59b700 1 -- 172.21.15.22:0/104400273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe680ca7d0 con 0x7efe54003a00 2023-07-11T00:31:43.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.170+0000 7efe6ed9c700 1 --2- 172.21.15.22:0/104400273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe68159fd0 0x7efe6815a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:43.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.171+0000 7efe6e59b700 1 --2- 172.21.15.22:0/104400273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe54003a00 0x7efe680c9cc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efe6400c800 tx=0x7efe64000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:43.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.171+0000 7efe5effd700 1 -- 172.21.15.22:0/104400273 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe640072d0 con 0x7efe54003a00 2023-07-11T00:31:43.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.171+0000 7efe5effd700 1 -- 172.21.15.22:0/104400273 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe64007450 con 0x7efe54003a00 2023-07-11T00:31:43.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.171+0000 7efe707ff700 1 -- 172.21.15.22:0/104400273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe680caab0 con 0x7efe54003a00 2023-07-11T00:31:43.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.171+0000 7efe5effd700 1 -- 172.21.15.22:0/104400273 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64007800 con 0x7efe54003a00 2023-07-11T00:31:43.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.171+0000 7efe707ff700 1 -- 172.21.15.22:0/104400273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe680ca200 con 0x7efe54003a00 2023-07-11T00:31:43.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.172+0000 7efe707ff700 1 -- 172.21.15.22:0/104400273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6804ea60 con 0x7efe54003a00 2023-07-11T00:31:43.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.173+0000 7efe5effd700 1 -- 172.21.15.22:0/104400273 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe6401e430 con 0x7efe54003a00 2023-07-11T00:31:43.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.175+0000 7efe5effd700 1 --2- 172.21.15.22:0/104400273 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efe4c06ace0 0x7efe4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:43.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.175+0000 7efe5effd700 1 -- 172.21.15.22:0/104400273 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5530+0+0 (secure 0 0 0) 0x7efe6408aac0 con 0x7efe54003a00 2023-07-11T00:31:43.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.175+0000 7efe6dd9a700 1 --2- 172.21.15.22:0/104400273 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efe4c06ace0 0x7efe4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:43.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.175+0000 7efe6dd9a700 1 --2- 172.21.15.22:0/104400273 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efe4c06ace0 0x7efe4c06d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efe680cbaa0 tx=0x7efe58008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:43.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.178+0000 7efe5effd700 1 -- 172.21.15.22:0/104400273 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7efe64055d70 con 0x7efe54003a00 2023-07-11T00:31:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.469+0000 7efe707ff700 1 -- 172.21.15.22:0/104400273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7efe680cceb0 con 0x7efe54003a00 2023-07-11T00:31:43.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.471+0000 7efe5effd700 1 -- 172.21.15.22:0/104400273 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7efe64059390 con 0x7efe54003a00 2023-07-11T00:31:43.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.474+0000 7efe707ff700 1 -- 172.21.15.22:0/104400273 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efe4c06ace0 msgr2=0x7efe4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:43.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.474+0000 7efe707ff700 1 --2- 172.21.15.22:0/104400273 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efe4c06ace0 0x7efe4c06d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efe680cbaa0 tx=0x7efe58008040 comp rx=0 tx=0).stop 2023-07-11T00:31:43.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.474+0000 7efe707ff700 1 -- 172.21.15.22:0/104400273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe54003a00 msgr2=0x7efe680c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:43.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.474+0000 7efe707ff700 1 --2- 172.21.15.22:0/104400273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe54003a00 0x7efe680c9cc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efe6400c800 tx=0x7efe64000fe0 comp rx=0 tx=0).stop 2023-07-11T00:31:43.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.475+0000 7efe707ff700 1 -- 172.21.15.22:0/104400273 shutdown_connections 2023-07-11T00:31:43.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.475+0000 7efe707ff700 1 --2- 172.21.15.22:0/104400273 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7efe4c06ace0 0x7efe4c06d190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:43.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.475+0000 7efe707ff700 1 --2- 172.21.15.22:0/104400273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe68159fd0 0x7efe6815a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:43.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.475+0000 7efe707ff700 1 --2- 172.21.15.22:0/104400273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe54003a00 0x7efe680c9cc0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:43.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.475+0000 7efe707ff700 1 --2- 172.21.15.22:0/104400273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe681598c0 0x7efe6814dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:43.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.475+0000 7efe707ff700 1 -- 172.21.15.22:0/104400273 >> 172.21.15.22:0/104400273 conn(0x7efe68071660 msgr2=0x7efe6815c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:43.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.475+0000 7efe707ff700 1 -- 172.21.15.22:0/104400273 shutdown_connections 2023-07-11T00:31:43.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.475+0000 7efe707ff700 1 -- 172.21.15.22:0/104400273 wait complete. 2023-07-11T00:31:43.494 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-11T00:31:43.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.695+0000 7f791d5ff700 1 Processor -- start 2023-07-11T00:31:43.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.695+0000 7f791d5ff700 1 -- start start 2023-07-11T00:31:43.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.697+0000 7f791d5ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f791815c460 0x7f79180b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:43.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.697+0000 7f791d5ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79180d1790 con 0x7f79180cf8f0 2023-07-11T00:31:43.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.697+0000 7f791d5ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79180cd950 con 0x7f79180d2640 2023-07-11T00:31:43.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.697+0000 7f791d5ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79180cedd0 con 0x7f791815c460 2023-07-11T00:31:43.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.697+0000 7f7916ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f791815c460 0x7f79180b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:43.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.697+0000 7f79177fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f79180cf8f0 0x7f791815fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46924/0 (socket says 172.21.15.22:46924) 2023-07-11T00:31:43.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.697+0000 7f79177fe700 1 -- 172.21.15.22:0/248851860 learned_addr learned my addr 172.21.15.22:0/248851860 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:43.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.697+0000 7f7915ffb700 1 -- 172.21.15.22:0/248851860 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384529660 0 0) 0x7f79180d1790 con 0x7f79180cf8f0 2023-07-11T00:31:43.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.697+0000 7f7915ffb700 1 -- 172.21.15.22:0/248851860 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79000035b0 con 0x7f79180cf8f0 2023-07-11T00:31:43.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.697+0000 7f7916ffd700 1 -- 172.21.15.22:0/248851860 >> v1:172.21.15.184:6789/0 conn(0x7f79180d2640 legacy=0x7f79180cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:43.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.698+0000 7f7916ffd700 1 -- 172.21.15.22:0/248851860 >> v1:172.21.15.22:6789/0 conn(0x7f79180cf8f0 legacy=0x7f791815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:43.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.698+0000 7f7916ffd700 1 -- 172.21.15.22:0/248851860 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79180d14b0 con 0x7f791815c460 2023-07-11T00:31:43.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.698+0000 7f7916ffd700 1 --2- 172.21.15.22:0/248851860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f791815c460 0x7f79180b59d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7908009840 tx=0x7f7908009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2551e322b0e6f90d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:43.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.698+0000 7f7915ffb700 1 -- 172.21.15.22:0/248851860 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908011830 con 0x7f791815c460 2023-07-11T00:31:43.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.698+0000 7f7915ffb700 1 -- 172.21.15.22:0/248851860 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7908011990 con 0x7f791815c460 2023-07-11T00:31:43.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.698+0000 7f7915ffb700 1 -- 172.21.15.22:0/248851860 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908011d20 con 0x7f791815c460 2023-07-11T00:31:43.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.699+0000 7f791d5ff700 1 -- 172.21.15.22:0/248851860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f791815c460 msgr2=0x7f79180b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:43.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.699+0000 7f791d5ff700 1 --2- 172.21.15.22:0/248851860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f791815c460 0x7f79180b59d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7908009840 tx=0x7f7908009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:43.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.699+0000 7f791d5ff700 1 -- 172.21.15.22:0/248851860 shutdown_connections 2023-07-11T00:31:43.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.699+0000 7f791d5ff700 1 --2- 172.21.15.22:0/248851860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f791815c460 0x7f79180b59d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:43.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.699+0000 7f791d5ff700 1 -- 172.21.15.22:0/248851860 >> 172.21.15.22:0/248851860 conn(0x7f7918071660 msgr2=0x7f7918071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:43.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.699+0000 7f791d5ff700 1 -- 172.21.15.22:0/248851860 shutdown_connections 2023-07-11T00:31:43.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.699+0000 7f791d5ff700 1 -- 172.21.15.22:0/248851860 wait complete. 2023-07-11T00:31:43.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.701+0000 7f791d5ff700 1 Processor -- start 2023-07-11T00:31:43.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.701+0000 7f791d5ff700 1 -- start start 2023-07-11T00:31:43.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.702+0000 7f791d5ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79180cf8f0 0x7f79181523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:43.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.702+0000 7f791d5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79180d2640 0x7f79180cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:43.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.702+0000 7f791d5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f791815c460 0x7f79180cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:43.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.702+0000 7f791d5ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79180cad90 con 0x7f79180cf8f0 2023-07-11T00:31:43.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.702+0000 7f791d5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79180c9cf0 con 0x7f791815c460 2023-07-11T00:31:43.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.702+0000 7f791d5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79180c9fd0 con 0x7f79180d2640 2023-07-11T00:31:43.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.702+0000 7f7916ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79180cf8f0 0x7f79181523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:43.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.702+0000 7f7916ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79180cf8f0 0x7f79181523a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55134/0 (socket says 172.21.15.22:55134) 2023-07-11T00:31:43.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.702+0000 7f7916ffd700 1 -- 172.21.15.22:0/2739456402 learned_addr learned my addr 172.21.15.22:0/2739456402 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:43.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.702+0000 7f79167fc700 1 --2- 172.21.15.22:0/2739456402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79180d2640 0x7f79180cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:43.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.702+0000 7f79177fe700 1 --2- 172.21.15.22:0/2739456402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f791815c460 0x7f79180cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:43.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.702+0000 7f7916ffd700 1 -- 172.21.15.22:0/2739456402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79180d2640 msgr2=0x7f79180cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:43.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.702+0000 7f7916ffd700 1 --2- 172.21.15.22:0/2739456402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79180d2640 0x7f79180cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:43.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.702+0000 7f7916ffd700 1 -- 172.21.15.22:0/2739456402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f791815c460 msgr2=0x7f79180cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:43.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.702+0000 7f7916ffd700 1 --2- 172.21.15.22:0/2739456402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f791815c460 0x7f79180cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:43.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.702+0000 7f7916ffd700 1 -- 172.21.15.22:0/2739456402 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79080094a0 con 0x7f79180cf8f0 2023-07-11T00:31:43.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.703+0000 7f7916ffd700 1 --2- 172.21.15.22:0/2739456402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79180cf8f0 0x7f79181523a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7908009fd0 tx=0x7f7908004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:43.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.703+0000 7f78ff7fe700 1 -- 172.21.15.22:0/2739456402 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080038a0 con 0x7f79180cf8f0 2023-07-11T00:31:43.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.703+0000 7f78ff7fe700 1 -- 172.21.15.22:0/2739456402 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790801f070 con 0x7f79180cf8f0 2023-07-11T00:31:43.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.703+0000 7f78ff7fe700 1 -- 172.21.15.22:0/2739456402 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908003c40 con 0x7f79180cf8f0 2023-07-11T00:31:43.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.703+0000 7f791d5ff700 1 -- 172.21.15.22:0/2739456402 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79180ca2b0 con 0x7f79180cf8f0 2023-07-11T00:31:43.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.703+0000 7f791d5ff700 1 -- 172.21.15.22:0/2739456402 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79180ca870 con 0x7f79180cf8f0 2023-07-11T00:31:43.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.704+0000 7f791d5ff700 1 -- 172.21.15.22:0/2739456402 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f791804ea60 con 0x7f79180cf8f0 2023-07-11T00:31:43.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.705+0000 7f78ff7fe700 1 -- 172.21.15.22:0/2739456402 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7908026480 con 0x7f79180cf8f0 2023-07-11T00:31:43.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.706+0000 7f78ff7fe700 1 --2- 172.21.15.22:0/2739456402 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f790406ace0 0x7f790406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:43.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.706+0000 7f78ff7fe700 1 -- 172.21.15.22:0/2739456402 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7908021070 con 0x7f79180cf8f0 2023-07-11T00:31:43.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.707+0000 7f79167fc700 1 --2- 172.21.15.22:0/2739456402 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f790406ace0 0x7f790406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:43.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.707+0000 7f79167fc700 1 --2- 172.21.15.22:0/2739456402 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f790406ace0 0x7f790406d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f79180cfe40 tx=0x7f790c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:43.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.710+0000 7f78ff7fe700 1 -- 172.21.15.22:0/2739456402 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7908055ed0 con 0x7f79180cf8f0 2023-07-11T00:31:44.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:43.999+0000 7f791d5ff700 1 -- 172.21.15.22:0/2739456402 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f79180b4fa0 con 0x7f79180cf8f0 2023-07-11T00:31:44.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.003+0000 7f78ff7fe700 1 -- 172.21.15.22:0/2739456402 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f79080150a0 con 0x7f79180cf8f0 2023-07-11T00:31:44.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.005+0000 7f791d5ff700 1 -- 172.21.15.22:0/2739456402 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f790406ace0 msgr2=0x7f790406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:44.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.005+0000 7f791d5ff700 1 --2- 172.21.15.22:0/2739456402 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f790406ace0 0x7f790406d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f79180cfe40 tx=0x7f790c009040 comp rx=0 tx=0).stop 2023-07-11T00:31:44.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.005+0000 7f791d5ff700 1 -- 172.21.15.22:0/2739456402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79180cf8f0 msgr2=0x7f79181523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:44.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.005+0000 7f791d5ff700 1 --2- 172.21.15.22:0/2739456402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79180cf8f0 0x7f79181523a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7908009fd0 tx=0x7f7908004750 comp rx=0 tx=0).stop 2023-07-11T00:31:44.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.005+0000 7f791d5ff700 1 -- 172.21.15.22:0/2739456402 shutdown_connections 2023-07-11T00:31:44.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.005+0000 7f791d5ff700 1 --2- 172.21.15.22:0/2739456402 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f790406ace0 0x7f790406d190 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:44.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.005+0000 7f791d5ff700 1 --2- 172.21.15.22:0/2739456402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f791815c460 0x7f79180cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:44.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.005+0000 7f791d5ff700 1 --2- 172.21.15.22:0/2739456402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f79180cf8f0 0x7f79181523a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:44.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.005+0000 7f791d5ff700 1 --2- 172.21.15.22:0/2739456402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79180d2640 0x7f79180cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:44.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.005+0000 7f791d5ff700 1 -- 172.21.15.22:0/2739456402 >> 172.21.15.22:0/2739456402 conn(0x7f7918071660 msgr2=0x7f791806b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:44.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.005+0000 7f791d5ff700 1 -- 172.21.15.22:0/2739456402 shutdown_connections 2023-07-11T00:31:44.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.006+0000 7f791d5ff700 1 -- 172.21.15.22:0/2739456402 wait complete. 2023-07-11T00:31:44.025 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-11T00:31:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.227+0000 7f7865dff700 1 Processor -- start 2023-07-11T00:31:44.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.227+0000 7f7865dff700 1 -- start start 2023-07-11T00:31:44.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.228+0000 7f7865dff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f786015c460 0x7f78600b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:44.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.228+0000 7f7865dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78600cf8f0 0x7f786015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:44.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.228+0000 7f7865dff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78600d1790 con 0x7f78600d2640 2023-07-11T00:31:44.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.228+0000 7f7865dff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78600cedd0 con 0x7f786015c460 2023-07-11T00:31:44.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.228+0000 7f7865dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78600cd950 con 0x7f78600cf8f0 2023-07-11T00:31:44.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.229+0000 7f785f7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f786015c460 0x7f78600b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:44.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.229+0000 7f785effd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f78600d2640 0x7f78600cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46940/0 (socket says 172.21.15.22:46940) 2023-07-11T00:31:44.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.229+0000 7f785effd700 1 -- 172.21.15.22:0/3810080968 learned_addr learned my addr 172.21.15.22:0/3810080968 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:44.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.229+0000 7f785ffff700 1 --2- 172.21.15.22:0/3810080968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78600cf8f0 0x7f786015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:44.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.229+0000 7f785f7fe700 1 -- 172.21.15.22:0/3810080968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78600cf8f0 msgr2=0x7f786015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:44.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.229+0000 7f785f7fe700 1 --2- 172.21.15.22:0/3810080968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78600cf8f0 0x7f786015fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:44.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.229+0000 7f785e7fc700 1 -- 172.21.15.22:0/3810080968 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484564178 0 0) 0x7f78600d1790 con 0x7f78600d2640 2023-07-11T00:31:44.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.229+0000 7f785f7fe700 1 -- 172.21.15.22:0/3810080968 >> v1:172.21.15.22:6789/0 conn(0x7f78600d2640 legacy=0x7f78600cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:44.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.229+0000 7f785f7fe700 1 -- 172.21.15.22:0/3810080968 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78600d14b0 con 0x7f786015c460 2023-07-11T00:31:44.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.229+0000 7f785f7fe700 1 --2- 172.21.15.22:0/3810080968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786015c460 0x7f78600b59d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7850009840 tx=0x7f7850009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9656d258e2bebe7b server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:44.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.230+0000 7f785e7fc700 1 -- 172.21.15.22:0/3810080968 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7850011830 con 0x7f786015c460 2023-07-11T00:31:44.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.230+0000 7f785e7fc700 1 -- 172.21.15.22:0/3810080968 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7850011990 con 0x7f786015c460 2023-07-11T00:31:44.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.230+0000 7f785e7fc700 1 -- 172.21.15.22:0/3810080968 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7850011d20 con 0x7f786015c460 2023-07-11T00:31:44.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.230+0000 7f7865dff700 1 -- 172.21.15.22:0/3810080968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786015c460 msgr2=0x7f78600b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:44.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.230+0000 7f7865dff700 1 --2- 172.21.15.22:0/3810080968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786015c460 0x7f78600b59d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7850009840 tx=0x7f7850009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:44.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.230+0000 7f7865dff700 1 -- 172.21.15.22:0/3810080968 shutdown_connections 2023-07-11T00:31:44.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.230+0000 7f7865dff700 1 --2- 172.21.15.22:0/3810080968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78600cf8f0 0x7f786015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:44.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.230+0000 7f7865dff700 1 --2- 172.21.15.22:0/3810080968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786015c460 0x7f78600b59d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:44.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.230+0000 7f7865dff700 1 -- 172.21.15.22:0/3810080968 >> 172.21.15.22:0/3810080968 conn(0x7f7860071660 msgr2=0x7f7860071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:44.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.230+0000 7f7865dff700 1 -- 172.21.15.22:0/3810080968 shutdown_connections 2023-07-11T00:31:44.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.230+0000 7f7865dff700 1 -- 172.21.15.22:0/3810080968 wait complete. 2023-07-11T00:31:44.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.232+0000 7f7865dff700 1 Processor -- start 2023-07-11T00:31:44.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.232+0000 7f7865dff700 1 -- start start 2023-07-11T00:31:44.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.233+0000 7f7865dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78600cf8f0 0x7f78600cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:44.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.233+0000 7f7865dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78600d2640 0x7f78601579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:44.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.233+0000 7f7865dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786015c460 0x7f7860157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:44.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.233+0000 7f7865dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7860158450 con 0x7f786015c460 2023-07-11T00:31:44.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.233+0000 7f7865dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78600c7fb0 con 0x7f78600cf8f0 2023-07-11T00:31:44.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.233+0000 7f7865dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78600c9cf0 con 0x7f78600d2640 2023-07-11T00:31:44.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.233+0000 7f785ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786015c460 0x7f7860157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:44.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.233+0000 7f785ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786015c460 0x7f7860157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55150/0 (socket says 172.21.15.22:55150) 2023-07-11T00:31:44.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.233+0000 7f785ffff700 1 -- 172.21.15.22:0/2320837662 learned_addr learned my addr 172.21.15.22:0/2320837662 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:44.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.233+0000 7f785effd700 1 --2- 172.21.15.22:0/2320837662 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78600d2640 0x7f78601579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:44.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.234+0000 7f785f7fe700 1 --2- 172.21.15.22:0/2320837662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78600cf8f0 0x7f78600cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:44.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.234+0000 7f785ffff700 1 -- 172.21.15.22:0/2320837662 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78600d2640 msgr2=0x7f78601579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:44.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.234+0000 7f785ffff700 1 --2- 172.21.15.22:0/2320837662 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78600d2640 0x7f78601579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:44.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.234+0000 7f785ffff700 1 -- 172.21.15.22:0/2320837662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78600cf8f0 msgr2=0x7f78600cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:44.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.234+0000 7f785ffff700 1 --2- 172.21.15.22:0/2320837662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78600cf8f0 0x7f78600cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:44.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.234+0000 7f785ffff700 1 -- 172.21.15.22:0/2320837662 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78500094a0 con 0x7f786015c460 2023-07-11T00:31:44.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.234+0000 7f785ffff700 1 --2- 172.21.15.22:0/2320837662 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786015c460 0x7f7860157f10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7858007e60 tx=0x7f785800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:44.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.234+0000 7f7847fff700 1 -- 172.21.15.22:0/2320837662 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785800ed30 con 0x7f786015c460 2023-07-11T00:31:44.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.234+0000 7f7847fff700 1 -- 172.21.15.22:0/2320837662 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7858014420 con 0x7f786015c460 2023-07-11T00:31:44.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.234+0000 7f7847fff700 1 -- 172.21.15.22:0/2320837662 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78580147d0 con 0x7f786015c460 2023-07-11T00:31:44.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.234+0000 7f7865dff700 1 -- 172.21.15.22:0/2320837662 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78600c9fd0 con 0x7f786015c460 2023-07-11T00:31:44.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.235+0000 7f7865dff700 1 -- 172.21.15.22:0/2320837662 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78600ca590 con 0x7f786015c460 2023-07-11T00:31:44.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.236+0000 7f7865dff700 1 -- 172.21.15.22:0/2320837662 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78600ca720 con 0x7f786015c460 2023-07-11T00:31:44.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.237+0000 7f7847fff700 1 -- 172.21.15.22:0/2320837662 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7858014930 con 0x7f786015c460 2023-07-11T00:31:44.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.238+0000 7f7847fff700 1 --2- 172.21.15.22:0/2320837662 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f784c06ace0 0x7f784c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:44.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.238+0000 7f7847fff700 1 -- 172.21.15.22:0/2320837662 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7858089990 con 0x7f786015c460 2023-07-11T00:31:44.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.238+0000 7f785f7fe700 1 --2- 172.21.15.22:0/2320837662 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f784c06ace0 0x7f784c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:44.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.239+0000 7f785f7fe700 1 --2- 172.21.15.22:0/2320837662 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f784c06ace0 0x7f784c06d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f78500090b0 tx=0x7f785001c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:44.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.242+0000 7f7847fff700 1 -- 172.21.15.22:0/2320837662 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7858054c60 con 0x7f786015c460 2023-07-11T00:31:44.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.538+0000 7f7865dff700 1 -- 172.21.15.22:0/2320837662 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f786004ea60 con 0x7f786015c460 2023-07-11T00:31:44.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.542+0000 7f7847fff700 1 -- 172.21.15.22:0/2320837662 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7858058280 con 0x7f786015c460 2023-07-11T00:31:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.545+0000 7f7865dff700 1 -- 172.21.15.22:0/2320837662 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f784c06ace0 msgr2=0x7f784c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.545+0000 7f7865dff700 1 --2- 172.21.15.22:0/2320837662 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f784c06ace0 0x7f784c06d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f78500090b0 tx=0x7f785001c040 comp rx=0 tx=0).stop 2023-07-11T00:31:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.545+0000 7f7865dff700 1 -- 172.21.15.22:0/2320837662 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786015c460 msgr2=0x7f7860157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:44.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.545+0000 7f7865dff700 1 --2- 172.21.15.22:0/2320837662 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786015c460 0x7f7860157f10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7858007e60 tx=0x7f785800e3c0 comp rx=0 tx=0).stop 2023-07-11T00:31:44.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.545+0000 7f7865dff700 1 -- 172.21.15.22:0/2320837662 shutdown_connections 2023-07-11T00:31:44.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.545+0000 7f7865dff700 1 --2- 172.21.15.22:0/2320837662 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f784c06ace0 0x7f784c06d190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:44.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.545+0000 7f7865dff700 1 --2- 172.21.15.22:0/2320837662 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786015c460 0x7f7860157f10 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:44.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.545+0000 7f7865dff700 1 --2- 172.21.15.22:0/2320837662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78600cf8f0 0x7f78600cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:44.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.545+0000 7f7865dff700 1 --2- 172.21.15.22:0/2320837662 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78600d2640 0x7f78601579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:44.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.545+0000 7f7865dff700 1 -- 172.21.15.22:0/2320837662 >> 172.21.15.22:0/2320837662 conn(0x7f7860071660 msgr2=0x7f786015c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:44.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.545+0000 7f7865dff700 1 -- 172.21.15.22:0/2320837662 shutdown_connections 2023-07-11T00:31:44.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.545+0000 7f7865dff700 1 -- 172.21.15.22:0/2320837662 wait complete. 2023-07-11T00:31:44.564 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-11T00:31:44.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.765+0000 7f058d9ff700 1 Processor -- start 2023-07-11T00:31:44.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.765+0000 7f058d9ff700 1 -- start start 2023-07-11T00:31:44.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.766+0000 7f058d9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05880b59d0 0x7f05881671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:44.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.766+0000 7f058d9ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05880d1790 con 0x7f05880d2640 2023-07-11T00:31:44.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.766+0000 7f058d9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05880cd950 con 0x7f058815c460 2023-07-11T00:31:44.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.766+0000 7f058d9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05880cedd0 con 0x7f05880b59d0 2023-07-11T00:31:44.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.766+0000 7f05867fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f05880d2640 0x7f05880cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46946/0 (socket says 172.21.15.22:46946) 2023-07-11T00:31:44.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.766+0000 7f05867fc700 1 -- 172.21.15.22:0/3826870726 learned_addr learned my addr 172.21.15.22:0/3826870726 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:44.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.767+0000 7f05877fe700 1 --2- 172.21.15.22:0/3826870726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05880b59d0 0x7f05881671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:44.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.767+0000 7f0585ffb700 1 -- 172.21.15.22:0/3826870726 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567985396 0 0) 0x7f05880d1790 con 0x7f05880d2640 2023-07-11T00:31:44.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.767+0000 7f0585ffb700 1 -- 172.21.15.22:0/3826870726 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05700035b0 con 0x7f05880d2640 2023-07-11T00:31:44.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.767+0000 7f0585ffb700 1 -- 172.21.15.22:0/3826870726 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195704833 0 0) 0x7f05880cd950 con 0x7f058815c460 2023-07-11T00:31:44.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.767+0000 7f0585ffb700 1 -- 172.21.15.22:0/3826870726 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05880d1790 con 0x7f058815c460 2023-07-11T00:31:44.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.767+0000 7f05877fe700 1 -- 172.21.15.22:0/3826870726 >> v1:172.21.15.184:6789/0 conn(0x7f058815c460 legacy=0x7f05880cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:44.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.767+0000 7f05877fe700 1 -- 172.21.15.22:0/3826870726 >> v1:172.21.15.22:6789/0 conn(0x7f05880d2640 legacy=0x7f05880cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:44.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.767+0000 7f05877fe700 1 -- 172.21.15.22:0/3826870726 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05880d14b0 con 0x7f05880b59d0 2023-07-11T00:31:44.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.768+0000 7f05877fe700 1 --2- 172.21.15.22:0/3826870726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05880b59d0 0x7f05881671b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0580009dc0 tx=0x7f058000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1956069b583fd717 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:44.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.768+0000 7f0585ffb700 1 -- 172.21.15.22:0/3826870726 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058000e070 con 0x7f05880b59d0 2023-07-11T00:31:44.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.768+0000 7f0585ffb700 1 -- 172.21.15.22:0/3826870726 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058000bb20 con 0x7f05880b59d0 2023-07-11T00:31:44.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.768+0000 7f0585ffb700 1 -- 172.21.15.22:0/3826870726 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058000be90 con 0x7f05880b59d0 2023-07-11T00:31:44.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.768+0000 7f058d9ff700 1 -- 172.21.15.22:0/3826870726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05880b59d0 msgr2=0x7f05881671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:44.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.768+0000 7f058d9ff700 1 --2- 172.21.15.22:0/3826870726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05880b59d0 0x7f05881671b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0580009dc0 tx=0x7f058000b330 comp rx=0 tx=0).stop 2023-07-11T00:31:44.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.768+0000 7f058d9ff700 1 -- 172.21.15.22:0/3826870726 shutdown_connections 2023-07-11T00:31:44.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.769+0000 7f058d9ff700 1 --2- 172.21.15.22:0/3826870726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05880b59d0 0x7f05881671b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:44.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.769+0000 7f058d9ff700 1 -- 172.21.15.22:0/3826870726 >> 172.21.15.22:0/3826870726 conn(0x7f0588071660 msgr2=0x7f0588071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:44.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.769+0000 7f058d9ff700 1 -- 172.21.15.22:0/3826870726 shutdown_connections 2023-07-11T00:31:44.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.769+0000 7f058d9ff700 1 -- 172.21.15.22:0/3826870726 wait complete. 2023-07-11T00:31:44.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.771+0000 7f058d9ff700 1 Processor -- start 2023-07-11T00:31:44.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.771+0000 7f058d9ff700 1 -- start start 2023-07-11T00:31:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.772+0000 7f058d9ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05880b59d0 0x7f058814db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.772+0000 7f058d9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05880d2640 0x7f058815e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.772+0000 7f058d9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f058815c460 0x7f05881535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.773+0000 7f058d9ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05880c9c50 con 0x7f05880b59d0 2023-07-11T00:31:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.773+0000 7f058d9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05880ca4f0 con 0x7f05880d2640 2023-07-11T00:31:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.773+0000 7f058d9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058815eaa0 con 0x7f058815c460 2023-07-11T00:31:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.773+0000 7f0586ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05880b59d0 0x7f058814db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.773+0000 7f0586ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05880b59d0 0x7f058814db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55156/0 (socket says 172.21.15.22:55156) 2023-07-11T00:31:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.773+0000 7f0586ffd700 1 -- 172.21.15.22:0/3974362719 learned_addr learned my addr 172.21.15.22:0/3974362719 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.773+0000 7f05877fe700 1 --2- 172.21.15.22:0/3974362719 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f058815c460 0x7f05881535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.773+0000 7f05867fc700 1 --2- 172.21.15.22:0/3974362719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05880d2640 0x7f058815e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.773+0000 7f0586ffd700 1 -- 172.21.15.22:0/3974362719 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f058815c460 msgr2=0x7f05881535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.773+0000 7f0586ffd700 1 --2- 172.21.15.22:0/3974362719 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f058815c460 0x7f05881535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.773+0000 7f0586ffd700 1 -- 172.21.15.22:0/3974362719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05880d2640 msgr2=0x7f058815e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.773+0000 7f0586ffd700 1 --2- 172.21.15.22:0/3974362719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05880d2640 0x7f058815e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.773+0000 7f0586ffd700 1 -- 172.21.15.22:0/3974362719 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0580009a70 con 0x7f05880b59d0 2023-07-11T00:31:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.773+0000 7f05867fc700 1 --2- 172.21.15.22:0/3974362719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05880d2640 0x7f058815e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.773+0000 7f0586ffd700 1 --2- 172.21.15.22:0/3974362719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05880b59d0 0x7f058814db80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f057800c530 tx=0x7f057800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.774+0000 7f056ffff700 1 -- 172.21.15.22:0/3974362719 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05780052d0 con 0x7f05880b59d0 2023-07-11T00:31:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.774+0000 7f056ffff700 1 -- 172.21.15.22:0/3974362719 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0578005430 con 0x7f05880b59d0 2023-07-11T00:31:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.774+0000 7f058d9ff700 1 -- 172.21.15.22:0/3974362719 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05880c9ea0 con 0x7f05880b59d0 2023-07-11T00:31:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.774+0000 7f056ffff700 1 -- 172.21.15.22:0/3974362719 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05780038c0 con 0x7f05880b59d0 2023-07-11T00:31:44.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.774+0000 7f058d9ff700 1 -- 172.21.15.22:0/3974362719 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05880ca980 con 0x7f05880b59d0 2023-07-11T00:31:44.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.775+0000 7f058d9ff700 1 -- 172.21.15.22:0/3974362719 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0588066a00 con 0x7f05880b59d0 2023-07-11T00:31:44.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.776+0000 7f056ffff700 1 -- 172.21.15.22:0/3974362719 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0578003a20 con 0x7f05880b59d0 2023-07-11T00:31:44.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.777+0000 7f056ffff700 1 --2- 172.21.15.22:0/3974362719 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f057406ad10 0x7f057406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:44.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.777+0000 7f056ffff700 1 -- 172.21.15.22:0/3974362719 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f05780887d0 con 0x7f05880b59d0 2023-07-11T00:31:44.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.777+0000 7f05867fc700 1 --2- 172.21.15.22:0/3974362719 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f057406ad10 0x7f057406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:44.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.778+0000 7f05867fc700 1 --2- 172.21.15.22:0/3974362719 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f057406ad10 0x7f057406d1c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f05880d32f0 tx=0x7f057c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:44.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:44.781+0000 7f056ffff700 1 -- 172.21.15.22:0/3974362719 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0588066a00 con 0x7f05880b59d0 2023-07-11T00:31:45.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.075+0000 7f058d9ff700 1 -- 172.21.15.22:0/3974362719 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f0588066a00 con 0x7f05880b59d0 2023-07-11T00:31:45.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.078+0000 7f056ffff700 1 -- 172.21.15.22:0/3974362719 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0588066a00 con 0x7f05880b59d0 2023-07-11T00:31:45.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.080+0000 7f058d9ff700 1 -- 172.21.15.22:0/3974362719 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f057406ad10 msgr2=0x7f057406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:45.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.080+0000 7f058d9ff700 1 --2- 172.21.15.22:0/3974362719 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f057406ad10 0x7f057406d1c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f05880d32f0 tx=0x7f057c009040 comp rx=0 tx=0).stop 2023-07-11T00:31:45.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.080+0000 7f058d9ff700 1 -- 172.21.15.22:0/3974362719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05880b59d0 msgr2=0x7f058814db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:45.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.080+0000 7f058d9ff700 1 --2- 172.21.15.22:0/3974362719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05880b59d0 0x7f058814db80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f057800c530 tx=0x7f057800c840 comp rx=0 tx=0).stop 2023-07-11T00:31:45.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.080+0000 7f058d9ff700 1 -- 172.21.15.22:0/3974362719 shutdown_connections 2023-07-11T00:31:45.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.080+0000 7f058d9ff700 1 --2- 172.21.15.22:0/3974362719 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f057406ad10 0x7f057406d1c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.080+0000 7f058d9ff700 1 --2- 172.21.15.22:0/3974362719 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f058815c460 0x7f05881535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.080+0000 7f058d9ff700 1 --2- 172.21.15.22:0/3974362719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05880b59d0 0x7f058814db80 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.080+0000 7f058d9ff700 1 --2- 172.21.15.22:0/3974362719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05880d2640 0x7f058815e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.081+0000 7f058d9ff700 1 -- 172.21.15.22:0/3974362719 >> 172.21.15.22:0/3974362719 conn(0x7f0588071660 msgr2=0x7f05880d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:45.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.081+0000 7f058d9ff700 1 -- 172.21.15.22:0/3974362719 shutdown_connections 2023-07-11T00:31:45.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.081+0000 7f058d9ff700 1 -- 172.21.15.22:0/3974362719 wait complete. 2023-07-11T00:31:45.101 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:31:45.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.301+0000 7fe369dff700 1 Processor -- start 2023-07-11T00:31:45.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.301+0000 7fe369dff700 1 -- start start 2023-07-11T00:31:45.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.303+0000 7fe369dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe36415c460 0x7fe3640b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:45.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.303+0000 7fe369dff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3640d1790 con 0x7fe3640cf8f0 2023-07-11T00:31:45.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.303+0000 7fe369dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3640cd950 con 0x7fe3640d2640 2023-07-11T00:31:45.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.303+0000 7fe369dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640cedd0 con 0x7fe36415c460 2023-07-11T00:31:45.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.303+0000 7fe363fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe3640cf8f0 0x7fe36415fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46950/0 (socket says 172.21.15.22:46950) 2023-07-11T00:31:45.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.303+0000 7fe363fff700 1 -- 172.21.15.22:0/220511516 learned_addr learned my addr 172.21.15.22:0/220511516 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:45.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.303+0000 7fe3637fe700 1 --2- 172.21.15.22:0/220511516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe36415c460 0x7fe3640b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:45.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.303+0000 7fe362ffd700 1 -- 172.21.15.22:0/220511516 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 587875851 0 0) 0x7fe3640d1790 con 0x7fe3640cf8f0 2023-07-11T00:31:45.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.304+0000 7fe362ffd700 1 -- 172.21.15.22:0/220511516 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3500035b0 con 0x7fe3640cf8f0 2023-07-11T00:31:45.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.304+0000 7fe362ffd700 1 -- 172.21.15.22:0/220511516 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773373092 0 0) 0x7fe3640cd950 con 0x7fe3640d2640 2023-07-11T00:31:45.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.304+0000 7fe3637fe700 1 -- 172.21.15.22:0/220511516 >> v1:172.21.15.184:6789/0 conn(0x7fe3640d2640 legacy=0x7fe3640cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:45.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.304+0000 7fe3637fe700 1 -- 172.21.15.22:0/220511516 >> v1:172.21.15.22:6789/0 conn(0x7fe3640cf8f0 legacy=0x7fe36415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:45.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.304+0000 7fe3637fe700 1 -- 172.21.15.22:0/220511516 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3640d14b0 con 0x7fe36415c460 2023-07-11T00:31:45.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.304+0000 7fe3637fe700 1 --2- 172.21.15.22:0/220511516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe36415c460 0x7fe3640b59d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe354009870 tx=0x7fe354009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2ed6014b0cb0826 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:45.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.304+0000 7fe362ffd700 1 -- 172.21.15.22:0/220511516 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354011830 con 0x7fe36415c460 2023-07-11T00:31:45.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.304+0000 7fe362ffd700 1 -- 172.21.15.22:0/220511516 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe354011990 con 0x7fe36415c460 2023-07-11T00:31:45.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.304+0000 7fe362ffd700 1 -- 172.21.15.22:0/220511516 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354011d20 con 0x7fe36415c460 2023-07-11T00:31:45.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.305+0000 7fe369dff700 1 -- 172.21.15.22:0/220511516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe36415c460 msgr2=0x7fe3640b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:45.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.305+0000 7fe369dff700 1 --2- 172.21.15.22:0/220511516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe36415c460 0x7fe3640b59d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe354009870 tx=0x7fe354009b80 comp rx=0 tx=0).stop 2023-07-11T00:31:45.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.305+0000 7fe369dff700 1 -- 172.21.15.22:0/220511516 shutdown_connections 2023-07-11T00:31:45.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.305+0000 7fe369dff700 1 --2- 172.21.15.22:0/220511516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe36415c460 0x7fe3640b59d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.305+0000 7fe369dff700 1 -- 172.21.15.22:0/220511516 >> 172.21.15.22:0/220511516 conn(0x7fe364071660 msgr2=0x7fe364071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:45.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.305+0000 7fe369dff700 1 -- 172.21.15.22:0/220511516 shutdown_connections 2023-07-11T00:31:45.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.305+0000 7fe369dff700 1 -- 172.21.15.22:0/220511516 wait complete. 2023-07-11T00:31:45.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.307+0000 7fe369dff700 1 Processor -- start 2023-07-11T00:31:45.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.307+0000 7fe369dff700 1 -- start start 2023-07-11T00:31:45.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.308+0000 7fe369dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3640cf8f0 0x7fe3640c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:45.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.308+0000 7fe369dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3640d2640 0x7fe364156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:45.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.308+0000 7fe369dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe36415c460 0x7fe364155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:45.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.308+0000 7fe369dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640c72c0 con 0x7fe3640cf8f0 2023-07-11T00:31:45.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.308+0000 7fe369dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640c66b0 con 0x7fe3640d2640 2023-07-11T00:31:45.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.308+0000 7fe369dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640c6990 con 0x7fe36415c460 2023-07-11T00:31:45.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.308+0000 7fe3637fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3640cf8f0 0x7fe3640c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:45.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.308+0000 7fe3637fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3640cf8f0 0x7fe3640c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55162/0 (socket says 172.21.15.22:55162) 2023-07-11T00:31:45.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.308+0000 7fe3637fe700 1 -- 172.21.15.22:0/1253453105 learned_addr learned my addr 172.21.15.22:0/1253453105 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:45.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.308+0000 7fe35bfff700 1 --2- 172.21.15.22:0/1253453105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3640d2640 0x7fe364156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:45.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.308+0000 7fe363fff700 1 --2- 172.21.15.22:0/1253453105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe36415c460 0x7fe364155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:45.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.308+0000 7fe3637fe700 1 -- 172.21.15.22:0/1253453105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe36415c460 msgr2=0x7fe364155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:45.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.308+0000 7fe3637fe700 1 --2- 172.21.15.22:0/1253453105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe36415c460 0x7fe364155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.308+0000 7fe3637fe700 1 -- 172.21.15.22:0/1253453105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3640d2640 msgr2=0x7fe364156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:45.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.308+0000 7fe3637fe700 1 --2- 172.21.15.22:0/1253453105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3640d2640 0x7fe364156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.308+0000 7fe3637fe700 1 -- 172.21.15.22:0/1253453105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3540094a0 con 0x7fe3640cf8f0 2023-07-11T00:31:45.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.308+0000 7fe35bfff700 1 --2- 172.21.15.22:0/1253453105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3640d2640 0x7fe364156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:45.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.309+0000 7fe3637fe700 1 --2- 172.21.15.22:0/1253453105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3640cf8f0 0x7fe3640c9c50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe354009bc0 tx=0x7fe354004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:45.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.309+0000 7fe360ff9700 1 -- 172.21.15.22:0/1253453105 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35401a910 con 0x7fe3640cf8f0 2023-07-11T00:31:45.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.309+0000 7fe360ff9700 1 -- 172.21.15.22:0/1253453105 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35401aa70 con 0x7fe3640cf8f0 2023-07-11T00:31:45.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.309+0000 7fe360ff9700 1 -- 172.21.15.22:0/1253453105 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35401ade0 con 0x7fe3640cf8f0 2023-07-11T00:31:45.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.309+0000 7fe369dff700 1 -- 172.21.15.22:0/1253453105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3640c6c70 con 0x7fe3640cf8f0 2023-07-11T00:31:45.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.309+0000 7fe369dff700 1 -- 172.21.15.22:0/1253453105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe364158190 con 0x7fe3640cf8f0 2023-07-11T00:31:45.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.310+0000 7fe369dff700 1 -- 172.21.15.22:0/1253453105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe36404ea60 con 0x7fe3640cf8f0 2023-07-11T00:31:45.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.311+0000 7fe360ff9700 1 -- 172.21.15.22:0/1253453105 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe354022070 con 0x7fe3640cf8f0 2023-07-11T00:31:45.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.312+0000 7fe360ff9700 1 --2- 172.21.15.22:0/1253453105 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe34406ace0 0x7fe34406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:45.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.312+0000 7fe360ff9700 1 -- 172.21.15.22:0/1253453105 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe354089fe0 con 0x7fe3640cf8f0 2023-07-11T00:31:45.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.312+0000 7fe35bfff700 1 --2- 172.21.15.22:0/1253453105 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe34406ace0 0x7fe34406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:45.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.313+0000 7fe35bfff700 1 --2- 172.21.15.22:0/1253453105 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe34406ace0 0x7fe34406d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe3640b7aa0 tx=0x7fe34c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:45.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.317+0000 7fe360ff9700 1 -- 172.21.15.22:0/1253453105 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe354055380 con 0x7fe3640cf8f0 2023-07-11T00:31:45.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.527+0000 7fe369dff700 1 -- 172.21.15.22:0/1253453105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3640b4fa0 con 0x7fe3640cf8f0 2023-07-11T00:31:45.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.529+0000 7fe360ff9700 1 -- 172.21.15.22:0/1253453105 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+14786 (secure 0 0 0) 0x7fe354029020 con 0x7fe3640cf8f0 2023-07-11T00:31:45.531 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:45.531 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":34,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:31:41.303201+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:31:45.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.531+0000 7fe369dff700 1 -- 172.21.15.22:0/1253453105 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe34406ace0 msgr2=0x7fe34406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:45.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.531+0000 7fe369dff700 1 --2- 172.21.15.22:0/1253453105 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe34406ace0 0x7fe34406d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe3640b7aa0 tx=0x7fe34c009040 comp rx=0 tx=0).stop 2023-07-11T00:31:45.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.531+0000 7fe369dff700 1 -- 172.21.15.22:0/1253453105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3640cf8f0 msgr2=0x7fe3640c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:45.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.531+0000 7fe369dff700 1 --2- 172.21.15.22:0/1253453105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3640cf8f0 0x7fe3640c9c50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe354009bc0 tx=0x7fe354004750 comp rx=0 tx=0).stop 2023-07-11T00:31:45.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.531+0000 7fe369dff700 1 -- 172.21.15.22:0/1253453105 shutdown_connections 2023-07-11T00:31:45.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.531+0000 7fe369dff700 1 --2- 172.21.15.22:0/1253453105 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fe34406ace0 0x7fe34406d190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.531+0000 7fe369dff700 1 --2- 172.21.15.22:0/1253453105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe36415c460 0x7fe364155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.531+0000 7fe369dff700 1 --2- 172.21.15.22:0/1253453105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3640cf8f0 0x7fe3640c9c50 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.531+0000 7fe369dff700 1 --2- 172.21.15.22:0/1253453105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3640d2640 0x7fe364156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.531+0000 7fe369dff700 1 -- 172.21.15.22:0/1253453105 >> 172.21.15.22:0/1253453105 conn(0x7fe364071660 msgr2=0x7fe3640b6400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:45.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.531+0000 7fe369dff700 1 -- 172.21.15.22:0/1253453105 shutdown_connections 2023-07-11T00:31:45.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.531+0000 7fe369dff700 1 -- 172.21.15.22:0/1253453105 wait complete. 2023-07-11T00:31:45.552 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:29:57.631007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:29:58.547599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-11T00:31:45.552 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:31:45.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.754+0000 7f9c721ff700 1 Processor -- start 2023-07-11T00:31:45.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.754+0000 7f9c721ff700 1 -- start start 2023-07-11T00:31:45.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.755+0000 7f9c721ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c6c0b8430 0x7f9c6c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:45.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.755+0000 7f9c721ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c0d0b20 con 0x7f9c6c0d3730 2023-07-11T00:31:45.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.755+0000 7f9c721ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c0b4ee0 con 0x7f9c6c0cfc60 2023-07-11T00:31:45.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.755+0000 7f9c721ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6c0b8800 con 0x7f9c6c0b8430 2023-07-11T00:31:45.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.755+0000 7f9c6b7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c6c0b8430 0x7f9c6c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:45.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.756+0000 7f9c6affd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9c6c0d3730 0x7f9c6c0cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46952/0 (socket says 172.21.15.22:46952) 2023-07-11T00:31:45.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.756+0000 7f9c6affd700 1 -- 172.21.15.22:0/2082867906 learned_addr learned my addr 172.21.15.22:0/2082867906 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:45.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.756+0000 7f9c6a7fc700 1 -- 172.21.15.22:0/2082867906 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486186173 0 0) 0x7f9c6c0d0b20 con 0x7f9c6c0d3730 2023-07-11T00:31:45.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.756+0000 7f9c6a7fc700 1 -- 172.21.15.22:0/2082867906 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c540035b0 con 0x7f9c6c0d3730 2023-07-11T00:31:45.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.756+0000 7f9c6b7fe700 1 -- 172.21.15.22:0/2082867906 >> v1:172.21.15.184:6789/0 conn(0x7f9c6c0cfc60 legacy=0x7f9c6c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:45.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.756+0000 7f9c6b7fe700 1 -- 172.21.15.22:0/2082867906 >> v1:172.21.15.22:6789/0 conn(0x7f9c6c0d3730 legacy=0x7f9c6c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:45.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.756+0000 7f9c6b7fe700 1 -- 172.21.15.22:0/2082867906 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c0b51c0 con 0x7f9c6c0b8430 2023-07-11T00:31:45.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.756+0000 7f9c6b7fe700 1 --2- 172.21.15.22:0/2082867906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6c0b8430 0x7f9c6c0cd320 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009840 tx=0x7f9c5c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59590fd766db3d0a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.756+0000 7f9c6a7fc700 1 -- 172.21.15.22:0/2082867906 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c011830 con 0x7f9c6c0b8430 2023-07-11T00:31:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.757+0000 7f9c6a7fc700 1 -- 172.21.15.22:0/2082867906 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c011990 con 0x7f9c6c0b8430 2023-07-11T00:31:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.757+0000 7f9c6a7fc700 1 -- 172.21.15.22:0/2082867906 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c011d00 con 0x7f9c6c0b8430 2023-07-11T00:31:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.757+0000 7f9c721ff700 1 -- 172.21.15.22:0/2082867906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6c0b8430 msgr2=0x7f9c6c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.757+0000 7f9c721ff700 1 --2- 172.21.15.22:0/2082867906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6c0b8430 0x7f9c6c0cd320 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009840 tx=0x7f9c5c009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.757+0000 7f9c721ff700 1 -- 172.21.15.22:0/2082867906 shutdown_connections 2023-07-11T00:31:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.757+0000 7f9c721ff700 1 --2- 172.21.15.22:0/2082867906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6c0b8430 0x7f9c6c0cd320 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.757+0000 7f9c721ff700 1 -- 172.21.15.22:0/2082867906 >> 172.21.15.22:0/2082867906 conn(0x7f9c6c06b3f0 msgr2=0x7f9c6c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.757+0000 7f9c721ff700 1 -- 172.21.15.22:0/2082867906 shutdown_connections 2023-07-11T00:31:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.757+0000 7f9c721ff700 1 -- 172.21.15.22:0/2082867906 wait complete. 2023-07-11T00:31:45.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.759+0000 7f9c721ff700 1 Processor -- start 2023-07-11T00:31:45.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.759+0000 7f9c721ff700 1 -- start start 2023-07-11T00:31:45.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.760+0000 7f9c721ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c6c0b8430 0x7f9c6c0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:45.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.760+0000 7f9c721ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6c0cfc60 0x7f9c6c0b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:45.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.760+0000 7f9c721ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c6c0d3730 0x7f9c6c0b7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:45.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.760+0000 7f9c721ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0ccf40 con 0x7f9c6c0cfc60 2023-07-11T00:31:45.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.760+0000 7f9c721ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0c6a90 con 0x7f9c6c0d3730 2023-07-11T00:31:45.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.760+0000 7f9c721ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0c6d70 con 0x7f9c6c0b8430 2023-07-11T00:31:45.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.760+0000 7f9c6affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6c0cfc60 0x7f9c6c0b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:45.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.760+0000 7f9c6affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6c0cfc60 0x7f9c6c0b7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55180/0 (socket says 172.21.15.22:55180) 2023-07-11T00:31:45.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.760+0000 7f9c6affd700 1 -- 172.21.15.22:0/4157545997 learned_addr learned my addr 172.21.15.22:0/4157545997 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:45.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.761+0000 7f9c6affd700 1 -- 172.21.15.22:0/4157545997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c6c0b8430 msgr2=0x7f9c6c0cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:45.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.761+0000 7f9c6b7fe700 1 --2- 172.21.15.22:0/4157545997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c6c0b8430 0x7f9c6c0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:45.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.761+0000 7f9c6bfff700 1 --2- 172.21.15.22:0/4157545997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c6c0d3730 0x7f9c6c0b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:45.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.761+0000 7f9c6affd700 1 --2- 172.21.15.22:0/4157545997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c6c0b8430 0x7f9c6c0cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.761+0000 7f9c6affd700 1 -- 172.21.15.22:0/4157545997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c6c0d3730 msgr2=0x7f9c6c0b7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.761+0000 7f9c6affd700 1 --2- 172.21.15.22:0/4157545997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c6c0d3730 0x7f9c6c0b7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.761+0000 7f9c6affd700 1 -- 172.21.15.22:0/4157545997 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c0094a0 con 0x7f9c6c0cfc60 2023-07-11T00:31:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.761+0000 7f9c6b7fe700 1 --2- 172.21.15.22:0/4157545997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c6c0b8430 0x7f9c6c0cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.761+0000 7f9c6bfff700 1 --2- 172.21.15.22:0/4157545997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c6c0d3730 0x7f9c6c0b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.761+0000 7f9c6affd700 1 --2- 172.21.15.22:0/4157545997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6c0cfc60 0x7f9c6c0b7100 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9c60001eb0 tx=0x7f9c6000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.761+0000 7f9c53fff700 1 -- 172.21.15.22:0/4157545997 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c60005d70 con 0x7f9c6c0cfc60 2023-07-11T00:31:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.761+0000 7f9c53fff700 1 -- 172.21.15.22:0/4157545997 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c600070d0 con 0x7f9c6c0cfc60 2023-07-11T00:31:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.761+0000 7f9c53fff700 1 -- 172.21.15.22:0/4157545997 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c60007460 con 0x7f9c6c0cfc60 2023-07-11T00:31:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.761+0000 7f9c721ff700 1 -- 172.21.15.22:0/4157545997 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c0c7050 con 0x7f9c6c0cfc60 2023-07-11T00:31:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.761+0000 7f9c721ff700 1 -- 172.21.15.22:0/4157545997 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c0c7610 con 0x7f9c6c0cfc60 2023-07-11T00:31:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.762+0000 7f9c721ff700 1 -- 172.21.15.22:0/4157545997 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6c04ea60 con 0x7f9c6c0cfc60 2023-07-11T00:31:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.763+0000 7f9c53fff700 1 -- 172.21.15.22:0/4157545997 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9c600075c0 con 0x7f9c6c0cfc60 2023-07-11T00:31:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.764+0000 7f9c53fff700 1 --2- 172.21.15.22:0/4157545997 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9c5806ace0 0x7f9c5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.764+0000 7f9c53fff700 1 -- 172.21.15.22:0/4157545997 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9c60088800 con 0x7f9c6c0cfc60 2023-07-11T00:31:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.765+0000 7f9c6b7fe700 1 --2- 172.21.15.22:0/4157545997 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9c5806ace0 0x7f9c5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.765+0000 7f9c6b7fe700 1 --2- 172.21.15.22:0/4157545997 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9c5806ace0 0x7f9c5806d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0090b0 tx=0x7f9c5c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:45.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.769+0000 7f9c53fff700 1 -- 172.21.15.22:0/4157545997 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9c60053ab0 con 0x7f9c6c0cfc60 2023-07-11T00:31:45.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.989+0000 7f9c721ff700 1 -- 172.21.15.22:0/4157545997 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9c6c0b12e0 con 0x7f9c6c0cfc60 2023-07-11T00:31:45.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.990+0000 7f9c53fff700 1 -- 172.21.15.22:0/4157545997 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9c600570d0 con 0x7f9c6c0cfc60 2023-07-11T00:31:45.993 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2023-07-11T00:31:45.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.992+0000 7f9c721ff700 1 -- 172.21.15.22:0/4157545997 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9c5806ace0 msgr2=0x7f9c5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:45.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.992+0000 7f9c721ff700 1 --2- 172.21.15.22:0/4157545997 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9c5806ace0 0x7f9c5806d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0090b0 tx=0x7f9c5c008030 comp rx=0 tx=0).stop 2023-07-11T00:31:45.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.992+0000 7f9c721ff700 1 -- 172.21.15.22:0/4157545997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6c0cfc60 msgr2=0x7f9c6c0b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:45.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.992+0000 7f9c721ff700 1 --2- 172.21.15.22:0/4157545997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6c0cfc60 0x7f9c6c0b7100 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9c60001eb0 tx=0x7f9c6000c860 comp rx=0 tx=0).stop 2023-07-11T00:31:45.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.992+0000 7f9c721ff700 1 -- 172.21.15.22:0/4157545997 shutdown_connections 2023-07-11T00:31:45.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.992+0000 7f9c721ff700 1 --2- 172.21.15.22:0/4157545997 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f9c5806ace0 0x7f9c5806d190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.992+0000 7f9c721ff700 1 --2- 172.21.15.22:0/4157545997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c6c0b8430 0x7f9c6c0cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.992+0000 7f9c721ff700 1 --2- 172.21.15.22:0/4157545997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c6c0d3730 0x7f9c6c0b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.992+0000 7f9c721ff700 1 --2- 172.21.15.22:0/4157545997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c6c0cfc60 0x7f9c6c0b7100 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:45.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.992+0000 7f9c721ff700 1 -- 172.21.15.22:0/4157545997 >> 172.21.15.22:0/4157545997 conn(0x7f9c6c06b3f0 msgr2=0x7f9c6c0cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:45.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.993+0000 7f9c721ff700 1 -- 172.21.15.22:0/4157545997 shutdown_connections 2023-07-11T00:31:45.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:45.993+0000 7f9c721ff700 1 -- 172.21.15.22:0/4157545997 wait complete. 2023-07-11T00:31:46.013 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:31:46.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.216+0000 7fa3ca1ff700 1 Processor -- start 2023-07-11T00:31:46.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.216+0000 7fa3ca1ff700 1 -- start start 2023-07-11T00:31:46.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.217+0000 7fa3ca1ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa3c40cfc60 0x7fa3c4167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:46.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.217+0000 7fa3ca1ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c40d0b20 con 0x7fa3c40b8430 2023-07-11T00:31:46.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.217+0000 7fa3ca1ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c40b4ee0 con 0x7fa3c40d3730 2023-07-11T00:31:46.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.217+0000 7fa3ca1ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c40cda30 con 0x7fa3c40cfc60 2023-07-11T00:31:46.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.217+0000 7fa3c37fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa3c40b8430 0x7fa3c40cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46968/0 (socket says 172.21.15.22:46968) 2023-07-11T00:31:46.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.218+0000 7fa3c37fe700 1 -- 172.21.15.22:0/3453815378 learned_addr learned my addr 172.21.15.22:0/3453815378 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:46.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.217+0000 7fa3c3fff700 1 --2- 172.21.15.22:0/3453815378 >> v2:172.21.15.22:3300/0 conn(0x7fa3c40cfc60 0x7fa3c4167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:46.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.218+0000 7fa3c27fc700 1 -- 172.21.15.22:0/3453815378 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019561048 0 0) 0x7fa3c40d0b20 con 0x7fa3c40b8430 2023-07-11T00:31:46.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.218+0000 7fa3c3fff700 1 -- 172.21.15.22:0/3453815378 >> v1:172.21.15.184:6789/0 conn(0x7fa3c40d3730 legacy=0x7fa3c40cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:46.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.218+0000 7fa3c3fff700 1 -- 172.21.15.22:0/3453815378 >> v1:172.21.15.22:6789/0 conn(0x7fa3c40b8430 legacy=0x7fa3c40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:46.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.218+0000 7fa3c3fff700 1 -- 172.21.15.22:0/3453815378 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c40b51c0 con 0x7fa3c40cfc60 2023-07-11T00:31:46.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.218+0000 7fa3c3fff700 1 --2- 172.21.15.22:0/3453815378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3c40cfc60 0x7fa3c4167010 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc009d90 tx=0x7fa3bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa778f8a75061995 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:46.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.219+0000 7fa3c27fc700 1 -- 172.21.15.22:0/3453815378 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc00e070 con 0x7fa3c40cfc60 2023-07-11T00:31:46.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.219+0000 7fa3c27fc700 1 -- 172.21.15.22:0/3453815378 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc00bbd0 con 0x7fa3c40cfc60 2023-07-11T00:31:46.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.219+0000 7fa3c27fc700 1 -- 172.21.15.22:0/3453815378 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc012430 con 0x7fa3c40cfc60 2023-07-11T00:31:46.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.219+0000 7fa3ca1ff700 1 -- 172.21.15.22:0/3453815378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3c40cfc60 msgr2=0x7fa3c4167010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:46.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.219+0000 7fa3ca1ff700 1 --2- 172.21.15.22:0/3453815378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3c40cfc60 0x7fa3c4167010 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc009d90 tx=0x7fa3bc00b330 comp rx=0 tx=0).stop 2023-07-11T00:31:46.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.219+0000 7fa3ca1ff700 1 -- 172.21.15.22:0/3453815378 shutdown_connections 2023-07-11T00:31:46.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.219+0000 7fa3ca1ff700 1 --2- 172.21.15.22:0/3453815378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3c40cfc60 0x7fa3c4167010 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.219+0000 7fa3ca1ff700 1 -- 172.21.15.22:0/3453815378 >> 172.21.15.22:0/3453815378 conn(0x7fa3c406b3f0 msgr2=0x7fa3c406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:46.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.219+0000 7fa3ca1ff700 1 -- 172.21.15.22:0/3453815378 shutdown_connections 2023-07-11T00:31:46.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.219+0000 7fa3ca1ff700 1 -- 172.21.15.22:0/3453815378 wait complete. 2023-07-11T00:31:46.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.221+0000 7fa3ca1ff700 1 Processor -- start 2023-07-11T00:31:46.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.221+0000 7fa3ca1ff700 1 -- start start 2023-07-11T00:31:46.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.222+0000 7fa3ca1ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3c40b8430 0x7fa3c414d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:46.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.222+0000 7fa3ca1ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c40cfc60 0x7fa3c40c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:46.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.222+0000 7fa3ca1ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3c40d3730 0x7fa3c40b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:46.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.222+0000 7fa3ca1ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c414d650 con 0x7fa3c40b8430 2023-07-11T00:31:46.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.222+0000 7fa3ca1ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c414daf0 con 0x7fa3c40d3730 2023-07-11T00:31:46.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.222+0000 7fa3ca1ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40c6bc0 con 0x7fa3c40cfc60 2023-07-11T00:31:46.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.222+0000 7fa3c37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3c40b8430 0x7fa3c414d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:46.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.223+0000 7fa3c37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3c40b8430 0x7fa3c414d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55198/0 (socket says 172.21.15.22:55198) 2023-07-11T00:31:46.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.223+0000 7fa3c37fe700 1 -- 172.21.15.22:0/2591182174 learned_addr learned my addr 172.21.15.22:0/2591182174 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:46.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.223+0000 7fa3c2ffd700 1 --2- 172.21.15.22:0/2591182174 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c40cfc60 0x7fa3c40c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:46.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.223+0000 7fa3c3fff700 1 --2- 172.21.15.22:0/2591182174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3c40d3730 0x7fa3c40b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:46.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.223+0000 7fa3c37fe700 1 -- 172.21.15.22:0/2591182174 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c40cfc60 msgr2=0x7fa3c40c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:46.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.223+0000 7fa3c37fe700 1 --2- 172.21.15.22:0/2591182174 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c40cfc60 0x7fa3c40c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.223+0000 7fa3c37fe700 1 -- 172.21.15.22:0/2591182174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3c40d3730 msgr2=0x7fa3c40b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:46.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.223+0000 7fa3c37fe700 1 --2- 172.21.15.22:0/2591182174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3c40d3730 0x7fa3c40b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.223+0000 7fa3c37fe700 1 -- 172.21.15.22:0/2591182174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc009a70 con 0x7fa3c40b8430 2023-07-11T00:31:46.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.223+0000 7fa3c3fff700 1 --2- 172.21.15.22:0/2591182174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3c40d3730 0x7fa3c40b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:46.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.223+0000 7fa3c37fe700 1 --2- 172.21.15.22:0/2591182174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3c40b8430 0x7fa3c414d110 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400c520 tx=0x7fa3b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:46.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.223+0000 7fa3abfff700 1 -- 172.21.15.22:0/2591182174 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4004c80 con 0x7fa3c40b8430 2023-07-11T00:31:46.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.224+0000 7fa3abfff700 1 -- 172.21.15.22:0/2591182174 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b4004e00 con 0x7fa3c40b8430 2023-07-11T00:31:46.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.224+0000 7fa3ca1ff700 1 -- 172.21.15.22:0/2591182174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c40cae90 con 0x7fa3c40b8430 2023-07-11T00:31:46.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.224+0000 7fa3abfff700 1 -- 172.21.15.22:0/2591182174 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4007310 con 0x7fa3c40b8430 2023-07-11T00:31:46.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.224+0000 7fa3ca1ff700 1 -- 172.21.15.22:0/2591182174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c40cb450 con 0x7fa3c40b8430 2023-07-11T00:31:46.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.225+0000 7fa3ca1ff700 1 -- 172.21.15.22:0/2591182174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c40cb670 con 0x7fa3c40b8430 2023-07-11T00:31:46.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.226+0000 7fa3abfff700 1 -- 172.21.15.22:0/2591182174 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa3b4007470 con 0x7fa3c40b8430 2023-07-11T00:31:46.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.227+0000 7fa3abfff700 1 --2- 172.21.15.22:0/2591182174 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa3b006ace0 0x7fa3b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:46.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.227+0000 7fa3abfff700 1 -- 172.21.15.22:0/2591182174 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa3b4089110 con 0x7fa3c40b8430 2023-07-11T00:31:46.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.227+0000 7fa3c2ffd700 1 --2- 172.21.15.22:0/2591182174 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa3b006ace0 0x7fa3b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:46.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.228+0000 7fa3c2ffd700 1 --2- 172.21.15.22:0/2591182174 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa3b006ace0 0x7fa3b006d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa3c415fc50 tx=0x7fa3b8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:46.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.231+0000 7fa3abfff700 1 -- 172.21.15.22:0/2591182174 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa3b40542b0 con 0x7fa3c40b8430 2023-07-11T00:31:46.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.443+0000 7fa3ca1ff700 1 -- 172.21.15.22:0/2591182174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa3c404ea60 con 0x7fa3c40b8430 2023-07-11T00:31:46.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.443+0000 7fa3abfff700 1 -- 172.21.15.22:0/2591182174 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa3b40578d0 con 0x7fa3c40b8430 2023-07-11T00:31:46.446 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-07-11T00:31:46.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.446+0000 7fa3ca1ff700 1 -- 172.21.15.22:0/2591182174 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa3b006ace0 msgr2=0x7fa3b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:46.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.446+0000 7fa3ca1ff700 1 --2- 172.21.15.22:0/2591182174 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa3b006ace0 0x7fa3b006d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa3c415fc50 tx=0x7fa3b8009040 comp rx=0 tx=0).stop 2023-07-11T00:31:46.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.446+0000 7fa3ca1ff700 1 -- 172.21.15.22:0/2591182174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3c40b8430 msgr2=0x7fa3c414d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:46.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.446+0000 7fa3ca1ff700 1 --2- 172.21.15.22:0/2591182174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3c40b8430 0x7fa3c414d110 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400c520 tx=0x7fa3b400c8e0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.446+0000 7fa3ca1ff700 1 -- 172.21.15.22:0/2591182174 shutdown_connections 2023-07-11T00:31:46.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.446+0000 7fa3ca1ff700 1 --2- 172.21.15.22:0/2591182174 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa3b006ace0 0x7fa3b006d190 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.446+0000 7fa3ca1ff700 1 --2- 172.21.15.22:0/2591182174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3c40d3730 0x7fa3c40b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.446+0000 7fa3ca1ff700 1 --2- 172.21.15.22:0/2591182174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3c40b8430 0x7fa3c414d110 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.446+0000 7fa3ca1ff700 1 --2- 172.21.15.22:0/2591182174 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c40cfc60 0x7fa3c40c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.446+0000 7fa3ca1ff700 1 -- 172.21.15.22:0/2591182174 >> 172.21.15.22:0/2591182174 conn(0x7fa3c406b3f0 msgr2=0x7fa3c40cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:46.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.446+0000 7fa3ca1ff700 1 -- 172.21.15.22:0/2591182174 shutdown_connections 2023-07-11T00:31:46.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.446+0000 7fa3ca1ff700 1 -- 172.21.15.22:0/2591182174 wait complete. 2023-07-11T00:31:46.467 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-11T00:31:46.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.665+0000 7f87675ff700 1 Processor -- start 2023-07-11T00:31:46.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.665+0000 7f87675ff700 1 -- start start 2023-07-11T00:31:46.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.667+0000 7f87675ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f87600d2640 0x7f87600b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:46.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.667+0000 7f87675ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f87600cf8f0 0x7f876015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:46.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.667+0000 7f87675ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87600d1790 con 0x7f876015c460 2023-07-11T00:31:46.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.667+0000 7f87675ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87600cedd0 con 0x7f87600cf8f0 2023-07-11T00:31:46.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.667+0000 7f87675ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87600cd950 con 0x7f87600d2640 2023-07-11T00:31:46.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.667+0000 7f876539b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f876015c460 0x7f87600cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46970/0 (socket says 172.21.15.22:46970) 2023-07-11T00:31:46.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.667+0000 7f876539b700 1 -- 172.21.15.22:0/2027868641 learned_addr learned my addr 172.21.15.22:0/2027868641 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:46.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.667+0000 7f8765b9c700 1 --2- 172.21.15.22:0/2027868641 >> v2:172.21.15.22:3300/0 conn(0x7f87600cf8f0 0x7f876015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:46.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.667+0000 7f8757fff700 1 -- 172.21.15.22:0/2027868641 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 680130728 0 0) 0x7f87600d1790 con 0x7f876015c460 2023-07-11T00:31:46.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.667+0000 7f8764b9a700 1 --2- 172.21.15.22:0/2027868641 >> v2:172.21.15.184:3300/0 conn(0x7f87600d2640 0x7f87600b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:46.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.667+0000 7f8757fff700 1 -- 172.21.15.22:0/2027868641 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f874c0035b0 con 0x7f876015c460 2023-07-11T00:31:46.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.667+0000 7f8765b9c700 1 -- 172.21.15.22:0/2027868641 >> v2:172.21.15.184:3300/0 conn(0x7f87600d2640 msgr2=0x7f87600b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:46.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.668+0000 7f8765b9c700 1 --2- 172.21.15.22:0/2027868641 >> v2:172.21.15.184:3300/0 conn(0x7f87600d2640 0x7f87600b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.668+0000 7f8765b9c700 1 -- 172.21.15.22:0/2027868641 >> v1:172.21.15.22:6789/0 conn(0x7f876015c460 legacy=0x7f87600cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:46.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.668+0000 7f8765b9c700 1 -- 172.21.15.22:0/2027868641 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87600d14b0 con 0x7f87600cf8f0 2023-07-11T00:31:46.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.668+0000 7f8765b9c700 1 --2- 172.21.15.22:0/2027868641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87600cf8f0 0x7f876015fe20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f876015fd80 tx=0x7f875800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34cac33784828dfe server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:46.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.668+0000 7f8757fff700 1 -- 172.21.15.22:0/2027868641 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875800e070 con 0x7f87600cf8f0 2023-07-11T00:31:46.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.668+0000 7f8757fff700 1 -- 172.21.15.22:0/2027868641 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875800bb20 con 0x7f87600cf8f0 2023-07-11T00:31:46.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.668+0000 7f8757fff700 1 -- 172.21.15.22:0/2027868641 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8758012430 con 0x7f87600cf8f0 2023-07-11T00:31:46.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.669+0000 7f87675ff700 1 -- 172.21.15.22:0/2027868641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87600cf8f0 msgr2=0x7f876015fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:46.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.669+0000 7f87675ff700 1 --2- 172.21.15.22:0/2027868641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87600cf8f0 0x7f876015fe20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f876015fd80 tx=0x7f875800b330 comp rx=0 tx=0).stop 2023-07-11T00:31:46.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.669+0000 7f87675ff700 1 -- 172.21.15.22:0/2027868641 shutdown_connections 2023-07-11T00:31:46.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.669+0000 7f87675ff700 1 --2- 172.21.15.22:0/2027868641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87600cf8f0 0x7f876015fe20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.669+0000 7f87675ff700 1 --2- 172.21.15.22:0/2027868641 >> v2:172.21.15.184:3300/0 conn(0x7f87600d2640 0x7f87600b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.669+0000 7f87675ff700 1 -- 172.21.15.22:0/2027868641 >> 172.21.15.22:0/2027868641 conn(0x7f8760071660 msgr2=0x7f8760071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:46.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.669+0000 7f87675ff700 1 -- 172.21.15.22:0/2027868641 shutdown_connections 2023-07-11T00:31:46.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.669+0000 7f87675ff700 1 -- 172.21.15.22:0/2027868641 wait complete. 2023-07-11T00:31:46.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.670+0000 7f87675ff700 1 Processor -- start 2023-07-11T00:31:46.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.671+0000 7f87675ff700 1 -- start start 2023-07-11T00:31:46.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.672+0000 7f87675ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87600cf8f0 0x7f87600c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:46.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.672+0000 7f87675ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87600d2640 0x7f87600cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:46.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.672+0000 7f87675ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f876015c460 0x7f87600c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:46.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.672+0000 7f87675ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87600c96d0 con 0x7f87600d2640 2023-07-11T00:31:46.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.672+0000 7f87675ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87600cb520 con 0x7f87600cf8f0 2023-07-11T00:31:46.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.672+0000 7f87675ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87600cb800 con 0x7f876015c460 2023-07-11T00:31:46.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.672+0000 7f8764b9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87600d2640 0x7f87600cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:46.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.672+0000 7f8764b9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87600d2640 0x7f87600cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55224/0 (socket says 172.21.15.22:55224) 2023-07-11T00:31:46.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.672+0000 7f8764b9a700 1 -- 172.21.15.22:0/2771567999 learned_addr learned my addr 172.21.15.22:0/2771567999 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:46.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.672+0000 7f8764b9a700 1 -- 172.21.15.22:0/2771567999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f876015c460 msgr2=0x7f87600c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:46.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.672+0000 7f8764b9a700 1 --2- 172.21.15.22:0/2771567999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f876015c460 0x7f87600c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.672+0000 7f8764b9a700 1 -- 172.21.15.22:0/2771567999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87600cf8f0 msgr2=0x7f87600c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:46.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.672+0000 7f8764b9a700 1 --2- 172.21.15.22:0/2771567999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87600cf8f0 0x7f87600c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.672+0000 7f8764b9a700 1 -- 172.21.15.22:0/2771567999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8758009a70 con 0x7f87600d2640 2023-07-11T00:31:46.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.673+0000 7f8764b9a700 1 --2- 172.21.15.22:0/2771567999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87600d2640 0x7f87600cacf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f875000d800 tx=0x7f875000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:46.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.673+0000 7f8755ffb700 1 -- 172.21.15.22:0/2771567999 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87500125f0 con 0x7f87600d2640 2023-07-11T00:31:46.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.673+0000 7f8755ffb700 1 -- 172.21.15.22:0/2771567999 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8750012750 con 0x7f87600d2640 2023-07-11T00:31:46.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.673+0000 7f8755ffb700 1 -- 172.21.15.22:0/2771567999 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750012b00 con 0x7f87600d2640 2023-07-11T00:31:46.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.673+0000 7f87675ff700 1 -- 172.21.15.22:0/2771567999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87600cbae0 con 0x7f87600d2640 2023-07-11T00:31:46.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.673+0000 7f87675ff700 1 -- 172.21.15.22:0/2771567999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87600cc0a0 con 0x7f87600d2640 2023-07-11T00:31:46.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.674+0000 7f87675ff700 1 -- 172.21.15.22:0/2771567999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87600cc260 con 0x7f87600d2640 2023-07-11T00:31:46.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.675+0000 7f8755ffb700 1 -- 172.21.15.22:0/2771567999 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8750012c60 con 0x7f87600d2640 2023-07-11T00:31:46.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.676+0000 7f8755ffb700 1 --2- 172.21.15.22:0/2771567999 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f874406ace0 0x7f874406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:46.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.676+0000 7f8755ffb700 1 -- 172.21.15.22:0/2771567999 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8750089640 con 0x7f87600d2640 2023-07-11T00:31:46.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.677+0000 7f876539b700 1 --2- 172.21.15.22:0/2771567999 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f874406ace0 0x7f874406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:46.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.677+0000 7f876539b700 1 --2- 172.21.15.22:0/2771567999 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f874406ace0 0x7f874406d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f875c0016b0 tx=0x7f875c0079c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:46.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.681+0000 7f8755ffb700 1 -- 172.21.15.22:0/2771567999 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f87500548f0 con 0x7f87600d2640 2023-07-11T00:31:46.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.888+0000 7f87675ff700 1 -- 172.21.15.22:0/2771567999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f876004ea60 con 0x7f87600d2640 2023-07-11T00:31:46.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.889+0000 7f8755ffb700 1 -- 172.21.15.22:0/2771567999 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8750057f10 con 0x7f87600d2640 2023-07-11T00:31:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:46.892 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-07-11T00:31:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-07-11T00:31:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": "rbd" 2023-07-11T00:31:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-07-11T00:31:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-07-11T00:31:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 2, 2023-07-11T00:31:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-07-11T00:31:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-07-11T00:31:46.894 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-07-11T00:31:46.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.891+0000 7f87675ff700 1 -- 172.21.15.22:0/2771567999 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f874406ace0 msgr2=0x7f874406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.891+0000 7f87675ff700 1 --2- 172.21.15.22:0/2771567999 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f874406ace0 0x7f874406d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f875c0016b0 tx=0x7f875c0079c0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.891+0000 7f87675ff700 1 -- 172.21.15.22:0/2771567999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87600d2640 msgr2=0x7f87600cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.891+0000 7f87675ff700 1 --2- 172.21.15.22:0/2771567999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87600d2640 0x7f87600cacf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f875000d800 tx=0x7f875000dbc0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.891+0000 7f87675ff700 1 -- 172.21.15.22:0/2771567999 shutdown_connections 2023-07-11T00:31:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.891+0000 7f87675ff700 1 --2- 172.21.15.22:0/2771567999 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f874406ace0 0x7f874406d190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.891+0000 7f87675ff700 1 --2- 172.21.15.22:0/2771567999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f876015c460 0x7f87600c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.891+0000 7f87675ff700 1 --2- 172.21.15.22:0/2771567999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87600cf8f0 0x7f87600c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.891+0000 7f87675ff700 1 --2- 172.21.15.22:0/2771567999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87600d2640 0x7f87600cacf0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:46.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.891+0000 7f87675ff700 1 -- 172.21.15.22:0/2771567999 >> 172.21.15.22:0/2771567999 conn(0x7f8760071660 msgr2=0x7f87600b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:46.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.891+0000 7f87675ff700 1 -- 172.21.15.22:0/2771567999 shutdown_connections 2023-07-11T00:31:46.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:46.891+0000 7f87675ff700 1 -- 172.21.15.22:0/2771567999 wait complete. 2023-07-11T00:31:46.912 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-11T00:31:46.913 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-11T00:31:47.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.115+0000 7fc2981ff700 1 Processor -- start 2023-07-11T00:31:47.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.116+0000 7fc2981ff700 1 -- start start 2023-07-11T00:31:47.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.117+0000 7fc2981ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2900b82c0 0x7fc290160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:47.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.117+0000 7fc2981ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc290160db0 con 0x7fc2900cf4d0 2023-07-11T00:31:47.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.117+0000 7fc2981ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29015fe20 con 0x7fc2900b1f00 2023-07-11T00:31:47.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.117+0000 7fc2981ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2900b8690 con 0x7fc2900b82c0 2023-07-11T00:31:47.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.117+0000 7fc29679c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc2900cf4d0 0x7fc2900d06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46982/0 (socket says 172.21.15.22:46982) 2023-07-11T00:31:47.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.117+0000 7fc29679c700 1 -- 172.21.15.22:0/1390029210 learned_addr learned my addr 172.21.15.22:0/1390029210 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:47.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.117+0000 7fc295f9b700 1 --2- 172.21.15.22:0/1390029210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2900b82c0 0x7fc290160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:47.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc294f99700 1 -- 172.21.15.22:0/1390029210 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456264831 0 0) 0x7fc288001490 con 0x7fc2900cf4d0 2023-07-11T00:31:47.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc294f99700 1 -- 172.21.15.22:0/1390029210 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc27c0035b0 con 0x7fc2900cf4d0 2023-07-11T00:31:47.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc294f99700 1 -- 172.21.15.22:0/1390029210 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1033857539 0 0) 0x7fc27c0035b0 con 0x7fc2900cf4d0 2023-07-11T00:31:47.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc294f99700 1 -- 172.21.15.22:0/1390029210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2900b82c0 msgr2=0x7fc290160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:47.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc294f99700 1 --2- 172.21.15.22:0/1390029210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2900b82c0 0x7fc290160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:47.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc294f99700 1 -- 172.21.15.22:0/1390029210 >> v1:172.21.15.184:6789/0 conn(0x7fc2900b1f00 legacy=0x7fc2900ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:47.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc294f99700 1 -- 172.21.15.22:0/1390029210 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2901603e0 con 0x7fc2900cf4d0 2023-07-11T00:31:47.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc294f99700 1 -- 172.21.15.22:0/1390029210 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7fc288001b80 con 0x7fc2900cf4d0 2023-07-11T00:31:47.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc294f99700 1 -- 172.21.15.22:0/1390029210 >> v1:172.21.15.22:6789/0 conn(0x7fc2900cf4d0 legacy=0x7fc2900d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:47.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc294f99700 1 --2- 172.21.15.22:0/1390029210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc27c003a30 0x7fc27c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:47.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc294f99700 1 --2- 172.21.15.22:0/1390029210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2900b82c0 0x7fc27c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:47.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc294f99700 1 --2- 172.21.15.22:0/1390029210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c004d90 0x7fc27c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:47.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc294f99700 1 -- 172.21.15.22:0/1390029210 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2900b8690 con 0x7fc27c004d90 2023-07-11T00:31:47.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc294f99700 1 -- 172.21.15.22:0/1390029210 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c00baf0 con 0x7fc27c003a30 2023-07-11T00:31:47.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc294f99700 1 -- 172.21.15.22:0/1390029210 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c00bcb0 con 0x7fc2900b82c0 2023-07-11T00:31:47.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc29679c700 1 --2- 172.21.15.22:0/1390029210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c004d90 0x7fc27c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:47.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc295f9b700 1 --2- 172.21.15.22:0/1390029210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc27c003a30 0x7fc27c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.118+0000 7fc29579a700 1 --2- 172.21.15.22:0/1390029210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2900b82c0 0x7fc27c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.119+0000 7fc29679c700 1 -- 172.21.15.22:0/1390029210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2900b82c0 msgr2=0x7fc27c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.119+0000 7fc29679c700 1 --2- 172.21.15.22:0/1390029210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2900b82c0 0x7fc27c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.119+0000 7fc29679c700 1 -- 172.21.15.22:0/1390029210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc27c003a30 msgr2=0x7fc27c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.119+0000 7fc29679c700 1 --2- 172.21.15.22:0/1390029210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc27c003a30 0x7fc27c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.119+0000 7fc29679c700 1 -- 172.21.15.22:0/1390029210 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c0035b0 con 0x7fc27c004d90 2023-07-11T00:31:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.119+0000 7fc29679c700 1 --2- 172.21.15.22:0/1390029210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c004d90 0x7fc27c005200 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc28800a750 tx=0x7fc27c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8524bf6e4ac24a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.119+0000 7fc294f99700 1 -- 172.21.15.22:0/1390029210 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28800a3e0 con 0x7fc27c004d90 2023-07-11T00:31:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.119+0000 7fc294f99700 1 -- 172.21.15.22:0/1390029210 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2880072f0 con 0x7fc27c004d90 2023-07-11T00:31:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.119+0000 7fc294f99700 1 -- 172.21.15.22:0/1390029210 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2880076a0 con 0x7fc27c004d90 2023-07-11T00:31:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.120+0000 7fc2981ff700 1 -- 172.21.15.22:0/1390029210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c004d90 msgr2=0x7fc27c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.120+0000 7fc2981ff700 1 --2- 172.21.15.22:0/1390029210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c004d90 0x7fc27c005200 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc28800a750 tx=0x7fc27c005880 comp rx=0 tx=0).stop 2023-07-11T00:31:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.120+0000 7fc29679c700 1 -- 172.21.15.22:0/1390029210 reap_dead start 2023-07-11T00:31:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.120+0000 7fc2981ff700 1 -- 172.21.15.22:0/1390029210 shutdown_connections 2023-07-11T00:31:47.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.120+0000 7fc2981ff700 1 -- 172.21.15.22:0/1390029210 >> 172.21.15.22:0/1390029210 conn(0x7fc290071660 msgr2=0x7fc290071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:47.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.120+0000 7fc2981ff700 1 -- 172.21.15.22:0/1390029210 shutdown_connections 2023-07-11T00:31:47.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.120+0000 7fc2981ff700 1 -- 172.21.15.22:0/1390029210 wait complete. 2023-07-11T00:31:47.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.122+0000 7fc2981ff700 1 Processor -- start 2023-07-11T00:31:47.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.123+0000 7fc2981ff700 1 -- start start 2023-07-11T00:31:47.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.124+0000 7fc2981ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c004d90 0x7fc29014c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:47.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.124+0000 7fc2981ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc29014db60 0x7fc29014aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:47.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.124+0000 7fc2981ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2900b1450 0x7fc2900b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.124+0000 7fc2981ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29014ccf0 con 0x7fc27c004d90 2023-07-11T00:31:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.124+0000 7fc2981ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29014b710 con 0x7fc29014db60 2023-07-11T00:31:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.124+0000 7fc2981ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29014b9f0 con 0x7fc2900b1450 2023-07-11T00:31:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.124+0000 7fc295f9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c004d90 0x7fc29014c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.124+0000 7fc295f9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c004d90 0x7fc29014c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55244/0 (socket says 172.21.15.22:55244) 2023-07-11T00:31:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.124+0000 7fc295f9b700 1 -- 172.21.15.22:0/2453309942 learned_addr learned my addr 172.21.15.22:0/2453309942 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.124+0000 7fc29679c700 1 --2- 172.21.15.22:0/2453309942 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2900b1450 0x7fc2900b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.124+0000 7fc29579a700 1 --2- 172.21.15.22:0/2453309942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc29014db60 0x7fc29014aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.124+0000 7fc295f9b700 1 -- 172.21.15.22:0/2453309942 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2900b1450 msgr2=0x7fc2900b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.124+0000 7fc295f9b700 1 --2- 172.21.15.22:0/2453309942 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2900b1450 0x7fc2900b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.124+0000 7fc295f9b700 1 -- 172.21.15.22:0/2453309942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc29014db60 msgr2=0x7fc29014aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.124+0000 7fc295f9b700 1 --2- 172.21.15.22:0/2453309942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc29014db60 0x7fc29014aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.124+0000 7fc295f9b700 1 -- 172.21.15.22:0/2453309942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29014bcd0 con 0x7fc27c004d90 2023-07-11T00:31:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.125+0000 7fc295f9b700 1 --2- 172.21.15.22:0/2453309942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c004d90 0x7fc29014c7b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc28c011aa0 tx=0x7fc28c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.125+0000 7fc2867fc700 1 -- 172.21.15.22:0/2453309942 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c00f980 con 0x7fc27c004d90 2023-07-11T00:31:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.125+0000 7fc2867fc700 1 -- 172.21.15.22:0/2453309942 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c00fae0 con 0x7fc27c004d90 2023-07-11T00:31:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.125+0000 7fc2981ff700 1 -- 172.21.15.22:0/2453309942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29014bfb0 con 0x7fc27c004d90 2023-07-11T00:31:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.125+0000 7fc2867fc700 1 -- 172.21.15.22:0/2453309942 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c00fe90 con 0x7fc27c004d90 2023-07-11T00:31:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.125+0000 7fc2981ff700 1 -- 172.21.15.22:0/2453309942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29014b400 con 0x7fc27c004d90 2023-07-11T00:31:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.126+0000 7fc2981ff700 1 -- 172.21.15.22:0/2453309942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29014c600 con 0x7fc27c004d90 2023-07-11T00:31:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.127+0000 7fc2867fc700 1 -- 172.21.15.22:0/2453309942 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc28c014440 con 0x7fc27c004d90 2023-07-11T00:31:47.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.128+0000 7fc2867fc700 1 --2- 172.21.15.22:0/2453309942 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc27406ace0 0x7fc27406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:47.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.128+0000 7fc2867fc700 1 -- 172.21.15.22:0/2453309942 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fc28c089b00 con 0x7fc27c004d90 2023-07-11T00:31:47.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.129+0000 7fc29579a700 1 --2- 172.21.15.22:0/2453309942 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc27406ace0 0x7fc27406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:47.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.129+0000 7fc29579a700 1 --2- 172.21.15.22:0/2453309942 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc27406ace0 0x7fc27406d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc2900cb7a0 tx=0x7fc280009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:47.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.132+0000 7fc2867fc700 1 -- 172.21.15.22:0/2453309942 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc28c08be60 con 0x7fc27c004d90 2023-07-11T00:31:47.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.338+0000 7fc2981ff700 1 -- 172.21.15.22:0/2453309942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc290074180 con 0x7fc27c004d90 2023-07-11T00:31:47.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.430+0000 7fc2867fc700 1 -- 172.21.15.22:0/2453309942 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc28c0220b0 con 0x7fc27c004d90 2023-07-11T00:31:47.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.434+0000 7fc2981ff700 1 -- 172.21.15.22:0/2453309942 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc27406ace0 msgr2=0x7fc27406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:47.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.434+0000 7fc2981ff700 1 --2- 172.21.15.22:0/2453309942 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc27406ace0 0x7fc27406d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc2900cb7a0 tx=0x7fc280009040 comp rx=0 tx=0).stop 2023-07-11T00:31:47.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.434+0000 7fc2981ff700 1 -- 172.21.15.22:0/2453309942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c004d90 msgr2=0x7fc29014c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:47.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.434+0000 7fc2981ff700 1 --2- 172.21.15.22:0/2453309942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c004d90 0x7fc29014c7b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc28c011aa0 tx=0x7fc28c011e60 comp rx=0 tx=0).stop 2023-07-11T00:31:47.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.435+0000 7fc2981ff700 1 -- 172.21.15.22:0/2453309942 shutdown_connections 2023-07-11T00:31:47.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.435+0000 7fc2981ff700 1 --2- 172.21.15.22:0/2453309942 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc27406ace0 0x7fc27406d190 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:47.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.435+0000 7fc2981ff700 1 --2- 172.21.15.22:0/2453309942 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2900b1450 0x7fc2900b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:47.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.435+0000 7fc2981ff700 1 --2- 172.21.15.22:0/2453309942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c004d90 0x7fc29014c7b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:47.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.435+0000 7fc2981ff700 1 --2- 172.21.15.22:0/2453309942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc29014db60 0x7fc29014aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:47.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.435+0000 7fc2981ff700 1 -- 172.21.15.22:0/2453309942 >> 172.21.15.22:0/2453309942 conn(0x7fc290071660 msgr2=0x7fc2900d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:47.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.435+0000 7fc2981ff700 1 -- 172.21.15.22:0/2453309942 shutdown_connections 2023-07-11T00:31:47.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.435+0000 7fc2981ff700 1 -- 172.21.15.22:0/2453309942 wait complete. 2023-07-11T00:31:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-07-11T00:31:47.458 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-11T00:31:47.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.664+0000 7f14bc3ff700 1 Processor -- start 2023-07-11T00:31:47.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.664+0000 7f14bc3ff700 1 -- start start 2023-07-11T00:31:47.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.665+0000 7f14bc3ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f14b40d3730 0x7f14b40cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:47.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.665+0000 7f14bc3ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b40d0b20 con 0x7f14b40b8430 2023-07-11T00:31:47.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.665+0000 7f14bc3ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b40cfe90 con 0x7f14b40cfa90 2023-07-11T00:31:47.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.665+0000 7f14bc3ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b40cda30 con 0x7f14b40d3730 2023-07-11T00:31:47.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.666+0000 7f14b999a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f14b40d3730 0x7f14b40cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:47.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.666+0000 7f14ba19b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f14b40b8430 0x7f14b40cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46992/0 (socket says 172.21.15.22:46992) 2023-07-11T00:31:47.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.666+0000 7f14ba19b700 1 -- 172.21.15.22:0/1434237295 learned_addr learned my addr 172.21.15.22:0/1434237295 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:47.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.666+0000 7f14b999a700 1 -- 172.21.15.22:0/1434237295 >> v1:172.21.15.184:6789/0 conn(0x7f14b40cfa90 legacy=0x7f14b40d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:47.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.666+0000 7f14b999a700 1 -- 172.21.15.22:0/1434237295 >> v1:172.21.15.22:6789/0 conn(0x7f14b40b8430 legacy=0x7f14b40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:47.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.666+0000 7f14b999a700 1 -- 172.21.15.22:0/1434237295 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b40b4ee0 con 0x7f14b40d3730 2023-07-11T00:31:47.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.666+0000 7f14b9199700 1 -- 172.21.15.22:0/1434237295 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373652780 0 0) 0x7f14b40d0b20 con 0x7f14b40b8430 2023-07-11T00:31:47.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.666+0000 7f14b999a700 1 --2- 172.21.15.22:0/1434237295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14b40d3730 0x7f14b40cf550 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009840 tx=0x7f14a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98951597e5276dfe server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:47.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.666+0000 7f14b9199700 1 -- 172.21.15.22:0/1434237295 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4004230 con 0x7f14b40d3730 2023-07-11T00:31:47.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.667+0000 7f14b9199700 1 -- 172.21.15.22:0/1434237295 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a4004390 con 0x7f14b40d3730 2023-07-11T00:31:47.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.667+0000 7f14b9199700 1 -- 172.21.15.22:0/1434237295 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a40036a0 con 0x7f14b40d3730 2023-07-11T00:31:47.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.667+0000 7f14bc3ff700 1 -- 172.21.15.22:0/1434237295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14b40d3730 msgr2=0x7f14b40cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:47.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.667+0000 7f14bc3ff700 1 --2- 172.21.15.22:0/1434237295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14b40d3730 0x7f14b40cf550 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009840 tx=0x7f14a4009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:47.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.667+0000 7f14bc3ff700 1 -- 172.21.15.22:0/1434237295 shutdown_connections 2023-07-11T00:31:47.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.667+0000 7f14bc3ff700 1 --2- 172.21.15.22:0/1434237295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14b40d3730 0x7f14b40cf550 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:47.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.667+0000 7f14bc3ff700 1 -- 172.21.15.22:0/1434237295 >> 172.21.15.22:0/1434237295 conn(0x7f14b406b3f0 msgr2=0x7f14b406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:47.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.667+0000 7f14bc3ff700 1 -- 172.21.15.22:0/1434237295 shutdown_connections 2023-07-11T00:31:47.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.667+0000 7f14bc3ff700 1 -- 172.21.15.22:0/1434237295 wait complete. 2023-07-11T00:31:47.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.669+0000 7f14bc3ff700 1 Processor -- start 2023-07-11T00:31:47.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.669+0000 7f14bc3ff700 1 -- start start 2023-07-11T00:31:47.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.670+0000 7f14bc3ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14b40b8430 0x7f14b414feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:47.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.670+0000 7f14bc3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14b40cfa90 0x7f14b41f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:47.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.670+0000 7f14bc3ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14b40d3730 0x7f14b40c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:47.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.670+0000 7f14bc3ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b41f2b50 con 0x7f14b40d3730 2023-07-11T00:31:47.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.670+0000 7f14bc3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b41f2590 con 0x7f14b40cfa90 2023-07-11T00:31:47.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.670+0000 7f14bc3ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b41f2870 con 0x7f14b40b8430 2023-07-11T00:31:47.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.670+0000 7f14ba99c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14b40d3730 0x7f14b40c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:47.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.671+0000 7f14ba99c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14b40d3730 0x7f14b40c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55256/0 (socket says 172.21.15.22:55256) 2023-07-11T00:31:47.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.671+0000 7f14ba99c700 1 -- 172.21.15.22:0/3943971193 learned_addr learned my addr 172.21.15.22:0/3943971193 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:47.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.671+0000 7f14ba19b700 1 --2- 172.21.15.22:0/3943971193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14b40b8430 0x7f14b414feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:47.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.671+0000 7f14b999a700 1 --2- 172.21.15.22:0/3943971193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14b40cfa90 0x7f14b41f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:47.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.671+0000 7f14ba99c700 1 -- 172.21.15.22:0/3943971193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14b40b8430 msgr2=0x7f14b414feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:47.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.671+0000 7f14ba99c700 1 --2- 172.21.15.22:0/3943971193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14b40b8430 0x7f14b414feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:47.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.671+0000 7f14ba99c700 1 -- 172.21.15.22:0/3943971193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14b40cfa90 msgr2=0x7f14b41f1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:47.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.671+0000 7f14ba99c700 1 --2- 172.21.15.22:0/3943971193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14b40cfa90 0x7f14b41f1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:47.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.671+0000 7f14ba99c700 1 -- 172.21.15.22:0/3943971193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a40094a0 con 0x7f14b40d3730 2023-07-11T00:31:47.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.671+0000 7f14ba99c700 1 --2- 172.21.15.22:0/3943971193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14b40d3730 0x7f14b40c8c10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00cc10 tx=0x7f14ac00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:47.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.672+0000 7f14aaffd700 1 -- 172.21.15.22:0/3943971193 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00aa60 con 0x7f14b40d3730 2023-07-11T00:31:47.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.672+0000 7f14aaffd700 1 -- 172.21.15.22:0/3943971193 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac00abc0 con 0x7f14b40d3730 2023-07-11T00:31:47.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.672+0000 7f14aaffd700 1 -- 172.21.15.22:0/3943971193 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac012420 con 0x7f14b40d3730 2023-07-11T00:31:47.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.672+0000 7f14bc3ff700 1 -- 172.21.15.22:0/3943971193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b41f2e50 con 0x7f14b40d3730 2023-07-11T00:31:47.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.672+0000 7f14bc3ff700 1 -- 172.21.15.22:0/3943971193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b41503f0 con 0x7f14b40d3730 2023-07-11T00:31:47.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.673+0000 7f14bc3ff700 1 -- 172.21.15.22:0/3943971193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b41f2cb0 con 0x7f14b40d3730 2023-07-11T00:31:47.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.674+0000 7f14aaffd700 1 -- 172.21.15.22:0/3943971193 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f14ac012580 con 0x7f14b40d3730 2023-07-11T00:31:47.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.675+0000 7f14aaffd700 1 --2- 172.21.15.22:0/3943971193 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f149806ace0 0x7f149806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:47.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.675+0000 7f14aaffd700 1 -- 172.21.15.22:0/3943971193 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f14ac08a0d0 con 0x7f14b40d3730 2023-07-11T00:31:47.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.676+0000 7f14ba19b700 1 --2- 172.21.15.22:0/3943971193 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f149806ace0 0x7f149806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:47.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.677+0000 7f14ba19b700 1 --2- 172.21.15.22:0/3943971193 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f149806ace0 0x7f149806d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f14b0000f60 tx=0x7f14b0007e70 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:47.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.679+0000 7f14aaffd700 1 -- 172.21.15.22:0/3943971193 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f14ac055200 con 0x7f14b40d3730 2023-07-11T00:31:47.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:47.888+0000 7f14bc3ff700 1 -- 172.21.15.22:0/3943971193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f14b41f3370 con 0x7f14b40d3730 2023-07-11T00:31:48.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.437+0000 7f14aaffd700 1 -- 172.21.15.22:0/3943971193 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7f14b41f3370 con 0x7f14b40d3730 2023-07-11T00:31:48.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.443+0000 7f14bc3ff700 1 -- 172.21.15.22:0/3943971193 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f149806ace0 msgr2=0x7f149806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:48.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.443+0000 7f14bc3ff700 1 --2- 172.21.15.22:0/3943971193 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f149806ace0 0x7f149806d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f14b0000f60 tx=0x7f14b0007e70 comp rx=0 tx=0).stop 2023-07-11T00:31:48.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.443+0000 7f14bc3ff700 1 -- 172.21.15.22:0/3943971193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14b40d3730 msgr2=0x7f14b40c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:48.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.443+0000 7f14bc3ff700 1 --2- 172.21.15.22:0/3943971193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14b40d3730 0x7f14b40c8c10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00cc10 tx=0x7f14ac00cf20 comp rx=0 tx=0).stop 2023-07-11T00:31:48.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.446+0000 7f14bc3ff700 1 -- 172.21.15.22:0/3943971193 shutdown_connections 2023-07-11T00:31:48.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.446+0000 7f14bc3ff700 1 --2- 172.21.15.22:0/3943971193 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f149806ace0 0x7f149806d190 secure :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f14b0000f60 tx=0x7f14b0007e70 comp rx=0 tx=0).stop 2023-07-11T00:31:48.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.446+0000 7f14bc3ff700 1 --2- 172.21.15.22:0/3943971193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14b40b8430 0x7f14b414feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:48.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.446+0000 7f14bc3ff700 1 --2- 172.21.15.22:0/3943971193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14b40d3730 0x7f14b40c8c10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:48.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.446+0000 7f14bc3ff700 1 --2- 172.21.15.22:0/3943971193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14b40cfa90 0x7f14b41f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:48.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.446+0000 7f14bc3ff700 1 -- 172.21.15.22:0/3943971193 >> 172.21.15.22:0/3943971193 conn(0x7f14b406b3f0 msgr2=0x7f14b415bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:48.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.448+0000 7f14bc3ff700 1 -- 172.21.15.22:0/3943971193 shutdown_connections 2023-07-11T00:31:48.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.449+0000 7f14bc3ff700 1 -- 172.21.15.22:0/3943971193 wait complete. 2023-07-11T00:31:48.458 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-07-11T00:31:48.480 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-11T00:31:48.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.686+0000 7f80defff700 1 Processor -- start 2023-07-11T00:31:48.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.686+0000 7f80defff700 1 -- start start 2023-07-11T00:31:48.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.687+0000 7f80defff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f80d80b8430 0x7f80d80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:48.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.688+0000 7f80defff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80d80cfc60 0x7f80d80d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:48.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.688+0000 7f80defff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d80d0b20 con 0x7f80d80d3730 2023-07-11T00:31:48.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.688+0000 7f80defff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d80b8800 con 0x7f80d80cfc60 2023-07-11T00:31:48.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.688+0000 7f80defff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d80b4ee0 con 0x7f80d80b8430 2023-07-11T00:31:48.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.688+0000 7f80dd59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80d80cfc60 0x7f80d80d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:48.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.688+0000 7f80d7fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f80d80d3730 0x7f80d80cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46994/0 (socket says 172.21.15.22:46994) 2023-07-11T00:31:48.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.688+0000 7f80d7fff700 1 -- 172.21.15.22:0/4225303061 learned_addr learned my addr 172.21.15.22:0/4225303061 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:48.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.688+0000 7f80dcd9b700 1 --2- 172.21.15.22:0/4225303061 >> v2:172.21.15.184:3300/0 conn(0x7f80d80b8430 0x7f80d80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:48.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.688+0000 7f80dd59c700 1 -- 172.21.15.22:0/4225303061 >> v2:172.21.15.184:3300/0 conn(0x7f80d80b8430 msgr2=0x7f80d80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:48.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.688+0000 7f80dd59c700 1 --2- 172.21.15.22:0/4225303061 >> v2:172.21.15.184:3300/0 conn(0x7f80d80b8430 0x7f80d80cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:48.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.688+0000 7f80dd59c700 1 -- 172.21.15.22:0/4225303061 >> v1:172.21.15.22:6789/0 conn(0x7f80d80d3730 legacy=0x7f80d80cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:48.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.689+0000 7f80dd59c700 1 -- 172.21.15.22:0/4225303061 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d80b51c0 con 0x7f80d80cfc60 2023-07-11T00:31:48.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.689+0000 7f80d77fe700 1 -- 172.21.15.22:0/4225303061 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324486100 0 0) 0x7f80d80d0b20 con 0x7f80d80d3730 2023-07-11T00:31:48.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.689+0000 7f80dd59c700 1 --2- 172.21.15.22:0/4225303061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80d80cfc60 0x7f80d80d0fb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f80d80cf520 tx=0x7f80d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfd790ad6386d3a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:48.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.689+0000 7f80d77fe700 1 -- 172.21.15.22:0/4225303061 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d000e070 con 0x7f80d80cfc60 2023-07-11T00:31:48.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.689+0000 7f80d77fe700 1 -- 172.21.15.22:0/4225303061 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d000bb20 con 0x7f80d80cfc60 2023-07-11T00:31:48.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.689+0000 7f80d77fe700 1 -- 172.21.15.22:0/4225303061 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d0012430 con 0x7f80d80cfc60 2023-07-11T00:31:48.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.690+0000 7f80defff700 1 -- 172.21.15.22:0/4225303061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80d80cfc60 msgr2=0x7f80d80d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:48.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.690+0000 7f80defff700 1 --2- 172.21.15.22:0/4225303061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80d80cfc60 0x7f80d80d0fb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f80d80cf520 tx=0x7f80d000b330 comp rx=0 tx=0).stop 2023-07-11T00:31:48.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.690+0000 7f80defff700 1 -- 172.21.15.22:0/4225303061 shutdown_connections 2023-07-11T00:31:48.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.690+0000 7f80defff700 1 --2- 172.21.15.22:0/4225303061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80d80cfc60 0x7f80d80d0fb0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:48.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.690+0000 7f80defff700 1 --2- 172.21.15.22:0/4225303061 >> v2:172.21.15.184:3300/0 conn(0x7f80d80b8430 0x7f80d80cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:48.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.690+0000 7f80defff700 1 -- 172.21.15.22:0/4225303061 >> 172.21.15.22:0/4225303061 conn(0x7f80d806b3f0 msgr2=0x7f80d806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:48.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.690+0000 7f80defff700 1 -- 172.21.15.22:0/4225303061 shutdown_connections 2023-07-11T00:31:48.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.690+0000 7f80defff700 1 -- 172.21.15.22:0/4225303061 wait complete. 2023-07-11T00:31:48.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.692+0000 7f80defff700 1 Processor -- start 2023-07-11T00:31:48.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.692+0000 7f80defff700 1 -- start start 2023-07-11T00:31:48.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.693+0000 7f80defff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80d80b8430 0x7f80d80c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:48.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.693+0000 7f80defff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80d80cfc60 0x7f80d815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:48.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.693+0000 7f80defff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80d80d3730 0x7f80d815dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:48.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.693+0000 7f80defff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d815e6d0 con 0x7f80d80cfc60 2023-07-11T00:31:48.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.693+0000 7f80defff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d815cc10 con 0x7f80d80b8430 2023-07-11T00:31:48.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.693+0000 7f80defff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d815e3f0 con 0x7f80d80d3730 2023-07-11T00:31:48.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.693+0000 7f80d7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80d80cfc60 0x7f80d815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:48.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.693+0000 7f80d7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80d80cfc60 0x7f80d815d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55270/0 (socket says 172.21.15.22:55270) 2023-07-11T00:31:48.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.693+0000 7f80d7fff700 1 -- 172.21.15.22:0/2856374589 learned_addr learned my addr 172.21.15.22:0/2856374589 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:48.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.693+0000 7f80dcd9b700 1 --2- 172.21.15.22:0/2856374589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80d80b8430 0x7f80d80c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:48.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.693+0000 7f80dd59c700 1 --2- 172.21.15.22:0/2856374589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80d80d3730 0x7f80d815dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.693+0000 7f80d7fff700 1 -- 172.21.15.22:0/2856374589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80d80d3730 msgr2=0x7f80d815dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.694+0000 7f80d7fff700 1 --2- 172.21.15.22:0/2856374589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80d80d3730 0x7f80d815dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.694+0000 7f80d7fff700 1 -- 172.21.15.22:0/2856374589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80d80b8430 msgr2=0x7f80d80c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.694+0000 7f80d7fff700 1 --2- 172.21.15.22:0/2856374589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80d80b8430 0x7f80d80c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.694+0000 7f80d7fff700 1 -- 172.21.15.22:0/2856374589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d0009a70 con 0x7f80d80cfc60 2023-07-11T00:31:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.694+0000 7f80dcd9b700 1 --2- 172.21.15.22:0/2856374589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80d80b8430 0x7f80d80c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.694+0000 7f80d7fff700 1 --2- 172.21.15.22:0/2856374589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80d80cfc60 0x7f80d815d7b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f80c400c550 tx=0x7f80c400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.694+0000 7f80d57fa700 1 -- 172.21.15.22:0/2856374589 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4004c80 con 0x7f80d80cfc60 2023-07-11T00:31:48.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.694+0000 7f80d57fa700 1 -- 172.21.15.22:0/2856374589 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c4004e00 con 0x7f80d80cfc60 2023-07-11T00:31:48.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.694+0000 7f80d57fa700 1 -- 172.21.15.22:0/2856374589 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4007310 con 0x7f80d80cfc60 2023-07-11T00:31:48.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.694+0000 7f80defff700 1 -- 172.21.15.22:0/2856374589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d80c6810 con 0x7f80d80cfc60 2023-07-11T00:31:48.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.694+0000 7f80defff700 1 -- 172.21.15.22:0/2856374589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d80c6dd0 con 0x7f80d80cfc60 2023-07-11T00:31:48.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.695+0000 7f80defff700 1 -- 172.21.15.22:0/2856374589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d80c6670 con 0x7f80d80cfc60 2023-07-11T00:31:48.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.696+0000 7f80d57fa700 1 -- 172.21.15.22:0/2856374589 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f80c4007470 con 0x7f80d80cfc60 2023-07-11T00:31:48.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.697+0000 7f80d57fa700 1 --2- 172.21.15.22:0/2856374589 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80bc06ace0 0x7f80bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:48.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.698+0000 7f80d57fa700 1 -- 172.21.15.22:0/2856374589 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f80c40891d0 con 0x7f80d80cfc60 2023-07-11T00:31:48.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.698+0000 7f80dcd9b700 1 --2- 172.21.15.22:0/2856374589 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80bc06ace0 0x7f80bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:48.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.699+0000 7f80dcd9b700 1 --2- 172.21.15.22:0/2856374589 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80bc06ace0 0x7f80bc06d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f80cc009fd0 tx=0x7f80cc009210 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:48.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.702+0000 7f80d57fa700 1 -- 172.21.15.22:0/2856374589 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f80d80c6670 con 0x7f80d80cfc60 2023-07-11T00:31:48.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:48.960+0000 7f80defff700 1 -- 172.21.15.22:0/2856374589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f80d80c6670 con 0x7f80d80cfc60 2023-07-11T00:31:49.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.439+0000 7f80d57fa700 1 -- 172.21.15.22:0/2856374589 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f80d80c6670 con 0x7f80d80cfc60 2023-07-11T00:31:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.445+0000 7f80defff700 1 -- 172.21.15.22:0/2856374589 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80bc06ace0 msgr2=0x7f80bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.445+0000 7f80defff700 1 --2- 172.21.15.22:0/2856374589 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80bc06ace0 0x7f80bc06d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f80cc009fd0 tx=0x7f80cc009210 comp rx=0 tx=0).stop 2023-07-11T00:31:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.445+0000 7f80defff700 1 -- 172.21.15.22:0/2856374589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80d80cfc60 msgr2=0x7f80d815d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.445+0000 7f80defff700 1 --2- 172.21.15.22:0/2856374589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80d80cfc60 0x7f80d815d7b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f80c400c550 tx=0x7f80c400c860 comp rx=0 tx=0).stop 2023-07-11T00:31:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.445+0000 7f80defff700 1 -- 172.21.15.22:0/2856374589 shutdown_connections 2023-07-11T00:31:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.445+0000 7f80defff700 1 --2- 172.21.15.22:0/2856374589 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80bc06ace0 0x7f80bc06d190 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.445+0000 7f80defff700 1 --2- 172.21.15.22:0/2856374589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80d80d3730 0x7f80d815dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.445+0000 7f80defff700 1 --2- 172.21.15.22:0/2856374589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80d80b8430 0x7f80d80c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.445+0000 7f80defff700 1 --2- 172.21.15.22:0/2856374589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80d80cfc60 0x7f80d815d7b0 secure :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f80c400c550 tx=0x7f80c400c860 comp rx=0 tx=0).stop 2023-07-11T00:31:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.445+0000 7f80defff700 1 -- 172.21.15.22:0/2856374589 >> 172.21.15.22:0/2856374589 conn(0x7f80d806b3f0 msgr2=0x7f80d80b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:49.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.449+0000 7f80defff700 1 -- 172.21.15.22:0/2856374589 shutdown_connections 2023-07-11T00:31:49.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.450+0000 7f80defff700 1 -- 172.21.15.22:0/2856374589 wait complete. 2023-07-11T00:31:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 6 and data pool 7 2023-07-11T00:31:49.492 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:31:49.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.692+0000 7f00e63ff700 1 Processor -- start 2023-07-11T00:31:49.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.693+0000 7f00e63ff700 1 -- start start 2023-07-11T00:31:49.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.694+0000 7f00e63ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00e015c460 0x7f00e00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:49.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.694+0000 7f00e63ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e00d1790 con 0x7f00e00cf8f0 2023-07-11T00:31:49.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.694+0000 7f00e63ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e00cd950 con 0x7f00e00d2640 2023-07-11T00:31:49.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.694+0000 7f00e63ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e00cedd0 con 0x7f00e015c460 2023-07-11T00:31:49.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.694+0000 7f00e499c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f00e00cf8f0 0x7f00e015fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47004/0 (socket says 172.21.15.22:47004) 2023-07-11T00:31:49.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.694+0000 7f00e499c700 1 -- 172.21.15.22:0/3102480679 learned_addr learned my addr 172.21.15.22:0/3102480679 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:49.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.694+0000 7f00dffff700 1 --2- 172.21.15.22:0/3102480679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00e015c460 0x7f00e00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:49.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.695+0000 7f00deffd700 1 -- 172.21.15.22:0/3102480679 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067332553 0 0) 0x7f00e00d1790 con 0x7f00e00cf8f0 2023-07-11T00:31:49.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.695+0000 7f00deffd700 1 -- 172.21.15.22:0/3102480679 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c80035b0 con 0x7f00e00cf8f0 2023-07-11T00:31:49.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.695+0000 7f00deffd700 1 -- 172.21.15.22:0/3102480679 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800766139 0 0) 0x7f00e00cd950 con 0x7f00e00d2640 2023-07-11T00:31:49.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.695+0000 7f00deffd700 1 -- 172.21.15.22:0/3102480679 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00e00d1790 con 0x7f00e00d2640 2023-07-11T00:31:49.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.695+0000 7f00dffff700 1 -- 172.21.15.22:0/3102480679 >> v1:172.21.15.184:6789/0 conn(0x7f00e00d2640 legacy=0x7f00e00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:49.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.695+0000 7f00dffff700 1 -- 172.21.15.22:0/3102480679 >> v1:172.21.15.22:6789/0 conn(0x7f00e00cf8f0 legacy=0x7f00e015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:49.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.695+0000 7f00dffff700 1 -- 172.21.15.22:0/3102480679 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e00d14b0 con 0x7f00e015c460 2023-07-11T00:31:49.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.695+0000 7f00dffff700 1 --2- 172.21.15.22:0/3102480679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00e015c460 0x7f00e00b59d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009870 tx=0x7f00d0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2fb544d38cd8038 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:49.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.696+0000 7f00deffd700 1 -- 172.21.15.22:0/3102480679 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0011830 con 0x7f00e015c460 2023-07-11T00:31:49.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.696+0000 7f00deffd700 1 -- 172.21.15.22:0/3102480679 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d0011990 con 0x7f00e015c460 2023-07-11T00:31:49.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.696+0000 7f00deffd700 1 -- 172.21.15.22:0/3102480679 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0011d20 con 0x7f00e015c460 2023-07-11T00:31:49.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.696+0000 7f00e63ff700 1 -- 172.21.15.22:0/3102480679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00e015c460 msgr2=0x7f00e00b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:49.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.696+0000 7f00e63ff700 1 --2- 172.21.15.22:0/3102480679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00e015c460 0x7f00e00b59d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009870 tx=0x7f00d0009b80 comp rx=0 tx=0).stop 2023-07-11T00:31:49.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.696+0000 7f00e63ff700 1 -- 172.21.15.22:0/3102480679 shutdown_connections 2023-07-11T00:31:49.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.696+0000 7f00e63ff700 1 --2- 172.21.15.22:0/3102480679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00e015c460 0x7f00e00b59d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:49.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.696+0000 7f00e63ff700 1 -- 172.21.15.22:0/3102480679 >> 172.21.15.22:0/3102480679 conn(0x7f00e0071660 msgr2=0x7f00e0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:49.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.696+0000 7f00e63ff700 1 -- 172.21.15.22:0/3102480679 shutdown_connections 2023-07-11T00:31:49.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.696+0000 7f00e63ff700 1 -- 172.21.15.22:0/3102480679 wait complete. 2023-07-11T00:31:49.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.698+0000 7f00e63ff700 1 Processor -- start 2023-07-11T00:31:49.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.698+0000 7f00e63ff700 1 -- start start 2023-07-11T00:31:49.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.699+0000 7f00e63ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00e00cf8f0 0x7f00e014cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:49.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.699+0000 7f00e63ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00e00d2640 0x7f00e00cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:49.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.699+0000 7f00e63ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00e015c460 0x7f00e00c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:49.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.699+0000 7f00e63ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e0158200 con 0x7f00e015c460 2023-07-11T00:31:49.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.699+0000 7f00e63ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e00cc170 con 0x7f00e00d2640 2023-07-11T00:31:49.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.699+0000 7f00e63ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e00cc450 con 0x7f00e00cf8f0 2023-07-11T00:31:49.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.699+0000 7f00e499c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00e015c460 0x7f00e00c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:49.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.699+0000 7f00e499c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00e015c460 0x7f00e00c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55278/0 (socket says 172.21.15.22:55278) 2023-07-11T00:31:49.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.699+0000 7f00e499c700 1 -- 172.21.15.22:0/3180822604 learned_addr learned my addr 172.21.15.22:0/3180822604 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:49.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.699+0000 7f00dffff700 1 --2- 172.21.15.22:0/3180822604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00e00cf8f0 0x7f00e014cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:49.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.699+0000 7f00df7fe700 1 --2- 172.21.15.22:0/3180822604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00e00d2640 0x7f00e00cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:49.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.700+0000 7f00e499c700 1 -- 172.21.15.22:0/3180822604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00e00cf8f0 msgr2=0x7f00e014cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:49.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.700+0000 7f00e499c700 1 --2- 172.21.15.22:0/3180822604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00e00cf8f0 0x7f00e014cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:49.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.700+0000 7f00e499c700 1 -- 172.21.15.22:0/3180822604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00e00d2640 msgr2=0x7f00e00cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:49.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.700+0000 7f00e499c700 1 --2- 172.21.15.22:0/3180822604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00e00d2640 0x7f00e00cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:49.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.700+0000 7f00e499c700 1 -- 172.21.15.22:0/3180822604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d00094a0 con 0x7f00e015c460 2023-07-11T00:31:49.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.700+0000 7f00e499c700 1 --2- 172.21.15.22:0/3180822604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00e015c460 0x7f00e00c8a90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f00d800caf0 tx=0x7f00d800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:49.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.700+0000 7f00dcff9700 1 -- 172.21.15.22:0/3180822604 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d800a9e0 con 0x7f00e015c460 2023-07-11T00:31:49.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.700+0000 7f00dcff9700 1 -- 172.21.15.22:0/3180822604 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d800ab40 con 0x7f00e015c460 2023-07-11T00:31:49.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.700+0000 7f00e63ff700 1 -- 172.21.15.22:0/3180822604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e0158410 con 0x7f00e015c460 2023-07-11T00:31:49.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.700+0000 7f00dcff9700 1 -- 172.21.15.22:0/3180822604 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8012400 con 0x7f00e015c460 2023-07-11T00:31:49.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.700+0000 7f00e63ff700 1 -- 172.21.15.22:0/3180822604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e01e6930 con 0x7f00e015c460 2023-07-11T00:31:49.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.701+0000 7f00e63ff700 1 -- 172.21.15.22:0/3180822604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e0158930 con 0x7f00e015c460 2023-07-11T00:31:49.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.703+0000 7f00dcff9700 1 -- 172.21.15.22:0/3180822604 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f00d801b3b0 con 0x7f00e015c460 2023-07-11T00:31:49.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.704+0000 7f00dcff9700 1 --2- 172.21.15.22:0/3180822604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f00cc06ace0 0x7f00cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:49.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.704+0000 7f00dcff9700 1 -- 172.21.15.22:0/3180822604 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f00d80892b0 con 0x7f00e015c460 2023-07-11T00:31:49.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.704+0000 7f00dffff700 1 --2- 172.21.15.22:0/3180822604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f00cc06ace0 0x7f00cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:49.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.705+0000 7f00dffff700 1 --2- 172.21.15.22:0/3180822604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f00cc06ace0 0x7f00cc06d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f00d00097c0 tx=0x7f00d001c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:49.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.708+0000 7f00dcff9700 1 -- 172.21.15.22:0/3180822604 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f00e0158930 con 0x7f00e015c460 2023-07-11T00:31:49.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.919+0000 7f00e63ff700 1 -- 172.21.15.22:0/3180822604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00e0158930 con 0x7f00e015c460 2023-07-11T00:31:49.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.920+0000 7f00dcff9700 1 -- 172.21.15.22:0/3180822604 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18455 (secure 0 0 0) 0x7f00e0158930 con 0x7f00e015c460 2023-07-11T00:31:49.923 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:49.923 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":37,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:31:48.961715+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:31:47.379034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-11T00:31:47.929557+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:31:49.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.922+0000 7f00e63ff700 1 -- 172.21.15.22:0/3180822604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f00cc06ace0 msgr2=0x7f00cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:49.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.922+0000 7f00e63ff700 1 --2- 172.21.15.22:0/3180822604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f00cc06ace0 0x7f00cc06d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f00d00097c0 tx=0x7f00d001c040 comp rx=0 tx=0).stop 2023-07-11T00:31:49.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.922+0000 7f00e63ff700 1 -- 172.21.15.22:0/3180822604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00e015c460 msgr2=0x7f00e00c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:49.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.922+0000 7f00e63ff700 1 --2- 172.21.15.22:0/3180822604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00e015c460 0x7f00e00c8a90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f00d800caf0 tx=0x7f00d800ce00 comp rx=0 tx=0).stop 2023-07-11T00:31:49.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.922+0000 7f00e63ff700 1 -- 172.21.15.22:0/3180822604 shutdown_connections 2023-07-11T00:31:49.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.922+0000 7f00e63ff700 1 --2- 172.21.15.22:0/3180822604 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f00cc06ace0 0x7f00cc06d190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:49.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.922+0000 7f00e63ff700 1 --2- 172.21.15.22:0/3180822604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00e00cf8f0 0x7f00e014cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:49.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.922+0000 7f00e63ff700 1 --2- 172.21.15.22:0/3180822604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00e015c460 0x7f00e00c8a90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:49.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.922+0000 7f00e63ff700 1 --2- 172.21.15.22:0/3180822604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00e00d2640 0x7f00e00cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:49.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.923+0000 7f00e63ff700 1 -- 172.21.15.22:0/3180822604 >> 172.21.15.22:0/3180822604 conn(0x7f00e0071660 msgr2=0x7f00e00b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:49.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.923+0000 7f00e63ff700 1 -- 172.21.15.22:0/3180822604 shutdown_connections 2023-07-11T00:31:49.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:49.923+0000 7f00e63ff700 1 -- 172.21.15.22:0/3180822604 wait complete. 2023-07-11T00:31:49.943 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:31:50.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.142+0000 7fb6e59ff700 1 Processor -- start 2023-07-11T00:31:50.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.142+0000 7fb6e59ff700 1 -- start start 2023-07-11T00:31:50.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.143+0000 7fb6e59ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6e015c460 0x7fb6e00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:50.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.143+0000 7fb6e59ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6e00d2640 0x7fb6e00cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:50.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.143+0000 7fb6e59ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb6e00cf720 0x7fb6e00cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:50.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.143+0000 7fb6e59ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e00cedd0 con 0x7fb6e015c460 2023-07-11T00:31:50.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.143+0000 7fb6e59ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e00d1790 con 0x7fb6e00cf720 2023-07-11T00:31:50.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.143+0000 7fb6e59ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e00cd950 con 0x7fb6e00d2640 2023-07-11T00:31:50.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.144+0000 7fb6deffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6e015c460 0x7fb6e00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:50.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.144+0000 7fb6deffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6e015c460 0x7fb6e00b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48934/0 (socket says 172.21.15.22:48934) 2023-07-11T00:31:50.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.144+0000 7fb6deffd700 1 -- 172.21.15.22:0/2269598781 learned_addr learned my addr 172.21.15.22:0/2269598781 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:50.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.144+0000 7fb6df7fe700 1 --2- 172.21.15.22:0/2269598781 >> v2:172.21.15.184:3300/0 conn(0x7fb6e00cf720 0x7fb6e00cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:50.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.144+0000 7fb6de7fc700 1 --2- 172.21.15.22:0/2269598781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6e00d2640 0x7fb6e00cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:50.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.144+0000 7fb6deffd700 1 -- 172.21.15.22:0/2269598781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6e00d2640 msgr2=0x7fb6e00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:50.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.144+0000 7fb6deffd700 1 --2- 172.21.15.22:0/2269598781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6e00d2640 0x7fb6e00cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.144+0000 7fb6deffd700 1 -- 172.21.15.22:0/2269598781 >> v2:172.21.15.184:3300/0 conn(0x7fb6e00cf720 msgr2=0x7fb6e00cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:50.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.144+0000 7fb6deffd700 1 --2- 172.21.15.22:0/2269598781 >> v2:172.21.15.184:3300/0 conn(0x7fb6e00cf720 0x7fb6e00cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.144+0000 7fb6deffd700 1 -- 172.21.15.22:0/2269598781 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e00d14b0 con 0x7fb6e015c460 2023-07-11T00:31:50.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.144+0000 7fb6df7fe700 1 --2- 172.21.15.22:0/2269598781 >> v2:172.21.15.184:3300/0 conn(0x7fb6e00cf720 0x7fb6e00cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:50.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.144+0000 7fb6de7fc700 1 --2- 172.21.15.22:0/2269598781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6e00d2640 0x7fb6e00cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:50.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.144+0000 7fb6deffd700 1 --2- 172.21.15.22:0/2269598781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e015c460 0x7fb6e00b59d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb6e008bf90 tx=0x7fb6d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b56ed50c2c5ebb server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:50.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.144+0000 7fb6ddffb700 1 -- 172.21.15.22:0/2269598781 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d000b870 con 0x7fb6e015c460 2023-07-11T00:31:50.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.145+0000 7fb6ddffb700 1 -- 172.21.15.22:0/2269598781 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d000b9d0 con 0x7fb6e015c460 2023-07-11T00:31:50.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.145+0000 7fb6ddffb700 1 -- 172.21.15.22:0/2269598781 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d000bd60 con 0x7fb6e015c460 2023-07-11T00:31:50.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.145+0000 7fb6e59ff700 1 -- 172.21.15.22:0/2269598781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e015c460 msgr2=0x7fb6e00b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:50.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.145+0000 7fb6e59ff700 1 --2- 172.21.15.22:0/2269598781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e015c460 0x7fb6e00b59d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb6e008bf90 tx=0x7fb6d0009bd0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.145+0000 7fb6e59ff700 1 -- 172.21.15.22:0/2269598781 shutdown_connections 2023-07-11T00:31:50.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.145+0000 7fb6e59ff700 1 --2- 172.21.15.22:0/2269598781 >> v2:172.21.15.184:3300/0 conn(0x7fb6e00cf720 0x7fb6e00cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.145+0000 7fb6e59ff700 1 --2- 172.21.15.22:0/2269598781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e015c460 0x7fb6e00b59d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.145+0000 7fb6e59ff700 1 --2- 172.21.15.22:0/2269598781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6e00d2640 0x7fb6e00cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.145+0000 7fb6e59ff700 1 -- 172.21.15.22:0/2269598781 >> 172.21.15.22:0/2269598781 conn(0x7fb6e0071660 msgr2=0x7fb6e0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:50.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.145+0000 7fb6e59ff700 1 -- 172.21.15.22:0/2269598781 shutdown_connections 2023-07-11T00:31:50.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.145+0000 7fb6e59ff700 1 -- 172.21.15.22:0/2269598781 wait complete. 2023-07-11T00:31:50.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.147+0000 7fb6e59ff700 1 Processor -- start 2023-07-11T00:31:50.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.147+0000 7fb6e59ff700 1 -- start start 2023-07-11T00:31:50.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.148+0000 7fb6e59ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6e00cf720 0x7fb6e01e87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:50.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.148+0000 7fb6e59ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6e00d2640 0x7fb6e00cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:50.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.148+0000 7fb6e59ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e015c460 0x7fb6e0151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:50.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.148+0000 7fb6e59ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e00cb2b0 con 0x7fb6e015c460 2023-07-11T00:31:50.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.148+0000 7fb6e59ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e01e67f0 con 0x7fb6e00d2640 2023-07-11T00:31:50.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.148+0000 7fb6e59ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e00cafd0 con 0x7fb6e00cf720 2023-07-11T00:31:50.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.148+0000 7fb6de7fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6e00d2640 0x7fb6e00cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:50.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.148+0000 7fb6df7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e015c460 0x7fb6e0151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:50.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.148+0000 7fb6de7fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6e00d2640 0x7fb6e00cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:43240/0 (socket says 172.21.15.22:43240) 2023-07-11T00:31:50.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.148+0000 7fb6deffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6e00cf720 0x7fb6e01e87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:50.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.148+0000 7fb6de7fc700 1 -- 172.21.15.22:0/4040968099 learned_addr learned my addr 172.21.15.22:0/4040968099 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:50.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.149+0000 7fb6df7fe700 1 -- 172.21.15.22:0/4040968099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6e00cf720 msgr2=0x7fb6e01e87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:50.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.149+0000 7fb6df7fe700 1 --2- 172.21.15.22:0/4040968099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6e00cf720 0x7fb6e01e87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.149+0000 7fb6df7fe700 1 -- 172.21.15.22:0/4040968099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6e00d2640 msgr2=0x7fb6e00cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:50.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.149+0000 7fb6df7fe700 1 --2- 172.21.15.22:0/4040968099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6e00d2640 0x7fb6e00cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.149+0000 7fb6df7fe700 1 -- 172.21.15.22:0/4040968099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d0009550 con 0x7fb6e015c460 2023-07-11T00:31:50.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.149+0000 7fb6deffd700 1 --2- 172.21.15.22:0/4040968099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6e00cf720 0x7fb6e01e87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:50.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.149+0000 7fb6de7fc700 1 --2- 172.21.15.22:0/4040968099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6e00d2640 0x7fb6e00cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:50.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.149+0000 7fb6df7fe700 1 --2- 172.21.15.22:0/4040968099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e015c460 0x7fb6e0151590 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00d0100 tx=0x7fb6d800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:50.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.149+0000 7fb6c7fff700 1 -- 172.21.15.22:0/4040968099 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d800ac60 con 0x7fb6e015c460 2023-07-11T00:31:50.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.149+0000 7fb6c7fff700 1 -- 172.21.15.22:0/4040968099 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d800adc0 con 0x7fb6e015c460 2023-07-11T00:31:50.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.149+0000 7fb6c7fff700 1 -- 172.21.15.22:0/4040968099 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d800f6c0 con 0x7fb6e015c460 2023-07-11T00:31:50.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.149+0000 7fb6e59ff700 1 -- 172.21.15.22:0/4040968099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e01e6a90 con 0x7fb6e015c460 2023-07-11T00:31:50.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.150+0000 7fb6e59ff700 1 -- 172.21.15.22:0/4040968099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e0152340 con 0x7fb6e015c460 2023-07-11T00:31:50.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.151+0000 7fb6e59ff700 1 -- 172.21.15.22:0/4040968099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e01e6650 con 0x7fb6e015c460 2023-07-11T00:31:50.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.151+0000 7fb6c7fff700 1 -- 172.21.15.22:0/4040968099 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb6d800b040 con 0x7fb6e015c460 2023-07-11T00:31:50.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.153+0000 7fb6c7fff700 1 --2- 172.21.15.22:0/4040968099 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb6cc06ace0 0x7fb6cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:50.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.153+0000 7fb6c7fff700 1 -- 172.21.15.22:0/4040968099 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb6d8089ae0 con 0x7fb6e015c460 2023-07-11T00:31:50.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.153+0000 7fb6deffd700 1 --2- 172.21.15.22:0/4040968099 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb6cc06ace0 0x7fb6cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:50.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.154+0000 7fb6deffd700 1 --2- 172.21.15.22:0/4040968099 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb6cc06ace0 0x7fb6cc06d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0014040 tx=0x7fb6d0008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:50.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.158+0000 7fb6c7fff700 1 -- 172.21.15.22:0/4040968099 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb6e01e6650 con 0x7fb6e015c460 2023-07-11T00:31:50.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.366+0000 7fb6e59ff700 1 -- 172.21.15.22:0/4040968099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6e01e6fb0 con 0x7fb6e015c460 2023-07-11T00:31:50.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.368+0000 7fb6c7fff700 1 -- 172.21.15.22:0/4040968099 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18455 (secure 0 0 0) 0x7fb6e01e6fb0 con 0x7fb6e015c460 2023-07-11T00:31:50.370 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:50.371 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":37,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:31:48.961715+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:31:47.379034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-11T00:31:47.929557+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:31:50.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.370+0000 7fb6e59ff700 1 -- 172.21.15.22:0/4040968099 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb6cc06ace0 msgr2=0x7fb6cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:50.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.370+0000 7fb6e59ff700 1 --2- 172.21.15.22:0/4040968099 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb6cc06ace0 0x7fb6cc06d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0014040 tx=0x7fb6d0008030 comp rx=0 tx=0).stop 2023-07-11T00:31:50.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.370+0000 7fb6e59ff700 1 -- 172.21.15.22:0/4040968099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e015c460 msgr2=0x7fb6e0151590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.370+0000 7fb6e59ff700 1 --2- 172.21.15.22:0/4040968099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e015c460 0x7fb6e0151590 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00d0100 tx=0x7fb6d800cf10 comp rx=0 tx=0).stop 2023-07-11T00:31:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.370+0000 7fb6e59ff700 1 -- 172.21.15.22:0/4040968099 shutdown_connections 2023-07-11T00:31:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.370+0000 7fb6e59ff700 1 --2- 172.21.15.22:0/4040968099 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fb6cc06ace0 0x7fb6cc06d190 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.370+0000 7fb6e59ff700 1 --2- 172.21.15.22:0/4040968099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6e00cf720 0x7fb6e01e87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.370+0000 7fb6e59ff700 1 --2- 172.21.15.22:0/4040968099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e015c460 0x7fb6e0151590 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.370+0000 7fb6e59ff700 1 --2- 172.21.15.22:0/4040968099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6e00d2640 0x7fb6e00cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.370+0000 7fb6e59ff700 1 -- 172.21.15.22:0/4040968099 >> 172.21.15.22:0/4040968099 conn(0x7fb6e0071660 msgr2=0x7fb6e0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:50.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.370+0000 7fb6e59ff700 1 -- 172.21.15.22:0/4040968099 shutdown_connections 2023-07-11T00:31:50.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.370+0000 7fb6e59ff700 1 -- 172.21.15.22:0/4040968099 wait complete. 2023-07-11T00:31:50.391 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-11T00:31:50.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.596+0000 7f3517bff700 1 Processor -- start 2023-07-11T00:31:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.596+0000 7f3517bff700 1 -- start start 2023-07-11T00:31:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.597+0000 7f3517bff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f351015c690 0x7f35100adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:50.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.597+0000 7f3517bff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35100c9750 con 0x7f35100ca1f0 2023-07-11T00:31:50.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.597+0000 7f3517bff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35100cf1c0 con 0x7f35100cd0a0 2023-07-11T00:31:50.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.597+0000 7f3517bff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35100cd610 con 0x7f351015c690 2023-07-11T00:31:50.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.598+0000 7f351619c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f35100ca1f0 0x7f3510070440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57286/0 (socket says 172.21.15.22:57286) 2023-07-11T00:31:50.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.598+0000 7f351619c700 1 -- 172.21.15.22:0/3175558070 learned_addr learned my addr 172.21.15.22:0/3175558070 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:50.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.598+0000 7f351599b700 1 --2- 172.21.15.22:0/3175558070 >> v2:172.21.15.184:3300/0 conn(0x7f351015c690 0x7f35100adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:50.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.598+0000 7f3514999700 1 -- 172.21.15.22:0/3175558070 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275231965 0 0) 0x7f35100c9750 con 0x7f35100ca1f0 2023-07-11T00:31:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.598+0000 7f3514999700 1 -- 172.21.15.22:0/3175558070 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34fc0057c0 con 0x7f35100ca1f0 2023-07-11T00:31:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.598+0000 7f3514999700 1 -- 172.21.15.22:0/3175558070 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707617007 0 0) 0x7f35100cf1c0 con 0x7f35100cd0a0 2023-07-11T00:31:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.598+0000 7f3514999700 1 -- 172.21.15.22:0/3175558070 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35100c9750 con 0x7f35100cd0a0 2023-07-11T00:31:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.598+0000 7f3514999700 1 -- 172.21.15.22:0/3175558070 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2955448005 0 0) 0x7f34fc0057c0 con 0x7f35100ca1f0 2023-07-11T00:31:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.598+0000 7f3514999700 1 -- 172.21.15.22:0/3175558070 >> v2:172.21.15.184:3300/0 conn(0x7f351015c690 msgr2=0x7f35100adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.598+0000 7f3514999700 1 --2- 172.21.15.22:0/3175558070 >> v2:172.21.15.184:3300/0 conn(0x7f351015c690 0x7f35100adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.598+0000 7f3514999700 1 -- 172.21.15.22:0/3175558070 >> v1:172.21.15.184:6789/0 conn(0x7f35100cd0a0 legacy=0x7f351006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.598+0000 7f3514999700 1 -- 172.21.15.22:0/3175558070 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35100cd8f0 con 0x7f35100ca1f0 2023-07-11T00:31:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.598+0000 7f3514999700 1 -- 172.21.15.22:0/3175558070 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7f35080019f0 con 0x7f35100ca1f0 2023-07-11T00:31:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.599+0000 7f3514999700 1 -- 172.21.15.22:0/3175558070 >> v1:172.21.15.22:6789/0 conn(0x7f35100ca1f0 legacy=0x7f3510070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.599+0000 7f3514999700 1 --2- 172.21.15.22:0/3175558070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34fc005da0 0x7f34fc006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.599+0000 7f3514999700 1 --2- 172.21.15.22:0/3175558070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34fc006a60 0x7f34fc006ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.599+0000 7f3514999700 1 --2- 172.21.15.22:0/3175558070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34fc007410 0x7f34fc00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.599+0000 7f3514999700 1 -- 172.21.15.22:0/3175558070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35100cd610 con 0x7f34fc007410 2023-07-11T00:31:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.599+0000 7f3514999700 1 -- 172.21.15.22:0/3175558070 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc00e270 con 0x7f34fc006a60 2023-07-11T00:31:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.599+0000 7f3514999700 1 -- 172.21.15.22:0/3175558070 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc00e430 con 0x7f34fc005da0 2023-07-11T00:31:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.599+0000 7f351619c700 1 --2- 172.21.15.22:0/3175558070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34fc007410 0x7f34fc00dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.599+0000 7f351599b700 1 --2- 172.21.15.22:0/3175558070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34fc005da0 0x7f34fc006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.599+0000 7f351519a700 1 --2- 172.21.15.22:0/3175558070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34fc006a60 0x7f34fc006ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.599+0000 7f351619c700 1 -- 172.21.15.22:0/3175558070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34fc005da0 msgr2=0x7f34fc006190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.599+0000 7f351619c700 1 --2- 172.21.15.22:0/3175558070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34fc005da0 0x7f34fc006190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.599+0000 7f351619c700 1 -- 172.21.15.22:0/3175558070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34fc006a60 msgr2=0x7f34fc006ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:50.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.599+0000 7f351619c700 1 --2- 172.21.15.22:0/3175558070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34fc006a60 0x7f34fc006ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.599+0000 7f351619c700 1 -- 172.21.15.22:0/3175558070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc0057c0 con 0x7f34fc007410 2023-07-11T00:31:50.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.599+0000 7f351519a700 1 --2- 172.21.15.22:0/3175558070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34fc006a60 0x7f34fc006ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:50.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.599+0000 7f351619c700 1 -- 172.21.15.22:0/3175558070 reap_dead start 2023-07-11T00:31:50.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.600+0000 7f351619c700 1 --2- 172.21.15.22:0/3175558070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34fc007410 0x7f34fc00dc20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f350800a7c0 tx=0x7f34fc007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccbf282f010f84f server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:50.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.600+0000 7f3514999700 1 -- 172.21.15.22:0/3175558070 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508012600 con 0x7f34fc007410 2023-07-11T00:31:50.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.600+0000 7f3514999700 1 -- 172.21.15.22:0/3175558070 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3508012760 con 0x7f34fc007410 2023-07-11T00:31:50.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.600+0000 7f3514999700 1 -- 172.21.15.22:0/3175558070 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508012b10 con 0x7f34fc007410 2023-07-11T00:31:50.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.600+0000 7f3517bff700 1 -- 172.21.15.22:0/3175558070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34fc007410 msgr2=0x7f34fc00dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:50.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.600+0000 7f3517bff700 1 --2- 172.21.15.22:0/3175558070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34fc007410 0x7f34fc00dc20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f350800a7c0 tx=0x7f34fc007a90 comp rx=0 tx=0).stop 2023-07-11T00:31:50.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.600+0000 7f3517bff700 1 -- 172.21.15.22:0/3175558070 shutdown_connections 2023-07-11T00:31:50.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.600+0000 7f3517bff700 1 --2- 172.21.15.22:0/3175558070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34fc007410 0x7f34fc00dc20 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.600+0000 7f3517bff700 1 -- 172.21.15.22:0/3175558070 >> 172.21.15.22:0/3175558070 conn(0x7f35100b0fd0 msgr2=0x7f35100ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.601+0000 7f3517bff700 1 -- 172.21.15.22:0/3175558070 shutdown_connections 2023-07-11T00:31:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.601+0000 7f3517bff700 1 -- 172.21.15.22:0/3175558070 wait complete. 2023-07-11T00:31:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.602+0000 7f3517bff700 1 Processor -- start 2023-07-11T00:31:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.602+0000 7f3517bff700 1 -- start start 2023-07-11T00:31:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.603+0000 7f3517bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34fc007410 0x7f35100c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.603+0000 7f3517bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35101fa410 0x7f35100c1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.603+0000 7f3517bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35100c3e40 0x7f35100ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.603+0000 7f3517bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35100b32f0 con 0x7f35100c3e40 2023-07-11T00:31:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.603+0000 7f3517bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35100c4b10 con 0x7f35101fa410 2023-07-11T00:31:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.603+0000 7f3517bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35100b2ff0 con 0x7f34fc007410 2023-07-11T00:31:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.604+0000 7f351619c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35100c3e40 0x7f35100ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.604+0000 7f351619c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35100c3e40 0x7f35100ac0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48948/0 (socket says 172.21.15.22:48948) 2023-07-11T00:31:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.604+0000 7f351619c700 1 -- 172.21.15.22:0/3407080105 learned_addr learned my addr 172.21.15.22:0/3407080105 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.604+0000 7f351519a700 1 --2- 172.21.15.22:0/3407080105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35101fa410 0x7f35100c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.604+0000 7f351599b700 1 --2- 172.21.15.22:0/3407080105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34fc007410 0x7f35100c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.604+0000 7f351619c700 1 -- 172.21.15.22:0/3407080105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34fc007410 msgr2=0x7f35100c22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.604+0000 7f351619c700 1 --2- 172.21.15.22:0/3407080105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34fc007410 0x7f35100c22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.604+0000 7f351619c700 1 -- 172.21.15.22:0/3407080105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35101fa410 msgr2=0x7f35100c1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.604+0000 7f351619c700 1 --2- 172.21.15.22:0/3407080105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35101fa410 0x7f35100c1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.604+0000 7f351619c700 1 -- 172.21.15.22:0/3407080105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35100c4d80 con 0x7f35100c3e40 2023-07-11T00:31:50.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.604+0000 7f351619c700 1 --2- 172.21.15.22:0/3407080105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35100c3e40 0x7f35100ac0b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f35100cc2b0 tx=0x7f3508001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:50.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.605+0000 7f35067fc700 1 -- 172.21.15.22:0/3407080105 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508012ce0 con 0x7f35100c3e40 2023-07-11T00:31:50.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.605+0000 7f35067fc700 1 -- 172.21.15.22:0/3407080105 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3508012e60 con 0x7f35100c3e40 2023-07-11T00:31:50.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.605+0000 7f35067fc700 1 -- 172.21.15.22:0/3407080105 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350801e670 con 0x7f35100c3e40 2023-07-11T00:31:50.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.605+0000 7f3517bff700 1 -- 172.21.15.22:0/3407080105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35100c5060 con 0x7f35100c3e40 2023-07-11T00:31:50.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.605+0000 7f3517bff700 1 -- 172.21.15.22:0/3407080105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35100c44c0 con 0x7f35100c3e40 2023-07-11T00:31:50.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.606+0000 7f3517bff700 1 -- 172.21.15.22:0/3407080105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35100b34a0 con 0x7f35100c3e40 2023-07-11T00:31:50.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.607+0000 7f35067fc700 1 -- 172.21.15.22:0/3407080105 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f350801e7d0 con 0x7f35100c3e40 2023-07-11T00:31:50.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.608+0000 7f35067fc700 1 --2- 172.21.15.22:0/3407080105 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f34f406ace0 0x7f34f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:50.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.608+0000 7f35067fc700 1 -- 172.21.15.22:0/3407080105 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f350808afc0 con 0x7f35100c3e40 2023-07-11T00:31:50.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.608+0000 7f351599b700 1 --2- 172.21.15.22:0/3407080105 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f34f406ace0 0x7f34f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:50.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.609+0000 7f351599b700 1 --2- 172.21.15.22:0/3407080105 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f34f406ace0 0x7f34f406d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f351006e6e0 tx=0x7f350c009210 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:50.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.612+0000 7f35067fc700 1 -- 172.21.15.22:0/3407080105 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f35100b34a0 con 0x7f35100c3e40 2023-07-11T00:31:50.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:50.868+0000 7f3517bff700 1 -- 172.21.15.22:0/3407080105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f35100b34a0 con 0x7f35100c3e40 2023-07-11T00:31:51.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.468+0000 7f35067fc700 1 -- 172.21.15.22:0/3407080105 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f35100b34a0 con 0x7f35100c3e40 2023-07-11T00:31:51.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.470+0000 7f3517bff700 1 -- 172.21.15.22:0/3407080105 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f34f406ace0 msgr2=0x7f34f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:51.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.470+0000 7f3517bff700 1 --2- 172.21.15.22:0/3407080105 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f34f406ace0 0x7f34f406d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f351006e6e0 tx=0x7f350c009210 comp rx=0 tx=0).stop 2023-07-11T00:31:51.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.470+0000 7f3517bff700 1 -- 172.21.15.22:0/3407080105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35100c3e40 msgr2=0x7f35100ac0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:51.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.470+0000 7f3517bff700 1 --2- 172.21.15.22:0/3407080105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35100c3e40 0x7f35100ac0b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f35100cc2b0 tx=0x7f3508001d00 comp rx=0 tx=0).stop 2023-07-11T00:31:51.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.470+0000 7f3517bff700 1 -- 172.21.15.22:0/3407080105 shutdown_connections 2023-07-11T00:31:51.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.470+0000 7f3517bff700 1 --2- 172.21.15.22:0/3407080105 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f34f406ace0 0x7f34f406d190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:51.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.470+0000 7f3517bff700 1 --2- 172.21.15.22:0/3407080105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34fc007410 0x7f35100c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:51.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.470+0000 7f3517bff700 1 --2- 172.21.15.22:0/3407080105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35100c3e40 0x7f35100ac0b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:51.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.470+0000 7f3517bff700 1 --2- 172.21.15.22:0/3407080105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35101fa410 0x7f35100c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:51.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.470+0000 7f3517bff700 1 -- 172.21.15.22:0/3407080105 >> 172.21.15.22:0/3407080105 conn(0x7f35100b0fd0 msgr2=0x7f3510070340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:51.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.471+0000 7f3517bff700 1 -- 172.21.15.22:0/3407080105 shutdown_connections 2023-07-11T00:31:51.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.471+0000 7f3517bff700 1 -- 172.21.15.22:0/3407080105 wait complete. 2023-07-11T00:31:51.491 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-11T00:31:51.492 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-11T00:31:51.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.695+0000 7f86fdfff700 1 Processor -- start 2023-07-11T00:31:51.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.695+0000 7f86fdfff700 1 -- start start 2023-07-11T00:31:51.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.696+0000 7f86fdfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f80b8430 0x7f86f80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:51.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.696+0000 7f86fdfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f86f80cfc60 0x7f86f80d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:51.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.697+0000 7f86fdfff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f80d0b20 con 0x7f86f80d3730 2023-07-11T00:31:51.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.697+0000 7f86fdfff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f80b8800 con 0x7f86f80cfc60 2023-07-11T00:31:51.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.697+0000 7f86fdfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80b4ee0 con 0x7f86f80b8430 2023-07-11T00:31:51.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.697+0000 7f86f7fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f86f80cfc60 0x7f86f80d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:51.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.697+0000 7f86f7fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f86f80cfc60 0x7f86f80d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48962/0 (socket says 172.21.15.22:48962) 2023-07-11T00:31:51.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.697+0000 7f86f7fff700 1 -- 172.21.15.22:0/4281923831 learned_addr learned my addr 172.21.15.22:0/4281923831 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:51.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.697+0000 7f86f77fe700 1 --2- 172.21.15.22:0/4281923831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f80b8430 0x7f86f80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:51.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.697+0000 7f86f7fff700 1 -- 172.21.15.22:0/4281923831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f80b8430 msgr2=0x7f86f80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:51.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.697+0000 7f86f7fff700 1 --2- 172.21.15.22:0/4281923831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f80b8430 0x7f86f80cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:51.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.697+0000 7f86f7fff700 1 -- 172.21.15.22:0/4281923831 >> v1:172.21.15.184:6789/0 conn(0x7f86f80d3730 legacy=0x7f86f80cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:51.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.697+0000 7f86f7fff700 1 -- 172.21.15.22:0/4281923831 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f80b51c0 con 0x7f86f80cfc60 2023-07-11T00:31:51.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.698+0000 7f86f7fff700 1 --2- 172.21.15.22:0/4281923831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86f80cfc60 0x7f86f80d0fb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009e50 tx=0x7f86f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a38a34f30228d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:51.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.698+0000 7f86f6ffd700 1 -- 172.21.15.22:0/4281923831 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f000e070 con 0x7f86f80cfc60 2023-07-11T00:31:51.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.698+0000 7f86f6ffd700 1 -- 172.21.15.22:0/4281923831 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f0003a20 con 0x7f86f80cfc60 2023-07-11T00:31:51.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.698+0000 7f86f6ffd700 1 -- 172.21.15.22:0/4281923831 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f0003dd0 con 0x7f86f80cfc60 2023-07-11T00:31:51.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.698+0000 7f86fdfff700 1 -- 172.21.15.22:0/4281923831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86f80cfc60 msgr2=0x7f86f80d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:51.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.698+0000 7f86fdfff700 1 --2- 172.21.15.22:0/4281923831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86f80cfc60 0x7f86f80d0fb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009e50 tx=0x7f86f000b330 comp rx=0 tx=0).stop 2023-07-11T00:31:51.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.698+0000 7f86fdfff700 1 -- 172.21.15.22:0/4281923831 shutdown_connections 2023-07-11T00:31:51.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.698+0000 7f86fdfff700 1 --2- 172.21.15.22:0/4281923831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86f80cfc60 0x7f86f80d0fb0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:51.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.698+0000 7f86fdfff700 1 --2- 172.21.15.22:0/4281923831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f80b8430 0x7f86f80cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:51.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.698+0000 7f86fdfff700 1 -- 172.21.15.22:0/4281923831 >> 172.21.15.22:0/4281923831 conn(0x7f86f806b3f0 msgr2=0x7f86f806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:51.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.699+0000 7f86fdfff700 1 -- 172.21.15.22:0/4281923831 shutdown_connections 2023-07-11T00:31:51.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.699+0000 7f86fdfff700 1 -- 172.21.15.22:0/4281923831 wait complete. 2023-07-11T00:31:51.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.700+0000 7f86fdfff700 1 Processor -- start 2023-07-11T00:31:51.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.700+0000 7f86fdfff700 1 -- start start 2023-07-11T00:31:51.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.701+0000 7f86fdfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f80b8430 0x7f86f81f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:51.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.701+0000 7f86fdfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86f80cfc60 0x7f86f80ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:51.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.701+0000 7f86fdfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86f80d3730 0x7f86f80cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:51.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.701+0000 7f86fdfff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80c9c10 con 0x7f86f80cfc60 2023-07-11T00:31:51.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.701+0000 7f86fdfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f81f29c0 con 0x7f86f80d3730 2023-07-11T00:31:51.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.701+0000 7f86fdfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f815e9d0 con 0x7f86f80b8430 2023-07-11T00:31:51.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.702+0000 7f86effff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86f80cfc60 0x7f86f80ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:51.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.702+0000 7f86effff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86f80cfc60 0x7f86f80ca8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48966/0 (socket says 172.21.15.22:48966) 2023-07-11T00:31:51.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.702+0000 7f86effff700 1 -- 172.21.15.22:0/4112269522 learned_addr learned my addr 172.21.15.22:0/4112269522 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:51.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.702+0000 7f86f77fe700 1 --2- 172.21.15.22:0/4112269522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f80b8430 0x7f86f81f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:51.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.702+0000 7f86f7fff700 1 --2- 172.21.15.22:0/4112269522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86f80d3730 0x7f86f80cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:51.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.702+0000 7f86effff700 1 -- 172.21.15.22:0/4112269522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f80b8430 msgr2=0x7f86f81f2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:51.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.702+0000 7f86effff700 1 --2- 172.21.15.22:0/4112269522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f80b8430 0x7f86f81f2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:51.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.702+0000 7f86effff700 1 -- 172.21.15.22:0/4112269522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86f80d3730 msgr2=0x7f86f80cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:51.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.702+0000 7f86effff700 1 --2- 172.21.15.22:0/4112269522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86f80d3730 0x7f86f80cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:51.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.702+0000 7f86effff700 1 -- 172.21.15.22:0/4112269522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f0009b30 con 0x7f86f80cfc60 2023-07-11T00:31:51.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.702+0000 7f86f77fe700 1 --2- 172.21.15.22:0/4112269522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f80b8430 0x7f86f81f2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:51.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.702+0000 7f86effff700 1 --2- 172.21.15.22:0/4112269522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86f80cfc60 0x7f86f80ca8d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f86e000b4a0 tx=0x7f86e000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:51.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.703+0000 7f86f4ff9700 1 -- 172.21.15.22:0/4112269522 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0011830 con 0x7f86f80cfc60 2023-07-11T00:31:51.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.703+0000 7f86f4ff9700 1 -- 172.21.15.22:0/4112269522 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e0011990 con 0x7f86f80cfc60 2023-07-11T00:31:51.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.703+0000 7f86f4ff9700 1 -- 172.21.15.22:0/4112269522 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0011d40 con 0x7f86f80cfc60 2023-07-11T00:31:51.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.703+0000 7f86fdfff700 1 -- 172.21.15.22:0/4112269522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f80c9df0 con 0x7f86f80cfc60 2023-07-11T00:31:51.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.703+0000 7f86fdfff700 1 -- 172.21.15.22:0/4112269522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f80ca3b0 con 0x7f86f80cfc60 2023-07-11T00:31:51.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.704+0000 7f86fdfff700 1 -- 172.21.15.22:0/4112269522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f80ca5d0 con 0x7f86f80cfc60 2023-07-11T00:31:51.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.705+0000 7f86f4ff9700 1 -- 172.21.15.22:0/4112269522 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f86e001a400 con 0x7f86f80cfc60 2023-07-11T00:31:51.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.706+0000 7f86f4ff9700 1 --2- 172.21.15.22:0/4112269522 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f86d806ace0 0x7f86d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.706+0000 7f86f4ff9700 1 -- 172.21.15.22:0/4112269522 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f86e00893a0 con 0x7f86f80cfc60 2023-07-11T00:31:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.706+0000 7f86f77fe700 1 --2- 172.21.15.22:0/4112269522 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f86d806ace0 0x7f86d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.707+0000 7f86f77fe700 1 --2- 172.21.15.22:0/4112269522 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f86d806ace0 0x7f86d806d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f86e800aa50 tx=0x7f86e8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:51.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.710+0000 7f86f4ff9700 1 -- 172.21.15.22:0/4112269522 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f86e00541e0 con 0x7f86f80cfc60 2023-07-11T00:31:51.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:51.966+0000 7f86fdfff700 1 -- 172.21.15.22:0/4112269522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f86f80cd7e0 con 0x7f86f80cfc60 2023-07-11T00:31:52.303 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-07-11T00:31:52.301+0000 7ff9ae7f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-11T00:31:52.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.474+0000 7f86f4ff9700 1 -- 172.21.15.22:0/4112269522 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f86e0057800 con 0x7f86f80cfc60 2023-07-11T00:31:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.477+0000 7f86fdfff700 1 -- 172.21.15.22:0/4112269522 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f86d806ace0 msgr2=0x7f86d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.477+0000 7f86fdfff700 1 --2- 172.21.15.22:0/4112269522 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f86d806ace0 0x7f86d806d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f86e800aa50 tx=0x7f86e8008040 comp rx=0 tx=0).stop 2023-07-11T00:31:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.477+0000 7f86fdfff700 1 -- 172.21.15.22:0/4112269522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86f80cfc60 msgr2=0x7f86f80ca8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.477+0000 7f86fdfff700 1 --2- 172.21.15.22:0/4112269522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86f80cfc60 0x7f86f80ca8d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f86e000b4a0 tx=0x7f86e000b7b0 comp rx=0 tx=0).stop 2023-07-11T00:31:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.477+0000 7f86fdfff700 1 -- 172.21.15.22:0/4112269522 shutdown_connections 2023-07-11T00:31:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.477+0000 7f86fdfff700 1 --2- 172.21.15.22:0/4112269522 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f86d806ace0 0x7f86d806d190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.477+0000 7f86fdfff700 1 --2- 172.21.15.22:0/4112269522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f80b8430 0x7f86f81f2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.477+0000 7f86fdfff700 1 --2- 172.21.15.22:0/4112269522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86f80d3730 0x7f86f80cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.477+0000 7f86fdfff700 1 --2- 172.21.15.22:0/4112269522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86f80cfc60 0x7f86f80ca8d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.477+0000 7f86fdfff700 1 -- 172.21.15.22:0/4112269522 >> 172.21.15.22:0/4112269522 conn(0x7f86f806b3f0 msgr2=0x7f86f80b6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.477+0000 7f86fdfff700 1 -- 172.21.15.22:0/4112269522 shutdown_connections 2023-07-11T00:31:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.478+0000 7f86fdfff700 1 -- 172.21.15.22:0/4112269522 wait complete. 2023-07-11T00:31:52.500 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-11T00:31:52.501 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:31:52.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.703+0000 7f0a33dff700 1 Processor -- start 2023-07-11T00:31:52.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.704+0000 7f0a33dff700 1 -- start start 2023-07-11T00:31:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.705+0000 7f0a33dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a2c15c460 0x7f0a2c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.705+0000 7f0a33dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0a2c0cf8f0 0x7f0a2c15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.705+0000 7f0a33dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2c0d1790 con 0x7f0a2c0d2640 2023-07-11T00:31:52.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.705+0000 7f0a33dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2c0cedd0 con 0x7f0a2c0cf8f0 2023-07-11T00:31:52.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.705+0000 7f0a33dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0cd950 con 0x7f0a2c15c460 2023-07-11T00:31:52.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.705+0000 7f0a3239c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0a2c0cf8f0 0x7f0a2c15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:52.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.705+0000 7f0a31b9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a2c15c460 0x7f0a2c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:52.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.705+0000 7f0a3139a700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f0a2c0d2640 0x7f0a2c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:60516/0 (socket says 172.21.15.22:60516) 2023-07-11T00:31:52.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.705+0000 7f0a3139a700 1 -- 172.21.15.22:0/976731197 learned_addr learned my addr 172.21.15.22:0/976731197 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:52.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.706+0000 7f0a30b99700 1 -- 172.21.15.22:0/976731197 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310509820 0 0) 0x7f0a2c0d1790 con 0x7f0a2c0d2640 2023-07-11T00:31:52.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.706+0000 7f0a30b99700 1 -- 172.21.15.22:0/976731197 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a180035b0 con 0x7f0a2c0d2640 2023-07-11T00:31:52.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.706+0000 7f0a3239c700 1 -- 172.21.15.22:0/976731197 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a2c15c460 msgr2=0x7f0a2c0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:52.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.706+0000 7f0a3239c700 1 --2- 172.21.15.22:0/976731197 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a2c15c460 0x7f0a2c0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:52.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.706+0000 7f0a3239c700 1 -- 172.21.15.22:0/976731197 >> v1:172.21.15.184:6789/0 conn(0x7f0a2c0d2640 legacy=0x7f0a2c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:52.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.706+0000 7f0a3239c700 1 -- 172.21.15.22:0/976731197 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c0d14b0 con 0x7f0a2c0cf8f0 2023-07-11T00:31:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.706+0000 7f0a31b9b700 1 --2- 172.21.15.22:0/976731197 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a2c15c460 0x7f0a2c0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.706+0000 7f0a3239c700 1 --2- 172.21.15.22:0/976731197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a2c0cf8f0 0x7f0a2c15fe20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0a24009d90 tx=0x7f0a2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=266d6ec51b517ea9 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.706+0000 7f0a30b99700 1 -- 172.21.15.22:0/976731197 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2400e070 con 0x7f0a2c0cf8f0 2023-07-11T00:31:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.707+0000 7f0a30b99700 1 -- 172.21.15.22:0/976731197 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2400bb20 con 0x7f0a2c0cf8f0 2023-07-11T00:31:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.707+0000 7f0a30b99700 1 -- 172.21.15.22:0/976731197 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a24012430 con 0x7f0a2c0cf8f0 2023-07-11T00:31:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.707+0000 7f0a33dff700 1 -- 172.21.15.22:0/976731197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a2c0cf8f0 msgr2=0x7f0a2c15fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.707+0000 7f0a33dff700 1 --2- 172.21.15.22:0/976731197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a2c0cf8f0 0x7f0a2c15fe20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0a24009d90 tx=0x7f0a2400b330 comp rx=0 tx=0).stop 2023-07-11T00:31:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.707+0000 7f0a33dff700 1 -- 172.21.15.22:0/976731197 shutdown_connections 2023-07-11T00:31:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.707+0000 7f0a33dff700 1 --2- 172.21.15.22:0/976731197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a2c0cf8f0 0x7f0a2c15fe20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.707+0000 7f0a33dff700 1 --2- 172.21.15.22:0/976731197 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a2c15c460 0x7f0a2c0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:52.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.707+0000 7f0a33dff700 1 -- 172.21.15.22:0/976731197 >> 172.21.15.22:0/976731197 conn(0x7f0a2c071660 msgr2=0x7f0a2c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:52.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.707+0000 7f0a33dff700 1 -- 172.21.15.22:0/976731197 shutdown_connections 2023-07-11T00:31:52.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.707+0000 7f0a33dff700 1 -- 172.21.15.22:0/976731197 wait complete. 2023-07-11T00:31:52.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.709+0000 7f0a33dff700 1 Processor -- start 2023-07-11T00:31:52.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.709+0000 7f0a33dff700 1 -- start start 2023-07-11T00:31:52.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.710+0000 7f0a33dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a2c0cf8f0 0x7f0a2c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:52.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.710+0000 7f0a33dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a2c0d2640 0x7f0a2c14db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:52.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.710+0000 7f0a33dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a2c15c460 0x7f0a2c0cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:52.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.710+0000 7f0a33dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c14fff0 con 0x7f0a2c0d2640 2023-07-11T00:31:52.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.710+0000 7f0a33dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c14f720 con 0x7f0a2c15c460 2023-07-11T00:31:52.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.710+0000 7f0a33dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0cb1b0 con 0x7f0a2c0cf8f0 2023-07-11T00:31:52.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.710+0000 7f0a3139a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a2c0d2640 0x7f0a2c14db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:52.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.710+0000 7f0a3139a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a2c0d2640 0x7f0a2c14db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48974/0 (socket says 172.21.15.22:48974) 2023-07-11T00:31:52.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.710+0000 7f0a3139a700 1 -- 172.21.15.22:0/694427074 learned_addr learned my addr 172.21.15.22:0/694427074 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:52.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.711+0000 7f0a3239c700 1 --2- 172.21.15.22:0/694427074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a2c15c460 0x7f0a2c0cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:52.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.711+0000 7f0a31b9b700 1 --2- 172.21.15.22:0/694427074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a2c0cf8f0 0x7f0a2c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:52.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.711+0000 7f0a3139a700 1 -- 172.21.15.22:0/694427074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a2c0cf8f0 msgr2=0x7f0a2c0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:52.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.711+0000 7f0a3139a700 1 --2- 172.21.15.22:0/694427074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a2c0cf8f0 0x7f0a2c0cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:52.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.711+0000 7f0a3139a700 1 -- 172.21.15.22:0/694427074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a2c15c460 msgr2=0x7f0a2c0cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:52.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.711+0000 7f0a3139a700 1 --2- 172.21.15.22:0/694427074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a2c15c460 0x7f0a2c0cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:52.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.711+0000 7f0a3139a700 1 -- 172.21.15.22:0/694427074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a280094a0 con 0x7f0a2c0d2640 2023-07-11T00:31:52.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.711+0000 7f0a3139a700 1 --2- 172.21.15.22:0/694427074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a2c0d2640 0x7f0a2c14db80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c001eb0 tx=0x7f0a1c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:52.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.711+0000 7f0a227fc700 1 -- 172.21.15.22:0/694427074 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c005d70 con 0x7f0a2c0d2640 2023-07-11T00:31:52.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.711+0000 7f0a227fc700 1 -- 172.21.15.22:0/694427074 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1c0070d0 con 0x7f0a2c0d2640 2023-07-11T00:31:52.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.711+0000 7f0a227fc700 1 -- 172.21.15.22:0/694427074 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c007460 con 0x7f0a2c0d2640 2023-07-11T00:31:52.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.711+0000 7f0a33dff700 1 -- 172.21.15.22:0/694427074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a24009a70 con 0x7f0a2c0d2640 2023-07-11T00:31:52.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.711+0000 7f0a33dff700 1 -- 172.21.15.22:0/694427074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2c14fc80 con 0x7f0a2c0d2640 2023-07-11T00:31:52.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.712+0000 7f0a33dff700 1 -- 172.21.15.22:0/694427074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2c04ea60 con 0x7f0a2c0d2640 2023-07-11T00:31:52.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.714+0000 7f0a227fc700 1 -- 172.21.15.22:0/694427074 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a1c0075c0 con 0x7f0a2c0d2640 2023-07-11T00:31:52.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.715+0000 7f0a227fc700 1 --2- 172.21.15.22:0/694427074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0a1006ace0 0x7f0a1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:52.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.715+0000 7f0a227fc700 1 -- 172.21.15.22:0/694427074 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0a1c088ad0 con 0x7f0a2c0d2640 2023-07-11T00:31:52.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.715+0000 7f0a31b9b700 1 --2- 172.21.15.22:0/694427074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0a1006ace0 0x7f0a1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:52.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.716+0000 7f0a31b9b700 1 --2- 172.21.15.22:0/694427074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0a1006ace0 0x7f0a1006d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009d00 tx=0x7f0a28008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:52.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.719+0000 7f0a227fc700 1 -- 172.21.15.22:0/694427074 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0a1c053a30 con 0x7f0a2c0d2640 2023-07-11T00:31:52.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.977+0000 7f0a33dff700 1 -- 172.21.15.22:0/694427074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a2c150130 con 0x7f0a2c0d2640 2023-07-11T00:31:52.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.978+0000 7f0a227fc700 1 -- 172.21.15.22:0/694427074 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f0a1c057050 con 0x7f0a2c0d2640 2023-07-11T00:31:52.980 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:52.981 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/2706760734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2706760734},{"type":"v1","addr":"172.21.15.22:6834","nonce":2706760734}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/305167523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":305167523},{"type":"v1","addr":"172.21.15.22:6835","nonce":305167523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5361,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/1347996573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1347996573},{"type":"v1","addr":"172.21.15.184:6836","nonce":1347996573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:31:48.961676+0000","modified":"2023-07-11T00:31:51.968084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5364":{"gid":5364,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.184:6837/2685786652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2685786652},{"type":"v1","addr":"172.21.15.184:6837","nonce":2685786652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-11T00:31:52.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.980+0000 7f0a33dff700 1 -- 172.21.15.22:0/694427074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0a1006ace0 msgr2=0x7f0a1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:52.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.980+0000 7f0a33dff700 1 --2- 172.21.15.22:0/694427074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0a1006ace0 0x7f0a1006d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009d00 tx=0x7f0a28008040 comp rx=0 tx=0).stop 2023-07-11T00:31:52.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.980+0000 7f0a33dff700 1 -- 172.21.15.22:0/694427074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a2c0d2640 msgr2=0x7f0a2c14db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:52.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.980+0000 7f0a33dff700 1 --2- 172.21.15.22:0/694427074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a2c0d2640 0x7f0a2c14db80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c001eb0 tx=0x7f0a1c00c7b0 comp rx=0 tx=0).stop 2023-07-11T00:31:52.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.980+0000 7f0a33dff700 1 -- 172.21.15.22:0/694427074 shutdown_connections 2023-07-11T00:31:52.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.980+0000 7f0a33dff700 1 --2- 172.21.15.22:0/694427074 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f0a1006ace0 0x7f0a1006d190 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:52.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.980+0000 7f0a33dff700 1 --2- 172.21.15.22:0/694427074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a2c0cf8f0 0x7f0a2c0cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:52.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.980+0000 7f0a33dff700 1 --2- 172.21.15.22:0/694427074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a2c15c460 0x7f0a2c0cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:52.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.980+0000 7f0a33dff700 1 --2- 172.21.15.22:0/694427074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a2c0d2640 0x7f0a2c14db80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:52.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.980+0000 7f0a33dff700 1 -- 172.21.15.22:0/694427074 >> 172.21.15.22:0/694427074 conn(0x7f0a2c071660 msgr2=0x7f0a2c0b8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:52.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.980+0000 7f0a33dff700 1 -- 172.21.15.22:0/694427074 shutdown_connections 2023-07-11T00:31:52.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:52.981+0000 7f0a33dff700 1 -- 172.21.15.22:0/694427074 wait complete. 2023-07-11T00:31:52.985 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 17 2023-07-11T00:31:53.001 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:31:53.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.200+0000 7f80c27ff700 1 Processor -- start 2023-07-11T00:31:53.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.200+0000 7f80c27ff700 1 -- start start 2023-07-11T00:31:53.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.201+0000 7f80c27ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80bc0d2640 0x7f80bc0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:53.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.201+0000 7f80c27ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80bc0cf8f0 0x7f80bc15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:53.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.201+0000 7f80c27ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80bc0d1790 con 0x7f80bc15c460 2023-07-11T00:31:53.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.201+0000 7f80c27ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc0cedd0 con 0x7f80bc0d2640 2023-07-11T00:31:53.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.201+0000 7f80c27ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc0cd950 con 0x7f80bc0cf8f0 2023-07-11T00:31:53.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.201+0000 7f80bb7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80bc0d2640 0x7f80bc0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:53.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.202+0000 7f80bb7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80bc0d2640 0x7f80bc0b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48976/0 (socket says 172.21.15.22:48976) 2023-07-11T00:31:53.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.202+0000 7f80bbfff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f80bc15c460 0x7f80bc0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57298/0 (socket says 172.21.15.22:57298) 2023-07-11T00:31:53.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.202+0000 7f80bb7fe700 1 -- 172.21.15.22:0/176212143 learned_addr learned my addr 172.21.15.22:0/176212143 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:53.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.202+0000 7f80c0d9c700 1 --2- 172.21.15.22:0/176212143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80bc0cf8f0 0x7f80bc15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:53.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.202+0000 7f80bb7fe700 1 -- 172.21.15.22:0/176212143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80bc0cf8f0 msgr2=0x7f80bc15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:53.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.202+0000 7f80bb7fe700 1 --2- 172.21.15.22:0/176212143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80bc0cf8f0 0x7f80bc15fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.202+0000 7f80bb7fe700 1 -- 172.21.15.22:0/176212143 >> v1:172.21.15.22:6789/0 conn(0x7f80bc15c460 legacy=0x7f80bc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:53.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.202+0000 7f80bb7fe700 1 -- 172.21.15.22:0/176212143 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc0d14b0 con 0x7f80bc0d2640 2023-07-11T00:31:53.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.202+0000 7f80baffd700 1 -- 172.21.15.22:0/176212143 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087258856 0 0) 0x7f80bc0d1790 con 0x7f80bc15c460 2023-07-11T00:31:53.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.202+0000 7f80bb7fe700 1 --2- 172.21.15.22:0/176212143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80bc0d2640 0x7f80bc0b59d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f80b00098f0 tx=0x7f80b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb79cb80045a207e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:53.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.202+0000 7f80baffd700 1 -- 172.21.15.22:0/176212143 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b000b8a0 con 0x7f80bc0d2640 2023-07-11T00:31:53.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.202+0000 7f80baffd700 1 -- 172.21.15.22:0/176212143 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b000ba00 con 0x7f80bc0d2640 2023-07-11T00:31:53.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.203+0000 7f80baffd700 1 -- 172.21.15.22:0/176212143 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b000bd90 con 0x7f80bc0d2640 2023-07-11T00:31:53.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.203+0000 7f80c27ff700 1 -- 172.21.15.22:0/176212143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80bc0d2640 msgr2=0x7f80bc0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:53.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.203+0000 7f80c27ff700 1 --2- 172.21.15.22:0/176212143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80bc0d2640 0x7f80bc0b59d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f80b00098f0 tx=0x7f80b0009c00 comp rx=0 tx=0).stop 2023-07-11T00:31:53.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.203+0000 7f80c27ff700 1 -- 172.21.15.22:0/176212143 shutdown_connections 2023-07-11T00:31:53.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.203+0000 7f80c27ff700 1 --2- 172.21.15.22:0/176212143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80bc0cf8f0 0x7f80bc15fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.203+0000 7f80c27ff700 1 --2- 172.21.15.22:0/176212143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80bc0d2640 0x7f80bc0b59d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.203+0000 7f80c27ff700 1 -- 172.21.15.22:0/176212143 >> 172.21.15.22:0/176212143 conn(0x7f80bc071660 msgr2=0x7f80bc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:53.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.203+0000 7f80c27ff700 1 -- 172.21.15.22:0/176212143 shutdown_connections 2023-07-11T00:31:53.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.203+0000 7f80c27ff700 1 -- 172.21.15.22:0/176212143 wait complete. 2023-07-11T00:31:53.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.205+0000 7f80c27ff700 1 Processor -- start 2023-07-11T00:31:53.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.205+0000 7f80c27ff700 1 -- start start 2023-07-11T00:31:53.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.206+0000 7f80c27ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80bc0cf8f0 0x7f80bc15b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:53.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.206+0000 7f80c27ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80bc0d2640 0x7f80bc158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:53.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.206+0000 7f80c27ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80bc15c460 0x7f80bc14a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:53.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.206+0000 7f80c27ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc1592c0 con 0x7f80bc0cf8f0 2023-07-11T00:31:53.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.206+0000 7f80c27ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc1595a0 con 0x7f80bc15c460 2023-07-11T00:31:53.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.206+0000 7f80c27ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc159880 con 0x7f80bc0d2640 2023-07-11T00:31:53.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.206+0000 7f80bbfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80bc0cf8f0 0x7f80bc15b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:53.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.206+0000 7f80bbfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80bc0cf8f0 0x7f80bc15b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48990/0 (socket says 172.21.15.22:48990) 2023-07-11T00:31:53.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.206+0000 7f80bbfff700 1 -- 172.21.15.22:0/565482018 learned_addr learned my addr 172.21.15.22:0/565482018 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:53.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.206+0000 7f80bb7fe700 1 --2- 172.21.15.22:0/565482018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80bc0d2640 0x7f80bc158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:53.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.206+0000 7f80c0d9c700 1 --2- 172.21.15.22:0/565482018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80bc15c460 0x7f80bc14a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:53.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.207+0000 7f80bbfff700 1 -- 172.21.15.22:0/565482018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80bc0d2640 msgr2=0x7f80bc158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:53.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.207+0000 7f80bbfff700 1 --2- 172.21.15.22:0/565482018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80bc0d2640 0x7f80bc158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.207+0000 7f80bbfff700 1 -- 172.21.15.22:0/565482018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80bc15c460 msgr2=0x7f80bc14a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:53.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.207+0000 7f80bbfff700 1 --2- 172.21.15.22:0/565482018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80bc15c460 0x7f80bc14a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.207+0000 7f80bbfff700 1 -- 172.21.15.22:0/565482018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b0009550 con 0x7f80bc0cf8f0 2023-07-11T00:31:53.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.207+0000 7f80c0d9c700 1 --2- 172.21.15.22:0/565482018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80bc15c460 0x7f80bc14a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:53.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.207+0000 7f80bbfff700 1 --2- 172.21.15.22:0/565482018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80bc0cf8f0 0x7f80bc15b270 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00c550 tx=0x7f80ac00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:53.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.207+0000 7f80b8ff9700 1 -- 172.21.15.22:0/565482018 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac004c80 con 0x7f80bc0cf8f0 2023-07-11T00:31:53.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.207+0000 7f80b8ff9700 1 -- 172.21.15.22:0/565482018 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac004e00 con 0x7f80bc0cf8f0 2023-07-11T00:31:53.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.207+0000 7f80c27ff700 1 -- 172.21.15.22:0/565482018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80bc159b60 con 0x7f80bc0cf8f0 2023-07-11T00:31:53.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.207+0000 7f80b8ff9700 1 -- 172.21.15.22:0/565482018 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac007310 con 0x7f80bc0cf8f0 2023-07-11T00:31:53.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.207+0000 7f80c27ff700 1 -- 172.21.15.22:0/565482018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80bc15a360 con 0x7f80bc0cf8f0 2023-07-11T00:31:53.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.208+0000 7f80c27ff700 1 -- 172.21.15.22:0/565482018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80bc15a080 con 0x7f80bc0cf8f0 2023-07-11T00:31:53.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.209+0000 7f80b8ff9700 1 -- 172.21.15.22:0/565482018 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f80ac007470 con 0x7f80bc0cf8f0 2023-07-11T00:31:53.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.210+0000 7f80b8ff9700 1 --2- 172.21.15.22:0/565482018 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80a806ace0 0x7f80a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:53.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.210+0000 7f80b8ff9700 1 -- 172.21.15.22:0/565482018 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f80ac089250 con 0x7f80bc0cf8f0 2023-07-11T00:31:53.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.211+0000 7f80bb7fe700 1 --2- 172.21.15.22:0/565482018 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80a806ace0 0x7f80a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:53.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.211+0000 7f80bb7fe700 1 --2- 172.21.15.22:0/565482018 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80a806ace0 0x7f80a806d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f80b0014040 tx=0x7f80b0008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:53.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.214+0000 7f80b8ff9700 1 -- 172.21.15.22:0/565482018 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f80bc15a080 con 0x7f80bc0cf8f0 2023-07-11T00:31:53.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.420+0000 7f80c27ff700 1 -- 172.21.15.22:0/565482018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80bc15a080 con 0x7f80bc0cf8f0 2023-07-11T00:31:53.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.421+0000 7f80b8ff9700 1 -- 172.21.15.22:0/565482018 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18442 (secure 0 0 0) 0x7f80ac0541b0 con 0x7f80bc0cf8f0 2023-07-11T00:31:53.424 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:53.424 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":38,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:31:50.449042+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:31:47.379034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-11T00:31:47.929557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:31:53.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.424+0000 7f80c27ff700 1 -- 172.21.15.22:0/565482018 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80a806ace0 msgr2=0x7f80a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:53.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.424+0000 7f80c27ff700 1 --2- 172.21.15.22:0/565482018 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80a806ace0 0x7f80a806d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f80b0014040 tx=0x7f80b0008030 comp rx=0 tx=0).stop 2023-07-11T00:31:53.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.424+0000 7f80c27ff700 1 -- 172.21.15.22:0/565482018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80bc0cf8f0 msgr2=0x7f80bc15b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:53.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.424+0000 7f80c27ff700 1 --2- 172.21.15.22:0/565482018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80bc0cf8f0 0x7f80bc15b270 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00c550 tx=0x7f80ac00c860 comp rx=0 tx=0).stop 2023-07-11T00:31:53.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.424+0000 7f80c27ff700 1 -- 172.21.15.22:0/565482018 shutdown_connections 2023-07-11T00:31:53.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.424+0000 7f80c27ff700 1 --2- 172.21.15.22:0/565482018 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f80a806ace0 0x7f80a806d190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.424+0000 7f80c27ff700 1 --2- 172.21.15.22:0/565482018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80bc15c460 0x7f80bc14a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.424+0000 7f80c27ff700 1 --2- 172.21.15.22:0/565482018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80bc0cf8f0 0x7f80bc15b270 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.424+0000 7f80c27ff700 1 --2- 172.21.15.22:0/565482018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80bc0d2640 0x7f80bc158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.424+0000 7f80c27ff700 1 -- 172.21.15.22:0/565482018 >> 172.21.15.22:0/565482018 conn(0x7f80bc071660 msgr2=0x7f80bc0d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:53.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.424+0000 7f80c27ff700 1 -- 172.21.15.22:0/565482018 shutdown_connections 2023-07-11T00:31:53.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.424+0000 7f80c27ff700 1 -- 172.21.15.22:0/565482018 wait complete. 2023-07-11T00:31:53.445 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-11T00:31:53.446 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-11T00:31:53.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.646+0000 7f2005fff700 1 Processor -- start 2023-07-11T00:31:53.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.647+0000 7f2005fff700 1 -- start start 2023-07-11T00:31:53.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.648+0000 7f2005fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f200015c460 0x7f20000b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:53.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.648+0000 7f2005fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20000cf8f0 0x7f200015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:53.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.648+0000 7f2005fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20000d1790 con 0x7f20000d2640 2023-07-11T00:31:53.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.648+0000 7f2005fff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20000cedd0 con 0x7f200015c460 2023-07-11T00:31:53.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.648+0000 7f2005fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20000cd950 con 0x7f20000cf8f0 2023-07-11T00:31:53.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.648+0000 7f1fff7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f200015c460 0x7f20000b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:53.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.648+0000 7f1fff7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f200015c460 0x7f20000b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49006/0 (socket says 172.21.15.22:49006) 2023-07-11T00:31:53.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.648+0000 7f1fff7fe700 1 -- 172.21.15.22:0/339158810 learned_addr learned my addr 172.21.15.22:0/339158810 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:53.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.648+0000 7f1ffffff700 1 --2- 172.21.15.22:0/339158810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20000cf8f0 0x7f200015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:53.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.649+0000 7f1fff7fe700 1 -- 172.21.15.22:0/339158810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20000cf8f0 msgr2=0x7f200015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:53.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.649+0000 7f1fff7fe700 1 --2- 172.21.15.22:0/339158810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20000cf8f0 0x7f200015fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.649+0000 7f1fff7fe700 1 -- 172.21.15.22:0/339158810 >> v1:172.21.15.184:6789/0 conn(0x7f20000d2640 legacy=0x7f20000cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:53.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.649+0000 7f1fff7fe700 1 -- 172.21.15.22:0/339158810 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20000d14b0 con 0x7f200015c460 2023-07-11T00:31:53.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.649+0000 7f1fff7fe700 1 --2- 172.21.15.22:0/339158810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f200015c460 0x7f20000b59d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00098f0 tx=0x7f1ff0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7ce9f6d1d76313 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:53.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.649+0000 7f1ffe7fc700 1 -- 172.21.15.22:0/339158810 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000b8a0 con 0x7f200015c460 2023-07-11T00:31:53.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.649+0000 7f1ffe7fc700 1 -- 172.21.15.22:0/339158810 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff000ba00 con 0x7f200015c460 2023-07-11T00:31:53.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.649+0000 7f1ffe7fc700 1 -- 172.21.15.22:0/339158810 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000bd90 con 0x7f200015c460 2023-07-11T00:31:53.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.650+0000 7f2005fff700 1 -- 172.21.15.22:0/339158810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f200015c460 msgr2=0x7f20000b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:53.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.650+0000 7f2005fff700 1 --2- 172.21.15.22:0/339158810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f200015c460 0x7f20000b59d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00098f0 tx=0x7f1ff0009c00 comp rx=0 tx=0).stop 2023-07-11T00:31:53.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.650+0000 7f2005fff700 1 -- 172.21.15.22:0/339158810 shutdown_connections 2023-07-11T00:31:53.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.650+0000 7f2005fff700 1 --2- 172.21.15.22:0/339158810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20000cf8f0 0x7f200015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.650+0000 7f2005fff700 1 --2- 172.21.15.22:0/339158810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f200015c460 0x7f20000b59d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.650+0000 7f2005fff700 1 -- 172.21.15.22:0/339158810 >> 172.21.15.22:0/339158810 conn(0x7f2000071660 msgr2=0x7f2000071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:53.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.650+0000 7f2005fff700 1 -- 172.21.15.22:0/339158810 shutdown_connections 2023-07-11T00:31:53.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.650+0000 7f2005fff700 1 -- 172.21.15.22:0/339158810 wait complete. 2023-07-11T00:31:53.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.652+0000 7f2005fff700 1 Processor -- start 2023-07-11T00:31:53.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.652+0000 7f2005fff700 1 -- start start 2023-07-11T00:31:53.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.653+0000 7f2005fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20000cf8f0 0x7f2000153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:53.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.653+0000 7f2005fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20000d2640 0x7f20000c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:53.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.653+0000 7f2005fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f200015c460 0x7f20000c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:53.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.653+0000 7f2005fff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20000c66b0 con 0x7f200015c460 2023-07-11T00:31:53.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.653+0000 7f2005fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200015a9a0 con 0x7f20000d2640 2023-07-11T00:31:53.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.653+0000 7f2005fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200015ac80 con 0x7f20000cf8f0 2023-07-11T00:31:53.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.653+0000 7f1ffffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f200015c460 0x7f20000c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:53.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.653+0000 7f1ffffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f200015c460 0x7f20000c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49018/0 (socket says 172.21.15.22:49018) 2023-07-11T00:31:53.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.653+0000 7f1ffffff700 1 -- 172.21.15.22:0/701925541 learned_addr learned my addr 172.21.15.22:0/701925541 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:53.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.653+0000 7f1ffeffd700 1 --2- 172.21.15.22:0/701925541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20000d2640 0x7f20000c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:53.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.653+0000 7f1fff7fe700 1 --2- 172.21.15.22:0/701925541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20000cf8f0 0x7f2000153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:53.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.653+0000 7f1ffffff700 1 -- 172.21.15.22:0/701925541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20000cf8f0 msgr2=0x7f2000153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:53.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.653+0000 7f1ffffff700 1 --2- 172.21.15.22:0/701925541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20000cf8f0 0x7f2000153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.653+0000 7f1ffffff700 1 -- 172.21.15.22:0/701925541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20000d2640 msgr2=0x7f20000c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:53.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.653+0000 7f1ffffff700 1 --2- 172.21.15.22:0/701925541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20000d2640 0x7f20000c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.653+0000 7f1ffffff700 1 -- 172.21.15.22:0/701925541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff0009550 con 0x7f200015c460 2023-07-11T00:31:53.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.654+0000 7f1ffffff700 1 --2- 172.21.15.22:0/701925541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f200015c460 0x7f20000c8430 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8007e60 tx=0x7f1ff800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:53.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.654+0000 7f1fe7fff700 1 -- 172.21.15.22:0/701925541 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff800ede0 con 0x7f200015c460 2023-07-11T00:31:53.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.654+0000 7f1fe7fff700 1 -- 172.21.15.22:0/701925541 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff8014420 con 0x7f200015c460 2023-07-11T00:31:53.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.654+0000 7f2005fff700 1 -- 172.21.15.22:0/701925541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f200015af60 con 0x7f200015c460 2023-07-11T00:31:53.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.654+0000 7f1fe7fff700 1 -- 172.21.15.22:0/701925541 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff80147d0 con 0x7f200015c460 2023-07-11T00:31:53.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.654+0000 7f2005fff700 1 -- 172.21.15.22:0/701925541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200015a5c0 con 0x7f200015c460 2023-07-11T00:31:53.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.655+0000 7f2005fff700 1 -- 172.21.15.22:0/701925541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20000cd2e0 con 0x7f200015c460 2023-07-11T00:31:53.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.656+0000 7f1fe7fff700 1 -- 172.21.15.22:0/701925541 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ff8014930 con 0x7f200015c460 2023-07-11T00:31:53.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.658+0000 7f1fe7fff700 1 --2- 172.21.15.22:0/701925541 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1fec06ace0 0x7f1fec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:53.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.658+0000 7f1fe7fff700 1 -- 172.21.15.22:0/701925541 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1ff8089f10 con 0x7f200015c460 2023-07-11T00:31:53.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.658+0000 7f1fff7fe700 1 --2- 172.21.15.22:0/701925541 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1fec06ace0 0x7f1fec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:53.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.659+0000 7f1fff7fe700 1 --2- 172.21.15.22:0/701925541 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1fec06ace0 0x7f1fec06d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0014040 tx=0x7f1ff0008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:53.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.662+0000 7f1fe7fff700 1 -- 172.21.15.22:0/701925541 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f20000cd2e0 con 0x7f200015c460 2023-07-11T00:31:53.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.865+0000 7f2005fff700 1 -- 172.21.15.22:0/701925541 --> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20000cd5e0 con 0x7f1fec06ace0 2023-07-11T00:31:53.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.876+0000 7f1fe7fff700 1 -- 172.21.15.22:0/701925541 <== mgr.4114 v2:172.21.15.184:6832/380612710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299099 (secure 0 0 0) 0x7f1ff0006c60 con 0x7f1fec06ace0 2023-07-11T00:31:53.885 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:53.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.880+0000 7f2005fff700 1 -- 172.21.15.22:0/701925541 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1fec06ace0 msgr2=0x7f1fec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:53.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.880+0000 7f2005fff700 1 --2- 172.21.15.22:0/701925541 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1fec06ace0 0x7f1fec06d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0014040 tx=0x7f1ff0008030 comp rx=0 tx=0).stop 2023-07-11T00:31:53.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.880+0000 7f2005fff700 1 -- 172.21.15.22:0/701925541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f200015c460 msgr2=0x7f20000c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:53.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.880+0000 7f2005fff700 1 --2- 172.21.15.22:0/701925541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f200015c460 0x7f20000c8430 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8007e60 tx=0x7f1ff800e3c0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.880+0000 7f2005fff700 1 -- 172.21.15.22:0/701925541 shutdown_connections 2023-07-11T00:31:53.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.880+0000 7f2005fff700 1 --2- 172.21.15.22:0/701925541 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1fec06ace0 0x7f1fec06d190 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.880+0000 7f2005fff700 1 --2- 172.21.15.22:0/701925541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20000cf8f0 0x7f2000153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.880+0000 7f2005fff700 1 --2- 172.21.15.22:0/701925541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f200015c460 0x7f20000c8430 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.880+0000 7f2005fff700 1 --2- 172.21.15.22:0/701925541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20000d2640 0x7f20000c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:53.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.880+0000 7f2005fff700 1 -- 172.21.15.22:0/701925541 >> 172.21.15.22:0/701925541 conn(0x7f2000071660 msgr2=0x7f200015c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:53.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.880+0000 7f2005fff700 1 -- 172.21.15.22:0/701925541 shutdown_connections 2023-07-11T00:31:53.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:53.880+0000 7f2005fff700 1 -- 172.21.15.22:0/701925541 wait complete. 2023-07-11T00:31:53.888 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-07-11T00:31:53.901 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-07-11T00:31:52.518215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220384,"kb_used_data":4184,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754336,"statfs":{"total":773094113280,"available":772868440064,"internally_reserved":0,"allocated":4284416,"data_stored":2533420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.088157"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.434797+0000","last_change":"2023-07-11T00:31:47.434797+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.434797+0000","last_undegraded":"2023-07-11T00:31:47.434797+0000","last_fullsized":"2023-07-11T00:31:47.434797+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.437316+0000","last_change":"2023-07-11T00:31:47.437316+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.437316+0000","last_undegraded":"2023-07-11T00:31:47.437316+0000","last_fullsized":"2023-07-11T00:31:47.437316+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.432011+0000","last_change":"2023-07-11T00:31:47.432011+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.432011+0000","last_undegraded":"2023-07-11T00:31:47.432011+0000","last_fullsized":"2023-07-11T00:31:47.432011+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.438274+0000","last_change":"2023-07-11T00:31:47.438274+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.438274+0000","last_undegraded":"2023-07-11T00:31:47.438274+0000","last_fullsized":"2023-07-11T00:31:47.438274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.434749+0000","last_change":"2023-07-11T00:31:47.434749+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.434749+0000","last_undegraded":"2023-07-11T00:31:47.434749+0000","last_fullsized":"2023-07-11T00:31:47.434749+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.436112+0000","last_change":"2023-07-11T00:31:47.436112+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.436112+0000","last_undegraded":"2023-07-11T00:31:47.436112+0000","last_fullsized":"2023-07-11T00:31:47.436112+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.433295+0000","last_change":"2023-07-11T00:31:47.433295+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.433295+0000","last_undegraded":"2023-07-11T00:31:47.433295+0000","last_fullsized":"2023-07-11T00:31:47.433295+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.438606+0000","last_change":"2023-07-11T00:31:47.438606+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.438606+0000","last_undegraded":"2023-07-11T00:31:47.438606+0000","last_fullsized":"2023-07-11T00:31:47.438606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.436858+0000","last_change":"2023-07-11T00:31:47.436858+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.436858+0000","last_undegraded":"2023-07-11T00:31:47.436858+0000","last_fullsized":"2023-07-11T00:31:47.436858+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.438360+0000","last_change":"2023-07-11T00:31:47.438360+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.438360+0000","last_undegraded":"2023-07-11T00:31:47.438360+0000","last_fullsized":"2023-07-11T00:31:47.438360+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.439236+0000","last_change":"2023-07-11T00:31:47.439236+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.439236+0000","last_undegraded":"2023-07-11T00:31:47.439236+0000","last_fullsized":"2023-07-11T00:31:47.439236+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.432434+0000","last_change":"2023-07-11T00:31:47.432434+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.432434+0000","last_undegraded":"2023-07-11T00:31:47.432434+0000","last_fullsized":"2023-07-11T00:31:47.432434+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.435741+0000","last_change":"2023-07-11T00:31:47.435741+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.435741+0000","last_undegraded":"2023-07-11T00:31:47.435741+0000","last_fullsized":"2023-07-11T00:31:47.435741+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.437736+0000","last_change":"2023-07-11T00:31:47.437736+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.437736+0000","last_undegraded":"2023-07-11T00:31:47.437736+0000","last_fullsized":"2023-07-11T00:31:47.437736+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.434768+0000","last_change":"2023-07-11T00:31:47.434768+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.434768+0000","last_undegraded":"2023-07-11T00:31:47.434768+0000","last_fullsized":"2023-07-11T00:31:47.434768+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.438277+0000","last_change":"2023-07-11T00:31:47.438277+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.438277+0000","last_undegraded":"2023-07-11T00:31:47.438277+0000","last_fullsized":"2023-07-11T00:31:47.438277+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.432282+0000","last_change":"2023-07-11T00:31:47.432282+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.432282+0000","last_undegraded":"2023-07-11T00:31:47.432282+0000","last_fullsized":"2023-07-11T00:31:47.432282+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.436822+0000","last_change":"2023-07-11T00:31:47.436822+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.436822+0000","last_undegraded":"2023-07-11T00:31:47.436822+0000","last_fullsized":"2023-07-11T00:31:47.436822+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.433528+0000","last_change":"2023-07-11T00:31:47.433528+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.433528+0000","last_undegraded":"2023-07-11T00:31:47.433528+0000","last_fullsized":"2023-07-11T00:31:47.433528+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.434759+0000","last_change":"2023-07-11T00:31:47.434759+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.434759+0000","last_undegraded":"2023-07-11T00:31:47.434759+0000","last_fullsized":"2023-07-11T00:31:47.434759+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.435369+0000","last_change":"2023-07-11T00:31:47.435369+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.435369+0000","last_undegraded":"2023-07-11T00:31:47.435369+0000","last_fullsized":"2023-07-11T00:31:47.435369+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.433384+0000","last_change":"2023-07-11T00:31:47.433384+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.433384+0000","last_undegraded":"2023-07-11T00:31:47.433384+0000","last_fullsized":"2023-07-11T00:31:47.433384+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.437862+0000","last_change":"2023-07-11T00:31:47.437862+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.437862+0000","last_undegraded":"2023-07-11T00:31:47.437862+0000","last_fullsized":"2023-07-11T00:31:47.437862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.438497+0000","last_change":"2023-07-11T00:31:47.438497+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.438497+0000","last_undegraded":"2023-07-11T00:31:47.438497+0000","last_fullsized":"2023-07-11T00:31:47.438497+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.435595+0000","last_change":"2023-07-11T00:31:47.435595+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.435595+0000","last_undegraded":"2023-07-11T00:31:47.435595+0000","last_fullsized":"2023-07-11T00:31:47.435595+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.438710+0000","last_change":"2023-07-11T00:29:59.627086+0000","last_active":"2023-07-11T00:31:47.438710+0000","last_peered":"2023-07-11T00:31:47.438710+0000","last_clean":"2023-07-11T00:31:47.438710+0000","last_became_active":"2023-07-11T00:29:59.626687+0000","last_became_peered":"2023-07-11T00:29:59.626687+0000","last_unstale":"2023-07-11T00:31:47.438710+0000","last_undegraded":"2023-07-11T00:31:47.438710+0000","last_fullsized":"2023-07-11T00:31:47.438710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:54:01.862290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.438812+0000","last_change":"2023-07-11T00:31:47.438812+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.438812+0000","last_undegraded":"2023-07-11T00:31:47.438812+0000","last_fullsized":"2023-07-11T00:31:47.438812+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.436739+0000","last_change":"2023-07-11T00:29:59.589317+0000","last_active":"2023-07-11T00:31:47.436739+0000","last_peered":"2023-07-11T00:31:47.436739+0000","last_clean":"2023-07-11T00:31:47.436739+0000","last_became_active":"2023-07-11T00:29:59.588926+0000","last_became_peered":"2023-07-11T00:29:59.588926+0000","last_unstale":"2023-07-11T00:31:47.436739+0000","last_undegraded":"2023-07-11T00:31:47.436739+0000","last_fullsized":"2023-07-11T00:31:47.436739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:02:02.034480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.432029+0000","last_change":"2023-07-11T00:31:47.432029+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.432029+0000","last_undegraded":"2023-07-11T00:31:47.432029+0000","last_fullsized":"2023-07-11T00:31:47.432029+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.432686+0000","last_change":"2023-07-11T00:29:59.585672+0000","last_active":"2023-07-11T00:31:47.432686+0000","last_peered":"2023-07-11T00:31:47.432686+0000","last_clean":"2023-07-11T00:31:47.432686+0000","last_became_active":"2023-07-11T00:29:59.585405+0000","last_became_peered":"2023-07-11T00:29:59.585405+0000","last_unstale":"2023-07-11T00:31:47.432686+0000","last_undegraded":"2023-07-11T00:31:47.432686+0000","last_fullsized":"2023-07-11T00:31:47.432686+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:17:28.789596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":193,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.439772+0000","last_change":"2023-07-11T00:29:59.589132+0000","last_active":"2023-07-11T00:31:47.439772+0000","last_peered":"2023-07-11T00:31:47.439772+0000","last_clean":"2023-07-11T00:31:47.439772+0000","last_became_active":"2023-07-11T00:29:59.588293+0000","last_became_peered":"2023-07-11T00:29:59.588293+0000","last_unstale":"2023-07-11T00:31:47.439772+0000","last_undegraded":"2023-07-11T00:31:47.439772+0000","last_fullsized":"2023-07-11T00:31:47.439772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:25:42.727921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.438757+0000","last_change":"2023-07-11T00:31:47.438757+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.438757+0000","last_undegraded":"2023-07-11T00:31:47.438757+0000","last_fullsized":"2023-07-11T00:31:47.438757+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.439983+0000","last_change":"2023-07-11T00:29:59.978997+0000","last_active":"2023-07-11T00:31:47.439983+0000","last_peered":"2023-07-11T00:31:47.439983+0000","last_clean":"2023-07-11T00:31:47.439983+0000","last_became_active":"2023-07-11T00:29:59.978716+0000","last_became_peered":"2023-07-11T00:29:59.978716+0000","last_unstale":"2023-07-11T00:31:47.439983+0000","last_undegraded":"2023-07-11T00:31:47.439983+0000","last_fullsized":"2023-07-11T00:31:47.439983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:33:53.624838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.433555+0000","last_change":"2023-07-11T00:31:47.433555+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.433555+0000","last_undegraded":"2023-07-11T00:31:47.433555+0000","last_fullsized":"2023-07-11T00:31:47.433555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.439612+0000","last_change":"2023-07-11T00:29:59.978976+0000","last_active":"2023-07-11T00:31:47.439612+0000","last_peered":"2023-07-11T00:31:47.439612+0000","last_clean":"2023-07-11T00:31:47.439612+0000","last_became_active":"2023-07-11T00:29:59.978678+0000","last_became_peered":"2023-07-11T00:29:59.978678+0000","last_unstale":"2023-07-11T00:31:47.439612+0000","last_undegraded":"2023-07-11T00:31:47.439612+0000","last_fullsized":"2023-07-11T00:31:47.439612+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:21:52.495619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.434982+0000","last_change":"2023-07-11T00:31:47.434982+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.434982+0000","last_undegraded":"2023-07-11T00:31:47.434982+0000","last_fullsized":"2023-07-11T00:31:47.434982+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.434052+0000","last_change":"2023-07-11T00:29:59.979163+0000","last_active":"2023-07-11T00:31:47.434052+0000","last_peered":"2023-07-11T00:31:47.434052+0000","last_clean":"2023-07-11T00:31:47.434052+0000","last_became_active":"2023-07-11T00:29:59.978751+0000","last_became_peered":"2023-07-11T00:29:59.978751+0000","last_unstale":"2023-07-11T00:31:47.434052+0000","last_undegraded":"2023-07-11T00:31:47.434052+0000","last_fullsized":"2023-07-11T00:31:47.434052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:55:16.470291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.431983+0000","last_change":"2023-07-11T00:31:47.431983+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.431983+0000","last_undegraded":"2023-07-11T00:31:47.431983+0000","last_fullsized":"2023-07-11T00:31:47.431983+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.435560+0000","last_change":"2023-07-11T00:29:59.978981+0000","last_active":"2023-07-11T00:31:47.435560+0000","last_peered":"2023-07-11T00:31:47.435560+0000","last_clean":"2023-07-11T00:31:47.435560+0000","last_became_active":"2023-07-11T00:29:59.978633+0000","last_became_peered":"2023-07-11T00:29:59.978633+0000","last_unstale":"2023-07-11T00:31:47.435560+0000","last_undegraded":"2023-07-11T00:31:47.435560+0000","last_fullsized":"2023-07-11T00:31:47.435560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:58:18.247810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.437861+0000","last_change":"2023-07-11T00:31:47.437861+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.437861+0000","last_undegraded":"2023-07-11T00:31:47.437861+0000","last_fullsized":"2023-07-11T00:31:47.437861+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.435704+0000","last_change":"2023-07-11T00:29:59.585652+0000","last_active":"2023-07-11T00:31:47.435704+0000","last_peered":"2023-07-11T00:31:47.435704+0000","last_clean":"2023-07-11T00:31:47.435704+0000","last_became_active":"2023-07-11T00:29:59.585316+0000","last_became_peered":"2023-07-11T00:29:59.585316+0000","last_unstale":"2023-07-11T00:31:47.435704+0000","last_undegraded":"2023-07-11T00:31:47.435704+0000","last_fullsized":"2023-07-11T00:31:47.435704+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:01.589629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":760134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.496},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.68600000000000005}]},{"osd":1,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.74299999999999999}]},{"osd":2,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.76000000000000001}]},{"osd":3,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.60899999999999999}]},{"osd":4,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.627},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.63900000000000001}]},{"osd":5,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56200000000000006}]},{"osd":6,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.77300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":168405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":8.9930000000000003,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":4.8150000000000004,"5min":4.8150000000000004,"15min":4.8150000000000004},"last":0.90500000000000003}]},{"osd":1,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":4.9800000000000004,"5min":4.9800000000000004,"15min":4.9800000000000004},"last":0.746},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":1.0880000000000001}]},{"osd":2,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":3.0790000000000002,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":0.82899999999999996}]},{"osd":3,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":10.978999999999999,"5min":10.978999999999999,"15min":10.978999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":4.8300000000000001,"5min":4.8300000000000001,"15min":4.8300000000000001},"last":0.71599999999999997}]},{"osd":4,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":6.2309999999999999,"5min":6.2309999999999999,"15min":6.2309999999999999},"last":1.3109999999999999}]},{"osd":5,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.0209999999999999}]},{"osd":7,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.2669999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.2190000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":760134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.309},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44800000000000001}]},{"osd":2,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.52600000000000002}]},{"osd":3,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.40300000000000002}]},{"osd":4,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.59699999999999998}]},{"osd":5,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.61099999999999999}]},{"osd":6,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.55800000000000005}]},{"osd":7,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.54500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":168405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.33900000000000002}]},{"osd":2,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.42199999999999999}]},{"osd":3,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.377},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.49399999999999999}]},{"osd":4,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.66200000000000003}]},{"osd":5,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.629}]},{"osd":6,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.69399999999999995}]},{"osd":7,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.54200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":169766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":3.2989999999999999,"5min":3.2989999999999999,"15min":3.2989999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.49199999999999999}]},{"osd":1,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.024,"5min":3.024,"15min":3.024},"last":0.375}]},{"osd":3,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":3.0779999999999998,"5min":3.0779999999999998,"15min":3.0779999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.3330000000000002,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.56799999999999995}]},{"osd":4,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.2200000000000002,"5min":3.2200000000000002,"15min":3.2200000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.90400000000000003}]},{"osd":5,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":3.2629999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.87}]},{"osd":7,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.92600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":168405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":10.938000000000001,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.44}]},{"osd":1,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":10.874000000000001,"5min":10.874000000000001,"15min":10.874000000000001},"last":0.46700000000000003}]},{"osd":2,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":11.050000000000001,"5min":11.050000000000001,"15min":11.050000000000001},"last":0.51400000000000001}]},{"osd":4,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":0.69699999999999995}]},{"osd":5,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":11.015000000000001,"5min":11.015000000000001,"15min":11.015000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":10.978,"5min":10.978,"15min":10.978},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.754},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.72899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":169766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.871,"5min":2.871,"15min":2.871},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57499999999999996}]},{"osd":1,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.61199999999999999}]},{"osd":3,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":7.6790000000000003,"5min":7.6790000000000003,"15min":7.6790000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.78900000000000003}]},{"osd":5,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.81799999999999995}]},{"osd":6,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73599999999999999}]},{"osd":7,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.754},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.80700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":385024,"data_stored":168405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.622},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.76900000000000002}]},{"osd":2,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.84099999999999997}]},{"osd":3,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.72299999999999998}]},{"osd":4,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.68200000000000005}]},{"osd":6,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.82299999999999995}]},{"osd":7,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.873}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-11T00:31:53.910 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-11T00:31:54.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.139+0000 7f4b905ff700 1 Processor -- start 2023-07-11T00:31:54.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.140+0000 7f4b905ff700 1 -- start start 2023-07-11T00:31:54.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.141+0000 7f4b905ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4b8815c460 0x7f4b880b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:54.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.141+0000 7f4b905ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b880d2640 0x7f4b880cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:54.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.141+0000 7f4b905ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b880d1790 con 0x7f4b880cf720 2023-07-11T00:31:54.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.141+0000 7f4b905ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b880cedd0 con 0x7f4b8815c460 2023-07-11T00:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.141+0000 7f4b905ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880cd950 con 0x7f4b880d2640 2023-07-11T00:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.141+0000 7f4b8db9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b880d2640 0x7f4b880cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.141+0000 7f4b8db9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b880d2640 0x7f4b880cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:47890/0 (socket says 172.21.15.22:47890) 2023-07-11T00:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.141+0000 7f4b8db9a700 1 -- 172.21.15.22:0/903822569 learned_addr learned my addr 172.21.15.22:0/903822569 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.141+0000 7f4b8e39b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4b8815c460 0x7f4b880b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.141+0000 7f4b8eb9c700 1 --1- 172.21.15.22:0/903822569 >> v1:172.21.15.184:6789/0 conn(0x7f4b880cf720 0x7f4b880d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:60532/0 (socket says 172.21.15.22:60532) 2023-07-11T00:31:54.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.142+0000 7f4b8db9a700 1 -- 172.21.15.22:0/903822569 >> v2:172.21.15.184:3300/0 conn(0x7f4b8815c460 msgr2=0x7f4b880b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:54.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.142+0000 7f4b8db9a700 1 --2- 172.21.15.22:0/903822569 >> v2:172.21.15.184:3300/0 conn(0x7f4b8815c460 0x7f4b880b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:54.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.142+0000 7f4b8db9a700 1 -- 172.21.15.22:0/903822569 >> v1:172.21.15.184:6789/0 conn(0x7f4b880cf720 legacy=0x7f4b880d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:54.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.142+0000 7f4b8db9a700 1 -- 172.21.15.22:0/903822569 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b880d14b0 con 0x7f4b880d2640 2023-07-11T00:31:54.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.142+0000 7f4b8e39b700 1 --2- 172.21.15.22:0/903822569 >> v2:172.21.15.184:3300/0 conn(0x7f4b8815c460 0x7f4b880b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:54.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.142+0000 7f4b8db9a700 1 --2- 172.21.15.22:0/903822569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b880d2640 0x7f4b880cf1e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b780098f0 tx=0x7f4b78009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10b98daf4924160a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:54.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.142+0000 7f4b8d399700 1 -- 172.21.15.22:0/903822569 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78011830 con 0x7f4b880d2640 2023-07-11T00:31:54.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.142+0000 7f4b8d399700 1 -- 172.21.15.22:0/903822569 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b78011990 con 0x7f4b880d2640 2023-07-11T00:31:54.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.142+0000 7f4b8d399700 1 -- 172.21.15.22:0/903822569 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78011d20 con 0x7f4b880d2640 2023-07-11T00:31:54.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.143+0000 7f4b905ff700 1 -- 172.21.15.22:0/903822569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b880d2640 msgr2=0x7f4b880cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:54.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.143+0000 7f4b905ff700 1 --2- 172.21.15.22:0/903822569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b880d2640 0x7f4b880cf1e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b780098f0 tx=0x7f4b78009c00 comp rx=0 tx=0).stop 2023-07-11T00:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.143+0000 7f4b905ff700 1 -- 172.21.15.22:0/903822569 shutdown_connections 2023-07-11T00:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.143+0000 7f4b905ff700 1 --2- 172.21.15.22:0/903822569 >> v2:172.21.15.184:3300/0 conn(0x7f4b8815c460 0x7f4b880b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.143+0000 7f4b905ff700 1 --2- 172.21.15.22:0/903822569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b880d2640 0x7f4b880cf1e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.143+0000 7f4b905ff700 1 -- 172.21.15.22:0/903822569 >> 172.21.15.22:0/903822569 conn(0x7f4b88071660 msgr2=0x7f4b88071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.143+0000 7f4b905ff700 1 -- 172.21.15.22:0/903822569 shutdown_connections 2023-07-11T00:31:54.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.143+0000 7f4b905ff700 1 -- 172.21.15.22:0/903822569 wait complete. 2023-07-11T00:31:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.145+0000 7f4b905ff700 1 Processor -- start 2023-07-11T00:31:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.145+0000 7f4b905ff700 1 -- start start 2023-07-11T00:31:54.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.146+0000 7f4b905ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b880cf720 0x7f4b881461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:54.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.146+0000 7f4b905ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b880d2640 0x7f4b8815d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:54.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.146+0000 7f4b905ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b8815c460 0x7f4b88142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:54.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.146+0000 7f4b905ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8815ddc0 con 0x7f4b8815c460 2023-07-11T00:31:54.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.146+0000 7f4b905ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b881432a0 con 0x7f4b880cf720 2023-07-11T00:31:54.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.146+0000 7f4b905ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8815e060 con 0x7f4b880d2640 2023-07-11T00:31:54.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.146+0000 7f4b8eb9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b8815c460 0x7f4b88142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:54.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.146+0000 7f4b8eb9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b8815c460 0x7f4b88142d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49020/0 (socket says 172.21.15.22:49020) 2023-07-11T00:31:54.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.146+0000 7f4b8eb9c700 1 -- 172.21.15.22:0/4032787761 learned_addr learned my addr 172.21.15.22:0/4032787761 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:54.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.146+0000 7f4b8e39b700 1 --2- 172.21.15.22:0/4032787761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b880cf720 0x7f4b881461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.146+0000 7f4b8db9a700 1 --2- 172.21.15.22:0/4032787761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b880d2640 0x7f4b8815d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.147+0000 7f4b8e39b700 1 -- 172.21.15.22:0/4032787761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b880d2640 msgr2=0x7f4b8815d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.147+0000 7f4b8e39b700 1 --2- 172.21.15.22:0/4032787761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b880d2640 0x7f4b8815d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.147+0000 7f4b8e39b700 1 -- 172.21.15.22:0/4032787761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b8815c460 msgr2=0x7f4b88142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.147+0000 7f4b8e39b700 1 --2- 172.21.15.22:0/4032787761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b8815c460 0x7f4b88142d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.147+0000 7f4b8e39b700 1 -- 172.21.15.22:0/4032787761 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b840094a0 con 0x7f4b880cf720 2023-07-11T00:31:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.147+0000 7f4b8eb9c700 1 --2- 172.21.15.22:0/4032787761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b8815c460 0x7f4b88142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.147+0000 7f4b8e39b700 1 --2- 172.21.15.22:0/4032787761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b880cf720 0x7f4b881461b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400e9b0 tx=0x7f4b8400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.147+0000 7f4b7effd700 1 -- 172.21.15.22:0/4032787761 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8400ee50 con 0x7f4b880cf720 2023-07-11T00:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.147+0000 7f4b7effd700 1 -- 172.21.15.22:0/4032787761 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8400c850 con 0x7f4b880cf720 2023-07-11T00:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.147+0000 7f4b7effd700 1 -- 172.21.15.22:0/4032787761 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8400cc00 con 0x7f4b880cf720 2023-07-11T00:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.147+0000 7f4b905ff700 1 -- 172.21.15.22:0/4032787761 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b78009550 con 0x7f4b880cf720 2023-07-11T00:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.147+0000 7f4b905ff700 1 -- 172.21.15.22:0/4032787761 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8815e620 con 0x7f4b880cf720 2023-07-11T00:31:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.148+0000 7f4b905ff700 1 -- 172.21.15.22:0/4032787761 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8804ea60 con 0x7f4b880cf720 2023-07-11T00:31:54.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.150+0000 7f4b7effd700 1 -- 172.21.15.22:0/4032787761 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b84013470 con 0x7f4b880cf720 2023-07-11T00:31:54.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.151+0000 7f4b7effd700 1 --2- 172.21.15.22:0/4032787761 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4b6c06ace0 0x7f4b6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:54.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.151+0000 7f4b7effd700 1 -- 172.21.15.22:0/4032787761 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4b840895d0 con 0x7f4b880cf720 2023-07-11T00:31:54.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.151+0000 7f4b8db9a700 1 --2- 172.21.15.22:0/4032787761 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4b6c06ace0 0x7f4b6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:54.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.152+0000 7f4b8db9a700 1 --2- 172.21.15.22:0/4032787761 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4b6c06ace0 0x7f4b6c06d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4b78000c00 tx=0x7f4b78008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:54.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.156+0000 7f4b7effd700 1 -- 172.21.15.22:0/4032787761 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f4b84054530 con 0x7f4b880cf720 2023-07-11T00:31:54.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.355+0000 7f4b905ff700 1 -- 172.21.15.22:0/4032787761 --> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b880cd5e0 con 0x7f4b6c06ace0 2023-07-11T00:31:54.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.364+0000 7f4b7effd700 1 -- 172.21.15.22:0/4032787761 <== mgr.4114 v2:172.21.15.184:6832/380612710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299099 (secure 0 0 0) 0x7f4b78011b80 con 0x7f4b6c06ace0 2023-07-11T00:31:54.370 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:54.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.368+0000 7f4b905ff700 1 -- 172.21.15.22:0/4032787761 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4b6c06ace0 msgr2=0x7f4b6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:54.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.368+0000 7f4b905ff700 1 --2- 172.21.15.22:0/4032787761 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4b6c06ace0 0x7f4b6c06d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4b78000c00 tx=0x7f4b78008030 comp rx=0 tx=0).stop 2023-07-11T00:31:54.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.368+0000 7f4b905ff700 1 -- 172.21.15.22:0/4032787761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b880cf720 msgr2=0x7f4b881461b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:54.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.368+0000 7f4b905ff700 1 --2- 172.21.15.22:0/4032787761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b880cf720 0x7f4b881461b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400e9b0 tx=0x7f4b8400ecc0 comp rx=0 tx=0).stop 2023-07-11T00:31:54.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.368+0000 7f4b905ff700 1 -- 172.21.15.22:0/4032787761 shutdown_connections 2023-07-11T00:31:54.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.368+0000 7f4b905ff700 1 --2- 172.21.15.22:0/4032787761 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4b6c06ace0 0x7f4b6c06d190 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:54.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.368+0000 7f4b905ff700 1 --2- 172.21.15.22:0/4032787761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b8815c460 0x7f4b88142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:54.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.368+0000 7f4b905ff700 1 --2- 172.21.15.22:0/4032787761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b880cf720 0x7f4b881461b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:54.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.368+0000 7f4b905ff700 1 --2- 172.21.15.22:0/4032787761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b880d2640 0x7f4b8815d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:54.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.368+0000 7f4b905ff700 1 -- 172.21.15.22:0/4032787761 >> 172.21.15.22:0/4032787761 conn(0x7f4b88071660 msgr2=0x7f4b88153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:54.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.368+0000 7f4b905ff700 1 -- 172.21.15.22:0/4032787761 shutdown_connections 2023-07-11T00:31:54.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.368+0000 7f4b905ff700 1 -- 172.21.15.22:0/4032787761 wait complete. 2023-07-11T00:31:54.376 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-07-11T00:31:54.389 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-07-11T00:31:52.518215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220384,"kb_used_data":4184,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754336,"statfs":{"total":773094113280,"available":772868440064,"internally_reserved":0,"allocated":4284416,"data_stored":2533420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.088157"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.434797+0000","last_change":"2023-07-11T00:31:47.434797+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.434797+0000","last_undegraded":"2023-07-11T00:31:47.434797+0000","last_fullsized":"2023-07-11T00:31:47.434797+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.437316+0000","last_change":"2023-07-11T00:31:47.437316+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.437316+0000","last_undegraded":"2023-07-11T00:31:47.437316+0000","last_fullsized":"2023-07-11T00:31:47.437316+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.432011+0000","last_change":"2023-07-11T00:31:47.432011+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.432011+0000","last_undegraded":"2023-07-11T00:31:47.432011+0000","last_fullsized":"2023-07-11T00:31:47.432011+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.438274+0000","last_change":"2023-07-11T00:31:47.438274+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.438274+0000","last_undegraded":"2023-07-11T00:31:47.438274+0000","last_fullsized":"2023-07-11T00:31:47.438274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.434749+0000","last_change":"2023-07-11T00:31:47.434749+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.434749+0000","last_undegraded":"2023-07-11T00:31:47.434749+0000","last_fullsized":"2023-07-11T00:31:47.434749+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.436112+0000","last_change":"2023-07-11T00:31:47.436112+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.436112+0000","last_undegraded":"2023-07-11T00:31:47.436112+0000","last_fullsized":"2023-07-11T00:31:47.436112+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.433295+0000","last_change":"2023-07-11T00:31:47.433295+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.433295+0000","last_undegraded":"2023-07-11T00:31:47.433295+0000","last_fullsized":"2023-07-11T00:31:47.433295+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.438606+0000","last_change":"2023-07-11T00:31:47.438606+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.438606+0000","last_undegraded":"2023-07-11T00:31:47.438606+0000","last_fullsized":"2023-07-11T00:31:47.438606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.436858+0000","last_change":"2023-07-11T00:31:47.436858+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.436858+0000","last_undegraded":"2023-07-11T00:31:47.436858+0000","last_fullsized":"2023-07-11T00:31:47.436858+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.438360+0000","last_change":"2023-07-11T00:31:47.438360+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.438360+0000","last_undegraded":"2023-07-11T00:31:47.438360+0000","last_fullsized":"2023-07-11T00:31:47.438360+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.439236+0000","last_change":"2023-07-11T00:31:47.439236+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.439236+0000","last_undegraded":"2023-07-11T00:31:47.439236+0000","last_fullsized":"2023-07-11T00:31:47.439236+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.432434+0000","last_change":"2023-07-11T00:31:47.432434+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.432434+0000","last_undegraded":"2023-07-11T00:31:47.432434+0000","last_fullsized":"2023-07-11T00:31:47.432434+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.435741+0000","last_change":"2023-07-11T00:31:47.435741+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.435741+0000","last_undegraded":"2023-07-11T00:31:47.435741+0000","last_fullsized":"2023-07-11T00:31:47.435741+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.437736+0000","last_change":"2023-07-11T00:31:47.437736+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.437736+0000","last_undegraded":"2023-07-11T00:31:47.437736+0000","last_fullsized":"2023-07-11T00:31:47.437736+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.434768+0000","last_change":"2023-07-11T00:31:47.434768+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.434768+0000","last_undegraded":"2023-07-11T00:31:47.434768+0000","last_fullsized":"2023-07-11T00:31:47.434768+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.438277+0000","last_change":"2023-07-11T00:31:47.438277+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.438277+0000","last_undegraded":"2023-07-11T00:31:47.438277+0000","last_fullsized":"2023-07-11T00:31:47.438277+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.432282+0000","last_change":"2023-07-11T00:31:47.432282+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.432282+0000","last_undegraded":"2023-07-11T00:31:47.432282+0000","last_fullsized":"2023-07-11T00:31:47.432282+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.436822+0000","last_change":"2023-07-11T00:31:47.436822+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.436822+0000","last_undegraded":"2023-07-11T00:31:47.436822+0000","last_fullsized":"2023-07-11T00:31:47.436822+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.433528+0000","last_change":"2023-07-11T00:31:47.433528+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.433528+0000","last_undegraded":"2023-07-11T00:31:47.433528+0000","last_fullsized":"2023-07-11T00:31:47.433528+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.434759+0000","last_change":"2023-07-11T00:31:47.434759+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.434759+0000","last_undegraded":"2023-07-11T00:31:47.434759+0000","last_fullsized":"2023-07-11T00:31:47.434759+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.435369+0000","last_change":"2023-07-11T00:31:47.435369+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.435369+0000","last_undegraded":"2023-07-11T00:31:47.435369+0000","last_fullsized":"2023-07-11T00:31:47.435369+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.433384+0000","last_change":"2023-07-11T00:31:47.433384+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.433384+0000","last_undegraded":"2023-07-11T00:31:47.433384+0000","last_fullsized":"2023-07-11T00:31:47.433384+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.437862+0000","last_change":"2023-07-11T00:31:47.437862+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.437862+0000","last_undegraded":"2023-07-11T00:31:47.437862+0000","last_fullsized":"2023-07-11T00:31:47.437862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.438497+0000","last_change":"2023-07-11T00:31:47.438497+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.438497+0000","last_undegraded":"2023-07-11T00:31:47.438497+0000","last_fullsized":"2023-07-11T00:31:47.438497+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.435595+0000","last_change":"2023-07-11T00:31:47.435595+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.435595+0000","last_undegraded":"2023-07-11T00:31:47.435595+0000","last_fullsized":"2023-07-11T00:31:47.435595+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.438710+0000","last_change":"2023-07-11T00:29:59.627086+0000","last_active":"2023-07-11T00:31:47.438710+0000","last_peered":"2023-07-11T00:31:47.438710+0000","last_clean":"2023-07-11T00:31:47.438710+0000","last_became_active":"2023-07-11T00:29:59.626687+0000","last_became_peered":"2023-07-11T00:29:59.626687+0000","last_unstale":"2023-07-11T00:31:47.438710+0000","last_undegraded":"2023-07-11T00:31:47.438710+0000","last_fullsized":"2023-07-11T00:31:47.438710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:54:01.862290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.438812+0000","last_change":"2023-07-11T00:31:47.438812+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.438812+0000","last_undegraded":"2023-07-11T00:31:47.438812+0000","last_fullsized":"2023-07-11T00:31:47.438812+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.436739+0000","last_change":"2023-07-11T00:29:59.589317+0000","last_active":"2023-07-11T00:31:47.436739+0000","last_peered":"2023-07-11T00:31:47.436739+0000","last_clean":"2023-07-11T00:31:47.436739+0000","last_became_active":"2023-07-11T00:29:59.588926+0000","last_became_peered":"2023-07-11T00:29:59.588926+0000","last_unstale":"2023-07-11T00:31:47.436739+0000","last_undegraded":"2023-07-11T00:31:47.436739+0000","last_fullsized":"2023-07-11T00:31:47.436739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:02:02.034480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.432029+0000","last_change":"2023-07-11T00:31:47.432029+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.432029+0000","last_undegraded":"2023-07-11T00:31:47.432029+0000","last_fullsized":"2023-07-11T00:31:47.432029+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.432686+0000","last_change":"2023-07-11T00:29:59.585672+0000","last_active":"2023-07-11T00:31:47.432686+0000","last_peered":"2023-07-11T00:31:47.432686+0000","last_clean":"2023-07-11T00:31:47.432686+0000","last_became_active":"2023-07-11T00:29:59.585405+0000","last_became_peered":"2023-07-11T00:29:59.585405+0000","last_unstale":"2023-07-11T00:31:47.432686+0000","last_undegraded":"2023-07-11T00:31:47.432686+0000","last_fullsized":"2023-07-11T00:31:47.432686+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:17:28.789596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":193,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.439772+0000","last_change":"2023-07-11T00:29:59.589132+0000","last_active":"2023-07-11T00:31:47.439772+0000","last_peered":"2023-07-11T00:31:47.439772+0000","last_clean":"2023-07-11T00:31:47.439772+0000","last_became_active":"2023-07-11T00:29:59.588293+0000","last_became_peered":"2023-07-11T00:29:59.588293+0000","last_unstale":"2023-07-11T00:31:47.439772+0000","last_undegraded":"2023-07-11T00:31:47.439772+0000","last_fullsized":"2023-07-11T00:31:47.439772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:25:42.727921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.438757+0000","last_change":"2023-07-11T00:31:47.438757+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.438757+0000","last_undegraded":"2023-07-11T00:31:47.438757+0000","last_fullsized":"2023-07-11T00:31:47.438757+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.439983+0000","last_change":"2023-07-11T00:29:59.978997+0000","last_active":"2023-07-11T00:31:47.439983+0000","last_peered":"2023-07-11T00:31:47.439983+0000","last_clean":"2023-07-11T00:31:47.439983+0000","last_became_active":"2023-07-11T00:29:59.978716+0000","last_became_peered":"2023-07-11T00:29:59.978716+0000","last_unstale":"2023-07-11T00:31:47.439983+0000","last_undegraded":"2023-07-11T00:31:47.439983+0000","last_fullsized":"2023-07-11T00:31:47.439983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:33:53.624838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.433555+0000","last_change":"2023-07-11T00:31:47.433555+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.433555+0000","last_undegraded":"2023-07-11T00:31:47.433555+0000","last_fullsized":"2023-07-11T00:31:47.433555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.439612+0000","last_change":"2023-07-11T00:29:59.978976+0000","last_active":"2023-07-11T00:31:47.439612+0000","last_peered":"2023-07-11T00:31:47.439612+0000","last_clean":"2023-07-11T00:31:47.439612+0000","last_became_active":"2023-07-11T00:29:59.978678+0000","last_became_peered":"2023-07-11T00:29:59.978678+0000","last_unstale":"2023-07-11T00:31:47.439612+0000","last_undegraded":"2023-07-11T00:31:47.439612+0000","last_fullsized":"2023-07-11T00:31:47.439612+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:21:52.495619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.434982+0000","last_change":"2023-07-11T00:31:47.434982+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.434982+0000","last_undegraded":"2023-07-11T00:31:47.434982+0000","last_fullsized":"2023-07-11T00:31:47.434982+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.434052+0000","last_change":"2023-07-11T00:29:59.979163+0000","last_active":"2023-07-11T00:31:47.434052+0000","last_peered":"2023-07-11T00:31:47.434052+0000","last_clean":"2023-07-11T00:31:47.434052+0000","last_became_active":"2023-07-11T00:29:59.978751+0000","last_became_peered":"2023-07-11T00:29:59.978751+0000","last_unstale":"2023-07-11T00:31:47.434052+0000","last_undegraded":"2023-07-11T00:31:47.434052+0000","last_fullsized":"2023-07-11T00:31:47.434052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:55:16.470291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.431983+0000","last_change":"2023-07-11T00:31:47.431983+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.431983+0000","last_undegraded":"2023-07-11T00:31:47.431983+0000","last_fullsized":"2023-07-11T00:31:47.431983+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.435560+0000","last_change":"2023-07-11T00:29:59.978981+0000","last_active":"2023-07-11T00:31:47.435560+0000","last_peered":"2023-07-11T00:31:47.435560+0000","last_clean":"2023-07-11T00:31:47.435560+0000","last_became_active":"2023-07-11T00:29:59.978633+0000","last_became_peered":"2023-07-11T00:29:59.978633+0000","last_unstale":"2023-07-11T00:31:47.435560+0000","last_undegraded":"2023-07-11T00:31:47.435560+0000","last_fullsized":"2023-07-11T00:31:47.435560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:58:18.247810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-11T00:31:48.429265+0000","last_change":"2023-07-11T00:31:48.429265+0000","last_active":"2023-07-11T00:31:48.429265+0000","last_peered":"2023-07-11T00:31:48.429265+0000","last_clean":"2023-07-11T00:31:48.429265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:48.429265+0000","last_undegraded":"2023-07-11T00:31:48.429265+0000","last_fullsized":"2023-07-11T00:31:48.429265+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-11T00:31:47.437861+0000","last_change":"2023-07-11T00:31:47.437861+0000","last_active":"2023-07-11T00:31:47.423816+0000","last_peered":"2023-07-11T00:31:47.423816+0000","last_clean":"2023-07-11T00:31:47.423816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-11T00:31:47.437861+0000","last_undegraded":"2023-07-11T00:31:47.437861+0000","last_fullsized":"2023-07-11T00:31:47.437861+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-11T00:31:47.435704+0000","last_change":"2023-07-11T00:29:59.585652+0000","last_active":"2023-07-11T00:31:47.435704+0000","last_peered":"2023-07-11T00:31:47.435704+0000","last_clean":"2023-07-11T00:31:47.435704+0000","last_became_active":"2023-07-11T00:29:59.585316+0000","last_became_peered":"2023-07-11T00:29:59.585316+0000","last_unstale":"2023-07-11T00:31:47.435704+0000","last_undegraded":"2023-07-11T00:31:47.435704+0000","last_fullsized":"2023-07-11T00:31:47.435704+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:01.589629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":760134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.496},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.68600000000000005}]},{"osd":1,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.74299999999999999}]},{"osd":2,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.76000000000000001}]},{"osd":3,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.60899999999999999}]},{"osd":4,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.627},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.63900000000000001}]},{"osd":5,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56200000000000006}]},{"osd":6,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.77300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":168405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":8.9930000000000003,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":4.8150000000000004,"5min":4.8150000000000004,"15min":4.8150000000000004},"last":0.90500000000000003}]},{"osd":1,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":4.9800000000000004,"5min":4.9800000000000004,"15min":4.9800000000000004},"last":0.746},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":1.0880000000000001}]},{"osd":2,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":3.0790000000000002,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":0.82899999999999996}]},{"osd":3,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":10.978999999999999,"5min":10.978999999999999,"15min":10.978999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":4.8300000000000001,"5min":4.8300000000000001,"15min":4.8300000000000001},"last":0.71599999999999997}]},{"osd":4,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":6.2309999999999999,"5min":6.2309999999999999,"15min":6.2309999999999999},"last":1.3109999999999999}]},{"osd":5,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.0209999999999999}]},{"osd":7,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.2669999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.2190000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":760134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.309},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44800000000000001}]},{"osd":2,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.52600000000000002}]},{"osd":3,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.40300000000000002}]},{"osd":4,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.59699999999999998}]},{"osd":5,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.61099999999999999}]},{"osd":6,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.55800000000000005}]},{"osd":7,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.54500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":168405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.33900000000000002}]},{"osd":2,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.42199999999999999}]},{"osd":3,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.377},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.49399999999999999}]},{"osd":4,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.66200000000000003}]},{"osd":5,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.629}]},{"osd":6,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.69399999999999995}]},{"osd":7,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.54200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":169766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":3.2989999999999999,"5min":3.2989999999999999,"15min":3.2989999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.49199999999999999}]},{"osd":1,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.024,"5min":3.024,"15min":3.024},"last":0.375}]},{"osd":3,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":3.0779999999999998,"5min":3.0779999999999998,"15min":3.0779999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.3330000000000002,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.56799999999999995}]},{"osd":4,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.2200000000000002,"5min":3.2200000000000002,"15min":3.2200000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.90400000000000003}]},{"osd":5,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":3.2629999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.87}]},{"osd":7,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.92600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":168405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":10.938000000000001,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.44}]},{"osd":1,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":10.874000000000001,"5min":10.874000000000001,"15min":10.874000000000001},"last":0.46700000000000003}]},{"osd":2,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":11.050000000000001,"5min":11.050000000000001,"15min":11.050000000000001},"last":0.51400000000000001}]},{"osd":4,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":0.69699999999999995}]},{"osd":5,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":11.015000000000001,"5min":11.015000000000001,"15min":11.015000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":10.978,"5min":10.978,"15min":10.978},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.754},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.72899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":169766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.871,"5min":2.871,"15min":2.871},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57499999999999996}]},{"osd":1,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.61199999999999999}]},{"osd":3,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":7.6790000000000003,"5min":7.6790000000000003,"15min":7.6790000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.78900000000000003}]},{"osd":5,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.81799999999999995}]},{"osd":6,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73599999999999999}]},{"osd":7,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.754},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.80700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":385024,"data_stored":168405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.622},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.76900000000000002}]},{"osd":2,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.84099999999999997}]},{"osd":3,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.72299999999999998}]},{"osd":4,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.68200000000000005}]},{"osd":6,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.82299999999999995}]},{"osd":7,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.873}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-11T00:31:54.401 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-11T00:31:54.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.630+0000 7f25dd7ff700 1 Processor -- start 2023-07-11T00:31:54.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.630+0000 7f25dd7ff700 1 -- start start 2023-07-11T00:31:54.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.631+0000 7f25dd7ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f25d80b59d0 0x7f25d81671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:54.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.631+0000 7f25dd7ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d80d1790 con 0x7f25d80d2640 2023-07-11T00:31:54.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.631+0000 7f25dd7ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d80cd950 con 0x7f25d815c460 2023-07-11T00:31:54.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.631+0000 7f25dd7ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d80b5e10 con 0x7f25d80b59d0 2023-07-11T00:31:54.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.632+0000 7f25d67fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f25d80d2640 0x7f25d80cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57302/0 (socket says 172.21.15.22:57302) 2023-07-11T00:31:54.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.632+0000 7f25d67fc700 1 -- 172.21.15.22:0/3643442676 learned_addr learned my addr 172.21.15.22:0/3643442676 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:54.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.632+0000 7f25d77fe700 1 --2- 172.21.15.22:0/3643442676 >> v2:172.21.15.184:3300/0 conn(0x7f25d80b59d0 0x7f25d81671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:54.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.632+0000 7f25d5ffb700 1 -- 172.21.15.22:0/3643442676 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459276070 0 0) 0x7f25d80d1790 con 0x7f25d80d2640 2023-07-11T00:31:54.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.632+0000 7f25d5ffb700 1 -- 172.21.15.22:0/3643442676 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25c00035b0 con 0x7f25d80d2640 2023-07-11T00:31:54.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.632+0000 7f25d5ffb700 1 -- 172.21.15.22:0/3643442676 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314258839 0 0) 0x7f25d80cd950 con 0x7f25d815c460 2023-07-11T00:31:54.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.632+0000 7f25d5ffb700 1 -- 172.21.15.22:0/3643442676 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25d80d1790 con 0x7f25d815c460 2023-07-11T00:31:54.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.632+0000 7f25d77fe700 1 -- 172.21.15.22:0/3643442676 >> v1:172.21.15.184:6789/0 conn(0x7f25d815c460 legacy=0x7f25d80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:54.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.632+0000 7f25d5ffb700 1 -- 172.21.15.22:0/3643442676 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3268864448 0 0) 0x7f25c00035b0 con 0x7f25d80d2640 2023-07-11T00:31:54.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.632+0000 7f25d77fe700 1 -- 172.21.15.22:0/3643442676 >> v1:172.21.15.22:6789/0 conn(0x7f25d80d2640 legacy=0x7f25d80cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:54.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.632+0000 7f25d77fe700 1 -- 172.21.15.22:0/3643442676 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d80d14b0 con 0x7f25d80b59d0 2023-07-11T00:31:54.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.633+0000 7f25d77fe700 1 --2- 172.21.15.22:0/3643442676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25d80b59d0 0x7f25d81671b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009d90 tx=0x7f25d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3830b4f42aae291d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:54.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.633+0000 7f25d5ffb700 1 -- 172.21.15.22:0/3643442676 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d000e070 con 0x7f25d80b59d0 2023-07-11T00:31:54.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.633+0000 7f25d5ffb700 1 -- 172.21.15.22:0/3643442676 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d0003a20 con 0x7f25d80b59d0 2023-07-11T00:31:54.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.633+0000 7f25d5ffb700 1 -- 172.21.15.22:0/3643442676 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc001670 con 0x7f25d80b59d0 2023-07-11T00:31:54.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.634+0000 7f25dd7ff700 1 -- 172.21.15.22:0/3643442676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25d80b59d0 msgr2=0x7f25d81671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:54.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.634+0000 7f25dd7ff700 1 --2- 172.21.15.22:0/3643442676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25d80b59d0 0x7f25d81671b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009d90 tx=0x7f25d000b330 comp rx=0 tx=0).stop 2023-07-11T00:31:54.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.634+0000 7f25dd7ff700 1 -- 172.21.15.22:0/3643442676 shutdown_connections 2023-07-11T00:31:54.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.634+0000 7f25dd7ff700 1 --2- 172.21.15.22:0/3643442676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25d80b59d0 0x7f25d81671b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:54.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.634+0000 7f25dd7ff700 1 -- 172.21.15.22:0/3643442676 >> 172.21.15.22:0/3643442676 conn(0x7f25d8071660 msgr2=0x7f25d8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:54.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.634+0000 7f25dd7ff700 1 -- 172.21.15.22:0/3643442676 shutdown_connections 2023-07-11T00:31:54.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.634+0000 7f25dd7ff700 1 -- 172.21.15.22:0/3643442676 wait complete. 2023-07-11T00:31:54.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.635+0000 7f25dd7ff700 1 Processor -- start 2023-07-11T00:31:54.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.636+0000 7f25dd7ff700 1 -- start start 2023-07-11T00:31:54.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.636+0000 7f25dd7ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25d80b59d0 0x7f25d814cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:54.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.636+0000 7f25dd7ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25d80d2640 0x7f25d80c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:54.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.636+0000 7f25dd7ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25d815c460 0x7f25d815eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:54.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.636+0000 7f25dd7ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d814d020 con 0x7f25d80b59d0 2023-07-11T00:31:54.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.636+0000 7f25dd7ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80ca190 con 0x7f25d80d2640 2023-07-11T00:31:54.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.636+0000 7f25dd7ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80c7090 con 0x7f25d815c460 2023-07-11T00:31:54.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.637+0000 7f25d6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25d80b59d0 0x7f25d814cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:54.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.637+0000 7f25d6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25d80b59d0 0x7f25d814cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49030/0 (socket says 172.21.15.22:49030) 2023-07-11T00:31:54.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.637+0000 7f25d6ffd700 1 -- 172.21.15.22:0/1785199061 learned_addr learned my addr 172.21.15.22:0/1785199061 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:54.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.637+0000 7f25d67fc700 1 --2- 172.21.15.22:0/1785199061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25d80d2640 0x7f25d80c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:54.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.637+0000 7f25d77fe700 1 --2- 172.21.15.22:0/1785199061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25d815c460 0x7f25d815eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:54.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.637+0000 7f25d6ffd700 1 -- 172.21.15.22:0/1785199061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25d815c460 msgr2=0x7f25d815eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:54.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.637+0000 7f25d6ffd700 1 --2- 172.21.15.22:0/1785199061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25d815c460 0x7f25d815eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:54.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.637+0000 7f25d6ffd700 1 -- 172.21.15.22:0/1785199061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25d80d2640 msgr2=0x7f25d80c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:54.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.637+0000 7f25d6ffd700 1 --2- 172.21.15.22:0/1785199061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25d80d2640 0x7f25d80c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:54.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.637+0000 7f25d6ffd700 1 -- 172.21.15.22:0/1785199061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d0009a70 con 0x7f25d80b59d0 2023-07-11T00:31:54.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.637+0000 7f25d67fc700 1 --2- 172.21.15.22:0/1785199061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25d80d2640 0x7f25d80c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:54.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.637+0000 7f25d6ffd700 1 --2- 172.21.15.22:0/1785199061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25d80b59d0 0x7f25d814cae0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f25c800c550 tx=0x7f25c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:54.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.638+0000 7f25bf7fe700 1 -- 172.21.15.22:0/1785199061 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c80052d0 con 0x7f25d80b59d0 2023-07-11T00:31:54.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.638+0000 7f25bf7fe700 1 -- 172.21.15.22:0/1785199061 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c8005430 con 0x7f25d80b59d0 2023-07-11T00:31:54.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.638+0000 7f25bf7fe700 1 -- 172.21.15.22:0/1785199061 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c80038c0 con 0x7f25d80b59d0 2023-07-11T00:31:54.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.638+0000 7f25dd7ff700 1 -- 172.21.15.22:0/1785199061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d80c7360 con 0x7f25d80b59d0 2023-07-11T00:31:54.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.638+0000 7f25dd7ff700 1 -- 172.21.15.22:0/1785199061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d80c7920 con 0x7f25d80b59d0 2023-07-11T00:31:54.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.639+0000 7f25dd7ff700 1 -- 172.21.15.22:0/1785199061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d804ea60 con 0x7f25d80b59d0 2023-07-11T00:31:54.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.640+0000 7f25bf7fe700 1 -- 172.21.15.22:0/1785199061 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f25c8003a20 con 0x7f25d80b59d0 2023-07-11T00:31:54.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.641+0000 7f25bf7fe700 1 --2- 172.21.15.22:0/1785199061 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f25c406ad10 0x7f25c406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:54.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.641+0000 7f25bf7fe700 1 -- 172.21.15.22:0/1785199061 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f25c8088c50 con 0x7f25d80b59d0 2023-07-11T00:31:54.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.641+0000 7f25d67fc700 1 --2- 172.21.15.22:0/1785199061 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f25c406ad10 0x7f25c406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:54.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.642+0000 7f25d67fc700 1 --2- 172.21.15.22:0/1785199061 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f25c406ad10 0x7f25c406d1c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f25cc001eb0 tx=0x7f25cc001c80 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:54.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.645+0000 7f25bf7fe700 1 -- 172.21.15.22:0/1785199061 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f25c8053a90 con 0x7f25d80b59d0 2023-07-11T00:31:54.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.847+0000 7f25dd7ff700 1 -- 172.21.15.22:0/1785199061 --> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25d80cd5e0 con 0x7f25c406ad10 2023-07-11T00:31:54.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.857+0000 7f25bf7fe700 1 -- 172.21.15.22:0/1785199061 <== mgr.4114 v2:172.21.15.184:6832/380612710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311153 (secure 0 0 0) 0x7f25cc00e620 con 0x7f25c406ad10 2023-07-11T00:31:54.863 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:54.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.861+0000 7f25dd7ff700 1 -- 172.21.15.22:0/1785199061 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f25c406ad10 msgr2=0x7f25c406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:54.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.861+0000 7f25dd7ff700 1 --2- 172.21.15.22:0/1785199061 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f25c406ad10 0x7f25c406d1c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f25cc001eb0 tx=0x7f25cc001c80 comp rx=0 tx=0).stop 2023-07-11T00:31:54.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.861+0000 7f25dd7ff700 1 -- 172.21.15.22:0/1785199061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25d80b59d0 msgr2=0x7f25d814cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:54.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.861+0000 7f25dd7ff700 1 --2- 172.21.15.22:0/1785199061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25d80b59d0 0x7f25d814cae0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f25c800c550 tx=0x7f25c800c910 comp rx=0 tx=0).stop 2023-07-11T00:31:54.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.861+0000 7f25dd7ff700 1 -- 172.21.15.22:0/1785199061 shutdown_connections 2023-07-11T00:31:54.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.861+0000 7f25dd7ff700 1 --2- 172.21.15.22:0/1785199061 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f25c406ad10 0x7f25c406d1c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:54.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.861+0000 7f25dd7ff700 1 --2- 172.21.15.22:0/1785199061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25d815c460 0x7f25d815eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:54.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.861+0000 7f25dd7ff700 1 --2- 172.21.15.22:0/1785199061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25d80b59d0 0x7f25d814cae0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:54.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.861+0000 7f25dd7ff700 1 --2- 172.21.15.22:0/1785199061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25d80d2640 0x7f25d80c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:54.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.861+0000 7f25dd7ff700 1 -- 172.21.15.22:0/1785199061 >> 172.21.15.22:0/1785199061 conn(0x7f25d8071660 msgr2=0x7f25d80b6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:54.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.861+0000 7f25dd7ff700 1 -- 172.21.15.22:0/1785199061 shutdown_connections 2023-07-11T00:31:54.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:54.861+0000 7f25dd7ff700 1 -- 172.21.15.22:0/1785199061 wait complete. 2023-07-11T00:31:54.867 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-07-11T00:31:54.882 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2023-07-11T00:31:54.518531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":192,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220804,"kb_used_data":4632,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753916,"statfs":{"total":773094113280,"available":772868009984,"internally_reserved":0,"allocated":4743168,"data_stored":2760952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.077224"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465327+0000","last_change":"2023-07-11T00:31:49.457897+0000","last_active":"2023-07-11T00:31:50.465327+0000","last_peered":"2023-07-11T00:31:50.465327+0000","last_clean":"2023-07-11T00:31:50.465327+0000","last_became_active":"2023-07-11T00:31:49.457621+0000","last_became_peered":"2023-07-11T00:31:49.457621+0000","last_unstale":"2023-07-11T00:31:50.465327+0000","last_undegraded":"2023-07-11T00:31:50.465327+0000","last_fullsized":"2023-07-11T00:31:50.465327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:36:38.046459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.931074+0000","last_change":"2023-07-11T00:31:49.473191+0000","last_active":"2023-07-11T00:31:50.931074+0000","last_peered":"2023-07-11T00:31:50.931074+0000","last_clean":"2023-07-11T00:31:50.931074+0000","last_became_active":"2023-07-11T00:31:49.472875+0000","last_became_peered":"2023-07-11T00:31:49.472875+0000","last_unstale":"2023-07-11T00:31:50.931074+0000","last_undegraded":"2023-07-11T00:31:50.931074+0000","last_fullsized":"2023-07-11T00:31:50.931074+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:41:36.203534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.551975+0000","last_change":"2023-07-11T00:31:49.460150+0000","last_active":"2023-07-11T00:31:50.551975+0000","last_peered":"2023-07-11T00:31:50.551975+0000","last_clean":"2023-07-11T00:31:50.551975+0000","last_became_active":"2023-07-11T00:31:49.459860+0000","last_became_peered":"2023-07-11T00:31:49.459860+0000","last_unstale":"2023-07-11T00:31:50.551975+0000","last_undegraded":"2023-07-11T00:31:50.551975+0000","last_fullsized":"2023-07-11T00:31:50.551975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:27:24.039242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464008+0000","last_change":"2023-07-11T00:31:49.468186+0000","last_active":"2023-07-11T00:31:50.464008+0000","last_peered":"2023-07-11T00:31:50.464008+0000","last_clean":"2023-07-11T00:31:50.464008+0000","last_became_active":"2023-07-11T00:31:49.467915+0000","last_became_peered":"2023-07-11T00:31:49.467915+0000","last_unstale":"2023-07-11T00:31:50.464008+0000","last_undegraded":"2023-07-11T00:31:50.464008+0000","last_fullsized":"2023-07-11T00:31:50.464008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:55:33.326380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930832+0000","last_change":"2023-07-11T00:31:49.473162+0000","last_active":"2023-07-11T00:31:50.930832+0000","last_peered":"2023-07-11T00:31:50.930832+0000","last_clean":"2023-07-11T00:31:50.930832+0000","last_became_active":"2023-07-11T00:31:49.472848+0000","last_became_peered":"2023-07-11T00:31:49.472848+0000","last_unstale":"2023-07-11T00:31:50.930832+0000","last_undegraded":"2023-07-11T00:31:50.930832+0000","last_fullsized":"2023-07-11T00:31:50.930832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:35:16.582529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548485+0000","last_change":"2023-07-11T00:31:49.464936+0000","last_active":"2023-07-11T00:31:50.548485+0000","last_peered":"2023-07-11T00:31:50.548485+0000","last_clean":"2023-07-11T00:31:50.548485+0000","last_became_active":"2023-07-11T00:31:49.464652+0000","last_became_peered":"2023-07-11T00:31:49.464652+0000","last_unstale":"2023-07-11T00:31:50.548485+0000","last_undegraded":"2023-07-11T00:31:50.548485+0000","last_fullsized":"2023-07-11T00:31:50.548485+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:20:53.763650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465000+0000","last_change":"2023-07-11T00:31:49.462815+0000","last_active":"2023-07-11T00:31:50.465000+0000","last_peered":"2023-07-11T00:31:50.465000+0000","last_clean":"2023-07-11T00:31:50.465000+0000","last_became_active":"2023-07-11T00:31:49.462552+0000","last_became_peered":"2023-07-11T00:31:49.462552+0000","last_unstale":"2023-07-11T00:31:50.465000+0000","last_undegraded":"2023-07-11T00:31:50.465000+0000","last_fullsized":"2023-07-11T00:31:50.465000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:35:37.845496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464195+0000","last_change":"2023-07-11T00:31:49.475568+0000","last_active":"2023-07-11T00:31:50.464195+0000","last_peered":"2023-07-11T00:31:50.464195+0000","last_clean":"2023-07-11T00:31:50.464195+0000","last_became_active":"2023-07-11T00:31:49.475071+0000","last_became_peered":"2023-07-11T00:31:49.475071+0000","last_unstale":"2023-07-11T00:31:50.464195+0000","last_undegraded":"2023-07-11T00:31:50.464195+0000","last_fullsized":"2023-07-11T00:31:50.464195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:41:36.203534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464307+0000","last_change":"2023-07-11T00:31:49.467110+0000","last_active":"2023-07-11T00:31:50.464307+0000","last_peered":"2023-07-11T00:31:50.464307+0000","last_clean":"2023-07-11T00:31:50.464307+0000","last_became_active":"2023-07-11T00:31:49.466742+0000","last_became_peered":"2023-07-11T00:31:49.466742+0000","last_unstale":"2023-07-11T00:31:50.464307+0000","last_undegraded":"2023-07-11T00:31:50.464307+0000","last_fullsized":"2023-07-11T00:31:50.464307+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:47:53.130660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464445+0000","last_change":"2023-07-11T00:31:49.473011+0000","last_active":"2023-07-11T00:31:50.464445+0000","last_peered":"2023-07-11T00:31:50.464445+0000","last_clean":"2023-07-11T00:31:50.464445+0000","last_became_active":"2023-07-11T00:31:49.472475+0000","last_became_peered":"2023-07-11T00:31:49.472475+0000","last_unstale":"2023-07-11T00:31:50.464445+0000","last_undegraded":"2023-07-11T00:31:50.464445+0000","last_fullsized":"2023-07-11T00:31:50.464445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:32:42.635952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464122+0000","last_change":"2023-07-11T00:31:49.467110+0000","last_active":"2023-07-11T00:31:50.464122+0000","last_peered":"2023-07-11T00:31:50.464122+0000","last_clean":"2023-07-11T00:31:50.464122+0000","last_became_active":"2023-07-11T00:31:49.466758+0000","last_became_peered":"2023-07-11T00:31:49.466758+0000","last_unstale":"2023-07-11T00:31:50.464122+0000","last_undegraded":"2023-07-11T00:31:50.464122+0000","last_fullsized":"2023-07-11T00:31:50.464122+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:29:22.209529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.931147+0000","last_change":"2023-07-11T00:31:49.477246+0000","last_active":"2023-07-11T00:31:50.931147+0000","last_peered":"2023-07-11T00:31:50.931147+0000","last_clean":"2023-07-11T00:31:50.931147+0000","last_became_active":"2023-07-11T00:31:49.476968+0000","last_became_peered":"2023-07-11T00:31:49.476968+0000","last_unstale":"2023-07-11T00:31:50.931147+0000","last_undegraded":"2023-07-11T00:31:50.931147+0000","last_fullsized":"2023-07-11T00:31:50.931147+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:47:53.130660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930624+0000","last_change":"2023-07-11T00:31:49.462029+0000","last_active":"2023-07-11T00:31:50.930624+0000","last_peered":"2023-07-11T00:31:50.930624+0000","last_clean":"2023-07-11T00:31:50.930624+0000","last_became_active":"2023-07-11T00:31:49.461742+0000","last_became_peered":"2023-07-11T00:31:49.461742+0000","last_unstale":"2023-07-11T00:31:50.930624+0000","last_undegraded":"2023-07-11T00:31:50.930624+0000","last_fullsized":"2023-07-11T00:31:50.930624+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:01:17.061286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463885+0000","last_change":"2023-07-11T00:31:49.466009+0000","last_active":"2023-07-11T00:31:50.463885+0000","last_peered":"2023-07-11T00:31:50.463885+0000","last_clean":"2023-07-11T00:31:50.463885+0000","last_became_active":"2023-07-11T00:31:49.465744+0000","last_became_peered":"2023-07-11T00:31:49.465744+0000","last_unstale":"2023-07-11T00:31:50.463885+0000","last_undegraded":"2023-07-11T00:31:50.463885+0000","last_fullsized":"2023-07-11T00:31:50.463885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:56:19.968064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548338+0000","last_change":"2023-07-11T00:31:49.452358+0000","last_active":"2023-07-11T00:31:50.548338+0000","last_peered":"2023-07-11T00:31:50.548338+0000","last_clean":"2023-07-11T00:31:50.548338+0000","last_became_active":"2023-07-11T00:31:49.452092+0000","last_became_peered":"2023-07-11T00:31:49.452092+0000","last_unstale":"2023-07-11T00:31:50.548338+0000","last_undegraded":"2023-07-11T00:31:50.548338+0000","last_fullsized":"2023-07-11T00:31:50.548338+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:55:51.717124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463191+0000","last_change":"2023-07-11T00:31:49.478955+0000","last_active":"2023-07-11T00:31:50.463191+0000","last_peered":"2023-07-11T00:31:50.463191+0000","last_clean":"2023-07-11T00:31:50.463191+0000","last_became_active":"2023-07-11T00:31:49.478658+0000","last_became_peered":"2023-07-11T00:31:49.478658+0000","last_unstale":"2023-07-11T00:31:50.463191+0000","last_undegraded":"2023-07-11T00:31:50.463191+0000","last_fullsized":"2023-07-11T00:31:50.463191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:19:53.824107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552403+0000","last_change":"2023-07-11T00:31:49.470584+0000","last_active":"2023-07-11T00:31:50.552403+0000","last_peered":"2023-07-11T00:31:50.552403+0000","last_clean":"2023-07-11T00:31:50.552403+0000","last_became_active":"2023-07-11T00:31:49.470227+0000","last_became_peered":"2023-07-11T00:31:49.470227+0000","last_unstale":"2023-07-11T00:31:50.552403+0000","last_undegraded":"2023-07-11T00:31:50.552403+0000","last_fullsized":"2023-07-11T00:31:50.552403+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:13:53.014748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552146+0000","last_change":"2023-07-11T00:31:49.473741+0000","last_active":"2023-07-11T00:31:50.552146+0000","last_peered":"2023-07-11T00:31:50.552146+0000","last_clean":"2023-07-11T00:31:50.552146+0000","last_became_active":"2023-07-11T00:31:49.473435+0000","last_became_peered":"2023-07-11T00:31:49.473435+0000","last_unstale":"2023-07-11T00:31:50.552146+0000","last_undegraded":"2023-07-11T00:31:50.552146+0000","last_fullsized":"2023-07-11T00:31:50.552146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:16:57.332196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463706+0000","last_change":"2023-07-11T00:31:49.475022+0000","last_active":"2023-07-11T00:31:50.463706+0000","last_peered":"2023-07-11T00:31:50.463706+0000","last_clean":"2023-07-11T00:31:50.463706+0000","last_became_active":"2023-07-11T00:31:49.474696+0000","last_became_peered":"2023-07-11T00:31:49.474696+0000","last_unstale":"2023-07-11T00:31:50.463706+0000","last_undegraded":"2023-07-11T00:31:50.463706+0000","last_fullsized":"2023-07-11T00:31:50.463706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:46:54.858536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930637+0000","last_change":"2023-07-11T00:31:49.467212+0000","last_active":"2023-07-11T00:31:50.930637+0000","last_peered":"2023-07-11T00:31:50.930637+0000","last_clean":"2023-07-11T00:31:50.930637+0000","last_became_active":"2023-07-11T00:31:49.466932+0000","last_became_peered":"2023-07-11T00:31:49.466932+0000","last_unstale":"2023-07-11T00:31:50.930637+0000","last_undegraded":"2023-07-11T00:31:50.930637+0000","last_fullsized":"2023-07-11T00:31:50.930637+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:52:10.312151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548480+0000","last_change":"2023-07-11T00:31:49.458482+0000","last_active":"2023-07-11T00:31:50.548480+0000","last_peered":"2023-07-11T00:31:50.548480+0000","last_clean":"2023-07-11T00:31:50.548480+0000","last_became_active":"2023-07-11T00:31:49.458224+0000","last_became_peered":"2023-07-11T00:31:49.458224+0000","last_unstale":"2023-07-11T00:31:50.548480+0000","last_undegraded":"2023-07-11T00:31:50.548480+0000","last_fullsized":"2023-07-11T00:31:50.548480+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:11:56.418499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463919+0000","last_change":"2023-07-11T00:31:49.463657+0000","last_active":"2023-07-11T00:31:50.463919+0000","last_peered":"2023-07-11T00:31:50.463919+0000","last_clean":"2023-07-11T00:31:50.463919+0000","last_became_active":"2023-07-11T00:31:49.463388+0000","last_became_peered":"2023-07-11T00:31:49.463388+0000","last_unstale":"2023-07-11T00:31:50.463919+0000","last_undegraded":"2023-07-11T00:31:50.463919+0000","last_fullsized":"2023-07-11T00:31:50.463919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:07.266780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463215+0000","last_change":"2023-07-11T00:31:49.463794+0000","last_active":"2023-07-11T00:31:50.463215+0000","last_peered":"2023-07-11T00:31:50.463215+0000","last_clean":"2023-07-11T00:31:50.463215+0000","last_became_active":"2023-07-11T00:31:49.463465+0000","last_became_peered":"2023-07-11T00:31:49.463465+0000","last_unstale":"2023-07-11T00:31:50.463215+0000","last_undegraded":"2023-07-11T00:31:50.463215+0000","last_fullsized":"2023-07-11T00:31:50.463215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:30:09.468212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463140+0000","last_change":"2023-07-11T00:31:49.465033+0000","last_active":"2023-07-11T00:31:50.463140+0000","last_peered":"2023-07-11T00:31:50.463140+0000","last_clean":"2023-07-11T00:31:50.463140+0000","last_became_active":"2023-07-11T00:31:49.464732+0000","last_became_peered":"2023-07-11T00:31:49.464732+0000","last_unstale":"2023-07-11T00:31:50.463140+0000","last_undegraded":"2023-07-11T00:31:50.463140+0000","last_fullsized":"2023-07-11T00:31:50.463140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:34:58.446331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464124+0000","last_change":"2023-07-11T00:31:49.461466+0000","last_active":"2023-07-11T00:31:50.464124+0000","last_peered":"2023-07-11T00:31:50.464124+0000","last_clean":"2023-07-11T00:31:50.464124+0000","last_became_active":"2023-07-11T00:31:49.461107+0000","last_became_peered":"2023-07-11T00:31:49.461107+0000","last_unstale":"2023-07-11T00:31:50.464124+0000","last_undegraded":"2023-07-11T00:31:50.464124+0000","last_fullsized":"2023-07-11T00:31:50.464124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:10:16.280197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930674+0000","last_change":"2023-07-11T00:31:49.456912+0000","last_active":"2023-07-11T00:31:50.930674+0000","last_peered":"2023-07-11T00:31:50.930674+0000","last_clean":"2023-07-11T00:31:50.930674+0000","last_became_active":"2023-07-11T00:31:49.456427+0000","last_became_peered":"2023-07-11T00:31:49.456427+0000","last_unstale":"2023-07-11T00:31:50.930674+0000","last_undegraded":"2023-07-11T00:31:50.930674+0000","last_fullsized":"2023-07-11T00:31:50.930674+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:14:05.564588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552122+0000","last_change":"2023-07-11T00:31:49.471242+0000","last_active":"2023-07-11T00:31:50.552122+0000","last_peered":"2023-07-11T00:31:50.552122+0000","last_clean":"2023-07-11T00:31:50.552122+0000","last_became_active":"2023-07-11T00:31:49.470925+0000","last_became_peered":"2023-07-11T00:31:49.470925+0000","last_unstale":"2023-07-11T00:31:50.552122+0000","last_undegraded":"2023-07-11T00:31:50.552122+0000","last_fullsized":"2023-07-11T00:31:50.552122+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:19:23.867053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930858+0000","last_change":"2023-07-11T00:31:49.477295+0000","last_active":"2023-07-11T00:31:50.930858+0000","last_peered":"2023-07-11T00:31:50.930858+0000","last_clean":"2023-07-11T00:31:50.930858+0000","last_became_active":"2023-07-11T00:31:49.476956+0000","last_became_peered":"2023-07-11T00:31:49.476956+0000","last_unstale":"2023-07-11T00:31:50.930858+0000","last_undegraded":"2023-07-11T00:31:50.930858+0000","last_fullsized":"2023-07-11T00:31:50.930858+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:29:22.209529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463419+0000","last_change":"2023-07-11T00:31:49.462609+0000","last_active":"2023-07-11T00:31:50.463419+0000","last_peered":"2023-07-11T00:31:50.463419+0000","last_clean":"2023-07-11T00:31:50.463419+0000","last_became_active":"2023-07-11T00:31:49.462325+0000","last_became_peered":"2023-07-11T00:31:49.462325+0000","last_unstale":"2023-07-11T00:31:50.463419+0000","last_undegraded":"2023-07-11T00:31:50.463419+0000","last_fullsized":"2023-07-11T00:31:50.463419+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:23:53.308490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.551984+0000","last_change":"2023-07-11T00:31:49.462968+0000","last_active":"2023-07-11T00:31:50.551984+0000","last_peered":"2023-07-11T00:31:50.551984+0000","last_clean":"2023-07-11T00:31:50.551984+0000","last_became_active":"2023-07-11T00:31:49.462697+0000","last_became_peered":"2023-07-11T00:31:49.462697+0000","last_unstale":"2023-07-11T00:31:50.551984+0000","last_undegraded":"2023-07-11T00:31:50.551984+0000","last_fullsized":"2023-07-11T00:31:50.551984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:48:44.300412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548391+0000","last_change":"2023-07-11T00:31:49.468478+0000","last_active":"2023-07-11T00:31:50.548391+0000","last_peered":"2023-07-11T00:31:50.548391+0000","last_clean":"2023-07-11T00:31:50.548391+0000","last_became_active":"2023-07-11T00:31:49.468182+0000","last_became_peered":"2023-07-11T00:31:49.468182+0000","last_unstale":"2023-07-11T00:31:50.548391+0000","last_undegraded":"2023-07-11T00:31:50.548391+0000","last_fullsized":"2023-07-11T00:31:50.548391+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:29:49.167209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930497+0000","last_change":"2023-07-11T00:31:49.464098+0000","last_active":"2023-07-11T00:31:50.930497+0000","last_peered":"2023-07-11T00:31:50.930497+0000","last_clean":"2023-07-11T00:31:50.930497+0000","last_became_active":"2023-07-11T00:31:49.463328+0000","last_became_peered":"2023-07-11T00:31:49.463328+0000","last_unstale":"2023-07-11T00:31:50.930497+0000","last_undegraded":"2023-07-11T00:31:50.930497+0000","last_fullsized":"2023-07-11T00:31:50.930497+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:58:30.504188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.841000+0000","last_change":"2023-07-11T00:31:49.460009+0000","last_active":"2023-07-11T00:31:50.841000+0000","last_peered":"2023-07-11T00:31:50.841000+0000","last_clean":"2023-07-11T00:31:50.841000+0000","last_became_active":"2023-07-11T00:31:49.459703+0000","last_became_peered":"2023-07-11T00:31:49.459703+0000","last_unstale":"2023-07-11T00:31:50.841000+0000","last_undegraded":"2023-07-11T00:31:50.841000+0000","last_fullsized":"2023-07-11T00:31:50.841000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:35:36.955611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"37'4","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548845+0000","last_change":"2023-07-11T00:31:48.464531+0000","last_active":"2023-07-11T00:31:50.548845+0000","last_peered":"2023-07-11T00:31:50.548845+0000","last_clean":"2023-07-11T00:31:50.548845+0000","last_became_active":"2023-07-11T00:31:48.464245+0000","last_became_peered":"2023-07-11T00:31:48.464245+0000","last_unstale":"2023-07-11T00:31:50.548845+0000","last_undegraded":"2023-07-11T00:31:50.548845+0000","last_fullsized":"2023-07-11T00:31:50.548845+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:02:57.607091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463942+0000","last_change":"2023-07-11T00:31:49.452941+0000","last_active":"2023-07-11T00:31:50.463942+0000","last_peered":"2023-07-11T00:31:50.463942+0000","last_clean":"2023-07-11T00:31:50.463942+0000","last_became_active":"2023-07-11T00:31:49.452650+0000","last_became_peered":"2023-07-11T00:31:49.452650+0000","last_unstale":"2023-07-11T00:31:50.463942+0000","last_undegraded":"2023-07-11T00:31:50.463942+0000","last_fullsized":"2023-07-11T00:31:50.463942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:15:14.531915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552277+0000","last_change":"2023-07-11T00:31:48.465456+0000","last_active":"2023-07-11T00:31:50.552277+0000","last_peered":"2023-07-11T00:31:50.552277+0000","last_clean":"2023-07-11T00:31:50.552277+0000","last_became_active":"2023-07-11T00:31:48.465170+0000","last_became_peered":"2023-07-11T00:31:48.465170+0000","last_unstale":"2023-07-11T00:31:50.552277+0000","last_undegraded":"2023-07-11T00:31:50.552277+0000","last_fullsized":"2023-07-11T00:31:50.552277+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:14:57.064669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930927+0000","last_change":"2023-07-11T00:31:49.476732+0000","last_active":"2023-07-11T00:31:50.930927+0000","last_peered":"2023-07-11T00:31:50.930927+0000","last_clean":"2023-07-11T00:31:50.930927+0000","last_became_active":"2023-07-11T00:31:49.476428+0000","last_became_peered":"2023-07-11T00:31:49.476428+0000","last_unstale":"2023-07-11T00:31:50.930927+0000","last_undegraded":"2023-07-11T00:31:50.930927+0000","last_fullsized":"2023-07-11T00:31:50.930927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:03:51.889314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.840965+0000","last_change":"2023-07-11T00:31:48.456071+0000","last_active":"2023-07-11T00:31:50.840965+0000","last_peered":"2023-07-11T00:31:50.840965+0000","last_clean":"2023-07-11T00:31:50.840965+0000","last_became_active":"2023-07-11T00:31:48.455736+0000","last_became_peered":"2023-07-11T00:31:48.455736+0000","last_unstale":"2023-07-11T00:31:50.840965+0000","last_undegraded":"2023-07-11T00:31:50.840965+0000","last_fullsized":"2023-07-11T00:31:50.840965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:29:10.538359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.841038+0000","last_change":"2023-07-11T00:31:49.461523+0000","last_active":"2023-07-11T00:31:50.841038+0000","last_peered":"2023-07-11T00:31:50.841038+0000","last_clean":"2023-07-11T00:31:50.841038+0000","last_became_active":"2023-07-11T00:31:49.460767+0000","last_became_peered":"2023-07-11T00:31:49.460767+0000","last_unstale":"2023-07-11T00:31:50.841038+0000","last_undegraded":"2023-07-11T00:31:50.841038+0000","last_fullsized":"2023-07-11T00:31:50.841038+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:57:01.874861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465466+0000","last_change":"2023-07-11T00:31:48.455929+0000","last_active":"2023-07-11T00:31:50.465466+0000","last_peered":"2023-07-11T00:31:50.465466+0000","last_clean":"2023-07-11T00:31:50.465466+0000","last_became_active":"2023-07-11T00:31:48.455661+0000","last_became_peered":"2023-07-11T00:31:48.455661+0000","last_unstale":"2023-07-11T00:31:50.465466+0000","last_undegraded":"2023-07-11T00:31:50.465466+0000","last_fullsized":"2023-07-11T00:31:50.465466+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:38:01.335308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552119+0000","last_change":"2023-07-11T00:31:49.456344+0000","last_active":"2023-07-11T00:31:50.552119+0000","last_peered":"2023-07-11T00:31:50.552119+0000","last_clean":"2023-07-11T00:31:50.552119+0000","last_became_active":"2023-07-11T00:31:49.456067+0000","last_became_peered":"2023-07-11T00:31:49.456067+0000","last_unstale":"2023-07-11T00:31:50.552119+0000","last_undegraded":"2023-07-11T00:31:50.552119+0000","last_fullsized":"2023-07-11T00:31:50.552119+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:38:22.725063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548757+0000","last_change":"2023-07-11T00:31:48.454117+0000","last_active":"2023-07-11T00:31:50.548757+0000","last_peered":"2023-07-11T00:31:50.548757+0000","last_clean":"2023-07-11T00:31:50.548757+0000","last_became_active":"2023-07-11T00:31:48.453120+0000","last_became_peered":"2023-07-11T00:31:48.453120+0000","last_unstale":"2023-07-11T00:31:50.548757+0000","last_undegraded":"2023-07-11T00:31:50.548757+0000","last_fullsized":"2023-07-11T00:31:50.548757+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:59:08.190881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464030+0000","last_change":"2023-07-11T00:31:49.468724+0000","last_active":"2023-07-11T00:31:50.464030+0000","last_peered":"2023-07-11T00:31:50.464030+0000","last_clean":"2023-07-11T00:31:50.464030+0000","last_became_active":"2023-07-11T00:31:49.468103+0000","last_became_peered":"2023-07-11T00:31:49.468103+0000","last_unstale":"2023-07-11T00:31:50.464030+0000","last_undegraded":"2023-07-11T00:31:50.464030+0000","last_fullsized":"2023-07-11T00:31:50.464030+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:06:35.344642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552091+0000","last_change":"2023-07-11T00:31:48.460722+0000","last_active":"2023-07-11T00:31:50.552091+0000","last_peered":"2023-07-11T00:31:50.552091+0000","last_clean":"2023-07-11T00:31:50.552091+0000","last_became_active":"2023-07-11T00:31:48.460108+0000","last_became_peered":"2023-07-11T00:31:48.460108+0000","last_unstale":"2023-07-11T00:31:50.552091+0000","last_undegraded":"2023-07-11T00:31:50.552091+0000","last_fullsized":"2023-07-11T00:31:50.552091+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:52:55.184931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463756+0000","last_change":"2023-07-11T00:31:49.475377+0000","last_active":"2023-07-11T00:31:50.463756+0000","last_peered":"2023-07-11T00:31:50.463756+0000","last_clean":"2023-07-11T00:31:50.463756+0000","last_became_active":"2023-07-11T00:31:49.474744+0000","last_became_peered":"2023-07-11T00:31:49.474744+0000","last_unstale":"2023-07-11T00:31:50.463756+0000","last_undegraded":"2023-07-11T00:31:50.463756+0000","last_fullsized":"2023-07-11T00:31:50.463756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:34:16.011592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930635+0000","last_change":"2023-07-11T00:31:48.452786+0000","last_active":"2023-07-11T00:31:50.930635+0000","last_peered":"2023-07-11T00:31:50.930635+0000","last_clean":"2023-07-11T00:31:50.930635+0000","last_became_active":"2023-07-11T00:31:48.452491+0000","last_became_peered":"2023-07-11T00:31:48.452491+0000","last_unstale":"2023-07-11T00:31:50.930635+0000","last_undegraded":"2023-07-11T00:31:50.930635+0000","last_fullsized":"2023-07-11T00:31:50.930635+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:55:32.320931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463400+0000","last_change":"2023-07-11T00:31:49.464049+0000","last_active":"2023-07-11T00:31:50.463400+0000","last_peered":"2023-07-11T00:31:50.463400+0000","last_clean":"2023-07-11T00:31:50.463400+0000","last_became_active":"2023-07-11T00:31:49.463709+0000","last_became_peered":"2023-07-11T00:31:49.463709+0000","last_unstale":"2023-07-11T00:31:50.463400+0000","last_undegraded":"2023-07-11T00:31:50.463400+0000","last_fullsized":"2023-07-11T00:31:50.463400+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:10:30.034097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463864+0000","last_change":"2023-07-11T00:31:48.452945+0000","last_active":"2023-07-11T00:31:50.463864+0000","last_peered":"2023-07-11T00:31:50.463864+0000","last_clean":"2023-07-11T00:31:50.463864+0000","last_became_active":"2023-07-11T00:31:48.452673+0000","last_became_peered":"2023-07-11T00:31:48.452673+0000","last_unstale":"2023-07-11T00:31:50.463864+0000","last_undegraded":"2023-07-11T00:31:50.463864+0000","last_fullsized":"2023-07-11T00:31:50.463864+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:12:42.857074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552174+0000","last_change":"2023-07-11T00:31:49.469671+0000","last_active":"2023-07-11T00:31:50.552174+0000","last_peered":"2023-07-11T00:31:50.552174+0000","last_clean":"2023-07-11T00:31:50.552174+0000","last_became_active":"2023-07-11T00:31:49.469372+0000","last_became_peered":"2023-07-11T00:31:49.469372+0000","last_unstale":"2023-07-11T00:31:50.552174+0000","last_undegraded":"2023-07-11T00:31:50.552174+0000","last_fullsized":"2023-07-11T00:31:50.552174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:43:27.154891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552424+0000","last_change":"2023-07-11T00:31:48.459990+0000","last_active":"2023-07-11T00:31:50.552424+0000","last_peered":"2023-07-11T00:31:50.552424+0000","last_clean":"2023-07-11T00:31:50.552424+0000","last_became_active":"2023-07-11T00:31:48.459720+0000","last_became_peered":"2023-07-11T00:31:48.459720+0000","last_unstale":"2023-07-11T00:31:50.552424+0000","last_undegraded":"2023-07-11T00:31:50.552424+0000","last_fullsized":"2023-07-11T00:31:50.552424+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:16:19.619668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465482+0000","last_change":"2023-07-11T00:31:49.467742+0000","last_active":"2023-07-11T00:31:50.465482+0000","last_peered":"2023-07-11T00:31:50.465482+0000","last_clean":"2023-07-11T00:31:50.465482+0000","last_became_active":"2023-07-11T00:31:49.467428+0000","last_became_peered":"2023-07-11T00:31:49.467428+0000","last_unstale":"2023-07-11T00:31:50.465482+0000","last_undegraded":"2023-07-11T00:31:50.465482+0000","last_fullsized":"2023-07-11T00:31:50.465482+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:55:03.029006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464531+0000","last_change":"2023-07-11T00:31:48.457902+0000","last_active":"2023-07-11T00:31:50.464531+0000","last_peered":"2023-07-11T00:31:50.464531+0000","last_clean":"2023-07-11T00:31:50.464531+0000","last_became_active":"2023-07-11T00:31:48.457412+0000","last_became_peered":"2023-07-11T00:31:48.457412+0000","last_unstale":"2023-07-11T00:31:50.464531+0000","last_undegraded":"2023-07-11T00:31:50.464531+0000","last_fullsized":"2023-07-11T00:31:50.464531+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:56:55.793084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548818+0000","last_change":"2023-07-11T00:31:49.457276+0000","last_active":"2023-07-11T00:31:50.548818+0000","last_peered":"2023-07-11T00:31:50.548818+0000","last_clean":"2023-07-11T00:31:50.548818+0000","last_became_active":"2023-07-11T00:31:49.456945+0000","last_became_peered":"2023-07-11T00:31:49.456945+0000","last_unstale":"2023-07-11T00:31:50.548818+0000","last_undegraded":"2023-07-11T00:31:50.548818+0000","last_fullsized":"2023-07-11T00:31:50.548818+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:06:58.029031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465487+0000","last_change":"2023-07-11T00:31:48.466071+0000","last_active":"2023-07-11T00:31:50.465487+0000","last_peered":"2023-07-11T00:31:50.465487+0000","last_clean":"2023-07-11T00:31:50.465487+0000","last_became_active":"2023-07-11T00:31:48.465805+0000","last_became_peered":"2023-07-11T00:31:48.465805+0000","last_unstale":"2023-07-11T00:31:50.465487+0000","last_undegraded":"2023-07-11T00:31:50.465487+0000","last_fullsized":"2023-07-11T00:31:50.465487+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:00:20.861071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465231+0000","last_change":"2023-07-11T00:31:49.462951+0000","last_active":"2023-07-11T00:31:50.465231+0000","last_peered":"2023-07-11T00:31:50.465231+0000","last_clean":"2023-07-11T00:31:50.465231+0000","last_became_active":"2023-07-11T00:31:49.462697+0000","last_became_peered":"2023-07-11T00:31:49.462697+0000","last_unstale":"2023-07-11T00:31:50.465231+0000","last_undegraded":"2023-07-11T00:31:50.465231+0000","last_fullsized":"2023-07-11T00:31:50.465231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:54:39.325193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930767+0000","last_change":"2023-07-11T00:31:48.460219+0000","last_active":"2023-07-11T00:31:50.930767+0000","last_peered":"2023-07-11T00:31:50.930767+0000","last_clean":"2023-07-11T00:31:50.930767+0000","last_became_active":"2023-07-11T00:31:48.459912+0000","last_became_peered":"2023-07-11T00:31:48.459912+0000","last_unstale":"2023-07-11T00:31:50.930767+0000","last_undegraded":"2023-07-11T00:31:50.930767+0000","last_fullsized":"2023-07-11T00:31:50.930767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:45:19.175378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463739+0000","last_change":"2023-07-11T00:31:49.475294+0000","last_active":"2023-07-11T00:31:50.463739+0000","last_peered":"2023-07-11T00:31:50.463739+0000","last_clean":"2023-07-11T00:31:50.463739+0000","last_became_active":"2023-07-11T00:31:49.474989+0000","last_became_peered":"2023-07-11T00:31:49.474989+0000","last_unstale":"2023-07-11T00:31:50.463739+0000","last_undegraded":"2023-07-11T00:31:50.463739+0000","last_fullsized":"2023-07-11T00:31:50.463739+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:37:56.551481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548601+0000","last_change":"2023-07-11T00:31:48.459454+0000","last_active":"2023-07-11T00:31:50.548601+0000","last_peered":"2023-07-11T00:31:50.548601+0000","last_clean":"2023-07-11T00:31:50.548601+0000","last_became_active":"2023-07-11T00:31:48.459171+0000","last_became_peered":"2023-07-11T00:31:48.459171+0000","last_unstale":"2023-07-11T00:31:50.548601+0000","last_undegraded":"2023-07-11T00:31:50.548601+0000","last_fullsized":"2023-07-11T00:31:50.548601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:45:57.125951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464177+0000","last_change":"2023-07-11T00:31:49.465444+0000","last_active":"2023-07-11T00:31:50.464177+0000","last_peered":"2023-07-11T00:31:50.464177+0000","last_clean":"2023-07-11T00:31:50.464177+0000","last_became_active":"2023-07-11T00:31:49.465153+0000","last_became_peered":"2023-07-11T00:31:49.465153+0000","last_unstale":"2023-07-11T00:31:50.464177+0000","last_undegraded":"2023-07-11T00:31:50.464177+0000","last_fullsized":"2023-07-11T00:31:50.464177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:03:51.889314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465230+0000","last_change":"2023-07-11T00:31:48.451216+0000","last_active":"2023-07-11T00:31:50.465230+0000","last_peered":"2023-07-11T00:31:50.465230+0000","last_clean":"2023-07-11T00:31:50.465230+0000","last_became_active":"2023-07-11T00:31:48.450908+0000","last_became_peered":"2023-07-11T00:31:48.450908+0000","last_unstale":"2023-07-11T00:31:50.465230+0000","last_undegraded":"2023-07-11T00:31:50.465230+0000","last_fullsized":"2023-07-11T00:31:50.465230+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:26:43.963576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548338+0000","last_change":"2023-07-11T00:31:49.457334+0000","last_active":"2023-07-11T00:31:50.548338+0000","last_peered":"2023-07-11T00:31:50.548338+0000","last_clean":"2023-07-11T00:31:50.548338+0000","last_became_active":"2023-07-11T00:31:49.457007+0000","last_became_peered":"2023-07-11T00:31:49.457007+0000","last_unstale":"2023-07-11T00:31:50.548338+0000","last_undegraded":"2023-07-11T00:31:50.548338+0000","last_fullsized":"2023-07-11T00:31:50.548338+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:10:23.036418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548644+0000","last_change":"2023-07-11T00:31:48.459371+0000","last_active":"2023-07-11T00:31:50.548644+0000","last_peered":"2023-07-11T00:31:50.548644+0000","last_clean":"2023-07-11T00:31:50.548644+0000","last_became_active":"2023-07-11T00:31:48.459074+0000","last_became_peered":"2023-07-11T00:31:48.459074+0000","last_unstale":"2023-07-11T00:31:50.548644+0000","last_undegraded":"2023-07-11T00:31:50.548644+0000","last_fullsized":"2023-07-11T00:31:50.548644+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:14:58.023063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465233+0000","last_change":"2023-07-11T00:31:49.469862+0000","last_active":"2023-07-11T00:31:50.465233+0000","last_peered":"2023-07-11T00:31:50.465233+0000","last_clean":"2023-07-11T00:31:50.465233+0000","last_became_active":"2023-07-11T00:31:49.469579+0000","last_became_peered":"2023-07-11T00:31:49.469579+0000","last_unstale":"2023-07-11T00:31:50.465233+0000","last_undegraded":"2023-07-11T00:31:50.465233+0000","last_fullsized":"2023-07-11T00:31:50.465233+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:23:24.823459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"37'8","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464039+0000","last_change":"2023-07-11T00:31:48.453039+0000","last_active":"2023-07-11T00:31:50.464039+0000","last_peered":"2023-07-11T00:31:50.464039+0000","last_clean":"2023-07-11T00:31:50.464039+0000","last_became_active":"2023-07-11T00:31:48.452775+0000","last_became_peered":"2023-07-11T00:31:48.452775+0000","last_unstale":"2023-07-11T00:31:50.464039+0000","last_undegraded":"2023-07-11T00:31:50.464039+0000","last_fullsized":"2023-07-11T00:31:50.464039+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:55:13.814371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930818+0000","last_change":"2023-07-11T00:31:49.467791+0000","last_active":"2023-07-11T00:31:50.930818+0000","last_peered":"2023-07-11T00:31:50.930818+0000","last_clean":"2023-07-11T00:31:50.930818+0000","last_became_active":"2023-07-11T00:31:49.467496+0000","last_became_peered":"2023-07-11T00:31:49.467496+0000","last_unstale":"2023-07-11T00:31:50.930818+0000","last_undegraded":"2023-07-11T00:31:50.930818+0000","last_fullsized":"2023-07-11T00:31:50.930818+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:41:11.170234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930655+0000","last_change":"2023-07-11T00:31:48.454390+0000","last_active":"2023-07-11T00:31:50.930655+0000","last_peered":"2023-07-11T00:31:50.930655+0000","last_clean":"2023-07-11T00:31:50.930655+0000","last_became_active":"2023-07-11T00:31:48.453977+0000","last_became_peered":"2023-07-11T00:31:48.453977+0000","last_unstale":"2023-07-11T00:31:50.930655+0000","last_undegraded":"2023-07-11T00:31:50.930655+0000","last_fullsized":"2023-07-11T00:31:50.930655+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:16:44.595511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464437+0000","last_change":"2023-07-11T00:31:49.475446+0000","last_active":"2023-07-11T00:31:50.464437+0000","last_peered":"2023-07-11T00:31:50.464437+0000","last_clean":"2023-07-11T00:31:50.464437+0000","last_became_active":"2023-07-11T00:31:49.475131+0000","last_became_peered":"2023-07-11T00:31:49.475131+0000","last_unstale":"2023-07-11T00:31:50.464437+0000","last_undegraded":"2023-07-11T00:31:50.464437+0000","last_fullsized":"2023-07-11T00:31:50.464437+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:06:54.099393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552284+0000","last_change":"2023-07-11T00:31:48.457843+0000","last_active":"2023-07-11T00:31:50.552284+0000","last_peered":"2023-07-11T00:31:50.552284+0000","last_clean":"2023-07-11T00:31:50.552284+0000","last_became_active":"2023-07-11T00:31:48.457582+0000","last_became_peered":"2023-07-11T00:31:48.457582+0000","last_unstale":"2023-07-11T00:31:50.552284+0000","last_undegraded":"2023-07-11T00:31:50.552284+0000","last_fullsized":"2023-07-11T00:31:50.552284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:56:00.183592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463667+0000","last_change":"2023-07-11T00:31:49.461645+0000","last_active":"2023-07-11T00:31:50.463667+0000","last_peered":"2023-07-11T00:31:50.463667+0000","last_clean":"2023-07-11T00:31:50.463667+0000","last_became_active":"2023-07-11T00:31:49.461362+0000","last_became_peered":"2023-07-11T00:31:49.461362+0000","last_unstale":"2023-07-11T00:31:50.463667+0000","last_undegraded":"2023-07-11T00:31:50.463667+0000","last_fullsized":"2023-07-11T00:31:50.463667+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:19:18.644430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.931052+0000","last_change":"2023-07-11T00:31:48.453565+0000","last_active":"2023-07-11T00:31:50.931052+0000","last_peered":"2023-07-11T00:31:50.931052+0000","last_clean":"2023-07-11T00:31:50.931052+0000","last_became_active":"2023-07-11T00:31:48.453289+0000","last_became_peered":"2023-07-11T00:31:48.453289+0000","last_unstale":"2023-07-11T00:31:50.931052+0000","last_undegraded":"2023-07-11T00:31:50.931052+0000","last_fullsized":"2023-07-11T00:31:50.931052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:51:13.554586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464048+0000","last_change":"2023-07-11T00:31:49.461206+0000","last_active":"2023-07-11T00:31:50.464048+0000","last_peered":"2023-07-11T00:31:50.464048+0000","last_clean":"2023-07-11T00:31:50.464048+0000","last_became_active":"2023-07-11T00:31:49.460915+0000","last_became_peered":"2023-07-11T00:31:49.460915+0000","last_unstale":"2023-07-11T00:31:50.464048+0000","last_undegraded":"2023-07-11T00:31:50.464048+0000","last_fullsized":"2023-07-11T00:31:50.464048+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:09:59.566658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548620+0000","last_change":"2023-07-11T00:31:48.464387+0000","last_active":"2023-07-11T00:31:50.548620+0000","last_peered":"2023-07-11T00:31:50.548620+0000","last_clean":"2023-07-11T00:31:50.548620+0000","last_became_active":"2023-07-11T00:31:48.463976+0000","last_became_peered":"2023-07-11T00:31:48.463976+0000","last_unstale":"2023-07-11T00:31:50.548620+0000","last_undegraded":"2023-07-11T00:31:50.548620+0000","last_fullsized":"2023-07-11T00:31:50.548620+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:46:01.127469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548356+0000","last_change":"2023-07-11T00:31:49.457373+0000","last_active":"2023-07-11T00:31:50.548356+0000","last_peered":"2023-07-11T00:31:50.548356+0000","last_clean":"2023-07-11T00:31:50.548356+0000","last_became_active":"2023-07-11T00:31:49.456989+0000","last_became_peered":"2023-07-11T00:31:49.456989+0000","last_unstale":"2023-07-11T00:31:50.548356+0000","last_undegraded":"2023-07-11T00:31:50.548356+0000","last_fullsized":"2023-07-11T00:31:50.548356+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:45:48.093542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548633+0000","last_change":"2023-07-11T00:31:48.454291+0000","last_active":"2023-07-11T00:31:50.548633+0000","last_peered":"2023-07-11T00:31:50.548633+0000","last_clean":"2023-07-11T00:31:50.548633+0000","last_became_active":"2023-07-11T00:31:48.453556+0000","last_became_peered":"2023-07-11T00:31:48.453556+0000","last_unstale":"2023-07-11T00:31:50.548633+0000","last_undegraded":"2023-07-11T00:31:50.548633+0000","last_fullsized":"2023-07-11T00:31:50.548633+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:59:13.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.840786+0000","last_change":"2023-07-11T00:31:49.470003+0000","last_active":"2023-07-11T00:31:50.840786+0000","last_peered":"2023-07-11T00:31:50.840786+0000","last_clean":"2023-07-11T00:31:50.840786+0000","last_became_active":"2023-07-11T00:31:49.469739+0000","last_became_peered":"2023-07-11T00:31:49.469739+0000","last_unstale":"2023-07-11T00:31:50.840786+0000","last_undegraded":"2023-07-11T00:31:50.840786+0000","last_fullsized":"2023-07-11T00:31:50.840786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:46:08.980085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930728+0000","last_change":"2023-07-11T00:31:48.464395+0000","last_active":"2023-07-11T00:31:50.930728+0000","last_peered":"2023-07-11T00:31:50.930728+0000","last_clean":"2023-07-11T00:31:50.930728+0000","last_became_active":"2023-07-11T00:31:48.464089+0000","last_became_peered":"2023-07-11T00:31:48.464089+0000","last_unstale":"2023-07-11T00:31:50.930728+0000","last_undegraded":"2023-07-11T00:31:50.930728+0000","last_fullsized":"2023-07-11T00:31:50.930728+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:55:13.814371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930551+0000","last_change":"2023-07-11T00:31:49.458863+0000","last_active":"2023-07-11T00:31:50.930551+0000","last_peered":"2023-07-11T00:31:50.930551+0000","last_clean":"2023-07-11T00:31:50.930551+0000","last_became_active":"2023-07-11T00:31:49.458587+0000","last_became_peered":"2023-07-11T00:31:49.458587+0000","last_unstale":"2023-07-11T00:31:50.930551+0000","last_undegraded":"2023-07-11T00:31:50.930551+0000","last_fullsized":"2023-07-11T00:31:50.930551+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:58:35.054271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463676+0000","last_change":"2023-07-11T00:31:48.457841+0000","last_active":"2023-07-11T00:31:50.463676+0000","last_peered":"2023-07-11T00:31:50.463676+0000","last_clean":"2023-07-11T00:31:50.463676+0000","last_became_active":"2023-07-11T00:31:48.457470+0000","last_became_peered":"2023-07-11T00:31:48.457470+0000","last_unstale":"2023-07-11T00:31:50.463676+0000","last_undegraded":"2023-07-11T00:31:50.463676+0000","last_fullsized":"2023-07-11T00:31:50.463676+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:52:38.330454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463812+0000","last_change":"2023-07-11T00:31:49.466813+0000","last_active":"2023-07-11T00:31:50.463812+0000","last_peered":"2023-07-11T00:31:50.463812+0000","last_clean":"2023-07-11T00:31:50.463812+0000","last_became_active":"2023-07-11T00:31:49.466466+0000","last_became_peered":"2023-07-11T00:31:49.466466+0000","last_unstale":"2023-07-11T00:31:50.463812+0000","last_undegraded":"2023-07-11T00:31:50.463812+0000","last_fullsized":"2023-07-11T00:31:50.463812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:00:06.489225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464625+0000","last_change":"2023-07-11T00:31:48.449708+0000","last_active":"2023-07-11T00:31:50.464625+0000","last_peered":"2023-07-11T00:31:50.464625+0000","last_clean":"2023-07-11T00:31:50.464625+0000","last_became_active":"2023-07-11T00:31:48.449399+0000","last_became_peered":"2023-07-11T00:31:48.449399+0000","last_unstale":"2023-07-11T00:31:50.464625+0000","last_undegraded":"2023-07-11T00:31:50.464625+0000","last_fullsized":"2023-07-11T00:31:50.464625+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:31:41.789660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548512+0000","last_change":"2023-07-11T00:31:49.458138+0000","last_active":"2023-07-11T00:31:50.548512+0000","last_peered":"2023-07-11T00:31:50.548512+0000","last_clean":"2023-07-11T00:31:50.548512+0000","last_became_active":"2023-07-11T00:31:49.457794+0000","last_became_peered":"2023-07-11T00:31:49.457794+0000","last_unstale":"2023-07-11T00:31:50.548512+0000","last_undegraded":"2023-07-11T00:31:50.548512+0000","last_fullsized":"2023-07-11T00:31:50.548512+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:30:43.373895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552268+0000","last_change":"2023-07-11T00:31:48.460880+0000","last_active":"2023-07-11T00:31:50.552268+0000","last_peered":"2023-07-11T00:31:50.552268+0000","last_clean":"2023-07-11T00:31:50.552268+0000","last_became_active":"2023-07-11T00:31:48.460428+0000","last_became_peered":"2023-07-11T00:31:48.460428+0000","last_unstale":"2023-07-11T00:31:50.552268+0000","last_undegraded":"2023-07-11T00:31:50.552268+0000","last_fullsized":"2023-07-11T00:31:50.552268+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:23:34.138695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552092+0000","last_change":"2023-07-11T00:29:59.627086+0000","last_active":"2023-07-11T00:31:50.552092+0000","last_peered":"2023-07-11T00:31:50.552092+0000","last_clean":"2023-07-11T00:31:50.552092+0000","last_became_active":"2023-07-11T00:29:59.626687+0000","last_became_peered":"2023-07-11T00:29:59.626687+0000","last_unstale":"2023-07-11T00:31:50.552092+0000","last_undegraded":"2023-07-11T00:31:50.552092+0000","last_fullsized":"2023-07-11T00:31:50.552092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:05:05.999803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548573+0000","last_change":"2023-07-11T00:31:49.462940+0000","last_active":"2023-07-11T00:31:50.548573+0000","last_peered":"2023-07-11T00:31:50.548573+0000","last_clean":"2023-07-11T00:31:50.548573+0000","last_became_active":"2023-07-11T00:31:49.462662+0000","last_became_peered":"2023-07-11T00:31:49.462662+0000","last_unstale":"2023-07-11T00:31:50.548573+0000","last_undegraded":"2023-07-11T00:31:50.548573+0000","last_fullsized":"2023-07-11T00:31:50.548573+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:24:33.910258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465231+0000","last_change":"2023-07-11T00:31:48.462340+0000","last_active":"2023-07-11T00:31:50.465231+0000","last_peered":"2023-07-11T00:31:50.465231+0000","last_clean":"2023-07-11T00:31:50.465231+0000","last_became_active":"2023-07-11T00:31:48.462048+0000","last_became_peered":"2023-07-11T00:31:48.462048+0000","last_unstale":"2023-07-11T00:31:50.465231+0000","last_undegraded":"2023-07-11T00:31:50.465231+0000","last_fullsized":"2023-07-11T00:31:50.465231+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:57:05.902050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548741+0000","last_change":"2023-07-11T00:29:59.589317+0000","last_active":"2023-07-11T00:31:50.548741+0000","last_peered":"2023-07-11T00:31:50.548741+0000","last_clean":"2023-07-11T00:31:50.548741+0000","last_became_active":"2023-07-11T00:29:59.588926+0000","last_became_peered":"2023-07-11T00:29:59.588926+0000","last_unstale":"2023-07-11T00:31:50.548741+0000","last_undegraded":"2023-07-11T00:31:50.548741+0000","last_fullsized":"2023-07-11T00:31:50.548741+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:33:59.990479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465483+0000","last_change":"2023-07-11T00:31:49.462413+0000","last_active":"2023-07-11T00:31:50.465483+0000","last_peered":"2023-07-11T00:31:50.465483+0000","last_clean":"2023-07-11T00:31:50.465483+0000","last_became_active":"2023-07-11T00:31:49.462056+0000","last_became_peered":"2023-07-11T00:31:49.462056+0000","last_unstale":"2023-07-11T00:31:50.465483+0000","last_undegraded":"2023-07-11T00:31:50.465483+0000","last_fullsized":"2023-07-11T00:31:50.465483+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:08:47.268896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.840768+0000","last_change":"2023-07-11T00:31:48.459774+0000","last_active":"2023-07-11T00:31:50.840768+0000","last_peered":"2023-07-11T00:31:50.840768+0000","last_clean":"2023-07-11T00:31:50.840768+0000","last_became_active":"2023-07-11T00:31:48.459485+0000","last_became_peered":"2023-07-11T00:31:48.459485+0000","last_unstale":"2023-07-11T00:31:50.840768+0000","last_undegraded":"2023-07-11T00:31:50.840768+0000","last_fullsized":"2023-07-11T00:31:50.840768+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:53:50.852325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.840732+0000","last_change":"2023-07-11T00:29:59.585672+0000","last_active":"2023-07-11T00:31:50.840732+0000","last_peered":"2023-07-11T00:31:50.840732+0000","last_clean":"2023-07-11T00:31:50.840732+0000","last_became_active":"2023-07-11T00:29:59.585405+0000","last_became_peered":"2023-07-11T00:29:59.585405+0000","last_unstale":"2023-07-11T00:31:50.840732+0000","last_undegraded":"2023-07-11T00:31:50.840732+0000","last_fullsized":"2023-07-11T00:31:50.840732+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:20:01.273572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":199,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464825+0000","last_change":"2023-07-11T00:29:59.589132+0000","last_active":"2023-07-11T00:31:50.464825+0000","last_peered":"2023-07-11T00:31:50.464825+0000","last_clean":"2023-07-11T00:31:50.464825+0000","last_became_active":"2023-07-11T00:29:59.588293+0000","last_became_peered":"2023-07-11T00:29:59.588293+0000","last_unstale":"2023-07-11T00:31:50.464825+0000","last_undegraded":"2023-07-11T00:31:50.464825+0000","last_fullsized":"2023-07-11T00:31:50.464825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:38:20.599991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464125+0000","last_change":"2023-07-11T00:31:49.467643+0000","last_active":"2023-07-11T00:31:50.464125+0000","last_peered":"2023-07-11T00:31:50.464125+0000","last_clean":"2023-07-11T00:31:50.464125+0000","last_became_active":"2023-07-11T00:31:49.467390+0000","last_became_peered":"2023-07-11T00:31:49.467390+0000","last_unstale":"2023-07-11T00:31:50.464125+0000","last_undegraded":"2023-07-11T00:31:50.464125+0000","last_fullsized":"2023-07-11T00:31:50.464125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:35:16.582529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465583+0000","last_change":"2023-07-11T00:31:48.465932+0000","last_active":"2023-07-11T00:31:50.465583+0000","last_peered":"2023-07-11T00:31:50.465583+0000","last_clean":"2023-07-11T00:31:50.465583+0000","last_became_active":"2023-07-11T00:31:48.465433+0000","last_became_peered":"2023-07-11T00:31:48.465433+0000","last_unstale":"2023-07-11T00:31:50.465583+0000","last_undegraded":"2023-07-11T00:31:50.465583+0000","last_fullsized":"2023-07-11T00:31:50.465583+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:32:31.160541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465260+0000","last_change":"2023-07-11T00:29:59.978997+0000","last_active":"2023-07-11T00:31:50.465260+0000","last_peered":"2023-07-11T00:31:50.465260+0000","last_clean":"2023-07-11T00:31:50.465260+0000","last_became_active":"2023-07-11T00:29:59.978716+0000","last_became_peered":"2023-07-11T00:29:59.978716+0000","last_unstale":"2023-07-11T00:31:50.465260+0000","last_undegraded":"2023-07-11T00:31:50.465260+0000","last_fullsized":"2023-07-11T00:31:50.465260+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:42:25.875263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464456+0000","last_change":"2023-07-11T00:31:49.464724+0000","last_active":"2023-07-11T00:31:50.464456+0000","last_peered":"2023-07-11T00:31:50.464456+0000","last_clean":"2023-07-11T00:31:50.464456+0000","last_became_active":"2023-07-11T00:31:49.464410+0000","last_became_peered":"2023-07-11T00:31:49.464410+0000","last_unstale":"2023-07-11T00:31:50.464456+0000","last_undegraded":"2023-07-11T00:31:50.464456+0000","last_fullsized":"2023-07-11T00:31:50.464456+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:44:25.921005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.931177+0000","last_change":"2023-07-11T00:31:48.453012+0000","last_active":"2023-07-11T00:31:50.931177+0000","last_peered":"2023-07-11T00:31:50.931177+0000","last_clean":"2023-07-11T00:31:50.931177+0000","last_became_active":"2023-07-11T00:31:48.452702+0000","last_became_peered":"2023-07-11T00:31:48.452702+0000","last_unstale":"2023-07-11T00:31:50.931177+0000","last_undegraded":"2023-07-11T00:31:50.931177+0000","last_fullsized":"2023-07-11T00:31:50.931177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:06:53.093944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464823+0000","last_change":"2023-07-11T00:29:59.978976+0000","last_active":"2023-07-11T00:31:50.464823+0000","last_peered":"2023-07-11T00:31:50.464823+0000","last_clean":"2023-07-11T00:31:50.464823+0000","last_became_active":"2023-07-11T00:29:59.978678+0000","last_became_peered":"2023-07-11T00:29:59.978678+0000","last_unstale":"2023-07-11T00:31:50.464823+0000","last_undegraded":"2023-07-11T00:31:50.464823+0000","last_fullsized":"2023-07-11T00:31:50.464823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:50:49.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464049+0000","last_change":"2023-07-11T00:31:49.475079+0000","last_active":"2023-07-11T00:31:50.464049+0000","last_peered":"2023-07-11T00:31:50.464049+0000","last_clean":"2023-07-11T00:31:50.464049+0000","last_became_active":"2023-07-11T00:31:49.474768+0000","last_became_peered":"2023-07-11T00:31:49.474768+0000","last_unstale":"2023-07-11T00:31:50.464049+0000","last_undegraded":"2023-07-11T00:31:50.464049+0000","last_fullsized":"2023-07-11T00:31:50.464049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:35:29.061426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548773+0000","last_change":"2023-07-11T00:31:48.461436+0000","last_active":"2023-07-11T00:31:50.548773+0000","last_peered":"2023-07-11T00:31:50.548773+0000","last_clean":"2023-07-11T00:31:50.548773+0000","last_became_active":"2023-07-11T00:31:48.461132+0000","last_became_peered":"2023-07-11T00:31:48.461132+0000","last_unstale":"2023-07-11T00:31:50.548773+0000","last_undegraded":"2023-07-11T00:31:50.548773+0000","last_fullsized":"2023-07-11T00:31:50.548773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:58:34.998041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930753+0000","last_change":"2023-07-11T00:29:59.979163+0000","last_active":"2023-07-11T00:31:50.930753+0000","last_peered":"2023-07-11T00:31:50.930753+0000","last_clean":"2023-07-11T00:31:50.930753+0000","last_became_active":"2023-07-11T00:29:59.978751+0000","last_became_peered":"2023-07-11T00:29:59.978751+0000","last_unstale":"2023-07-11T00:31:50.930753+0000","last_undegraded":"2023-07-11T00:31:50.930753+0000","last_fullsized":"2023-07-11T00:31:50.930753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:04:45.489808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930630+0000","last_change":"2023-07-11T00:31:49.465942+0000","last_active":"2023-07-11T00:31:50.930630+0000","last_peered":"2023-07-11T00:31:50.930630+0000","last_clean":"2023-07-11T00:31:50.930630+0000","last_became_active":"2023-07-11T00:31:49.465627+0000","last_became_peered":"2023-07-11T00:31:49.465627+0000","last_unstale":"2023-07-11T00:31:50.930630+0000","last_undegraded":"2023-07-11T00:31:50.930630+0000","last_fullsized":"2023-07-11T00:31:50.930630+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:07.266780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.840640+0000","last_change":"2023-07-11T00:31:48.462834+0000","last_active":"2023-07-11T00:31:50.840640+0000","last_peered":"2023-07-11T00:31:50.840640+0000","last_clean":"2023-07-11T00:31:50.840640+0000","last_became_active":"2023-07-11T00:31:48.462167+0000","last_became_peered":"2023-07-11T00:31:48.462167+0000","last_unstale":"2023-07-11T00:31:50.840640+0000","last_undegraded":"2023-07-11T00:31:50.840640+0000","last_fullsized":"2023-07-11T00:31:50.840640+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:28:20.214160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463784+0000","last_change":"2023-07-11T00:29:59.978981+0000","last_active":"2023-07-11T00:31:50.463784+0000","last_peered":"2023-07-11T00:31:50.463784+0000","last_clean":"2023-07-11T00:31:50.463784+0000","last_became_active":"2023-07-11T00:29:59.978633+0000","last_became_peered":"2023-07-11T00:29:59.978633+0000","last_unstale":"2023-07-11T00:31:50.463784+0000","last_undegraded":"2023-07-11T00:31:50.463784+0000","last_fullsized":"2023-07-11T00:31:50.463784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:07:35.112456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.551938+0000","last_change":"2023-07-11T00:31:49.457970+0000","last_active":"2023-07-11T00:31:50.551938+0000","last_peered":"2023-07-11T00:31:50.551938+0000","last_clean":"2023-07-11T00:31:50.551938+0000","last_became_active":"2023-07-11T00:31:49.457706+0000","last_became_peered":"2023-07-11T00:31:49.457706+0000","last_unstale":"2023-07-11T00:31:50.551938+0000","last_undegraded":"2023-07-11T00:31:50.551938+0000","last_fullsized":"2023-07-11T00:31:50.551938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:57:21.898195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464183+0000","last_change":"2023-07-11T00:31:48.458841+0000","last_active":"2023-07-11T00:31:50.464183+0000","last_peered":"2023-07-11T00:31:50.464183+0000","last_clean":"2023-07-11T00:31:50.464183+0000","last_became_active":"2023-07-11T00:31:48.458577+0000","last_became_peered":"2023-07-11T00:31:48.458577+0000","last_unstale":"2023-07-11T00:31:50.464183+0000","last_undegraded":"2023-07-11T00:31:50.464183+0000","last_fullsized":"2023-07-11T00:31:50.464183+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:51:13.554586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464200+0000","last_change":"2023-07-11T00:29:59.585652+0000","last_active":"2023-07-11T00:31:50.464200+0000","last_peered":"2023-07-11T00:31:50.464200+0000","last_clean":"2023-07-11T00:31:50.464200+0000","last_became_active":"2023-07-11T00:29:59.585316+0000","last_became_peered":"2023-07-11T00:29:59.585316+0000","last_unstale":"2023-07-11T00:31:50.464200+0000","last_undegraded":"2023-07-11T00:31:50.464200+0000","last_fullsized":"2023-07-11T00:31:50.464200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:06:59.351986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":788075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.67000000000000004}]},{"osd":1,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.89000000000000001}]},{"osd":2,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.84899999999999998}]},{"osd":3,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.87},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.94199999999999995}]},{"osd":4,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.62}]},{"osd":5,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.754}]},{"osd":6,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.92100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":196928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":8.9930000000000003,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":4.8150000000000004,"5min":4.8150000000000004,"15min":4.8150000000000004},"last":0.80500000000000005}]},{"osd":1,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":4.9800000000000004,"5min":4.9800000000000004,"15min":4.9800000000000004},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.76600000000000001}]},{"osd":2,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":3.0790000000000002,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":0.88900000000000001}]},{"osd":3,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":10.978999999999999,"5min":10.978999999999999,"15min":10.978999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":4.8300000000000001,"5min":4.8300000000000001,"15min":4.8300000000000001},"last":0.69299999999999995}]},{"osd":4,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":6.2309999999999999,"5min":6.2309999999999999,"15min":6.2309999999999999},"last":0.64800000000000002}]},{"osd":5,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":0.748},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.92300000000000004}]},{"osd":7,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.87}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":788055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.502},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47599999999999998}]},{"osd":2,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.55500000000000005}]},{"osd":3,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.628},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.65200000000000002}]},{"osd":6,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.61199999999999999}]},{"osd":7,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.59999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":196290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.47999999999999998}]},{"osd":2,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.376}]},{"osd":3,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.46300000000000002}]},{"osd":4,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67000000000000004}]},{"osd":5,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.505}]},{"osd":6,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.624}]},{"osd":7,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.59099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":199203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":3.2989999999999999,"5min":3.2989999999999999,"15min":3.2989999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.47699999999999998}]},{"osd":1,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.437},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.024,"5min":3.024,"15min":3.024},"last":0.53200000000000003}]},{"osd":3,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":3.0779999999999998,"5min":3.0779999999999998,"15min":3.0779999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.3330000000000002,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.56399999999999995}]},{"osd":4,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.2200000000000002,"5min":3.2200000000000002,"15min":3.2200000000000002},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.78700000000000003}]},{"osd":5,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":3.2629999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":0.88900000000000001}]},{"osd":6,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.879}]},{"osd":7,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.91700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":196894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":10.938000000000001,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.42399999999999999}]},{"osd":1,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":10.874000000000001,"5min":10.874000000000001,"15min":10.874000000000001},"last":0.48899999999999999}]},{"osd":2,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":11.050000000000001,"5min":11.050000000000001,"15min":11.050000000000001},"last":0.45500000000000002}]},{"osd":4,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":0.65700000000000003}]},{"osd":5,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":11.015000000000001,"5min":11.015000000000001,"15min":11.015000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":10.978,"5min":10.978,"15min":10.978},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.67700000000000005}]},{"osd":7,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.79400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":199181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.871,"5min":2.871,"15min":2.871},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.622}]},{"osd":1,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.90500000000000003}]},{"osd":2,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.75800000000000001}]},{"osd":3,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":7.6790000000000003,"5min":7.6790000000000003,"15min":7.6790000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.81699999999999995}]},{"osd":5,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.95499999999999996}]},{"osd":6,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.872}]},{"osd":7,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.73999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":196326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.53800000000000003}]},{"osd":1,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.81699999999999995}]},{"osd":2,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.71699999999999997}]},{"osd":3,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.69299999999999995}]},{"osd":4,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.875},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.65400000000000003}]},{"osd":6,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.069},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.92200000000000004}]},{"osd":7,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.747}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-11T00:31:54.891 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-11T00:31:55.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.123+0000 7f4e597ff700 1 Processor -- start 2023-07-11T00:31:55.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.123+0000 7f4e597ff700 1 -- start start 2023-07-11T00:31:55.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.124+0000 7f4e597ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4e5415c460 0x7f4e540b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.124+0000 7f4e597ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4e540d2640 0x7f4e540cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.124+0000 7f4e597ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e540d1790 con 0x7f4e540cf720 2023-07-11T00:31:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.124+0000 7f4e597ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e540cedd0 con 0x7f4e5415c460 2023-07-11T00:31:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.124+0000 7f4e597ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e540cd950 con 0x7f4e540d2640 2023-07-11T00:31:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.124+0000 7f4e52ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4e5415c460 0x7f4e540b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.124+0000 7f4e52ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4e5415c460 0x7f4e540b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49038/0 (socket says 172.21.15.22:49038) 2023-07-11T00:31:55.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.124+0000 7f4e52ffd700 1 -- 172.21.15.22:0/805010875 learned_addr learned my addr 172.21.15.22:0/805010875 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:55.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.125+0000 7f4e52ffd700 1 -- 172.21.15.22:0/805010875 >> v2:172.21.15.184:3300/0 conn(0x7f4e540d2640 msgr2=0x7f4e540cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:55.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.125+0000 7f4e527fc700 1 --2- 172.21.15.22:0/805010875 >> v2:172.21.15.184:3300/0 conn(0x7f4e540d2640 0x7f4e540cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:55.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.125+0000 7f4e52ffd700 1 --2- 172.21.15.22:0/805010875 >> v2:172.21.15.184:3300/0 conn(0x7f4e540d2640 0x7f4e540cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:55.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.125+0000 7f4e52ffd700 1 -- 172.21.15.22:0/805010875 >> v1:172.21.15.184:6789/0 conn(0x7f4e540cf720 legacy=0x7f4e540d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:55.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.125+0000 7f4e52ffd700 1 -- 172.21.15.22:0/805010875 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e540d14b0 con 0x7f4e5415c460 2023-07-11T00:31:55.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.125+0000 7f4e527fc700 1 --2- 172.21.15.22:0/805010875 >> v2:172.21.15.184:3300/0 conn(0x7f4e540d2640 0x7f4e540cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:31:55.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.125+0000 7f4e52ffd700 1 --2- 172.21.15.22:0/805010875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e5415c460 0x7f4e540b59d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4e5415fd80 tx=0x7f4e44009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866e9e9277212349 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:55.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.125+0000 7f4e51ffb700 1 -- 172.21.15.22:0/805010875 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4400b870 con 0x7f4e5415c460 2023-07-11T00:31:55.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.126+0000 7f4e51ffb700 1 -- 172.21.15.22:0/805010875 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4400b9d0 con 0x7f4e5415c460 2023-07-11T00:31:55.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.126+0000 7f4e51ffb700 1 -- 172.21.15.22:0/805010875 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4400bd60 con 0x7f4e5415c460 2023-07-11T00:31:55.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.126+0000 7f4e597ff700 1 -- 172.21.15.22:0/805010875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e5415c460 msgr2=0x7f4e540b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:55.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.126+0000 7f4e597ff700 1 --2- 172.21.15.22:0/805010875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e5415c460 0x7f4e540b59d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4e5415fd80 tx=0x7f4e44009bd0 comp rx=0 tx=0).stop 2023-07-11T00:31:55.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.126+0000 7f4e597ff700 1 -- 172.21.15.22:0/805010875 shutdown_connections 2023-07-11T00:31:55.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.126+0000 7f4e597ff700 1 --2- 172.21.15.22:0/805010875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e5415c460 0x7f4e540b59d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:55.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.126+0000 7f4e597ff700 1 --2- 172.21.15.22:0/805010875 >> v2:172.21.15.184:3300/0 conn(0x7f4e540d2640 0x7f4e540cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:55.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.126+0000 7f4e597ff700 1 -- 172.21.15.22:0/805010875 >> 172.21.15.22:0/805010875 conn(0x7f4e54071660 msgr2=0x7f4e54071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:55.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.126+0000 7f4e597ff700 1 -- 172.21.15.22:0/805010875 shutdown_connections 2023-07-11T00:31:55.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.126+0000 7f4e597ff700 1 -- 172.21.15.22:0/805010875 wait complete. 2023-07-11T00:31:55.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.129+0000 7f4e597ff700 1 Processor -- start 2023-07-11T00:31:55.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.129+0000 7f4e597ff700 1 -- start start 2023-07-11T00:31:55.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.130+0000 7f4e597ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e540cf720 0x7f4e54159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:55.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.130+0000 7f4e597ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e540d2640 0x7f4e5414ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:55.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.130+0000 7f4e597ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e5415c460 0x7f4e540c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:55.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.130+0000 7f4e597ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540c7580 con 0x7f4e5415c460 2023-07-11T00:31:55.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.130+0000 7f4e597ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540c66b0 con 0x7f4e540d2640 2023-07-11T00:31:55.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.130+0000 7f4e597ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540c6900 con 0x7f4e540cf720 2023-07-11T00:31:55.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.130+0000 7f4e537fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e5415c460 0x7f4e540c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:55.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.130+0000 7f4e537fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e5415c460 0x7f4e540c8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49054/0 (socket says 172.21.15.22:49054) 2023-07-11T00:31:55.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.130+0000 7f4e537fe700 1 -- 172.21.15.22:0/2284213890 learned_addr learned my addr 172.21.15.22:0/2284213890 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:55.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.131+0000 7f4e527fc700 1 --2- 172.21.15.22:0/2284213890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e540d2640 0x7f4e5414ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:55.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.131+0000 7f4e52ffd700 1 --2- 172.21.15.22:0/2284213890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e540cf720 0x7f4e54159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:55.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.131+0000 7f4e537fe700 1 -- 172.21.15.22:0/2284213890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e540cf720 msgr2=0x7f4e54159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:55.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.131+0000 7f4e537fe700 1 --2- 172.21.15.22:0/2284213890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e540cf720 0x7f4e54159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:55.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.131+0000 7f4e537fe700 1 -- 172.21.15.22:0/2284213890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e540d2640 msgr2=0x7f4e5414ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:55.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.131+0000 7f4e537fe700 1 --2- 172.21.15.22:0/2284213890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e540d2640 0x7f4e5414ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:55.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.131+0000 7f4e537fe700 1 -- 172.21.15.22:0/2284213890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e44009550 con 0x7f4e5415c460 2023-07-11T00:31:55.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.131+0000 7f4e537fe700 1 --2- 172.21.15.22:0/2284213890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e5415c460 0x7f4e540c8eb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00cb50 tx=0x7f4e4c00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:55.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.131+0000 7f4e3b7fe700 1 -- 172.21.15.22:0/2284213890 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c003c00 con 0x7f4e5415c460 2023-07-11T00:31:55.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.131+0000 7f4e3b7fe700 1 -- 172.21.15.22:0/2284213890 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c003d60 con 0x7f4e5415c460 2023-07-11T00:31:55.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.131+0000 7f4e3b7fe700 1 -- 172.21.15.22:0/2284213890 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00ab70 con 0x7f4e5415c460 2023-07-11T00:31:55.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.131+0000 7f4e597ff700 1 -- 172.21.15.22:0/2284213890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e540c6be0 con 0x7f4e5415c460 2023-07-11T00:31:55.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.132+0000 7f4e597ff700 1 -- 172.21.15.22:0/2284213890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e540c71a0 con 0x7f4e5415c460 2023-07-11T00:31:55.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.132+0000 7f4e597ff700 1 -- 172.21.15.22:0/2284213890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e540c76c0 con 0x7f4e5415c460 2023-07-11T00:31:55.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.133+0000 7f4e3b7fe700 1 -- 172.21.15.22:0/2284213890 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4e4c00acd0 con 0x7f4e5415c460 2023-07-11T00:31:55.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.134+0000 7f4e3b7fe700 1 --2- 172.21.15.22:0/2284213890 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4e4006ace0 0x7f4e4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.135+0000 7f4e3b7fe700 1 -- 172.21.15.22:0/2284213890 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4e4c089670 con 0x7f4e5415c460 2023-07-11T00:31:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.135+0000 7f4e52ffd700 1 --2- 172.21.15.22:0/2284213890 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4e4006ace0 0x7f4e4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.136+0000 7f4e52ffd700 1 --2- 172.21.15.22:0/2284213890 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4e4006ace0 0x7f4e4006d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4e44000c00 tx=0x7f4e44008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:55.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.140+0000 7f4e3b7fe700 1 -- 172.21.15.22:0/2284213890 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f4e540c76c0 con 0x7f4e5415c460 2023-07-11T00:31:55.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.428+0000 7f4e597ff700 1 -- 172.21.15.22:0/2284213890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4e540c76c0 con 0x7f4e5415c460 2023-07-11T00:31:55.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.429+0000 7f4e3b7fe700 1 -- 172.21.15.22:0/2284213890 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1109 (secure 0 0 0) 0x7f4e540c76c0 con 0x7f4e5415c460 2023-07-11T00:31:55.432 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:55.432 INFO:teuthology.orchestra.run.smithi022.stdout:{"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":130,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1689035397,"num_in_osds":8,"osd_in_since":1689035388,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":225673216,"bytes_avail":772868440064,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":5364}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-07-11T00:31:12.508185+0000","services":{}},"progress_events":{}} 2023-07-11T00:31:55.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.431+0000 7f4e597ff700 1 -- 172.21.15.22:0/2284213890 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4e4006ace0 msgr2=0x7f4e4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:55.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.431+0000 7f4e597ff700 1 --2- 172.21.15.22:0/2284213890 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4e4006ace0 0x7f4e4006d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4e44000c00 tx=0x7f4e44008030 comp rx=0 tx=0).stop 2023-07-11T00:31:55.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.431+0000 7f4e597ff700 1 -- 172.21.15.22:0/2284213890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e5415c460 msgr2=0x7f4e540c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:55.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.431+0000 7f4e597ff700 1 --2- 172.21.15.22:0/2284213890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e5415c460 0x7f4e540c8eb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00cb50 tx=0x7f4e4c00cf10 comp rx=0 tx=0).stop 2023-07-11T00:31:55.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.431+0000 7f4e597ff700 1 -- 172.21.15.22:0/2284213890 shutdown_connections 2023-07-11T00:31:55.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.431+0000 7f4e597ff700 1 --2- 172.21.15.22:0/2284213890 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f4e4006ace0 0x7f4e4006d190 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:55.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.431+0000 7f4e597ff700 1 --2- 172.21.15.22:0/2284213890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e540cf720 0x7f4e54159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:55.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.431+0000 7f4e597ff700 1 --2- 172.21.15.22:0/2284213890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e5415c460 0x7f4e540c8eb0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:55.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.431+0000 7f4e597ff700 1 --2- 172.21.15.22:0/2284213890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e540d2640 0x7f4e5414ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:55.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.431+0000 7f4e597ff700 1 -- 172.21.15.22:0/2284213890 >> 172.21.15.22:0/2284213890 conn(0x7f4e54071660 msgr2=0x7f4e540d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:55.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.431+0000 7f4e597ff700 1 -- 172.21.15.22:0/2284213890 shutdown_connections 2023-07-11T00:31:55.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.431+0000 7f4e597ff700 1 -- 172.21.15.22:0/2284213890 wait complete. 2023-07-11T00:31:55.451 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-11T00:31:55.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-11T00:31:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.651+0000 7fc763dff700 1 Processor -- start 2023-07-11T00:31:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.651+0000 7fc763dff700 1 -- start start 2023-07-11T00:31:55.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.653+0000 7fc763dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc75c0d2640 0x7fc75c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:55.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.653+0000 7fc763dff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75c0d1790 con 0x7fc75c0cf8f0 2023-07-11T00:31:55.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.653+0000 7fc763dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75c0cd950 con 0x7fc75c15c460 2023-07-11T00:31:55.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.653+0000 7fc763dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75c0cedd0 con 0x7fc75c0d2640 2023-07-11T00:31:55.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.653+0000 7fc76239c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc75c0cf8f0 0x7fc75c15fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57314/0 (socket says 172.21.15.22:57314) 2023-07-11T00:31:55.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.653+0000 7fc76239c700 1 -- 172.21.15.22:0/2046462291 learned_addr learned my addr 172.21.15.22:0/2046462291 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:55.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.653+0000 7fc76139a700 1 --2- 172.21.15.22:0/2046462291 >> v2:172.21.15.184:3300/0 conn(0x7fc75c0d2640 0x7fc75c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:55.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.654+0000 7fc760b99700 1 -- 172.21.15.22:0/2046462291 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654947101 0 0) 0x7fc75c0d1790 con 0x7fc75c0cf8f0 2023-07-11T00:31:55.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.654+0000 7fc760b99700 1 -- 172.21.15.22:0/2046462291 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7480035b0 con 0x7fc75c0cf8f0 2023-07-11T00:31:55.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.654+0000 7fc760b99700 1 -- 172.21.15.22:0/2046462291 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256763098 0 0) 0x7fc75c0cd950 con 0x7fc75c15c460 2023-07-11T00:31:55.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.654+0000 7fc760b99700 1 -- 172.21.15.22:0/2046462291 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc75c0d1790 con 0x7fc75c15c460 2023-07-11T00:31:55.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.654+0000 7fc76139a700 1 -- 172.21.15.22:0/2046462291 >> v1:172.21.15.184:6789/0 conn(0x7fc75c15c460 legacy=0x7fc75c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:55.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.654+0000 7fc76139a700 1 -- 172.21.15.22:0/2046462291 >> v1:172.21.15.22:6789/0 conn(0x7fc75c0cf8f0 legacy=0x7fc75c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:55.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.654+0000 7fc76139a700 1 -- 172.21.15.22:0/2046462291 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c0d14b0 con 0x7fc75c0d2640 2023-07-11T00:31:55.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.654+0000 7fc76139a700 1 --2- 172.21.15.22:0/2046462291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc75c0d2640 0x7fc75c0b59d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009840 tx=0x7fc74c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d902ecc9ba073f7b server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:55.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.654+0000 7fc760b99700 1 -- 172.21.15.22:0/2046462291 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c011830 con 0x7fc75c0d2640 2023-07-11T00:31:55.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.655+0000 7fc760b99700 1 -- 172.21.15.22:0/2046462291 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c011990 con 0x7fc75c0d2640 2023-07-11T00:31:55.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.655+0000 7fc760b99700 1 -- 172.21.15.22:0/2046462291 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c011d20 con 0x7fc75c0d2640 2023-07-11T00:31:55.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.655+0000 7fc763dff700 1 -- 172.21.15.22:0/2046462291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc75c0d2640 msgr2=0x7fc75c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:55.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.655+0000 7fc763dff700 1 --2- 172.21.15.22:0/2046462291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc75c0d2640 0x7fc75c0b59d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009840 tx=0x7fc74c009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:55.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.655+0000 7fc763dff700 1 -- 172.21.15.22:0/2046462291 shutdown_connections 2023-07-11T00:31:55.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.655+0000 7fc763dff700 1 --2- 172.21.15.22:0/2046462291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc75c0d2640 0x7fc75c0b59d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:55.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.655+0000 7fc763dff700 1 -- 172.21.15.22:0/2046462291 >> 172.21.15.22:0/2046462291 conn(0x7fc75c071660 msgr2=0x7fc75c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:55.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.655+0000 7fc763dff700 1 -- 172.21.15.22:0/2046462291 shutdown_connections 2023-07-11T00:31:55.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.655+0000 7fc763dff700 1 -- 172.21.15.22:0/2046462291 wait complete. 2023-07-11T00:31:55.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.657+0000 7fc763dff700 1 Processor -- start 2023-07-11T00:31:55.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.657+0000 7fc763dff700 1 -- start start 2023-07-11T00:31:55.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.658+0000 7fc763dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc75c0cf8f0 0x7fc75c15b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:55.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.658+0000 7fc763dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc75c0d2640 0x7fc75c151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:55.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.658+0000 7fc763dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc75c15c460 0x7fc75c0c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:55.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.658+0000 7fc763dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c152800 con 0x7fc75c0d2640 2023-07-11T00:31:55.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.658+0000 7fc763dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0c7980 con 0x7fc75c15c460 2023-07-11T00:31:55.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.658+0000 7fc763dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0c73c0 con 0x7fc75c0cf8f0 2023-07-11T00:31:55.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.658+0000 7fc76139a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc75c0d2640 0x7fc75c151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:55.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.658+0000 7fc76139a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc75c0d2640 0x7fc75c151990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49060/0 (socket says 172.21.15.22:49060) 2023-07-11T00:31:55.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.658+0000 7fc76139a700 1 -- 172.21.15.22:0/2518067043 learned_addr learned my addr 172.21.15.22:0/2518067043 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:55.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.658+0000 7fc761b9b700 1 --2- 172.21.15.22:0/2518067043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc75c0cf8f0 0x7fc75c15b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:55.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.659+0000 7fc76239c700 1 --2- 172.21.15.22:0/2518067043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc75c15c460 0x7fc75c0c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:55.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.659+0000 7fc76139a700 1 -- 172.21.15.22:0/2518067043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc75c0cf8f0 msgr2=0x7fc75c15b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:55.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.659+0000 7fc76139a700 1 --2- 172.21.15.22:0/2518067043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc75c0cf8f0 0x7fc75c15b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:55.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.659+0000 7fc76139a700 1 -- 172.21.15.22:0/2518067043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc75c15c460 msgr2=0x7fc75c0c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:55.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.659+0000 7fc76139a700 1 --2- 172.21.15.22:0/2518067043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc75c15c460 0x7fc75c0c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:55.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.659+0000 7fc76139a700 1 -- 172.21.15.22:0/2518067043 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c0094a0 con 0x7fc75c0d2640 2023-07-11T00:31:55.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.659+0000 7fc76139a700 1 --2- 172.21.15.22:0/2518067043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc75c0d2640 0x7fc75c151990 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc74c0090b0 tx=0x7fc74c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:55.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.659+0000 7fc7527fc700 1 -- 172.21.15.22:0/2518067043 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c01a760 con 0x7fc75c0d2640 2023-07-11T00:31:55.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.659+0000 7fc7527fc700 1 -- 172.21.15.22:0/2518067043 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c01a8c0 con 0x7fc75c0d2640 2023-07-11T00:31:55.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.659+0000 7fc763dff700 1 -- 172.21.15.22:0/2518067043 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75c0c76a0 con 0x7fc75c0d2640 2023-07-11T00:31:55.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.659+0000 7fc7527fc700 1 -- 172.21.15.22:0/2518067043 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c01ac30 con 0x7fc75c0d2640 2023-07-11T00:31:55.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.660+0000 7fc763dff700 1 -- 172.21.15.22:0/2518067043 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75c0c92f0 con 0x7fc75c0d2640 2023-07-11T00:31:55.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.661+0000 7fc763dff700 1 -- 172.21.15.22:0/2518067043 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75c0c8ad0 con 0x7fc75c0d2640 2023-07-11T00:31:55.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.662+0000 7fc7527fc700 1 -- 172.21.15.22:0/2518067043 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc74c022070 con 0x7fc75c0d2640 2023-07-11T00:31:55.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.663+0000 7fc7527fc700 1 --2- 172.21.15.22:0/2518067043 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc74006ace0 0x7fc74006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:55.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.663+0000 7fc7527fc700 1 -- 172.21.15.22:0/2518067043 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc74c08a5e0 con 0x7fc75c0d2640 2023-07-11T00:31:55.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.664+0000 7fc761b9b700 1 --2- 172.21.15.22:0/2518067043 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc74006ace0 0x7fc74006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:55.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.664+0000 7fc761b9b700 1 --2- 172.21.15.22:0/2518067043 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc74006ace0 0x7fc74006d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc7580011e0 tx=0x7fc758009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:55.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.668+0000 7fc7527fc700 1 -- 172.21.15.22:0/2518067043 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc75c0c8ad0 con 0x7fc75c0d2640 2023-07-11T00:31:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.869+0000 7fc763dff700 1 -- 172.21.15.22:0/2518067043 --> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc75c0cd5e0 con 0x7fc74006ace0 2023-07-11T00:31:55.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.879+0000 7fc7527fc700 1 -- 172.21.15.22:0/2518067043 <== mgr.4114 v2:172.21.15.184:6832/380612710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311153 (secure 0 0 0) 0x7fc758001570 con 0x7fc74006ace0 2023-07-11T00:31:55.887 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:55.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.883+0000 7fc763dff700 1 -- 172.21.15.22:0/2518067043 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc74006ace0 msgr2=0x7fc74006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:55.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.883+0000 7fc763dff700 1 --2- 172.21.15.22:0/2518067043 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc74006ace0 0x7fc74006d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc7580011e0 tx=0x7fc758009040 comp rx=0 tx=0).stop 2023-07-11T00:31:55.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.883+0000 7fc763dff700 1 -- 172.21.15.22:0/2518067043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc75c0d2640 msgr2=0x7fc75c151990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:55.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.883+0000 7fc763dff700 1 --2- 172.21.15.22:0/2518067043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc75c0d2640 0x7fc75c151990 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc74c0090b0 tx=0x7fc74c004750 comp rx=0 tx=0).stop 2023-07-11T00:31:55.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.883+0000 7fc763dff700 1 -- 172.21.15.22:0/2518067043 shutdown_connections 2023-07-11T00:31:55.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.883+0000 7fc763dff700 1 --2- 172.21.15.22:0/2518067043 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc74006ace0 0x7fc74006d190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:55.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.883+0000 7fc763dff700 1 --2- 172.21.15.22:0/2518067043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc75c0cf8f0 0x7fc75c15b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:55.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.883+0000 7fc763dff700 1 --2- 172.21.15.22:0/2518067043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc75c15c460 0x7fc75c0c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:55.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.883+0000 7fc763dff700 1 --2- 172.21.15.22:0/2518067043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc75c0d2640 0x7fc75c151990 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:55.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.883+0000 7fc763dff700 1 -- 172.21.15.22:0/2518067043 >> 172.21.15.22:0/2518067043 conn(0x7fc75c071660 msgr2=0x7fc75c0cf070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:55.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.883+0000 7fc763dff700 1 -- 172.21.15.22:0/2518067043 shutdown_connections 2023-07-11T00:31:55.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:55.883+0000 7fc763dff700 1 -- 172.21.15.22:0/2518067043 wait complete. 2023-07-11T00:31:55.894 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-07-11T00:31:55.905 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2023-07-11T00:31:54.518531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":192,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220804,"kb_used_data":4632,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753916,"statfs":{"total":773094113280,"available":772868009984,"internally_reserved":0,"allocated":4743168,"data_stored":2760952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.077224"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465327+0000","last_change":"2023-07-11T00:31:49.457897+0000","last_active":"2023-07-11T00:31:50.465327+0000","last_peered":"2023-07-11T00:31:50.465327+0000","last_clean":"2023-07-11T00:31:50.465327+0000","last_became_active":"2023-07-11T00:31:49.457621+0000","last_became_peered":"2023-07-11T00:31:49.457621+0000","last_unstale":"2023-07-11T00:31:50.465327+0000","last_undegraded":"2023-07-11T00:31:50.465327+0000","last_fullsized":"2023-07-11T00:31:50.465327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:36:38.046459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.931074+0000","last_change":"2023-07-11T00:31:49.473191+0000","last_active":"2023-07-11T00:31:50.931074+0000","last_peered":"2023-07-11T00:31:50.931074+0000","last_clean":"2023-07-11T00:31:50.931074+0000","last_became_active":"2023-07-11T00:31:49.472875+0000","last_became_peered":"2023-07-11T00:31:49.472875+0000","last_unstale":"2023-07-11T00:31:50.931074+0000","last_undegraded":"2023-07-11T00:31:50.931074+0000","last_fullsized":"2023-07-11T00:31:50.931074+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:41:36.203534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.551975+0000","last_change":"2023-07-11T00:31:49.460150+0000","last_active":"2023-07-11T00:31:50.551975+0000","last_peered":"2023-07-11T00:31:50.551975+0000","last_clean":"2023-07-11T00:31:50.551975+0000","last_became_active":"2023-07-11T00:31:49.459860+0000","last_became_peered":"2023-07-11T00:31:49.459860+0000","last_unstale":"2023-07-11T00:31:50.551975+0000","last_undegraded":"2023-07-11T00:31:50.551975+0000","last_fullsized":"2023-07-11T00:31:50.551975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:27:24.039242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464008+0000","last_change":"2023-07-11T00:31:49.468186+0000","last_active":"2023-07-11T00:31:50.464008+0000","last_peered":"2023-07-11T00:31:50.464008+0000","last_clean":"2023-07-11T00:31:50.464008+0000","last_became_active":"2023-07-11T00:31:49.467915+0000","last_became_peered":"2023-07-11T00:31:49.467915+0000","last_unstale":"2023-07-11T00:31:50.464008+0000","last_undegraded":"2023-07-11T00:31:50.464008+0000","last_fullsized":"2023-07-11T00:31:50.464008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:55:33.326380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930832+0000","last_change":"2023-07-11T00:31:49.473162+0000","last_active":"2023-07-11T00:31:50.930832+0000","last_peered":"2023-07-11T00:31:50.930832+0000","last_clean":"2023-07-11T00:31:50.930832+0000","last_became_active":"2023-07-11T00:31:49.472848+0000","last_became_peered":"2023-07-11T00:31:49.472848+0000","last_unstale":"2023-07-11T00:31:50.930832+0000","last_undegraded":"2023-07-11T00:31:50.930832+0000","last_fullsized":"2023-07-11T00:31:50.930832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:35:16.582529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548485+0000","last_change":"2023-07-11T00:31:49.464936+0000","last_active":"2023-07-11T00:31:50.548485+0000","last_peered":"2023-07-11T00:31:50.548485+0000","last_clean":"2023-07-11T00:31:50.548485+0000","last_became_active":"2023-07-11T00:31:49.464652+0000","last_became_peered":"2023-07-11T00:31:49.464652+0000","last_unstale":"2023-07-11T00:31:50.548485+0000","last_undegraded":"2023-07-11T00:31:50.548485+0000","last_fullsized":"2023-07-11T00:31:50.548485+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:20:53.763650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465000+0000","last_change":"2023-07-11T00:31:49.462815+0000","last_active":"2023-07-11T00:31:50.465000+0000","last_peered":"2023-07-11T00:31:50.465000+0000","last_clean":"2023-07-11T00:31:50.465000+0000","last_became_active":"2023-07-11T00:31:49.462552+0000","last_became_peered":"2023-07-11T00:31:49.462552+0000","last_unstale":"2023-07-11T00:31:50.465000+0000","last_undegraded":"2023-07-11T00:31:50.465000+0000","last_fullsized":"2023-07-11T00:31:50.465000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:35:37.845496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464195+0000","last_change":"2023-07-11T00:31:49.475568+0000","last_active":"2023-07-11T00:31:50.464195+0000","last_peered":"2023-07-11T00:31:50.464195+0000","last_clean":"2023-07-11T00:31:50.464195+0000","last_became_active":"2023-07-11T00:31:49.475071+0000","last_became_peered":"2023-07-11T00:31:49.475071+0000","last_unstale":"2023-07-11T00:31:50.464195+0000","last_undegraded":"2023-07-11T00:31:50.464195+0000","last_fullsized":"2023-07-11T00:31:50.464195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:41:36.203534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464307+0000","last_change":"2023-07-11T00:31:49.467110+0000","last_active":"2023-07-11T00:31:50.464307+0000","last_peered":"2023-07-11T00:31:50.464307+0000","last_clean":"2023-07-11T00:31:50.464307+0000","last_became_active":"2023-07-11T00:31:49.466742+0000","last_became_peered":"2023-07-11T00:31:49.466742+0000","last_unstale":"2023-07-11T00:31:50.464307+0000","last_undegraded":"2023-07-11T00:31:50.464307+0000","last_fullsized":"2023-07-11T00:31:50.464307+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:47:53.130660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464445+0000","last_change":"2023-07-11T00:31:49.473011+0000","last_active":"2023-07-11T00:31:50.464445+0000","last_peered":"2023-07-11T00:31:50.464445+0000","last_clean":"2023-07-11T00:31:50.464445+0000","last_became_active":"2023-07-11T00:31:49.472475+0000","last_became_peered":"2023-07-11T00:31:49.472475+0000","last_unstale":"2023-07-11T00:31:50.464445+0000","last_undegraded":"2023-07-11T00:31:50.464445+0000","last_fullsized":"2023-07-11T00:31:50.464445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:32:42.635952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464122+0000","last_change":"2023-07-11T00:31:49.467110+0000","last_active":"2023-07-11T00:31:50.464122+0000","last_peered":"2023-07-11T00:31:50.464122+0000","last_clean":"2023-07-11T00:31:50.464122+0000","last_became_active":"2023-07-11T00:31:49.466758+0000","last_became_peered":"2023-07-11T00:31:49.466758+0000","last_unstale":"2023-07-11T00:31:50.464122+0000","last_undegraded":"2023-07-11T00:31:50.464122+0000","last_fullsized":"2023-07-11T00:31:50.464122+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:29:22.209529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.931147+0000","last_change":"2023-07-11T00:31:49.477246+0000","last_active":"2023-07-11T00:31:50.931147+0000","last_peered":"2023-07-11T00:31:50.931147+0000","last_clean":"2023-07-11T00:31:50.931147+0000","last_became_active":"2023-07-11T00:31:49.476968+0000","last_became_peered":"2023-07-11T00:31:49.476968+0000","last_unstale":"2023-07-11T00:31:50.931147+0000","last_undegraded":"2023-07-11T00:31:50.931147+0000","last_fullsized":"2023-07-11T00:31:50.931147+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:47:53.130660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930624+0000","last_change":"2023-07-11T00:31:49.462029+0000","last_active":"2023-07-11T00:31:50.930624+0000","last_peered":"2023-07-11T00:31:50.930624+0000","last_clean":"2023-07-11T00:31:50.930624+0000","last_became_active":"2023-07-11T00:31:49.461742+0000","last_became_peered":"2023-07-11T00:31:49.461742+0000","last_unstale":"2023-07-11T00:31:50.930624+0000","last_undegraded":"2023-07-11T00:31:50.930624+0000","last_fullsized":"2023-07-11T00:31:50.930624+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:01:17.061286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463885+0000","last_change":"2023-07-11T00:31:49.466009+0000","last_active":"2023-07-11T00:31:50.463885+0000","last_peered":"2023-07-11T00:31:50.463885+0000","last_clean":"2023-07-11T00:31:50.463885+0000","last_became_active":"2023-07-11T00:31:49.465744+0000","last_became_peered":"2023-07-11T00:31:49.465744+0000","last_unstale":"2023-07-11T00:31:50.463885+0000","last_undegraded":"2023-07-11T00:31:50.463885+0000","last_fullsized":"2023-07-11T00:31:50.463885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:56:19.968064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548338+0000","last_change":"2023-07-11T00:31:49.452358+0000","last_active":"2023-07-11T00:31:50.548338+0000","last_peered":"2023-07-11T00:31:50.548338+0000","last_clean":"2023-07-11T00:31:50.548338+0000","last_became_active":"2023-07-11T00:31:49.452092+0000","last_became_peered":"2023-07-11T00:31:49.452092+0000","last_unstale":"2023-07-11T00:31:50.548338+0000","last_undegraded":"2023-07-11T00:31:50.548338+0000","last_fullsized":"2023-07-11T00:31:50.548338+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:55:51.717124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463191+0000","last_change":"2023-07-11T00:31:49.478955+0000","last_active":"2023-07-11T00:31:50.463191+0000","last_peered":"2023-07-11T00:31:50.463191+0000","last_clean":"2023-07-11T00:31:50.463191+0000","last_became_active":"2023-07-11T00:31:49.478658+0000","last_became_peered":"2023-07-11T00:31:49.478658+0000","last_unstale":"2023-07-11T00:31:50.463191+0000","last_undegraded":"2023-07-11T00:31:50.463191+0000","last_fullsized":"2023-07-11T00:31:50.463191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:19:53.824107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552403+0000","last_change":"2023-07-11T00:31:49.470584+0000","last_active":"2023-07-11T00:31:50.552403+0000","last_peered":"2023-07-11T00:31:50.552403+0000","last_clean":"2023-07-11T00:31:50.552403+0000","last_became_active":"2023-07-11T00:31:49.470227+0000","last_became_peered":"2023-07-11T00:31:49.470227+0000","last_unstale":"2023-07-11T00:31:50.552403+0000","last_undegraded":"2023-07-11T00:31:50.552403+0000","last_fullsized":"2023-07-11T00:31:50.552403+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:13:53.014748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552146+0000","last_change":"2023-07-11T00:31:49.473741+0000","last_active":"2023-07-11T00:31:50.552146+0000","last_peered":"2023-07-11T00:31:50.552146+0000","last_clean":"2023-07-11T00:31:50.552146+0000","last_became_active":"2023-07-11T00:31:49.473435+0000","last_became_peered":"2023-07-11T00:31:49.473435+0000","last_unstale":"2023-07-11T00:31:50.552146+0000","last_undegraded":"2023-07-11T00:31:50.552146+0000","last_fullsized":"2023-07-11T00:31:50.552146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:16:57.332196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463706+0000","last_change":"2023-07-11T00:31:49.475022+0000","last_active":"2023-07-11T00:31:50.463706+0000","last_peered":"2023-07-11T00:31:50.463706+0000","last_clean":"2023-07-11T00:31:50.463706+0000","last_became_active":"2023-07-11T00:31:49.474696+0000","last_became_peered":"2023-07-11T00:31:49.474696+0000","last_unstale":"2023-07-11T00:31:50.463706+0000","last_undegraded":"2023-07-11T00:31:50.463706+0000","last_fullsized":"2023-07-11T00:31:50.463706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:46:54.858536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930637+0000","last_change":"2023-07-11T00:31:49.467212+0000","last_active":"2023-07-11T00:31:50.930637+0000","last_peered":"2023-07-11T00:31:50.930637+0000","last_clean":"2023-07-11T00:31:50.930637+0000","last_became_active":"2023-07-11T00:31:49.466932+0000","last_became_peered":"2023-07-11T00:31:49.466932+0000","last_unstale":"2023-07-11T00:31:50.930637+0000","last_undegraded":"2023-07-11T00:31:50.930637+0000","last_fullsized":"2023-07-11T00:31:50.930637+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:52:10.312151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548480+0000","last_change":"2023-07-11T00:31:49.458482+0000","last_active":"2023-07-11T00:31:50.548480+0000","last_peered":"2023-07-11T00:31:50.548480+0000","last_clean":"2023-07-11T00:31:50.548480+0000","last_became_active":"2023-07-11T00:31:49.458224+0000","last_became_peered":"2023-07-11T00:31:49.458224+0000","last_unstale":"2023-07-11T00:31:50.548480+0000","last_undegraded":"2023-07-11T00:31:50.548480+0000","last_fullsized":"2023-07-11T00:31:50.548480+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:11:56.418499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463919+0000","last_change":"2023-07-11T00:31:49.463657+0000","last_active":"2023-07-11T00:31:50.463919+0000","last_peered":"2023-07-11T00:31:50.463919+0000","last_clean":"2023-07-11T00:31:50.463919+0000","last_became_active":"2023-07-11T00:31:49.463388+0000","last_became_peered":"2023-07-11T00:31:49.463388+0000","last_unstale":"2023-07-11T00:31:50.463919+0000","last_undegraded":"2023-07-11T00:31:50.463919+0000","last_fullsized":"2023-07-11T00:31:50.463919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:07.266780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463215+0000","last_change":"2023-07-11T00:31:49.463794+0000","last_active":"2023-07-11T00:31:50.463215+0000","last_peered":"2023-07-11T00:31:50.463215+0000","last_clean":"2023-07-11T00:31:50.463215+0000","last_became_active":"2023-07-11T00:31:49.463465+0000","last_became_peered":"2023-07-11T00:31:49.463465+0000","last_unstale":"2023-07-11T00:31:50.463215+0000","last_undegraded":"2023-07-11T00:31:50.463215+0000","last_fullsized":"2023-07-11T00:31:50.463215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:30:09.468212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463140+0000","last_change":"2023-07-11T00:31:49.465033+0000","last_active":"2023-07-11T00:31:50.463140+0000","last_peered":"2023-07-11T00:31:50.463140+0000","last_clean":"2023-07-11T00:31:50.463140+0000","last_became_active":"2023-07-11T00:31:49.464732+0000","last_became_peered":"2023-07-11T00:31:49.464732+0000","last_unstale":"2023-07-11T00:31:50.463140+0000","last_undegraded":"2023-07-11T00:31:50.463140+0000","last_fullsized":"2023-07-11T00:31:50.463140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:34:58.446331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464124+0000","last_change":"2023-07-11T00:31:49.461466+0000","last_active":"2023-07-11T00:31:50.464124+0000","last_peered":"2023-07-11T00:31:50.464124+0000","last_clean":"2023-07-11T00:31:50.464124+0000","last_became_active":"2023-07-11T00:31:49.461107+0000","last_became_peered":"2023-07-11T00:31:49.461107+0000","last_unstale":"2023-07-11T00:31:50.464124+0000","last_undegraded":"2023-07-11T00:31:50.464124+0000","last_fullsized":"2023-07-11T00:31:50.464124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:10:16.280197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930674+0000","last_change":"2023-07-11T00:31:49.456912+0000","last_active":"2023-07-11T00:31:50.930674+0000","last_peered":"2023-07-11T00:31:50.930674+0000","last_clean":"2023-07-11T00:31:50.930674+0000","last_became_active":"2023-07-11T00:31:49.456427+0000","last_became_peered":"2023-07-11T00:31:49.456427+0000","last_unstale":"2023-07-11T00:31:50.930674+0000","last_undegraded":"2023-07-11T00:31:50.930674+0000","last_fullsized":"2023-07-11T00:31:50.930674+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:14:05.564588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552122+0000","last_change":"2023-07-11T00:31:49.471242+0000","last_active":"2023-07-11T00:31:50.552122+0000","last_peered":"2023-07-11T00:31:50.552122+0000","last_clean":"2023-07-11T00:31:50.552122+0000","last_became_active":"2023-07-11T00:31:49.470925+0000","last_became_peered":"2023-07-11T00:31:49.470925+0000","last_unstale":"2023-07-11T00:31:50.552122+0000","last_undegraded":"2023-07-11T00:31:50.552122+0000","last_fullsized":"2023-07-11T00:31:50.552122+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:19:23.867053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930858+0000","last_change":"2023-07-11T00:31:49.477295+0000","last_active":"2023-07-11T00:31:50.930858+0000","last_peered":"2023-07-11T00:31:50.930858+0000","last_clean":"2023-07-11T00:31:50.930858+0000","last_became_active":"2023-07-11T00:31:49.476956+0000","last_became_peered":"2023-07-11T00:31:49.476956+0000","last_unstale":"2023-07-11T00:31:50.930858+0000","last_undegraded":"2023-07-11T00:31:50.930858+0000","last_fullsized":"2023-07-11T00:31:50.930858+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:29:22.209529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463419+0000","last_change":"2023-07-11T00:31:49.462609+0000","last_active":"2023-07-11T00:31:50.463419+0000","last_peered":"2023-07-11T00:31:50.463419+0000","last_clean":"2023-07-11T00:31:50.463419+0000","last_became_active":"2023-07-11T00:31:49.462325+0000","last_became_peered":"2023-07-11T00:31:49.462325+0000","last_unstale":"2023-07-11T00:31:50.463419+0000","last_undegraded":"2023-07-11T00:31:50.463419+0000","last_fullsized":"2023-07-11T00:31:50.463419+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:23:53.308490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.551984+0000","last_change":"2023-07-11T00:31:49.462968+0000","last_active":"2023-07-11T00:31:50.551984+0000","last_peered":"2023-07-11T00:31:50.551984+0000","last_clean":"2023-07-11T00:31:50.551984+0000","last_became_active":"2023-07-11T00:31:49.462697+0000","last_became_peered":"2023-07-11T00:31:49.462697+0000","last_unstale":"2023-07-11T00:31:50.551984+0000","last_undegraded":"2023-07-11T00:31:50.551984+0000","last_fullsized":"2023-07-11T00:31:50.551984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:48:44.300412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548391+0000","last_change":"2023-07-11T00:31:49.468478+0000","last_active":"2023-07-11T00:31:50.548391+0000","last_peered":"2023-07-11T00:31:50.548391+0000","last_clean":"2023-07-11T00:31:50.548391+0000","last_became_active":"2023-07-11T00:31:49.468182+0000","last_became_peered":"2023-07-11T00:31:49.468182+0000","last_unstale":"2023-07-11T00:31:50.548391+0000","last_undegraded":"2023-07-11T00:31:50.548391+0000","last_fullsized":"2023-07-11T00:31:50.548391+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:29:49.167209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930497+0000","last_change":"2023-07-11T00:31:49.464098+0000","last_active":"2023-07-11T00:31:50.930497+0000","last_peered":"2023-07-11T00:31:50.930497+0000","last_clean":"2023-07-11T00:31:50.930497+0000","last_became_active":"2023-07-11T00:31:49.463328+0000","last_became_peered":"2023-07-11T00:31:49.463328+0000","last_unstale":"2023-07-11T00:31:50.930497+0000","last_undegraded":"2023-07-11T00:31:50.930497+0000","last_fullsized":"2023-07-11T00:31:50.930497+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:58:30.504188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.841000+0000","last_change":"2023-07-11T00:31:49.460009+0000","last_active":"2023-07-11T00:31:50.841000+0000","last_peered":"2023-07-11T00:31:50.841000+0000","last_clean":"2023-07-11T00:31:50.841000+0000","last_became_active":"2023-07-11T00:31:49.459703+0000","last_became_peered":"2023-07-11T00:31:49.459703+0000","last_unstale":"2023-07-11T00:31:50.841000+0000","last_undegraded":"2023-07-11T00:31:50.841000+0000","last_fullsized":"2023-07-11T00:31:50.841000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:35:36.955611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"37'4","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548845+0000","last_change":"2023-07-11T00:31:48.464531+0000","last_active":"2023-07-11T00:31:50.548845+0000","last_peered":"2023-07-11T00:31:50.548845+0000","last_clean":"2023-07-11T00:31:50.548845+0000","last_became_active":"2023-07-11T00:31:48.464245+0000","last_became_peered":"2023-07-11T00:31:48.464245+0000","last_unstale":"2023-07-11T00:31:50.548845+0000","last_undegraded":"2023-07-11T00:31:50.548845+0000","last_fullsized":"2023-07-11T00:31:50.548845+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:02:57.607091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463942+0000","last_change":"2023-07-11T00:31:49.452941+0000","last_active":"2023-07-11T00:31:50.463942+0000","last_peered":"2023-07-11T00:31:50.463942+0000","last_clean":"2023-07-11T00:31:50.463942+0000","last_became_active":"2023-07-11T00:31:49.452650+0000","last_became_peered":"2023-07-11T00:31:49.452650+0000","last_unstale":"2023-07-11T00:31:50.463942+0000","last_undegraded":"2023-07-11T00:31:50.463942+0000","last_fullsized":"2023-07-11T00:31:50.463942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:15:14.531915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552277+0000","last_change":"2023-07-11T00:31:48.465456+0000","last_active":"2023-07-11T00:31:50.552277+0000","last_peered":"2023-07-11T00:31:50.552277+0000","last_clean":"2023-07-11T00:31:50.552277+0000","last_became_active":"2023-07-11T00:31:48.465170+0000","last_became_peered":"2023-07-11T00:31:48.465170+0000","last_unstale":"2023-07-11T00:31:50.552277+0000","last_undegraded":"2023-07-11T00:31:50.552277+0000","last_fullsized":"2023-07-11T00:31:50.552277+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:14:57.064669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930927+0000","last_change":"2023-07-11T00:31:49.476732+0000","last_active":"2023-07-11T00:31:50.930927+0000","last_peered":"2023-07-11T00:31:50.930927+0000","last_clean":"2023-07-11T00:31:50.930927+0000","last_became_active":"2023-07-11T00:31:49.476428+0000","last_became_peered":"2023-07-11T00:31:49.476428+0000","last_unstale":"2023-07-11T00:31:50.930927+0000","last_undegraded":"2023-07-11T00:31:50.930927+0000","last_fullsized":"2023-07-11T00:31:50.930927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:03:51.889314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.840965+0000","last_change":"2023-07-11T00:31:48.456071+0000","last_active":"2023-07-11T00:31:50.840965+0000","last_peered":"2023-07-11T00:31:50.840965+0000","last_clean":"2023-07-11T00:31:50.840965+0000","last_became_active":"2023-07-11T00:31:48.455736+0000","last_became_peered":"2023-07-11T00:31:48.455736+0000","last_unstale":"2023-07-11T00:31:50.840965+0000","last_undegraded":"2023-07-11T00:31:50.840965+0000","last_fullsized":"2023-07-11T00:31:50.840965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:29:10.538359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.841038+0000","last_change":"2023-07-11T00:31:49.461523+0000","last_active":"2023-07-11T00:31:50.841038+0000","last_peered":"2023-07-11T00:31:50.841038+0000","last_clean":"2023-07-11T00:31:50.841038+0000","last_became_active":"2023-07-11T00:31:49.460767+0000","last_became_peered":"2023-07-11T00:31:49.460767+0000","last_unstale":"2023-07-11T00:31:50.841038+0000","last_undegraded":"2023-07-11T00:31:50.841038+0000","last_fullsized":"2023-07-11T00:31:50.841038+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:57:01.874861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465466+0000","last_change":"2023-07-11T00:31:48.455929+0000","last_active":"2023-07-11T00:31:50.465466+0000","last_peered":"2023-07-11T00:31:50.465466+0000","last_clean":"2023-07-11T00:31:50.465466+0000","last_became_active":"2023-07-11T00:31:48.455661+0000","last_became_peered":"2023-07-11T00:31:48.455661+0000","last_unstale":"2023-07-11T00:31:50.465466+0000","last_undegraded":"2023-07-11T00:31:50.465466+0000","last_fullsized":"2023-07-11T00:31:50.465466+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:38:01.335308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552119+0000","last_change":"2023-07-11T00:31:49.456344+0000","last_active":"2023-07-11T00:31:50.552119+0000","last_peered":"2023-07-11T00:31:50.552119+0000","last_clean":"2023-07-11T00:31:50.552119+0000","last_became_active":"2023-07-11T00:31:49.456067+0000","last_became_peered":"2023-07-11T00:31:49.456067+0000","last_unstale":"2023-07-11T00:31:50.552119+0000","last_undegraded":"2023-07-11T00:31:50.552119+0000","last_fullsized":"2023-07-11T00:31:50.552119+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:38:22.725063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548757+0000","last_change":"2023-07-11T00:31:48.454117+0000","last_active":"2023-07-11T00:31:50.548757+0000","last_peered":"2023-07-11T00:31:50.548757+0000","last_clean":"2023-07-11T00:31:50.548757+0000","last_became_active":"2023-07-11T00:31:48.453120+0000","last_became_peered":"2023-07-11T00:31:48.453120+0000","last_unstale":"2023-07-11T00:31:50.548757+0000","last_undegraded":"2023-07-11T00:31:50.548757+0000","last_fullsized":"2023-07-11T00:31:50.548757+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:59:08.190881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464030+0000","last_change":"2023-07-11T00:31:49.468724+0000","last_active":"2023-07-11T00:31:50.464030+0000","last_peered":"2023-07-11T00:31:50.464030+0000","last_clean":"2023-07-11T00:31:50.464030+0000","last_became_active":"2023-07-11T00:31:49.468103+0000","last_became_peered":"2023-07-11T00:31:49.468103+0000","last_unstale":"2023-07-11T00:31:50.464030+0000","last_undegraded":"2023-07-11T00:31:50.464030+0000","last_fullsized":"2023-07-11T00:31:50.464030+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:06:35.344642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552091+0000","last_change":"2023-07-11T00:31:48.460722+0000","last_active":"2023-07-11T00:31:50.552091+0000","last_peered":"2023-07-11T00:31:50.552091+0000","last_clean":"2023-07-11T00:31:50.552091+0000","last_became_active":"2023-07-11T00:31:48.460108+0000","last_became_peered":"2023-07-11T00:31:48.460108+0000","last_unstale":"2023-07-11T00:31:50.552091+0000","last_undegraded":"2023-07-11T00:31:50.552091+0000","last_fullsized":"2023-07-11T00:31:50.552091+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:52:55.184931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463756+0000","last_change":"2023-07-11T00:31:49.475377+0000","last_active":"2023-07-11T00:31:50.463756+0000","last_peered":"2023-07-11T00:31:50.463756+0000","last_clean":"2023-07-11T00:31:50.463756+0000","last_became_active":"2023-07-11T00:31:49.474744+0000","last_became_peered":"2023-07-11T00:31:49.474744+0000","last_unstale":"2023-07-11T00:31:50.463756+0000","last_undegraded":"2023-07-11T00:31:50.463756+0000","last_fullsized":"2023-07-11T00:31:50.463756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:34:16.011592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930635+0000","last_change":"2023-07-11T00:31:48.452786+0000","last_active":"2023-07-11T00:31:50.930635+0000","last_peered":"2023-07-11T00:31:50.930635+0000","last_clean":"2023-07-11T00:31:50.930635+0000","last_became_active":"2023-07-11T00:31:48.452491+0000","last_became_peered":"2023-07-11T00:31:48.452491+0000","last_unstale":"2023-07-11T00:31:50.930635+0000","last_undegraded":"2023-07-11T00:31:50.930635+0000","last_fullsized":"2023-07-11T00:31:50.930635+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:55:32.320931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463400+0000","last_change":"2023-07-11T00:31:49.464049+0000","last_active":"2023-07-11T00:31:50.463400+0000","last_peered":"2023-07-11T00:31:50.463400+0000","last_clean":"2023-07-11T00:31:50.463400+0000","last_became_active":"2023-07-11T00:31:49.463709+0000","last_became_peered":"2023-07-11T00:31:49.463709+0000","last_unstale":"2023-07-11T00:31:50.463400+0000","last_undegraded":"2023-07-11T00:31:50.463400+0000","last_fullsized":"2023-07-11T00:31:50.463400+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:10:30.034097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463864+0000","last_change":"2023-07-11T00:31:48.452945+0000","last_active":"2023-07-11T00:31:50.463864+0000","last_peered":"2023-07-11T00:31:50.463864+0000","last_clean":"2023-07-11T00:31:50.463864+0000","last_became_active":"2023-07-11T00:31:48.452673+0000","last_became_peered":"2023-07-11T00:31:48.452673+0000","last_unstale":"2023-07-11T00:31:50.463864+0000","last_undegraded":"2023-07-11T00:31:50.463864+0000","last_fullsized":"2023-07-11T00:31:50.463864+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:12:42.857074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552174+0000","last_change":"2023-07-11T00:31:49.469671+0000","last_active":"2023-07-11T00:31:50.552174+0000","last_peered":"2023-07-11T00:31:50.552174+0000","last_clean":"2023-07-11T00:31:50.552174+0000","last_became_active":"2023-07-11T00:31:49.469372+0000","last_became_peered":"2023-07-11T00:31:49.469372+0000","last_unstale":"2023-07-11T00:31:50.552174+0000","last_undegraded":"2023-07-11T00:31:50.552174+0000","last_fullsized":"2023-07-11T00:31:50.552174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:43:27.154891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552424+0000","last_change":"2023-07-11T00:31:48.459990+0000","last_active":"2023-07-11T00:31:50.552424+0000","last_peered":"2023-07-11T00:31:50.552424+0000","last_clean":"2023-07-11T00:31:50.552424+0000","last_became_active":"2023-07-11T00:31:48.459720+0000","last_became_peered":"2023-07-11T00:31:48.459720+0000","last_unstale":"2023-07-11T00:31:50.552424+0000","last_undegraded":"2023-07-11T00:31:50.552424+0000","last_fullsized":"2023-07-11T00:31:50.552424+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:16:19.619668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465482+0000","last_change":"2023-07-11T00:31:49.467742+0000","last_active":"2023-07-11T00:31:50.465482+0000","last_peered":"2023-07-11T00:31:50.465482+0000","last_clean":"2023-07-11T00:31:50.465482+0000","last_became_active":"2023-07-11T00:31:49.467428+0000","last_became_peered":"2023-07-11T00:31:49.467428+0000","last_unstale":"2023-07-11T00:31:50.465482+0000","last_undegraded":"2023-07-11T00:31:50.465482+0000","last_fullsized":"2023-07-11T00:31:50.465482+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:55:03.029006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464531+0000","last_change":"2023-07-11T00:31:48.457902+0000","last_active":"2023-07-11T00:31:50.464531+0000","last_peered":"2023-07-11T00:31:50.464531+0000","last_clean":"2023-07-11T00:31:50.464531+0000","last_became_active":"2023-07-11T00:31:48.457412+0000","last_became_peered":"2023-07-11T00:31:48.457412+0000","last_unstale":"2023-07-11T00:31:50.464531+0000","last_undegraded":"2023-07-11T00:31:50.464531+0000","last_fullsized":"2023-07-11T00:31:50.464531+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:56:55.793084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548818+0000","last_change":"2023-07-11T00:31:49.457276+0000","last_active":"2023-07-11T00:31:50.548818+0000","last_peered":"2023-07-11T00:31:50.548818+0000","last_clean":"2023-07-11T00:31:50.548818+0000","last_became_active":"2023-07-11T00:31:49.456945+0000","last_became_peered":"2023-07-11T00:31:49.456945+0000","last_unstale":"2023-07-11T00:31:50.548818+0000","last_undegraded":"2023-07-11T00:31:50.548818+0000","last_fullsized":"2023-07-11T00:31:50.548818+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:06:58.029031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465487+0000","last_change":"2023-07-11T00:31:48.466071+0000","last_active":"2023-07-11T00:31:50.465487+0000","last_peered":"2023-07-11T00:31:50.465487+0000","last_clean":"2023-07-11T00:31:50.465487+0000","last_became_active":"2023-07-11T00:31:48.465805+0000","last_became_peered":"2023-07-11T00:31:48.465805+0000","last_unstale":"2023-07-11T00:31:50.465487+0000","last_undegraded":"2023-07-11T00:31:50.465487+0000","last_fullsized":"2023-07-11T00:31:50.465487+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:00:20.861071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465231+0000","last_change":"2023-07-11T00:31:49.462951+0000","last_active":"2023-07-11T00:31:50.465231+0000","last_peered":"2023-07-11T00:31:50.465231+0000","last_clean":"2023-07-11T00:31:50.465231+0000","last_became_active":"2023-07-11T00:31:49.462697+0000","last_became_peered":"2023-07-11T00:31:49.462697+0000","last_unstale":"2023-07-11T00:31:50.465231+0000","last_undegraded":"2023-07-11T00:31:50.465231+0000","last_fullsized":"2023-07-11T00:31:50.465231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:54:39.325193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930767+0000","last_change":"2023-07-11T00:31:48.460219+0000","last_active":"2023-07-11T00:31:50.930767+0000","last_peered":"2023-07-11T00:31:50.930767+0000","last_clean":"2023-07-11T00:31:50.930767+0000","last_became_active":"2023-07-11T00:31:48.459912+0000","last_became_peered":"2023-07-11T00:31:48.459912+0000","last_unstale":"2023-07-11T00:31:50.930767+0000","last_undegraded":"2023-07-11T00:31:50.930767+0000","last_fullsized":"2023-07-11T00:31:50.930767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:45:19.175378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463739+0000","last_change":"2023-07-11T00:31:49.475294+0000","last_active":"2023-07-11T00:31:50.463739+0000","last_peered":"2023-07-11T00:31:50.463739+0000","last_clean":"2023-07-11T00:31:50.463739+0000","last_became_active":"2023-07-11T00:31:49.474989+0000","last_became_peered":"2023-07-11T00:31:49.474989+0000","last_unstale":"2023-07-11T00:31:50.463739+0000","last_undegraded":"2023-07-11T00:31:50.463739+0000","last_fullsized":"2023-07-11T00:31:50.463739+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:37:56.551481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548601+0000","last_change":"2023-07-11T00:31:48.459454+0000","last_active":"2023-07-11T00:31:50.548601+0000","last_peered":"2023-07-11T00:31:50.548601+0000","last_clean":"2023-07-11T00:31:50.548601+0000","last_became_active":"2023-07-11T00:31:48.459171+0000","last_became_peered":"2023-07-11T00:31:48.459171+0000","last_unstale":"2023-07-11T00:31:50.548601+0000","last_undegraded":"2023-07-11T00:31:50.548601+0000","last_fullsized":"2023-07-11T00:31:50.548601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:45:57.125951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464177+0000","last_change":"2023-07-11T00:31:49.465444+0000","last_active":"2023-07-11T00:31:50.464177+0000","last_peered":"2023-07-11T00:31:50.464177+0000","last_clean":"2023-07-11T00:31:50.464177+0000","last_became_active":"2023-07-11T00:31:49.465153+0000","last_became_peered":"2023-07-11T00:31:49.465153+0000","last_unstale":"2023-07-11T00:31:50.464177+0000","last_undegraded":"2023-07-11T00:31:50.464177+0000","last_fullsized":"2023-07-11T00:31:50.464177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:03:51.889314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465230+0000","last_change":"2023-07-11T00:31:48.451216+0000","last_active":"2023-07-11T00:31:50.465230+0000","last_peered":"2023-07-11T00:31:50.465230+0000","last_clean":"2023-07-11T00:31:50.465230+0000","last_became_active":"2023-07-11T00:31:48.450908+0000","last_became_peered":"2023-07-11T00:31:48.450908+0000","last_unstale":"2023-07-11T00:31:50.465230+0000","last_undegraded":"2023-07-11T00:31:50.465230+0000","last_fullsized":"2023-07-11T00:31:50.465230+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:26:43.963576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548338+0000","last_change":"2023-07-11T00:31:49.457334+0000","last_active":"2023-07-11T00:31:50.548338+0000","last_peered":"2023-07-11T00:31:50.548338+0000","last_clean":"2023-07-11T00:31:50.548338+0000","last_became_active":"2023-07-11T00:31:49.457007+0000","last_became_peered":"2023-07-11T00:31:49.457007+0000","last_unstale":"2023-07-11T00:31:50.548338+0000","last_undegraded":"2023-07-11T00:31:50.548338+0000","last_fullsized":"2023-07-11T00:31:50.548338+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:10:23.036418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548644+0000","last_change":"2023-07-11T00:31:48.459371+0000","last_active":"2023-07-11T00:31:50.548644+0000","last_peered":"2023-07-11T00:31:50.548644+0000","last_clean":"2023-07-11T00:31:50.548644+0000","last_became_active":"2023-07-11T00:31:48.459074+0000","last_became_peered":"2023-07-11T00:31:48.459074+0000","last_unstale":"2023-07-11T00:31:50.548644+0000","last_undegraded":"2023-07-11T00:31:50.548644+0000","last_fullsized":"2023-07-11T00:31:50.548644+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:14:58.023063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465233+0000","last_change":"2023-07-11T00:31:49.469862+0000","last_active":"2023-07-11T00:31:50.465233+0000","last_peered":"2023-07-11T00:31:50.465233+0000","last_clean":"2023-07-11T00:31:50.465233+0000","last_became_active":"2023-07-11T00:31:49.469579+0000","last_became_peered":"2023-07-11T00:31:49.469579+0000","last_unstale":"2023-07-11T00:31:50.465233+0000","last_undegraded":"2023-07-11T00:31:50.465233+0000","last_fullsized":"2023-07-11T00:31:50.465233+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:23:24.823459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"37'8","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464039+0000","last_change":"2023-07-11T00:31:48.453039+0000","last_active":"2023-07-11T00:31:50.464039+0000","last_peered":"2023-07-11T00:31:50.464039+0000","last_clean":"2023-07-11T00:31:50.464039+0000","last_became_active":"2023-07-11T00:31:48.452775+0000","last_became_peered":"2023-07-11T00:31:48.452775+0000","last_unstale":"2023-07-11T00:31:50.464039+0000","last_undegraded":"2023-07-11T00:31:50.464039+0000","last_fullsized":"2023-07-11T00:31:50.464039+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:55:13.814371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930818+0000","last_change":"2023-07-11T00:31:49.467791+0000","last_active":"2023-07-11T00:31:50.930818+0000","last_peered":"2023-07-11T00:31:50.930818+0000","last_clean":"2023-07-11T00:31:50.930818+0000","last_became_active":"2023-07-11T00:31:49.467496+0000","last_became_peered":"2023-07-11T00:31:49.467496+0000","last_unstale":"2023-07-11T00:31:50.930818+0000","last_undegraded":"2023-07-11T00:31:50.930818+0000","last_fullsized":"2023-07-11T00:31:50.930818+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:41:11.170234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930655+0000","last_change":"2023-07-11T00:31:48.454390+0000","last_active":"2023-07-11T00:31:50.930655+0000","last_peered":"2023-07-11T00:31:50.930655+0000","last_clean":"2023-07-11T00:31:50.930655+0000","last_became_active":"2023-07-11T00:31:48.453977+0000","last_became_peered":"2023-07-11T00:31:48.453977+0000","last_unstale":"2023-07-11T00:31:50.930655+0000","last_undegraded":"2023-07-11T00:31:50.930655+0000","last_fullsized":"2023-07-11T00:31:50.930655+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:16:44.595511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464437+0000","last_change":"2023-07-11T00:31:49.475446+0000","last_active":"2023-07-11T00:31:50.464437+0000","last_peered":"2023-07-11T00:31:50.464437+0000","last_clean":"2023-07-11T00:31:50.464437+0000","last_became_active":"2023-07-11T00:31:49.475131+0000","last_became_peered":"2023-07-11T00:31:49.475131+0000","last_unstale":"2023-07-11T00:31:50.464437+0000","last_undegraded":"2023-07-11T00:31:50.464437+0000","last_fullsized":"2023-07-11T00:31:50.464437+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:06:54.099393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552284+0000","last_change":"2023-07-11T00:31:48.457843+0000","last_active":"2023-07-11T00:31:50.552284+0000","last_peered":"2023-07-11T00:31:50.552284+0000","last_clean":"2023-07-11T00:31:50.552284+0000","last_became_active":"2023-07-11T00:31:48.457582+0000","last_became_peered":"2023-07-11T00:31:48.457582+0000","last_unstale":"2023-07-11T00:31:50.552284+0000","last_undegraded":"2023-07-11T00:31:50.552284+0000","last_fullsized":"2023-07-11T00:31:50.552284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:56:00.183592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463667+0000","last_change":"2023-07-11T00:31:49.461645+0000","last_active":"2023-07-11T00:31:50.463667+0000","last_peered":"2023-07-11T00:31:50.463667+0000","last_clean":"2023-07-11T00:31:50.463667+0000","last_became_active":"2023-07-11T00:31:49.461362+0000","last_became_peered":"2023-07-11T00:31:49.461362+0000","last_unstale":"2023-07-11T00:31:50.463667+0000","last_undegraded":"2023-07-11T00:31:50.463667+0000","last_fullsized":"2023-07-11T00:31:50.463667+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:19:18.644430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.931052+0000","last_change":"2023-07-11T00:31:48.453565+0000","last_active":"2023-07-11T00:31:50.931052+0000","last_peered":"2023-07-11T00:31:50.931052+0000","last_clean":"2023-07-11T00:31:50.931052+0000","last_became_active":"2023-07-11T00:31:48.453289+0000","last_became_peered":"2023-07-11T00:31:48.453289+0000","last_unstale":"2023-07-11T00:31:50.931052+0000","last_undegraded":"2023-07-11T00:31:50.931052+0000","last_fullsized":"2023-07-11T00:31:50.931052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:51:13.554586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464048+0000","last_change":"2023-07-11T00:31:49.461206+0000","last_active":"2023-07-11T00:31:50.464048+0000","last_peered":"2023-07-11T00:31:50.464048+0000","last_clean":"2023-07-11T00:31:50.464048+0000","last_became_active":"2023-07-11T00:31:49.460915+0000","last_became_peered":"2023-07-11T00:31:49.460915+0000","last_unstale":"2023-07-11T00:31:50.464048+0000","last_undegraded":"2023-07-11T00:31:50.464048+0000","last_fullsized":"2023-07-11T00:31:50.464048+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:09:59.566658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548620+0000","last_change":"2023-07-11T00:31:48.464387+0000","last_active":"2023-07-11T00:31:50.548620+0000","last_peered":"2023-07-11T00:31:50.548620+0000","last_clean":"2023-07-11T00:31:50.548620+0000","last_became_active":"2023-07-11T00:31:48.463976+0000","last_became_peered":"2023-07-11T00:31:48.463976+0000","last_unstale":"2023-07-11T00:31:50.548620+0000","last_undegraded":"2023-07-11T00:31:50.548620+0000","last_fullsized":"2023-07-11T00:31:50.548620+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:46:01.127469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548356+0000","last_change":"2023-07-11T00:31:49.457373+0000","last_active":"2023-07-11T00:31:50.548356+0000","last_peered":"2023-07-11T00:31:50.548356+0000","last_clean":"2023-07-11T00:31:50.548356+0000","last_became_active":"2023-07-11T00:31:49.456989+0000","last_became_peered":"2023-07-11T00:31:49.456989+0000","last_unstale":"2023-07-11T00:31:50.548356+0000","last_undegraded":"2023-07-11T00:31:50.548356+0000","last_fullsized":"2023-07-11T00:31:50.548356+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:45:48.093542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548633+0000","last_change":"2023-07-11T00:31:48.454291+0000","last_active":"2023-07-11T00:31:50.548633+0000","last_peered":"2023-07-11T00:31:50.548633+0000","last_clean":"2023-07-11T00:31:50.548633+0000","last_became_active":"2023-07-11T00:31:48.453556+0000","last_became_peered":"2023-07-11T00:31:48.453556+0000","last_unstale":"2023-07-11T00:31:50.548633+0000","last_undegraded":"2023-07-11T00:31:50.548633+0000","last_fullsized":"2023-07-11T00:31:50.548633+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:59:13.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.840786+0000","last_change":"2023-07-11T00:31:49.470003+0000","last_active":"2023-07-11T00:31:50.840786+0000","last_peered":"2023-07-11T00:31:50.840786+0000","last_clean":"2023-07-11T00:31:50.840786+0000","last_became_active":"2023-07-11T00:31:49.469739+0000","last_became_peered":"2023-07-11T00:31:49.469739+0000","last_unstale":"2023-07-11T00:31:50.840786+0000","last_undegraded":"2023-07-11T00:31:50.840786+0000","last_fullsized":"2023-07-11T00:31:50.840786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:46:08.980085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930728+0000","last_change":"2023-07-11T00:31:48.464395+0000","last_active":"2023-07-11T00:31:50.930728+0000","last_peered":"2023-07-11T00:31:50.930728+0000","last_clean":"2023-07-11T00:31:50.930728+0000","last_became_active":"2023-07-11T00:31:48.464089+0000","last_became_peered":"2023-07-11T00:31:48.464089+0000","last_unstale":"2023-07-11T00:31:50.930728+0000","last_undegraded":"2023-07-11T00:31:50.930728+0000","last_fullsized":"2023-07-11T00:31:50.930728+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:55:13.814371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930551+0000","last_change":"2023-07-11T00:31:49.458863+0000","last_active":"2023-07-11T00:31:50.930551+0000","last_peered":"2023-07-11T00:31:50.930551+0000","last_clean":"2023-07-11T00:31:50.930551+0000","last_became_active":"2023-07-11T00:31:49.458587+0000","last_became_peered":"2023-07-11T00:31:49.458587+0000","last_unstale":"2023-07-11T00:31:50.930551+0000","last_undegraded":"2023-07-11T00:31:50.930551+0000","last_fullsized":"2023-07-11T00:31:50.930551+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:58:35.054271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463676+0000","last_change":"2023-07-11T00:31:48.457841+0000","last_active":"2023-07-11T00:31:50.463676+0000","last_peered":"2023-07-11T00:31:50.463676+0000","last_clean":"2023-07-11T00:31:50.463676+0000","last_became_active":"2023-07-11T00:31:48.457470+0000","last_became_peered":"2023-07-11T00:31:48.457470+0000","last_unstale":"2023-07-11T00:31:50.463676+0000","last_undegraded":"2023-07-11T00:31:50.463676+0000","last_fullsized":"2023-07-11T00:31:50.463676+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:52:38.330454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463812+0000","last_change":"2023-07-11T00:31:49.466813+0000","last_active":"2023-07-11T00:31:50.463812+0000","last_peered":"2023-07-11T00:31:50.463812+0000","last_clean":"2023-07-11T00:31:50.463812+0000","last_became_active":"2023-07-11T00:31:49.466466+0000","last_became_peered":"2023-07-11T00:31:49.466466+0000","last_unstale":"2023-07-11T00:31:50.463812+0000","last_undegraded":"2023-07-11T00:31:50.463812+0000","last_fullsized":"2023-07-11T00:31:50.463812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:00:06.489225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464625+0000","last_change":"2023-07-11T00:31:48.449708+0000","last_active":"2023-07-11T00:31:50.464625+0000","last_peered":"2023-07-11T00:31:50.464625+0000","last_clean":"2023-07-11T00:31:50.464625+0000","last_became_active":"2023-07-11T00:31:48.449399+0000","last_became_peered":"2023-07-11T00:31:48.449399+0000","last_unstale":"2023-07-11T00:31:50.464625+0000","last_undegraded":"2023-07-11T00:31:50.464625+0000","last_fullsized":"2023-07-11T00:31:50.464625+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:31:41.789660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548512+0000","last_change":"2023-07-11T00:31:49.458138+0000","last_active":"2023-07-11T00:31:50.548512+0000","last_peered":"2023-07-11T00:31:50.548512+0000","last_clean":"2023-07-11T00:31:50.548512+0000","last_became_active":"2023-07-11T00:31:49.457794+0000","last_became_peered":"2023-07-11T00:31:49.457794+0000","last_unstale":"2023-07-11T00:31:50.548512+0000","last_undegraded":"2023-07-11T00:31:50.548512+0000","last_fullsized":"2023-07-11T00:31:50.548512+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:30:43.373895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552268+0000","last_change":"2023-07-11T00:31:48.460880+0000","last_active":"2023-07-11T00:31:50.552268+0000","last_peered":"2023-07-11T00:31:50.552268+0000","last_clean":"2023-07-11T00:31:50.552268+0000","last_became_active":"2023-07-11T00:31:48.460428+0000","last_became_peered":"2023-07-11T00:31:48.460428+0000","last_unstale":"2023-07-11T00:31:50.552268+0000","last_undegraded":"2023-07-11T00:31:50.552268+0000","last_fullsized":"2023-07-11T00:31:50.552268+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:23:34.138695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552092+0000","last_change":"2023-07-11T00:29:59.627086+0000","last_active":"2023-07-11T00:31:50.552092+0000","last_peered":"2023-07-11T00:31:50.552092+0000","last_clean":"2023-07-11T00:31:50.552092+0000","last_became_active":"2023-07-11T00:29:59.626687+0000","last_became_peered":"2023-07-11T00:29:59.626687+0000","last_unstale":"2023-07-11T00:31:50.552092+0000","last_undegraded":"2023-07-11T00:31:50.552092+0000","last_fullsized":"2023-07-11T00:31:50.552092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:05:05.999803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548573+0000","last_change":"2023-07-11T00:31:49.462940+0000","last_active":"2023-07-11T00:31:50.548573+0000","last_peered":"2023-07-11T00:31:50.548573+0000","last_clean":"2023-07-11T00:31:50.548573+0000","last_became_active":"2023-07-11T00:31:49.462662+0000","last_became_peered":"2023-07-11T00:31:49.462662+0000","last_unstale":"2023-07-11T00:31:50.548573+0000","last_undegraded":"2023-07-11T00:31:50.548573+0000","last_fullsized":"2023-07-11T00:31:50.548573+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:24:33.910258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465231+0000","last_change":"2023-07-11T00:31:48.462340+0000","last_active":"2023-07-11T00:31:50.465231+0000","last_peered":"2023-07-11T00:31:50.465231+0000","last_clean":"2023-07-11T00:31:50.465231+0000","last_became_active":"2023-07-11T00:31:48.462048+0000","last_became_peered":"2023-07-11T00:31:48.462048+0000","last_unstale":"2023-07-11T00:31:50.465231+0000","last_undegraded":"2023-07-11T00:31:50.465231+0000","last_fullsized":"2023-07-11T00:31:50.465231+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:57:05.902050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548741+0000","last_change":"2023-07-11T00:29:59.589317+0000","last_active":"2023-07-11T00:31:50.548741+0000","last_peered":"2023-07-11T00:31:50.548741+0000","last_clean":"2023-07-11T00:31:50.548741+0000","last_became_active":"2023-07-11T00:29:59.588926+0000","last_became_peered":"2023-07-11T00:29:59.588926+0000","last_unstale":"2023-07-11T00:31:50.548741+0000","last_undegraded":"2023-07-11T00:31:50.548741+0000","last_fullsized":"2023-07-11T00:31:50.548741+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:33:59.990479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465483+0000","last_change":"2023-07-11T00:31:49.462413+0000","last_active":"2023-07-11T00:31:50.465483+0000","last_peered":"2023-07-11T00:31:50.465483+0000","last_clean":"2023-07-11T00:31:50.465483+0000","last_became_active":"2023-07-11T00:31:49.462056+0000","last_became_peered":"2023-07-11T00:31:49.462056+0000","last_unstale":"2023-07-11T00:31:50.465483+0000","last_undegraded":"2023-07-11T00:31:50.465483+0000","last_fullsized":"2023-07-11T00:31:50.465483+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:08:47.268896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.840768+0000","last_change":"2023-07-11T00:31:48.459774+0000","last_active":"2023-07-11T00:31:50.840768+0000","last_peered":"2023-07-11T00:31:50.840768+0000","last_clean":"2023-07-11T00:31:50.840768+0000","last_became_active":"2023-07-11T00:31:48.459485+0000","last_became_peered":"2023-07-11T00:31:48.459485+0000","last_unstale":"2023-07-11T00:31:50.840768+0000","last_undegraded":"2023-07-11T00:31:50.840768+0000","last_fullsized":"2023-07-11T00:31:50.840768+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:53:50.852325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.840732+0000","last_change":"2023-07-11T00:29:59.585672+0000","last_active":"2023-07-11T00:31:50.840732+0000","last_peered":"2023-07-11T00:31:50.840732+0000","last_clean":"2023-07-11T00:31:50.840732+0000","last_became_active":"2023-07-11T00:29:59.585405+0000","last_became_peered":"2023-07-11T00:29:59.585405+0000","last_unstale":"2023-07-11T00:31:50.840732+0000","last_undegraded":"2023-07-11T00:31:50.840732+0000","last_fullsized":"2023-07-11T00:31:50.840732+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:20:01.273572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":199,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464825+0000","last_change":"2023-07-11T00:29:59.589132+0000","last_active":"2023-07-11T00:31:50.464825+0000","last_peered":"2023-07-11T00:31:50.464825+0000","last_clean":"2023-07-11T00:31:50.464825+0000","last_became_active":"2023-07-11T00:29:59.588293+0000","last_became_peered":"2023-07-11T00:29:59.588293+0000","last_unstale":"2023-07-11T00:31:50.464825+0000","last_undegraded":"2023-07-11T00:31:50.464825+0000","last_fullsized":"2023-07-11T00:31:50.464825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:38:20.599991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464125+0000","last_change":"2023-07-11T00:31:49.467643+0000","last_active":"2023-07-11T00:31:50.464125+0000","last_peered":"2023-07-11T00:31:50.464125+0000","last_clean":"2023-07-11T00:31:50.464125+0000","last_became_active":"2023-07-11T00:31:49.467390+0000","last_became_peered":"2023-07-11T00:31:49.467390+0000","last_unstale":"2023-07-11T00:31:50.464125+0000","last_undegraded":"2023-07-11T00:31:50.464125+0000","last_fullsized":"2023-07-11T00:31:50.464125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:35:16.582529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465583+0000","last_change":"2023-07-11T00:31:48.465932+0000","last_active":"2023-07-11T00:31:50.465583+0000","last_peered":"2023-07-11T00:31:50.465583+0000","last_clean":"2023-07-11T00:31:50.465583+0000","last_became_active":"2023-07-11T00:31:48.465433+0000","last_became_peered":"2023-07-11T00:31:48.465433+0000","last_unstale":"2023-07-11T00:31:50.465583+0000","last_undegraded":"2023-07-11T00:31:50.465583+0000","last_fullsized":"2023-07-11T00:31:50.465583+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:32:31.160541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465260+0000","last_change":"2023-07-11T00:29:59.978997+0000","last_active":"2023-07-11T00:31:50.465260+0000","last_peered":"2023-07-11T00:31:50.465260+0000","last_clean":"2023-07-11T00:31:50.465260+0000","last_became_active":"2023-07-11T00:29:59.978716+0000","last_became_peered":"2023-07-11T00:29:59.978716+0000","last_unstale":"2023-07-11T00:31:50.465260+0000","last_undegraded":"2023-07-11T00:31:50.465260+0000","last_fullsized":"2023-07-11T00:31:50.465260+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:42:25.875263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464456+0000","last_change":"2023-07-11T00:31:49.464724+0000","last_active":"2023-07-11T00:31:50.464456+0000","last_peered":"2023-07-11T00:31:50.464456+0000","last_clean":"2023-07-11T00:31:50.464456+0000","last_became_active":"2023-07-11T00:31:49.464410+0000","last_became_peered":"2023-07-11T00:31:49.464410+0000","last_unstale":"2023-07-11T00:31:50.464456+0000","last_undegraded":"2023-07-11T00:31:50.464456+0000","last_fullsized":"2023-07-11T00:31:50.464456+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:44:25.921005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.931177+0000","last_change":"2023-07-11T00:31:48.453012+0000","last_active":"2023-07-11T00:31:50.931177+0000","last_peered":"2023-07-11T00:31:50.931177+0000","last_clean":"2023-07-11T00:31:50.931177+0000","last_became_active":"2023-07-11T00:31:48.452702+0000","last_became_peered":"2023-07-11T00:31:48.452702+0000","last_unstale":"2023-07-11T00:31:50.931177+0000","last_undegraded":"2023-07-11T00:31:50.931177+0000","last_fullsized":"2023-07-11T00:31:50.931177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:06:53.093944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464823+0000","last_change":"2023-07-11T00:29:59.978976+0000","last_active":"2023-07-11T00:31:50.464823+0000","last_peered":"2023-07-11T00:31:50.464823+0000","last_clean":"2023-07-11T00:31:50.464823+0000","last_became_active":"2023-07-11T00:29:59.978678+0000","last_became_peered":"2023-07-11T00:29:59.978678+0000","last_unstale":"2023-07-11T00:31:50.464823+0000","last_undegraded":"2023-07-11T00:31:50.464823+0000","last_fullsized":"2023-07-11T00:31:50.464823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:50:49.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464049+0000","last_change":"2023-07-11T00:31:49.475079+0000","last_active":"2023-07-11T00:31:50.464049+0000","last_peered":"2023-07-11T00:31:50.464049+0000","last_clean":"2023-07-11T00:31:50.464049+0000","last_became_active":"2023-07-11T00:31:49.474768+0000","last_became_peered":"2023-07-11T00:31:49.474768+0000","last_unstale":"2023-07-11T00:31:50.464049+0000","last_undegraded":"2023-07-11T00:31:50.464049+0000","last_fullsized":"2023-07-11T00:31:50.464049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:35:29.061426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548773+0000","last_change":"2023-07-11T00:31:48.461436+0000","last_active":"2023-07-11T00:31:50.548773+0000","last_peered":"2023-07-11T00:31:50.548773+0000","last_clean":"2023-07-11T00:31:50.548773+0000","last_became_active":"2023-07-11T00:31:48.461132+0000","last_became_peered":"2023-07-11T00:31:48.461132+0000","last_unstale":"2023-07-11T00:31:50.548773+0000","last_undegraded":"2023-07-11T00:31:50.548773+0000","last_fullsized":"2023-07-11T00:31:50.548773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:58:34.998041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930753+0000","last_change":"2023-07-11T00:29:59.979163+0000","last_active":"2023-07-11T00:31:50.930753+0000","last_peered":"2023-07-11T00:31:50.930753+0000","last_clean":"2023-07-11T00:31:50.930753+0000","last_became_active":"2023-07-11T00:29:59.978751+0000","last_became_peered":"2023-07-11T00:29:59.978751+0000","last_unstale":"2023-07-11T00:31:50.930753+0000","last_undegraded":"2023-07-11T00:31:50.930753+0000","last_fullsized":"2023-07-11T00:31:50.930753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:04:45.489808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930630+0000","last_change":"2023-07-11T00:31:49.465942+0000","last_active":"2023-07-11T00:31:50.930630+0000","last_peered":"2023-07-11T00:31:50.930630+0000","last_clean":"2023-07-11T00:31:50.930630+0000","last_became_active":"2023-07-11T00:31:49.465627+0000","last_became_peered":"2023-07-11T00:31:49.465627+0000","last_unstale":"2023-07-11T00:31:50.930630+0000","last_undegraded":"2023-07-11T00:31:50.930630+0000","last_fullsized":"2023-07-11T00:31:50.930630+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:07.266780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.840640+0000","last_change":"2023-07-11T00:31:48.462834+0000","last_active":"2023-07-11T00:31:50.840640+0000","last_peered":"2023-07-11T00:31:50.840640+0000","last_clean":"2023-07-11T00:31:50.840640+0000","last_became_active":"2023-07-11T00:31:48.462167+0000","last_became_peered":"2023-07-11T00:31:48.462167+0000","last_unstale":"2023-07-11T00:31:50.840640+0000","last_undegraded":"2023-07-11T00:31:50.840640+0000","last_fullsized":"2023-07-11T00:31:50.840640+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:28:20.214160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463784+0000","last_change":"2023-07-11T00:29:59.978981+0000","last_active":"2023-07-11T00:31:50.463784+0000","last_peered":"2023-07-11T00:31:50.463784+0000","last_clean":"2023-07-11T00:31:50.463784+0000","last_became_active":"2023-07-11T00:29:59.978633+0000","last_became_peered":"2023-07-11T00:29:59.978633+0000","last_unstale":"2023-07-11T00:31:50.463784+0000","last_undegraded":"2023-07-11T00:31:50.463784+0000","last_fullsized":"2023-07-11T00:31:50.463784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:07:35.112456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.551938+0000","last_change":"2023-07-11T00:31:49.457970+0000","last_active":"2023-07-11T00:31:50.551938+0000","last_peered":"2023-07-11T00:31:50.551938+0000","last_clean":"2023-07-11T00:31:50.551938+0000","last_became_active":"2023-07-11T00:31:49.457706+0000","last_became_peered":"2023-07-11T00:31:49.457706+0000","last_unstale":"2023-07-11T00:31:50.551938+0000","last_undegraded":"2023-07-11T00:31:50.551938+0000","last_fullsized":"2023-07-11T00:31:50.551938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:57:21.898195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464183+0000","last_change":"2023-07-11T00:31:48.458841+0000","last_active":"2023-07-11T00:31:50.464183+0000","last_peered":"2023-07-11T00:31:50.464183+0000","last_clean":"2023-07-11T00:31:50.464183+0000","last_became_active":"2023-07-11T00:31:48.458577+0000","last_became_peered":"2023-07-11T00:31:48.458577+0000","last_unstale":"2023-07-11T00:31:50.464183+0000","last_undegraded":"2023-07-11T00:31:50.464183+0000","last_fullsized":"2023-07-11T00:31:50.464183+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:51:13.554586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464200+0000","last_change":"2023-07-11T00:29:59.585652+0000","last_active":"2023-07-11T00:31:50.464200+0000","last_peered":"2023-07-11T00:31:50.464200+0000","last_clean":"2023-07-11T00:31:50.464200+0000","last_became_active":"2023-07-11T00:29:59.585316+0000","last_became_peered":"2023-07-11T00:29:59.585316+0000","last_unstale":"2023-07-11T00:31:50.464200+0000","last_undegraded":"2023-07-11T00:31:50.464200+0000","last_fullsized":"2023-07-11T00:31:50.464200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:06:59.351986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":788075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.67000000000000004}]},{"osd":1,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.89000000000000001}]},{"osd":2,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.84899999999999998}]},{"osd":3,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.87},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.94199999999999995}]},{"osd":4,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.62}]},{"osd":5,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.754}]},{"osd":6,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.92100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":196928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":8.9930000000000003,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":4.8150000000000004,"5min":4.8150000000000004,"15min":4.8150000000000004},"last":0.80500000000000005}]},{"osd":1,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":4.9800000000000004,"5min":4.9800000000000004,"15min":4.9800000000000004},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.76600000000000001}]},{"osd":2,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":3.0790000000000002,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":0.88900000000000001}]},{"osd":3,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":10.978999999999999,"5min":10.978999999999999,"15min":10.978999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":4.8300000000000001,"5min":4.8300000000000001,"15min":4.8300000000000001},"last":0.69299999999999995}]},{"osd":4,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":6.2309999999999999,"5min":6.2309999999999999,"15min":6.2309999999999999},"last":0.64800000000000002}]},{"osd":5,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":0.748},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.92300000000000004}]},{"osd":7,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.87}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":788055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.502},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47599999999999998}]},{"osd":2,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.55500000000000005}]},{"osd":3,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.628},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.65200000000000002}]},{"osd":6,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.61199999999999999}]},{"osd":7,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.59999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":196290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.47999999999999998}]},{"osd":2,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.376}]},{"osd":3,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.46300000000000002}]},{"osd":4,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67000000000000004}]},{"osd":5,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.505}]},{"osd":6,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.624}]},{"osd":7,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.59099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":199203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":3.2989999999999999,"5min":3.2989999999999999,"15min":3.2989999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.47699999999999998}]},{"osd":1,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.437},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.024,"5min":3.024,"15min":3.024},"last":0.53200000000000003}]},{"osd":3,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":3.0779999999999998,"5min":3.0779999999999998,"15min":3.0779999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.3330000000000002,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.56399999999999995}]},{"osd":4,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.2200000000000002,"5min":3.2200000000000002,"15min":3.2200000000000002},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.78700000000000003}]},{"osd":5,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":3.2629999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":0.88900000000000001}]},{"osd":6,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.879}]},{"osd":7,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.91700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":196894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":10.938000000000001,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.42399999999999999}]},{"osd":1,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":10.874000000000001,"5min":10.874000000000001,"15min":10.874000000000001},"last":0.48899999999999999}]},{"osd":2,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":11.050000000000001,"5min":11.050000000000001,"15min":11.050000000000001},"last":0.45500000000000002}]},{"osd":4,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":0.65700000000000003}]},{"osd":5,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":11.015000000000001,"5min":11.015000000000001,"15min":11.015000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":10.978,"5min":10.978,"15min":10.978},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.67700000000000005}]},{"osd":7,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.79400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":199181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.871,"5min":2.871,"15min":2.871},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.622}]},{"osd":1,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.90500000000000003}]},{"osd":2,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.75800000000000001}]},{"osd":3,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":7.6790000000000003,"5min":7.6790000000000003,"15min":7.6790000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.81699999999999995}]},{"osd":5,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.95499999999999996}]},{"osd":6,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.872}]},{"osd":7,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.73999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":196326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.53800000000000003}]},{"osd":1,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.81699999999999995}]},{"osd":2,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.71699999999999997}]},{"osd":3,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.69299999999999995}]},{"osd":4,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.875},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.65400000000000003}]},{"osd":6,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.069},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.92200000000000004}]},{"osd":7,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.747}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-11T00:31:58.913 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-11T00:31:59.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.125+0000 7fa7fcfff700 1 Processor -- start 2023-07-11T00:31:59.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.125+0000 7fa7fcfff700 1 -- start start 2023-07-11T00:31:59.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.126+0000 7fa7fcfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa7f80d2640 0x7fa7f80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:59.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.126+0000 7fa7fcfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa7f80cf8f0 0x7fa7f815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:59.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.126+0000 7fa7fcfff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f80d1790 con 0x7fa7f815c460 2023-07-11T00:31:59.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.126+0000 7fa7fcfff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f80cedd0 con 0x7fa7f80cf8f0 2023-07-11T00:31:59.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.126+0000 7fa7fcfff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f80cd950 con 0x7fa7f80d2640 2023-07-11T00:31:59.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.127+0000 7fa7f659c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa7f815c460 0x7fa7f80cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57316/0 (socket says 172.21.15.22:57316) 2023-07-11T00:31:59.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.127+0000 7fa7f659c700 1 -- 172.21.15.22:0/567931547 learned_addr learned my addr 172.21.15.22:0/567931547 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:59.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.127+0000 7fa7f6d9d700 1 --2- 172.21.15.22:0/567931547 >> v2:172.21.15.22:3300/0 conn(0x7fa7f80cf8f0 0x7fa7f815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:59.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.127+0000 7fa7f5d9b700 1 --2- 172.21.15.22:0/567931547 >> v2:172.21.15.184:3300/0 conn(0x7fa7f80d2640 0x7fa7f80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:59.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.127+0000 7fa7f6d9d700 1 -- 172.21.15.22:0/567931547 >> v2:172.21.15.184:3300/0 conn(0x7fa7f80d2640 msgr2=0x7fa7f80b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:59.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.127+0000 7fa7f6d9d700 1 --2- 172.21.15.22:0/567931547 >> v2:172.21.15.184:3300/0 conn(0x7fa7f80d2640 0x7fa7f80b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.127+0000 7fa7f6d9d700 1 -- 172.21.15.22:0/567931547 >> v1:172.21.15.22:6789/0 conn(0x7fa7f815c460 legacy=0x7fa7f80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:59.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.127+0000 7fa7f559a700 1 -- 172.21.15.22:0/567931547 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792863409 0 0) 0x7fa7f80d1790 con 0x7fa7f815c460 2023-07-11T00:31:59.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.127+0000 7fa7f6d9d700 1 -- 172.21.15.22:0/567931547 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f80d14b0 con 0x7fa7f80cf8f0 2023-07-11T00:31:59.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.127+0000 7fa7f6d9d700 1 --2- 172.21.15.22:0/567931547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f80cf8f0 0x7fa7f815fe20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa7f815fd80 tx=0x7fa7f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd23798fd38b199 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:59.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.128+0000 7fa7f559a700 1 -- 172.21.15.22:0/567931547 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f000e070 con 0x7fa7f80cf8f0 2023-07-11T00:31:59.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.128+0000 7fa7f559a700 1 -- 172.21.15.22:0/567931547 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f000bbd0 con 0x7fa7f80cf8f0 2023-07-11T00:31:59.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.128+0000 7fa7f559a700 1 -- 172.21.15.22:0/567931547 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0012430 con 0x7fa7f80cf8f0 2023-07-11T00:31:59.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.128+0000 7fa7fcfff700 1 -- 172.21.15.22:0/567931547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f80cf8f0 msgr2=0x7fa7f815fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:59.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.128+0000 7fa7fcfff700 1 --2- 172.21.15.22:0/567931547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f80cf8f0 0x7fa7f815fe20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa7f815fd80 tx=0x7fa7f000b330 comp rx=0 tx=0).stop 2023-07-11T00:31:59.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.128+0000 7fa7fcfff700 1 -- 172.21.15.22:0/567931547 shutdown_connections 2023-07-11T00:31:59.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.128+0000 7fa7fcfff700 1 --2- 172.21.15.22:0/567931547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f80cf8f0 0x7fa7f815fe20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.128+0000 7fa7fcfff700 1 --2- 172.21.15.22:0/567931547 >> v2:172.21.15.184:3300/0 conn(0x7fa7f80d2640 0x7fa7f80b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.128+0000 7fa7fcfff700 1 -- 172.21.15.22:0/567931547 >> 172.21.15.22:0/567931547 conn(0x7fa7f8071660 msgr2=0x7fa7f8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:59.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.128+0000 7fa7fcfff700 1 -- 172.21.15.22:0/567931547 shutdown_connections 2023-07-11T00:31:59.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.128+0000 7fa7fcfff700 1 -- 172.21.15.22:0/567931547 wait complete. 2023-07-11T00:31:59.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.130+0000 7fa7fcfff700 1 Processor -- start 2023-07-11T00:31:59.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.130+0000 7fa7fcfff700 1 -- start start 2023-07-11T00:31:59.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.131+0000 7fa7fcfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f80cf8f0 0x7fa7f815d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:59.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.131+0000 7fa7fcfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f80d2640 0x7fa7f80cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:59.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.131+0000 7fa7fcfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7f815c460 0x7fa7f80cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:59.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.131+0000 7fa7fcfff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f8150940 con 0x7fa7f80cf8f0 2023-07-11T00:31:59.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.131+0000 7fa7fcfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f80c6a20 con 0x7fa7f815c460 2023-07-11T00:31:59.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.131+0000 7fa7fcfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f815f7d0 con 0x7fa7f80d2640 2023-07-11T00:31:59.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.131+0000 7fa7f659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f80cf8f0 0x7fa7f815d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:59.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.131+0000 7fa7f659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f80cf8f0 0x7fa7f815d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49072/0 (socket says 172.21.15.22:49072) 2023-07-11T00:31:59.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.132+0000 7fa7f659c700 1 -- 172.21.15.22:0/3865585115 learned_addr learned my addr 172.21.15.22:0/3865585115 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:59.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.132+0000 7fa7f6d9d700 1 --2- 172.21.15.22:0/3865585115 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7f815c460 0x7fa7f80cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:59.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.132+0000 7fa7f5d9b700 1 --2- 172.21.15.22:0/3865585115 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f80d2640 0x7fa7f80cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:59.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.132+0000 7fa7f659c700 1 -- 172.21.15.22:0/3865585115 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f80d2640 msgr2=0x7fa7f80cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:59.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.132+0000 7fa7f659c700 1 --2- 172.21.15.22:0/3865585115 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f80d2640 0x7fa7f80cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.132+0000 7fa7f659c700 1 -- 172.21.15.22:0/3865585115 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7f815c460 msgr2=0x7fa7f80cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:59.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.132+0000 7fa7f659c700 1 --2- 172.21.15.22:0/3865585115 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7f815c460 0x7fa7f80cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.132+0000 7fa7f659c700 1 -- 172.21.15.22:0/3865585115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f0009a70 con 0x7fa7f80cf8f0 2023-07-11T00:31:59.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.132+0000 7fa7f5d9b700 1 --2- 172.21.15.22:0/3865585115 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f80d2640 0x7fa7f80cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:31:59.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.132+0000 7fa7f659c700 1 --2- 172.21.15.22:0/3865585115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f80cf8f0 0x7fa7f815d240 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80011e0 tx=0x7fa7e800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:59.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.132+0000 7fa7e6ffd700 1 -- 172.21.15.22:0/3865585115 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8004c80 con 0x7fa7f80cf8f0 2023-07-11T00:31:59.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.132+0000 7fa7e6ffd700 1 -- 172.21.15.22:0/3865585115 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e8004de0 con 0x7fa7f80cf8f0 2023-07-11T00:31:59.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.132+0000 7fa7e6ffd700 1 -- 172.21.15.22:0/3865585115 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8007310 con 0x7fa7f80cf8f0 2023-07-11T00:31:59.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.132+0000 7fa7fcfff700 1 -- 172.21.15.22:0/3865585115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f815c8d0 con 0x7fa7f80cf8f0 2023-07-11T00:31:59.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.133+0000 7fa7fcfff700 1 -- 172.21.15.22:0/3865585115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f815cb40 con 0x7fa7f80cf8f0 2023-07-11T00:31:59.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.134+0000 7fa7fcfff700 1 -- 172.21.15.22:0/3865585115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f804ea60 con 0x7fa7f80cf8f0 2023-07-11T00:31:59.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.135+0000 7fa7e6ffd700 1 -- 172.21.15.22:0/3865585115 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa7e8007470 con 0x7fa7f80cf8f0 2023-07-11T00:31:59.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.136+0000 7fa7e6ffd700 1 --2- 172.21.15.22:0/3865585115 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa7d806ace0 0x7fa7d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:59.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.136+0000 7fa7e6ffd700 1 -- 172.21.15.22:0/3865585115 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa7e8089300 con 0x7fa7f80cf8f0 2023-07-11T00:31:59.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.136+0000 7fa7f5d9b700 1 --2- 172.21.15.22:0/3865585115 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa7d806ace0 0x7fa7d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:59.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.137+0000 7fa7f5d9b700 1 --2- 172.21.15.22:0/3865585115 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa7d806ace0 0x7fa7d806d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa7f815bc00 tx=0x7fa7ec008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:59.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.140+0000 7fa7e6ffd700 1 -- 172.21.15.22:0/3865585115 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa7e8054260 con 0x7fa7f80cf8f0 2023-07-11T00:31:59.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.343+0000 7fa7fcfff700 1 -- 172.21.15.22:0/3865585115 --> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7f80cd5e0 con 0x7fa7d806ace0 2023-07-11T00:31:59.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.353+0000 7fa7e6ffd700 1 -- 172.21.15.22:0/3865585115 <== mgr.4114 v2:172.21.15.184:6832/380612710 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311099 (secure 0 0 0) 0x7fa7ec007e90 con 0x7fa7d806ace0 2023-07-11T00:31:59.358 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:31:59.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.357+0000 7fa7fcfff700 1 -- 172.21.15.22:0/3865585115 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa7d806ace0 msgr2=0x7fa7d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:59.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.357+0000 7fa7fcfff700 1 --2- 172.21.15.22:0/3865585115 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa7d806ace0 0x7fa7d806d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa7f815bc00 tx=0x7fa7ec008040 comp rx=0 tx=0).stop 2023-07-11T00:31:59.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.357+0000 7fa7fcfff700 1 -- 172.21.15.22:0/3865585115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f80cf8f0 msgr2=0x7fa7f815d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:59.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.357+0000 7fa7fcfff700 1 --2- 172.21.15.22:0/3865585115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f80cf8f0 0x7fa7f815d240 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80011e0 tx=0x7fa7e800ca30 comp rx=0 tx=0).stop 2023-07-11T00:31:59.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.357+0000 7fa7fcfff700 1 -- 172.21.15.22:0/3865585115 shutdown_connections 2023-07-11T00:31:59.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.357+0000 7fa7fcfff700 1 --2- 172.21.15.22:0/3865585115 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fa7d806ace0 0x7fa7d806d190 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.357+0000 7fa7fcfff700 1 --2- 172.21.15.22:0/3865585115 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7f815c460 0x7fa7f80cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.357+0000 7fa7fcfff700 1 --2- 172.21.15.22:0/3865585115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f80cf8f0 0x7fa7f815d240 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.357+0000 7fa7fcfff700 1 --2- 172.21.15.22:0/3865585115 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f80d2640 0x7fa7f80cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.357+0000 7fa7fcfff700 1 -- 172.21.15.22:0/3865585115 >> 172.21.15.22:0/3865585115 conn(0x7fa7f8071660 msgr2=0x7fa7f80b8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:59.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.357+0000 7fa7fcfff700 1 -- 172.21.15.22:0/3865585115 shutdown_connections 2023-07-11T00:31:59.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.357+0000 7fa7fcfff700 1 -- 172.21.15.22:0/3865585115 wait complete. 2023-07-11T00:31:59.363 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-07-11T00:31:59.378 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-07-11T00:31:58.519511+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220804,"kb_used_data":4632,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753916,"statfs":{"total":773094113280,"available":772868009984,"internally_reserved":0,"allocated":4743168,"data_stored":2760952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.079474"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465327+0000","last_change":"2023-07-11T00:31:49.457897+0000","last_active":"2023-07-11T00:31:50.465327+0000","last_peered":"2023-07-11T00:31:50.465327+0000","last_clean":"2023-07-11T00:31:50.465327+0000","last_became_active":"2023-07-11T00:31:49.457621+0000","last_became_peered":"2023-07-11T00:31:49.457621+0000","last_unstale":"2023-07-11T00:31:50.465327+0000","last_undegraded":"2023-07-11T00:31:50.465327+0000","last_fullsized":"2023-07-11T00:31:50.465327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:36:38.046459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.931074+0000","last_change":"2023-07-11T00:31:49.473191+0000","last_active":"2023-07-11T00:31:50.931074+0000","last_peered":"2023-07-11T00:31:50.931074+0000","last_clean":"2023-07-11T00:31:50.931074+0000","last_became_active":"2023-07-11T00:31:49.472875+0000","last_became_peered":"2023-07-11T00:31:49.472875+0000","last_unstale":"2023-07-11T00:31:50.931074+0000","last_undegraded":"2023-07-11T00:31:50.931074+0000","last_fullsized":"2023-07-11T00:31:50.931074+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:41:36.203534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.551975+0000","last_change":"2023-07-11T00:31:49.460150+0000","last_active":"2023-07-11T00:31:50.551975+0000","last_peered":"2023-07-11T00:31:50.551975+0000","last_clean":"2023-07-11T00:31:50.551975+0000","last_became_active":"2023-07-11T00:31:49.459860+0000","last_became_peered":"2023-07-11T00:31:49.459860+0000","last_unstale":"2023-07-11T00:31:50.551975+0000","last_undegraded":"2023-07-11T00:31:50.551975+0000","last_fullsized":"2023-07-11T00:31:50.551975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:27:24.039242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464008+0000","last_change":"2023-07-11T00:31:49.468186+0000","last_active":"2023-07-11T00:31:50.464008+0000","last_peered":"2023-07-11T00:31:50.464008+0000","last_clean":"2023-07-11T00:31:50.464008+0000","last_became_active":"2023-07-11T00:31:49.467915+0000","last_became_peered":"2023-07-11T00:31:49.467915+0000","last_unstale":"2023-07-11T00:31:50.464008+0000","last_undegraded":"2023-07-11T00:31:50.464008+0000","last_fullsized":"2023-07-11T00:31:50.464008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:55:33.326380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930832+0000","last_change":"2023-07-11T00:31:49.473162+0000","last_active":"2023-07-11T00:31:50.930832+0000","last_peered":"2023-07-11T00:31:50.930832+0000","last_clean":"2023-07-11T00:31:50.930832+0000","last_became_active":"2023-07-11T00:31:49.472848+0000","last_became_peered":"2023-07-11T00:31:49.472848+0000","last_unstale":"2023-07-11T00:31:50.930832+0000","last_undegraded":"2023-07-11T00:31:50.930832+0000","last_fullsized":"2023-07-11T00:31:50.930832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:35:16.582529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548485+0000","last_change":"2023-07-11T00:31:49.464936+0000","last_active":"2023-07-11T00:31:50.548485+0000","last_peered":"2023-07-11T00:31:50.548485+0000","last_clean":"2023-07-11T00:31:50.548485+0000","last_became_active":"2023-07-11T00:31:49.464652+0000","last_became_peered":"2023-07-11T00:31:49.464652+0000","last_unstale":"2023-07-11T00:31:50.548485+0000","last_undegraded":"2023-07-11T00:31:50.548485+0000","last_fullsized":"2023-07-11T00:31:50.548485+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:20:53.763650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465000+0000","last_change":"2023-07-11T00:31:49.462815+0000","last_active":"2023-07-11T00:31:50.465000+0000","last_peered":"2023-07-11T00:31:50.465000+0000","last_clean":"2023-07-11T00:31:50.465000+0000","last_became_active":"2023-07-11T00:31:49.462552+0000","last_became_peered":"2023-07-11T00:31:49.462552+0000","last_unstale":"2023-07-11T00:31:50.465000+0000","last_undegraded":"2023-07-11T00:31:50.465000+0000","last_fullsized":"2023-07-11T00:31:50.465000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:35:37.845496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464195+0000","last_change":"2023-07-11T00:31:49.475568+0000","last_active":"2023-07-11T00:31:50.464195+0000","last_peered":"2023-07-11T00:31:50.464195+0000","last_clean":"2023-07-11T00:31:50.464195+0000","last_became_active":"2023-07-11T00:31:49.475071+0000","last_became_peered":"2023-07-11T00:31:49.475071+0000","last_unstale":"2023-07-11T00:31:50.464195+0000","last_undegraded":"2023-07-11T00:31:50.464195+0000","last_fullsized":"2023-07-11T00:31:50.464195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:41:36.203534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464307+0000","last_change":"2023-07-11T00:31:49.467110+0000","last_active":"2023-07-11T00:31:50.464307+0000","last_peered":"2023-07-11T00:31:50.464307+0000","last_clean":"2023-07-11T00:31:50.464307+0000","last_became_active":"2023-07-11T00:31:49.466742+0000","last_became_peered":"2023-07-11T00:31:49.466742+0000","last_unstale":"2023-07-11T00:31:50.464307+0000","last_undegraded":"2023-07-11T00:31:50.464307+0000","last_fullsized":"2023-07-11T00:31:50.464307+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:47:53.130660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464445+0000","last_change":"2023-07-11T00:31:49.473011+0000","last_active":"2023-07-11T00:31:50.464445+0000","last_peered":"2023-07-11T00:31:50.464445+0000","last_clean":"2023-07-11T00:31:50.464445+0000","last_became_active":"2023-07-11T00:31:49.472475+0000","last_became_peered":"2023-07-11T00:31:49.472475+0000","last_unstale":"2023-07-11T00:31:50.464445+0000","last_undegraded":"2023-07-11T00:31:50.464445+0000","last_fullsized":"2023-07-11T00:31:50.464445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:32:42.635952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464122+0000","last_change":"2023-07-11T00:31:49.467110+0000","last_active":"2023-07-11T00:31:50.464122+0000","last_peered":"2023-07-11T00:31:50.464122+0000","last_clean":"2023-07-11T00:31:50.464122+0000","last_became_active":"2023-07-11T00:31:49.466758+0000","last_became_peered":"2023-07-11T00:31:49.466758+0000","last_unstale":"2023-07-11T00:31:50.464122+0000","last_undegraded":"2023-07-11T00:31:50.464122+0000","last_fullsized":"2023-07-11T00:31:50.464122+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:29:22.209529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.931147+0000","last_change":"2023-07-11T00:31:49.477246+0000","last_active":"2023-07-11T00:31:50.931147+0000","last_peered":"2023-07-11T00:31:50.931147+0000","last_clean":"2023-07-11T00:31:50.931147+0000","last_became_active":"2023-07-11T00:31:49.476968+0000","last_became_peered":"2023-07-11T00:31:49.476968+0000","last_unstale":"2023-07-11T00:31:50.931147+0000","last_undegraded":"2023-07-11T00:31:50.931147+0000","last_fullsized":"2023-07-11T00:31:50.931147+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:47:53.130660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930624+0000","last_change":"2023-07-11T00:31:49.462029+0000","last_active":"2023-07-11T00:31:50.930624+0000","last_peered":"2023-07-11T00:31:50.930624+0000","last_clean":"2023-07-11T00:31:50.930624+0000","last_became_active":"2023-07-11T00:31:49.461742+0000","last_became_peered":"2023-07-11T00:31:49.461742+0000","last_unstale":"2023-07-11T00:31:50.930624+0000","last_undegraded":"2023-07-11T00:31:50.930624+0000","last_fullsized":"2023-07-11T00:31:50.930624+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:01:17.061286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463885+0000","last_change":"2023-07-11T00:31:49.466009+0000","last_active":"2023-07-11T00:31:50.463885+0000","last_peered":"2023-07-11T00:31:50.463885+0000","last_clean":"2023-07-11T00:31:50.463885+0000","last_became_active":"2023-07-11T00:31:49.465744+0000","last_became_peered":"2023-07-11T00:31:49.465744+0000","last_unstale":"2023-07-11T00:31:50.463885+0000","last_undegraded":"2023-07-11T00:31:50.463885+0000","last_fullsized":"2023-07-11T00:31:50.463885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:56:19.968064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548338+0000","last_change":"2023-07-11T00:31:49.452358+0000","last_active":"2023-07-11T00:31:50.548338+0000","last_peered":"2023-07-11T00:31:50.548338+0000","last_clean":"2023-07-11T00:31:50.548338+0000","last_became_active":"2023-07-11T00:31:49.452092+0000","last_became_peered":"2023-07-11T00:31:49.452092+0000","last_unstale":"2023-07-11T00:31:50.548338+0000","last_undegraded":"2023-07-11T00:31:50.548338+0000","last_fullsized":"2023-07-11T00:31:50.548338+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:55:51.717124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463191+0000","last_change":"2023-07-11T00:31:49.478955+0000","last_active":"2023-07-11T00:31:50.463191+0000","last_peered":"2023-07-11T00:31:50.463191+0000","last_clean":"2023-07-11T00:31:50.463191+0000","last_became_active":"2023-07-11T00:31:49.478658+0000","last_became_peered":"2023-07-11T00:31:49.478658+0000","last_unstale":"2023-07-11T00:31:50.463191+0000","last_undegraded":"2023-07-11T00:31:50.463191+0000","last_fullsized":"2023-07-11T00:31:50.463191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:19:53.824107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552403+0000","last_change":"2023-07-11T00:31:49.470584+0000","last_active":"2023-07-11T00:31:50.552403+0000","last_peered":"2023-07-11T00:31:50.552403+0000","last_clean":"2023-07-11T00:31:50.552403+0000","last_became_active":"2023-07-11T00:31:49.470227+0000","last_became_peered":"2023-07-11T00:31:49.470227+0000","last_unstale":"2023-07-11T00:31:50.552403+0000","last_undegraded":"2023-07-11T00:31:50.552403+0000","last_fullsized":"2023-07-11T00:31:50.552403+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:13:53.014748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552146+0000","last_change":"2023-07-11T00:31:49.473741+0000","last_active":"2023-07-11T00:31:50.552146+0000","last_peered":"2023-07-11T00:31:50.552146+0000","last_clean":"2023-07-11T00:31:50.552146+0000","last_became_active":"2023-07-11T00:31:49.473435+0000","last_became_peered":"2023-07-11T00:31:49.473435+0000","last_unstale":"2023-07-11T00:31:50.552146+0000","last_undegraded":"2023-07-11T00:31:50.552146+0000","last_fullsized":"2023-07-11T00:31:50.552146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:16:57.332196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463706+0000","last_change":"2023-07-11T00:31:49.475022+0000","last_active":"2023-07-11T00:31:50.463706+0000","last_peered":"2023-07-11T00:31:50.463706+0000","last_clean":"2023-07-11T00:31:50.463706+0000","last_became_active":"2023-07-11T00:31:49.474696+0000","last_became_peered":"2023-07-11T00:31:49.474696+0000","last_unstale":"2023-07-11T00:31:50.463706+0000","last_undegraded":"2023-07-11T00:31:50.463706+0000","last_fullsized":"2023-07-11T00:31:50.463706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:46:54.858536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930637+0000","last_change":"2023-07-11T00:31:49.467212+0000","last_active":"2023-07-11T00:31:50.930637+0000","last_peered":"2023-07-11T00:31:50.930637+0000","last_clean":"2023-07-11T00:31:50.930637+0000","last_became_active":"2023-07-11T00:31:49.466932+0000","last_became_peered":"2023-07-11T00:31:49.466932+0000","last_unstale":"2023-07-11T00:31:50.930637+0000","last_undegraded":"2023-07-11T00:31:50.930637+0000","last_fullsized":"2023-07-11T00:31:50.930637+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:52:10.312151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548480+0000","last_change":"2023-07-11T00:31:49.458482+0000","last_active":"2023-07-11T00:31:50.548480+0000","last_peered":"2023-07-11T00:31:50.548480+0000","last_clean":"2023-07-11T00:31:50.548480+0000","last_became_active":"2023-07-11T00:31:49.458224+0000","last_became_peered":"2023-07-11T00:31:49.458224+0000","last_unstale":"2023-07-11T00:31:50.548480+0000","last_undegraded":"2023-07-11T00:31:50.548480+0000","last_fullsized":"2023-07-11T00:31:50.548480+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:11:56.418499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463919+0000","last_change":"2023-07-11T00:31:49.463657+0000","last_active":"2023-07-11T00:31:50.463919+0000","last_peered":"2023-07-11T00:31:50.463919+0000","last_clean":"2023-07-11T00:31:50.463919+0000","last_became_active":"2023-07-11T00:31:49.463388+0000","last_became_peered":"2023-07-11T00:31:49.463388+0000","last_unstale":"2023-07-11T00:31:50.463919+0000","last_undegraded":"2023-07-11T00:31:50.463919+0000","last_fullsized":"2023-07-11T00:31:50.463919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:07.266780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463215+0000","last_change":"2023-07-11T00:31:49.463794+0000","last_active":"2023-07-11T00:31:50.463215+0000","last_peered":"2023-07-11T00:31:50.463215+0000","last_clean":"2023-07-11T00:31:50.463215+0000","last_became_active":"2023-07-11T00:31:49.463465+0000","last_became_peered":"2023-07-11T00:31:49.463465+0000","last_unstale":"2023-07-11T00:31:50.463215+0000","last_undegraded":"2023-07-11T00:31:50.463215+0000","last_fullsized":"2023-07-11T00:31:50.463215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:30:09.468212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463140+0000","last_change":"2023-07-11T00:31:49.465033+0000","last_active":"2023-07-11T00:31:50.463140+0000","last_peered":"2023-07-11T00:31:50.463140+0000","last_clean":"2023-07-11T00:31:50.463140+0000","last_became_active":"2023-07-11T00:31:49.464732+0000","last_became_peered":"2023-07-11T00:31:49.464732+0000","last_unstale":"2023-07-11T00:31:50.463140+0000","last_undegraded":"2023-07-11T00:31:50.463140+0000","last_fullsized":"2023-07-11T00:31:50.463140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:34:58.446331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464124+0000","last_change":"2023-07-11T00:31:49.461466+0000","last_active":"2023-07-11T00:31:50.464124+0000","last_peered":"2023-07-11T00:31:50.464124+0000","last_clean":"2023-07-11T00:31:50.464124+0000","last_became_active":"2023-07-11T00:31:49.461107+0000","last_became_peered":"2023-07-11T00:31:49.461107+0000","last_unstale":"2023-07-11T00:31:50.464124+0000","last_undegraded":"2023-07-11T00:31:50.464124+0000","last_fullsized":"2023-07-11T00:31:50.464124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:10:16.280197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930674+0000","last_change":"2023-07-11T00:31:49.456912+0000","last_active":"2023-07-11T00:31:50.930674+0000","last_peered":"2023-07-11T00:31:50.930674+0000","last_clean":"2023-07-11T00:31:50.930674+0000","last_became_active":"2023-07-11T00:31:49.456427+0000","last_became_peered":"2023-07-11T00:31:49.456427+0000","last_unstale":"2023-07-11T00:31:50.930674+0000","last_undegraded":"2023-07-11T00:31:50.930674+0000","last_fullsized":"2023-07-11T00:31:50.930674+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:14:05.564588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552122+0000","last_change":"2023-07-11T00:31:49.471242+0000","last_active":"2023-07-11T00:31:50.552122+0000","last_peered":"2023-07-11T00:31:50.552122+0000","last_clean":"2023-07-11T00:31:50.552122+0000","last_became_active":"2023-07-11T00:31:49.470925+0000","last_became_peered":"2023-07-11T00:31:49.470925+0000","last_unstale":"2023-07-11T00:31:50.552122+0000","last_undegraded":"2023-07-11T00:31:50.552122+0000","last_fullsized":"2023-07-11T00:31:50.552122+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:19:23.867053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930858+0000","last_change":"2023-07-11T00:31:49.477295+0000","last_active":"2023-07-11T00:31:50.930858+0000","last_peered":"2023-07-11T00:31:50.930858+0000","last_clean":"2023-07-11T00:31:50.930858+0000","last_became_active":"2023-07-11T00:31:49.476956+0000","last_became_peered":"2023-07-11T00:31:49.476956+0000","last_unstale":"2023-07-11T00:31:50.930858+0000","last_undegraded":"2023-07-11T00:31:50.930858+0000","last_fullsized":"2023-07-11T00:31:50.930858+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:29:22.209529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463419+0000","last_change":"2023-07-11T00:31:49.462609+0000","last_active":"2023-07-11T00:31:50.463419+0000","last_peered":"2023-07-11T00:31:50.463419+0000","last_clean":"2023-07-11T00:31:50.463419+0000","last_became_active":"2023-07-11T00:31:49.462325+0000","last_became_peered":"2023-07-11T00:31:49.462325+0000","last_unstale":"2023-07-11T00:31:50.463419+0000","last_undegraded":"2023-07-11T00:31:50.463419+0000","last_fullsized":"2023-07-11T00:31:50.463419+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:23:53.308490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.551984+0000","last_change":"2023-07-11T00:31:49.462968+0000","last_active":"2023-07-11T00:31:50.551984+0000","last_peered":"2023-07-11T00:31:50.551984+0000","last_clean":"2023-07-11T00:31:50.551984+0000","last_became_active":"2023-07-11T00:31:49.462697+0000","last_became_peered":"2023-07-11T00:31:49.462697+0000","last_unstale":"2023-07-11T00:31:50.551984+0000","last_undegraded":"2023-07-11T00:31:50.551984+0000","last_fullsized":"2023-07-11T00:31:50.551984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:48:44.300412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548391+0000","last_change":"2023-07-11T00:31:49.468478+0000","last_active":"2023-07-11T00:31:50.548391+0000","last_peered":"2023-07-11T00:31:50.548391+0000","last_clean":"2023-07-11T00:31:50.548391+0000","last_became_active":"2023-07-11T00:31:49.468182+0000","last_became_peered":"2023-07-11T00:31:49.468182+0000","last_unstale":"2023-07-11T00:31:50.548391+0000","last_undegraded":"2023-07-11T00:31:50.548391+0000","last_fullsized":"2023-07-11T00:31:50.548391+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:29:49.167209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930497+0000","last_change":"2023-07-11T00:31:49.464098+0000","last_active":"2023-07-11T00:31:50.930497+0000","last_peered":"2023-07-11T00:31:50.930497+0000","last_clean":"2023-07-11T00:31:50.930497+0000","last_became_active":"2023-07-11T00:31:49.463328+0000","last_became_peered":"2023-07-11T00:31:49.463328+0000","last_unstale":"2023-07-11T00:31:50.930497+0000","last_undegraded":"2023-07-11T00:31:50.930497+0000","last_fullsized":"2023-07-11T00:31:50.930497+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:58:30.504188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.841000+0000","last_change":"2023-07-11T00:31:49.460009+0000","last_active":"2023-07-11T00:31:50.841000+0000","last_peered":"2023-07-11T00:31:50.841000+0000","last_clean":"2023-07-11T00:31:50.841000+0000","last_became_active":"2023-07-11T00:31:49.459703+0000","last_became_peered":"2023-07-11T00:31:49.459703+0000","last_unstale":"2023-07-11T00:31:50.841000+0000","last_undegraded":"2023-07-11T00:31:50.841000+0000","last_fullsized":"2023-07-11T00:31:50.841000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:35:36.955611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"37'4","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548845+0000","last_change":"2023-07-11T00:31:48.464531+0000","last_active":"2023-07-11T00:31:50.548845+0000","last_peered":"2023-07-11T00:31:50.548845+0000","last_clean":"2023-07-11T00:31:50.548845+0000","last_became_active":"2023-07-11T00:31:48.464245+0000","last_became_peered":"2023-07-11T00:31:48.464245+0000","last_unstale":"2023-07-11T00:31:50.548845+0000","last_undegraded":"2023-07-11T00:31:50.548845+0000","last_fullsized":"2023-07-11T00:31:50.548845+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:02:57.607091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463942+0000","last_change":"2023-07-11T00:31:49.452941+0000","last_active":"2023-07-11T00:31:50.463942+0000","last_peered":"2023-07-11T00:31:50.463942+0000","last_clean":"2023-07-11T00:31:50.463942+0000","last_became_active":"2023-07-11T00:31:49.452650+0000","last_became_peered":"2023-07-11T00:31:49.452650+0000","last_unstale":"2023-07-11T00:31:50.463942+0000","last_undegraded":"2023-07-11T00:31:50.463942+0000","last_fullsized":"2023-07-11T00:31:50.463942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:15:14.531915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552277+0000","last_change":"2023-07-11T00:31:48.465456+0000","last_active":"2023-07-11T00:31:50.552277+0000","last_peered":"2023-07-11T00:31:50.552277+0000","last_clean":"2023-07-11T00:31:50.552277+0000","last_became_active":"2023-07-11T00:31:48.465170+0000","last_became_peered":"2023-07-11T00:31:48.465170+0000","last_unstale":"2023-07-11T00:31:50.552277+0000","last_undegraded":"2023-07-11T00:31:50.552277+0000","last_fullsized":"2023-07-11T00:31:50.552277+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:14:57.064669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930927+0000","last_change":"2023-07-11T00:31:49.476732+0000","last_active":"2023-07-11T00:31:50.930927+0000","last_peered":"2023-07-11T00:31:50.930927+0000","last_clean":"2023-07-11T00:31:50.930927+0000","last_became_active":"2023-07-11T00:31:49.476428+0000","last_became_peered":"2023-07-11T00:31:49.476428+0000","last_unstale":"2023-07-11T00:31:50.930927+0000","last_undegraded":"2023-07-11T00:31:50.930927+0000","last_fullsized":"2023-07-11T00:31:50.930927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:03:51.889314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.840965+0000","last_change":"2023-07-11T00:31:48.456071+0000","last_active":"2023-07-11T00:31:50.840965+0000","last_peered":"2023-07-11T00:31:50.840965+0000","last_clean":"2023-07-11T00:31:50.840965+0000","last_became_active":"2023-07-11T00:31:48.455736+0000","last_became_peered":"2023-07-11T00:31:48.455736+0000","last_unstale":"2023-07-11T00:31:50.840965+0000","last_undegraded":"2023-07-11T00:31:50.840965+0000","last_fullsized":"2023-07-11T00:31:50.840965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:29:10.538359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.841038+0000","last_change":"2023-07-11T00:31:49.461523+0000","last_active":"2023-07-11T00:31:50.841038+0000","last_peered":"2023-07-11T00:31:50.841038+0000","last_clean":"2023-07-11T00:31:50.841038+0000","last_became_active":"2023-07-11T00:31:49.460767+0000","last_became_peered":"2023-07-11T00:31:49.460767+0000","last_unstale":"2023-07-11T00:31:50.841038+0000","last_undegraded":"2023-07-11T00:31:50.841038+0000","last_fullsized":"2023-07-11T00:31:50.841038+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:57:01.874861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465466+0000","last_change":"2023-07-11T00:31:48.455929+0000","last_active":"2023-07-11T00:31:50.465466+0000","last_peered":"2023-07-11T00:31:50.465466+0000","last_clean":"2023-07-11T00:31:50.465466+0000","last_became_active":"2023-07-11T00:31:48.455661+0000","last_became_peered":"2023-07-11T00:31:48.455661+0000","last_unstale":"2023-07-11T00:31:50.465466+0000","last_undegraded":"2023-07-11T00:31:50.465466+0000","last_fullsized":"2023-07-11T00:31:50.465466+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:38:01.335308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552119+0000","last_change":"2023-07-11T00:31:49.456344+0000","last_active":"2023-07-11T00:31:50.552119+0000","last_peered":"2023-07-11T00:31:50.552119+0000","last_clean":"2023-07-11T00:31:50.552119+0000","last_became_active":"2023-07-11T00:31:49.456067+0000","last_became_peered":"2023-07-11T00:31:49.456067+0000","last_unstale":"2023-07-11T00:31:50.552119+0000","last_undegraded":"2023-07-11T00:31:50.552119+0000","last_fullsized":"2023-07-11T00:31:50.552119+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:38:22.725063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548757+0000","last_change":"2023-07-11T00:31:48.454117+0000","last_active":"2023-07-11T00:31:50.548757+0000","last_peered":"2023-07-11T00:31:50.548757+0000","last_clean":"2023-07-11T00:31:50.548757+0000","last_became_active":"2023-07-11T00:31:48.453120+0000","last_became_peered":"2023-07-11T00:31:48.453120+0000","last_unstale":"2023-07-11T00:31:50.548757+0000","last_undegraded":"2023-07-11T00:31:50.548757+0000","last_fullsized":"2023-07-11T00:31:50.548757+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:59:08.190881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464030+0000","last_change":"2023-07-11T00:31:49.468724+0000","last_active":"2023-07-11T00:31:50.464030+0000","last_peered":"2023-07-11T00:31:50.464030+0000","last_clean":"2023-07-11T00:31:50.464030+0000","last_became_active":"2023-07-11T00:31:49.468103+0000","last_became_peered":"2023-07-11T00:31:49.468103+0000","last_unstale":"2023-07-11T00:31:50.464030+0000","last_undegraded":"2023-07-11T00:31:50.464030+0000","last_fullsized":"2023-07-11T00:31:50.464030+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:06:35.344642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552091+0000","last_change":"2023-07-11T00:31:48.460722+0000","last_active":"2023-07-11T00:31:50.552091+0000","last_peered":"2023-07-11T00:31:50.552091+0000","last_clean":"2023-07-11T00:31:50.552091+0000","last_became_active":"2023-07-11T00:31:48.460108+0000","last_became_peered":"2023-07-11T00:31:48.460108+0000","last_unstale":"2023-07-11T00:31:50.552091+0000","last_undegraded":"2023-07-11T00:31:50.552091+0000","last_fullsized":"2023-07-11T00:31:50.552091+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:52:55.184931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463756+0000","last_change":"2023-07-11T00:31:49.475377+0000","last_active":"2023-07-11T00:31:50.463756+0000","last_peered":"2023-07-11T00:31:50.463756+0000","last_clean":"2023-07-11T00:31:50.463756+0000","last_became_active":"2023-07-11T00:31:49.474744+0000","last_became_peered":"2023-07-11T00:31:49.474744+0000","last_unstale":"2023-07-11T00:31:50.463756+0000","last_undegraded":"2023-07-11T00:31:50.463756+0000","last_fullsized":"2023-07-11T00:31:50.463756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:34:16.011592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930635+0000","last_change":"2023-07-11T00:31:48.452786+0000","last_active":"2023-07-11T00:31:50.930635+0000","last_peered":"2023-07-11T00:31:50.930635+0000","last_clean":"2023-07-11T00:31:50.930635+0000","last_became_active":"2023-07-11T00:31:48.452491+0000","last_became_peered":"2023-07-11T00:31:48.452491+0000","last_unstale":"2023-07-11T00:31:50.930635+0000","last_undegraded":"2023-07-11T00:31:50.930635+0000","last_fullsized":"2023-07-11T00:31:50.930635+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:55:32.320931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463400+0000","last_change":"2023-07-11T00:31:49.464049+0000","last_active":"2023-07-11T00:31:50.463400+0000","last_peered":"2023-07-11T00:31:50.463400+0000","last_clean":"2023-07-11T00:31:50.463400+0000","last_became_active":"2023-07-11T00:31:49.463709+0000","last_became_peered":"2023-07-11T00:31:49.463709+0000","last_unstale":"2023-07-11T00:31:50.463400+0000","last_undegraded":"2023-07-11T00:31:50.463400+0000","last_fullsized":"2023-07-11T00:31:50.463400+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:10:30.034097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463864+0000","last_change":"2023-07-11T00:31:48.452945+0000","last_active":"2023-07-11T00:31:50.463864+0000","last_peered":"2023-07-11T00:31:50.463864+0000","last_clean":"2023-07-11T00:31:50.463864+0000","last_became_active":"2023-07-11T00:31:48.452673+0000","last_became_peered":"2023-07-11T00:31:48.452673+0000","last_unstale":"2023-07-11T00:31:50.463864+0000","last_undegraded":"2023-07-11T00:31:50.463864+0000","last_fullsized":"2023-07-11T00:31:50.463864+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:12:42.857074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552174+0000","last_change":"2023-07-11T00:31:49.469671+0000","last_active":"2023-07-11T00:31:50.552174+0000","last_peered":"2023-07-11T00:31:50.552174+0000","last_clean":"2023-07-11T00:31:50.552174+0000","last_became_active":"2023-07-11T00:31:49.469372+0000","last_became_peered":"2023-07-11T00:31:49.469372+0000","last_unstale":"2023-07-11T00:31:50.552174+0000","last_undegraded":"2023-07-11T00:31:50.552174+0000","last_fullsized":"2023-07-11T00:31:50.552174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:43:27.154891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552424+0000","last_change":"2023-07-11T00:31:48.459990+0000","last_active":"2023-07-11T00:31:50.552424+0000","last_peered":"2023-07-11T00:31:50.552424+0000","last_clean":"2023-07-11T00:31:50.552424+0000","last_became_active":"2023-07-11T00:31:48.459720+0000","last_became_peered":"2023-07-11T00:31:48.459720+0000","last_unstale":"2023-07-11T00:31:50.552424+0000","last_undegraded":"2023-07-11T00:31:50.552424+0000","last_fullsized":"2023-07-11T00:31:50.552424+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:16:19.619668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465482+0000","last_change":"2023-07-11T00:31:49.467742+0000","last_active":"2023-07-11T00:31:50.465482+0000","last_peered":"2023-07-11T00:31:50.465482+0000","last_clean":"2023-07-11T00:31:50.465482+0000","last_became_active":"2023-07-11T00:31:49.467428+0000","last_became_peered":"2023-07-11T00:31:49.467428+0000","last_unstale":"2023-07-11T00:31:50.465482+0000","last_undegraded":"2023-07-11T00:31:50.465482+0000","last_fullsized":"2023-07-11T00:31:50.465482+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:55:03.029006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464531+0000","last_change":"2023-07-11T00:31:48.457902+0000","last_active":"2023-07-11T00:31:50.464531+0000","last_peered":"2023-07-11T00:31:50.464531+0000","last_clean":"2023-07-11T00:31:50.464531+0000","last_became_active":"2023-07-11T00:31:48.457412+0000","last_became_peered":"2023-07-11T00:31:48.457412+0000","last_unstale":"2023-07-11T00:31:50.464531+0000","last_undegraded":"2023-07-11T00:31:50.464531+0000","last_fullsized":"2023-07-11T00:31:50.464531+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:56:55.793084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548818+0000","last_change":"2023-07-11T00:31:49.457276+0000","last_active":"2023-07-11T00:31:50.548818+0000","last_peered":"2023-07-11T00:31:50.548818+0000","last_clean":"2023-07-11T00:31:50.548818+0000","last_became_active":"2023-07-11T00:31:49.456945+0000","last_became_peered":"2023-07-11T00:31:49.456945+0000","last_unstale":"2023-07-11T00:31:50.548818+0000","last_undegraded":"2023-07-11T00:31:50.548818+0000","last_fullsized":"2023-07-11T00:31:50.548818+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:06:58.029031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465487+0000","last_change":"2023-07-11T00:31:48.466071+0000","last_active":"2023-07-11T00:31:50.465487+0000","last_peered":"2023-07-11T00:31:50.465487+0000","last_clean":"2023-07-11T00:31:50.465487+0000","last_became_active":"2023-07-11T00:31:48.465805+0000","last_became_peered":"2023-07-11T00:31:48.465805+0000","last_unstale":"2023-07-11T00:31:50.465487+0000","last_undegraded":"2023-07-11T00:31:50.465487+0000","last_fullsized":"2023-07-11T00:31:50.465487+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:00:20.861071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465231+0000","last_change":"2023-07-11T00:31:49.462951+0000","last_active":"2023-07-11T00:31:50.465231+0000","last_peered":"2023-07-11T00:31:50.465231+0000","last_clean":"2023-07-11T00:31:50.465231+0000","last_became_active":"2023-07-11T00:31:49.462697+0000","last_became_peered":"2023-07-11T00:31:49.462697+0000","last_unstale":"2023-07-11T00:31:50.465231+0000","last_undegraded":"2023-07-11T00:31:50.465231+0000","last_fullsized":"2023-07-11T00:31:50.465231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:54:39.325193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930767+0000","last_change":"2023-07-11T00:31:48.460219+0000","last_active":"2023-07-11T00:31:50.930767+0000","last_peered":"2023-07-11T00:31:50.930767+0000","last_clean":"2023-07-11T00:31:50.930767+0000","last_became_active":"2023-07-11T00:31:48.459912+0000","last_became_peered":"2023-07-11T00:31:48.459912+0000","last_unstale":"2023-07-11T00:31:50.930767+0000","last_undegraded":"2023-07-11T00:31:50.930767+0000","last_fullsized":"2023-07-11T00:31:50.930767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:45:19.175378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463739+0000","last_change":"2023-07-11T00:31:49.475294+0000","last_active":"2023-07-11T00:31:50.463739+0000","last_peered":"2023-07-11T00:31:50.463739+0000","last_clean":"2023-07-11T00:31:50.463739+0000","last_became_active":"2023-07-11T00:31:49.474989+0000","last_became_peered":"2023-07-11T00:31:49.474989+0000","last_unstale":"2023-07-11T00:31:50.463739+0000","last_undegraded":"2023-07-11T00:31:50.463739+0000","last_fullsized":"2023-07-11T00:31:50.463739+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:37:56.551481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548601+0000","last_change":"2023-07-11T00:31:48.459454+0000","last_active":"2023-07-11T00:31:50.548601+0000","last_peered":"2023-07-11T00:31:50.548601+0000","last_clean":"2023-07-11T00:31:50.548601+0000","last_became_active":"2023-07-11T00:31:48.459171+0000","last_became_peered":"2023-07-11T00:31:48.459171+0000","last_unstale":"2023-07-11T00:31:50.548601+0000","last_undegraded":"2023-07-11T00:31:50.548601+0000","last_fullsized":"2023-07-11T00:31:50.548601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:45:57.125951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464177+0000","last_change":"2023-07-11T00:31:49.465444+0000","last_active":"2023-07-11T00:31:50.464177+0000","last_peered":"2023-07-11T00:31:50.464177+0000","last_clean":"2023-07-11T00:31:50.464177+0000","last_became_active":"2023-07-11T00:31:49.465153+0000","last_became_peered":"2023-07-11T00:31:49.465153+0000","last_unstale":"2023-07-11T00:31:50.464177+0000","last_undegraded":"2023-07-11T00:31:50.464177+0000","last_fullsized":"2023-07-11T00:31:50.464177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:03:51.889314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465230+0000","last_change":"2023-07-11T00:31:48.451216+0000","last_active":"2023-07-11T00:31:50.465230+0000","last_peered":"2023-07-11T00:31:50.465230+0000","last_clean":"2023-07-11T00:31:50.465230+0000","last_became_active":"2023-07-11T00:31:48.450908+0000","last_became_peered":"2023-07-11T00:31:48.450908+0000","last_unstale":"2023-07-11T00:31:50.465230+0000","last_undegraded":"2023-07-11T00:31:50.465230+0000","last_fullsized":"2023-07-11T00:31:50.465230+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:26:43.963576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548338+0000","last_change":"2023-07-11T00:31:49.457334+0000","last_active":"2023-07-11T00:31:50.548338+0000","last_peered":"2023-07-11T00:31:50.548338+0000","last_clean":"2023-07-11T00:31:50.548338+0000","last_became_active":"2023-07-11T00:31:49.457007+0000","last_became_peered":"2023-07-11T00:31:49.457007+0000","last_unstale":"2023-07-11T00:31:50.548338+0000","last_undegraded":"2023-07-11T00:31:50.548338+0000","last_fullsized":"2023-07-11T00:31:50.548338+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:10:23.036418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548644+0000","last_change":"2023-07-11T00:31:48.459371+0000","last_active":"2023-07-11T00:31:50.548644+0000","last_peered":"2023-07-11T00:31:50.548644+0000","last_clean":"2023-07-11T00:31:50.548644+0000","last_became_active":"2023-07-11T00:31:48.459074+0000","last_became_peered":"2023-07-11T00:31:48.459074+0000","last_unstale":"2023-07-11T00:31:50.548644+0000","last_undegraded":"2023-07-11T00:31:50.548644+0000","last_fullsized":"2023-07-11T00:31:50.548644+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:14:58.023063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465233+0000","last_change":"2023-07-11T00:31:49.469862+0000","last_active":"2023-07-11T00:31:50.465233+0000","last_peered":"2023-07-11T00:31:50.465233+0000","last_clean":"2023-07-11T00:31:50.465233+0000","last_became_active":"2023-07-11T00:31:49.469579+0000","last_became_peered":"2023-07-11T00:31:49.469579+0000","last_unstale":"2023-07-11T00:31:50.465233+0000","last_undegraded":"2023-07-11T00:31:50.465233+0000","last_fullsized":"2023-07-11T00:31:50.465233+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:23:24.823459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"37'8","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464039+0000","last_change":"2023-07-11T00:31:48.453039+0000","last_active":"2023-07-11T00:31:50.464039+0000","last_peered":"2023-07-11T00:31:50.464039+0000","last_clean":"2023-07-11T00:31:50.464039+0000","last_became_active":"2023-07-11T00:31:48.452775+0000","last_became_peered":"2023-07-11T00:31:48.452775+0000","last_unstale":"2023-07-11T00:31:50.464039+0000","last_undegraded":"2023-07-11T00:31:50.464039+0000","last_fullsized":"2023-07-11T00:31:50.464039+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:55:13.814371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930818+0000","last_change":"2023-07-11T00:31:49.467791+0000","last_active":"2023-07-11T00:31:50.930818+0000","last_peered":"2023-07-11T00:31:50.930818+0000","last_clean":"2023-07-11T00:31:50.930818+0000","last_became_active":"2023-07-11T00:31:49.467496+0000","last_became_peered":"2023-07-11T00:31:49.467496+0000","last_unstale":"2023-07-11T00:31:50.930818+0000","last_undegraded":"2023-07-11T00:31:50.930818+0000","last_fullsized":"2023-07-11T00:31:50.930818+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:41:11.170234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930655+0000","last_change":"2023-07-11T00:31:48.454390+0000","last_active":"2023-07-11T00:31:50.930655+0000","last_peered":"2023-07-11T00:31:50.930655+0000","last_clean":"2023-07-11T00:31:50.930655+0000","last_became_active":"2023-07-11T00:31:48.453977+0000","last_became_peered":"2023-07-11T00:31:48.453977+0000","last_unstale":"2023-07-11T00:31:50.930655+0000","last_undegraded":"2023-07-11T00:31:50.930655+0000","last_fullsized":"2023-07-11T00:31:50.930655+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:16:44.595511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464437+0000","last_change":"2023-07-11T00:31:49.475446+0000","last_active":"2023-07-11T00:31:50.464437+0000","last_peered":"2023-07-11T00:31:50.464437+0000","last_clean":"2023-07-11T00:31:50.464437+0000","last_became_active":"2023-07-11T00:31:49.475131+0000","last_became_peered":"2023-07-11T00:31:49.475131+0000","last_unstale":"2023-07-11T00:31:50.464437+0000","last_undegraded":"2023-07-11T00:31:50.464437+0000","last_fullsized":"2023-07-11T00:31:50.464437+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:06:54.099393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552284+0000","last_change":"2023-07-11T00:31:48.457843+0000","last_active":"2023-07-11T00:31:50.552284+0000","last_peered":"2023-07-11T00:31:50.552284+0000","last_clean":"2023-07-11T00:31:50.552284+0000","last_became_active":"2023-07-11T00:31:48.457582+0000","last_became_peered":"2023-07-11T00:31:48.457582+0000","last_unstale":"2023-07-11T00:31:50.552284+0000","last_undegraded":"2023-07-11T00:31:50.552284+0000","last_fullsized":"2023-07-11T00:31:50.552284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:56:00.183592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463667+0000","last_change":"2023-07-11T00:31:49.461645+0000","last_active":"2023-07-11T00:31:50.463667+0000","last_peered":"2023-07-11T00:31:50.463667+0000","last_clean":"2023-07-11T00:31:50.463667+0000","last_became_active":"2023-07-11T00:31:49.461362+0000","last_became_peered":"2023-07-11T00:31:49.461362+0000","last_unstale":"2023-07-11T00:31:50.463667+0000","last_undegraded":"2023-07-11T00:31:50.463667+0000","last_fullsized":"2023-07-11T00:31:50.463667+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:19:18.644430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.931052+0000","last_change":"2023-07-11T00:31:48.453565+0000","last_active":"2023-07-11T00:31:50.931052+0000","last_peered":"2023-07-11T00:31:50.931052+0000","last_clean":"2023-07-11T00:31:50.931052+0000","last_became_active":"2023-07-11T00:31:48.453289+0000","last_became_peered":"2023-07-11T00:31:48.453289+0000","last_unstale":"2023-07-11T00:31:50.931052+0000","last_undegraded":"2023-07-11T00:31:50.931052+0000","last_fullsized":"2023-07-11T00:31:50.931052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:51:13.554586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464048+0000","last_change":"2023-07-11T00:31:49.461206+0000","last_active":"2023-07-11T00:31:50.464048+0000","last_peered":"2023-07-11T00:31:50.464048+0000","last_clean":"2023-07-11T00:31:50.464048+0000","last_became_active":"2023-07-11T00:31:49.460915+0000","last_became_peered":"2023-07-11T00:31:49.460915+0000","last_unstale":"2023-07-11T00:31:50.464048+0000","last_undegraded":"2023-07-11T00:31:50.464048+0000","last_fullsized":"2023-07-11T00:31:50.464048+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:09:59.566658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548620+0000","last_change":"2023-07-11T00:31:48.464387+0000","last_active":"2023-07-11T00:31:50.548620+0000","last_peered":"2023-07-11T00:31:50.548620+0000","last_clean":"2023-07-11T00:31:50.548620+0000","last_became_active":"2023-07-11T00:31:48.463976+0000","last_became_peered":"2023-07-11T00:31:48.463976+0000","last_unstale":"2023-07-11T00:31:50.548620+0000","last_undegraded":"2023-07-11T00:31:50.548620+0000","last_fullsized":"2023-07-11T00:31:50.548620+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:46:01.127469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548356+0000","last_change":"2023-07-11T00:31:49.457373+0000","last_active":"2023-07-11T00:31:50.548356+0000","last_peered":"2023-07-11T00:31:50.548356+0000","last_clean":"2023-07-11T00:31:50.548356+0000","last_became_active":"2023-07-11T00:31:49.456989+0000","last_became_peered":"2023-07-11T00:31:49.456989+0000","last_unstale":"2023-07-11T00:31:50.548356+0000","last_undegraded":"2023-07-11T00:31:50.548356+0000","last_fullsized":"2023-07-11T00:31:50.548356+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:45:48.093542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548633+0000","last_change":"2023-07-11T00:31:48.454291+0000","last_active":"2023-07-11T00:31:50.548633+0000","last_peered":"2023-07-11T00:31:50.548633+0000","last_clean":"2023-07-11T00:31:50.548633+0000","last_became_active":"2023-07-11T00:31:48.453556+0000","last_became_peered":"2023-07-11T00:31:48.453556+0000","last_unstale":"2023-07-11T00:31:50.548633+0000","last_undegraded":"2023-07-11T00:31:50.548633+0000","last_fullsized":"2023-07-11T00:31:50.548633+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:59:13.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.840786+0000","last_change":"2023-07-11T00:31:49.470003+0000","last_active":"2023-07-11T00:31:50.840786+0000","last_peered":"2023-07-11T00:31:50.840786+0000","last_clean":"2023-07-11T00:31:50.840786+0000","last_became_active":"2023-07-11T00:31:49.469739+0000","last_became_peered":"2023-07-11T00:31:49.469739+0000","last_unstale":"2023-07-11T00:31:50.840786+0000","last_undegraded":"2023-07-11T00:31:50.840786+0000","last_fullsized":"2023-07-11T00:31:50.840786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:46:08.980085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930728+0000","last_change":"2023-07-11T00:31:48.464395+0000","last_active":"2023-07-11T00:31:50.930728+0000","last_peered":"2023-07-11T00:31:50.930728+0000","last_clean":"2023-07-11T00:31:50.930728+0000","last_became_active":"2023-07-11T00:31:48.464089+0000","last_became_peered":"2023-07-11T00:31:48.464089+0000","last_unstale":"2023-07-11T00:31:50.930728+0000","last_undegraded":"2023-07-11T00:31:50.930728+0000","last_fullsized":"2023-07-11T00:31:50.930728+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:55:13.814371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930551+0000","last_change":"2023-07-11T00:31:49.458863+0000","last_active":"2023-07-11T00:31:50.930551+0000","last_peered":"2023-07-11T00:31:50.930551+0000","last_clean":"2023-07-11T00:31:50.930551+0000","last_became_active":"2023-07-11T00:31:49.458587+0000","last_became_peered":"2023-07-11T00:31:49.458587+0000","last_unstale":"2023-07-11T00:31:50.930551+0000","last_undegraded":"2023-07-11T00:31:50.930551+0000","last_fullsized":"2023-07-11T00:31:50.930551+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:58:35.054271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463676+0000","last_change":"2023-07-11T00:31:48.457841+0000","last_active":"2023-07-11T00:31:50.463676+0000","last_peered":"2023-07-11T00:31:50.463676+0000","last_clean":"2023-07-11T00:31:50.463676+0000","last_became_active":"2023-07-11T00:31:48.457470+0000","last_became_peered":"2023-07-11T00:31:48.457470+0000","last_unstale":"2023-07-11T00:31:50.463676+0000","last_undegraded":"2023-07-11T00:31:50.463676+0000","last_fullsized":"2023-07-11T00:31:50.463676+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:52:38.330454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463812+0000","last_change":"2023-07-11T00:31:49.466813+0000","last_active":"2023-07-11T00:31:50.463812+0000","last_peered":"2023-07-11T00:31:50.463812+0000","last_clean":"2023-07-11T00:31:50.463812+0000","last_became_active":"2023-07-11T00:31:49.466466+0000","last_became_peered":"2023-07-11T00:31:49.466466+0000","last_unstale":"2023-07-11T00:31:50.463812+0000","last_undegraded":"2023-07-11T00:31:50.463812+0000","last_fullsized":"2023-07-11T00:31:50.463812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:00:06.489225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464625+0000","last_change":"2023-07-11T00:31:48.449708+0000","last_active":"2023-07-11T00:31:50.464625+0000","last_peered":"2023-07-11T00:31:50.464625+0000","last_clean":"2023-07-11T00:31:50.464625+0000","last_became_active":"2023-07-11T00:31:48.449399+0000","last_became_peered":"2023-07-11T00:31:48.449399+0000","last_unstale":"2023-07-11T00:31:50.464625+0000","last_undegraded":"2023-07-11T00:31:50.464625+0000","last_fullsized":"2023-07-11T00:31:50.464625+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:31:41.789660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548512+0000","last_change":"2023-07-11T00:31:49.458138+0000","last_active":"2023-07-11T00:31:50.548512+0000","last_peered":"2023-07-11T00:31:50.548512+0000","last_clean":"2023-07-11T00:31:50.548512+0000","last_became_active":"2023-07-11T00:31:49.457794+0000","last_became_peered":"2023-07-11T00:31:49.457794+0000","last_unstale":"2023-07-11T00:31:50.548512+0000","last_undegraded":"2023-07-11T00:31:50.548512+0000","last_fullsized":"2023-07-11T00:31:50.548512+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:30:43.373895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552268+0000","last_change":"2023-07-11T00:31:48.460880+0000","last_active":"2023-07-11T00:31:50.552268+0000","last_peered":"2023-07-11T00:31:50.552268+0000","last_clean":"2023-07-11T00:31:50.552268+0000","last_became_active":"2023-07-11T00:31:48.460428+0000","last_became_peered":"2023-07-11T00:31:48.460428+0000","last_unstale":"2023-07-11T00:31:50.552268+0000","last_undegraded":"2023-07-11T00:31:50.552268+0000","last_fullsized":"2023-07-11T00:31:50.552268+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:23:34.138695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.552092+0000","last_change":"2023-07-11T00:29:59.627086+0000","last_active":"2023-07-11T00:31:50.552092+0000","last_peered":"2023-07-11T00:31:50.552092+0000","last_clean":"2023-07-11T00:31:50.552092+0000","last_became_active":"2023-07-11T00:29:59.626687+0000","last_became_peered":"2023-07-11T00:29:59.626687+0000","last_unstale":"2023-07-11T00:31:50.552092+0000","last_undegraded":"2023-07-11T00:31:50.552092+0000","last_fullsized":"2023-07-11T00:31:50.552092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:05:05.999803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548573+0000","last_change":"2023-07-11T00:31:49.462940+0000","last_active":"2023-07-11T00:31:50.548573+0000","last_peered":"2023-07-11T00:31:50.548573+0000","last_clean":"2023-07-11T00:31:50.548573+0000","last_became_active":"2023-07-11T00:31:49.462662+0000","last_became_peered":"2023-07-11T00:31:49.462662+0000","last_unstale":"2023-07-11T00:31:50.548573+0000","last_undegraded":"2023-07-11T00:31:50.548573+0000","last_fullsized":"2023-07-11T00:31:50.548573+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:24:33.910258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465231+0000","last_change":"2023-07-11T00:31:48.462340+0000","last_active":"2023-07-11T00:31:50.465231+0000","last_peered":"2023-07-11T00:31:50.465231+0000","last_clean":"2023-07-11T00:31:50.465231+0000","last_became_active":"2023-07-11T00:31:48.462048+0000","last_became_peered":"2023-07-11T00:31:48.462048+0000","last_unstale":"2023-07-11T00:31:50.465231+0000","last_undegraded":"2023-07-11T00:31:50.465231+0000","last_fullsized":"2023-07-11T00:31:50.465231+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:57:05.902050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548741+0000","last_change":"2023-07-11T00:29:59.589317+0000","last_active":"2023-07-11T00:31:50.548741+0000","last_peered":"2023-07-11T00:31:50.548741+0000","last_clean":"2023-07-11T00:31:50.548741+0000","last_became_active":"2023-07-11T00:29:59.588926+0000","last_became_peered":"2023-07-11T00:29:59.588926+0000","last_unstale":"2023-07-11T00:31:50.548741+0000","last_undegraded":"2023-07-11T00:31:50.548741+0000","last_fullsized":"2023-07-11T00:31:50.548741+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:33:59.990479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465483+0000","last_change":"2023-07-11T00:31:49.462413+0000","last_active":"2023-07-11T00:31:50.465483+0000","last_peered":"2023-07-11T00:31:50.465483+0000","last_clean":"2023-07-11T00:31:50.465483+0000","last_became_active":"2023-07-11T00:31:49.462056+0000","last_became_peered":"2023-07-11T00:31:49.462056+0000","last_unstale":"2023-07-11T00:31:50.465483+0000","last_undegraded":"2023-07-11T00:31:50.465483+0000","last_fullsized":"2023-07-11T00:31:50.465483+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:08:47.268896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.840768+0000","last_change":"2023-07-11T00:31:48.459774+0000","last_active":"2023-07-11T00:31:50.840768+0000","last_peered":"2023-07-11T00:31:50.840768+0000","last_clean":"2023-07-11T00:31:50.840768+0000","last_became_active":"2023-07-11T00:31:48.459485+0000","last_became_peered":"2023-07-11T00:31:48.459485+0000","last_unstale":"2023-07-11T00:31:50.840768+0000","last_undegraded":"2023-07-11T00:31:50.840768+0000","last_fullsized":"2023-07-11T00:31:50.840768+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:53:50.852325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.840732+0000","last_change":"2023-07-11T00:29:59.585672+0000","last_active":"2023-07-11T00:31:50.840732+0000","last_peered":"2023-07-11T00:31:50.840732+0000","last_clean":"2023-07-11T00:31:50.840732+0000","last_became_active":"2023-07-11T00:29:59.585405+0000","last_became_peered":"2023-07-11T00:29:59.585405+0000","last_unstale":"2023-07-11T00:31:50.840732+0000","last_undegraded":"2023-07-11T00:31:50.840732+0000","last_fullsized":"2023-07-11T00:31:50.840732+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:20:01.273572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":199,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464825+0000","last_change":"2023-07-11T00:29:59.589132+0000","last_active":"2023-07-11T00:31:50.464825+0000","last_peered":"2023-07-11T00:31:50.464825+0000","last_clean":"2023-07-11T00:31:50.464825+0000","last_became_active":"2023-07-11T00:29:59.588293+0000","last_became_peered":"2023-07-11T00:29:59.588293+0000","last_unstale":"2023-07-11T00:31:50.464825+0000","last_undegraded":"2023-07-11T00:31:50.464825+0000","last_fullsized":"2023-07-11T00:31:50.464825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:38:20.599991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464125+0000","last_change":"2023-07-11T00:31:49.467643+0000","last_active":"2023-07-11T00:31:50.464125+0000","last_peered":"2023-07-11T00:31:50.464125+0000","last_clean":"2023-07-11T00:31:50.464125+0000","last_became_active":"2023-07-11T00:31:49.467390+0000","last_became_peered":"2023-07-11T00:31:49.467390+0000","last_unstale":"2023-07-11T00:31:50.464125+0000","last_undegraded":"2023-07-11T00:31:50.464125+0000","last_fullsized":"2023-07-11T00:31:50.464125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:35:16.582529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465583+0000","last_change":"2023-07-11T00:31:48.465932+0000","last_active":"2023-07-11T00:31:50.465583+0000","last_peered":"2023-07-11T00:31:50.465583+0000","last_clean":"2023-07-11T00:31:50.465583+0000","last_became_active":"2023-07-11T00:31:48.465433+0000","last_became_peered":"2023-07-11T00:31:48.465433+0000","last_unstale":"2023-07-11T00:31:50.465583+0000","last_undegraded":"2023-07-11T00:31:50.465583+0000","last_fullsized":"2023-07-11T00:31:50.465583+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:32:31.160541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.465260+0000","last_change":"2023-07-11T00:29:59.978997+0000","last_active":"2023-07-11T00:31:50.465260+0000","last_peered":"2023-07-11T00:31:50.465260+0000","last_clean":"2023-07-11T00:31:50.465260+0000","last_became_active":"2023-07-11T00:29:59.978716+0000","last_became_peered":"2023-07-11T00:29:59.978716+0000","last_unstale":"2023-07-11T00:31:50.465260+0000","last_undegraded":"2023-07-11T00:31:50.465260+0000","last_fullsized":"2023-07-11T00:31:50.465260+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:42:25.875263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464456+0000","last_change":"2023-07-11T00:31:49.464724+0000","last_active":"2023-07-11T00:31:50.464456+0000","last_peered":"2023-07-11T00:31:50.464456+0000","last_clean":"2023-07-11T00:31:50.464456+0000","last_became_active":"2023-07-11T00:31:49.464410+0000","last_became_peered":"2023-07-11T00:31:49.464410+0000","last_unstale":"2023-07-11T00:31:50.464456+0000","last_undegraded":"2023-07-11T00:31:50.464456+0000","last_fullsized":"2023-07-11T00:31:50.464456+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:44:25.921005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.931177+0000","last_change":"2023-07-11T00:31:48.453012+0000","last_active":"2023-07-11T00:31:50.931177+0000","last_peered":"2023-07-11T00:31:50.931177+0000","last_clean":"2023-07-11T00:31:50.931177+0000","last_became_active":"2023-07-11T00:31:48.452702+0000","last_became_peered":"2023-07-11T00:31:48.452702+0000","last_unstale":"2023-07-11T00:31:50.931177+0000","last_undegraded":"2023-07-11T00:31:50.931177+0000","last_fullsized":"2023-07-11T00:31:50.931177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:06:53.093944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464823+0000","last_change":"2023-07-11T00:29:59.978976+0000","last_active":"2023-07-11T00:31:50.464823+0000","last_peered":"2023-07-11T00:31:50.464823+0000","last_clean":"2023-07-11T00:31:50.464823+0000","last_became_active":"2023-07-11T00:29:59.978678+0000","last_became_peered":"2023-07-11T00:29:59.978678+0000","last_unstale":"2023-07-11T00:31:50.464823+0000","last_undegraded":"2023-07-11T00:31:50.464823+0000","last_fullsized":"2023-07-11T00:31:50.464823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:50:49.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464049+0000","last_change":"2023-07-11T00:31:49.475079+0000","last_active":"2023-07-11T00:31:50.464049+0000","last_peered":"2023-07-11T00:31:50.464049+0000","last_clean":"2023-07-11T00:31:50.464049+0000","last_became_active":"2023-07-11T00:31:49.474768+0000","last_became_peered":"2023-07-11T00:31:49.474768+0000","last_unstale":"2023-07-11T00:31:50.464049+0000","last_undegraded":"2023-07-11T00:31:50.464049+0000","last_fullsized":"2023-07-11T00:31:50.464049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:35:29.061426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.548773+0000","last_change":"2023-07-11T00:31:48.461436+0000","last_active":"2023-07-11T00:31:50.548773+0000","last_peered":"2023-07-11T00:31:50.548773+0000","last_clean":"2023-07-11T00:31:50.548773+0000","last_became_active":"2023-07-11T00:31:48.461132+0000","last_became_peered":"2023-07-11T00:31:48.461132+0000","last_unstale":"2023-07-11T00:31:50.548773+0000","last_undegraded":"2023-07-11T00:31:50.548773+0000","last_fullsized":"2023-07-11T00:31:50.548773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:58:34.998041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930753+0000","last_change":"2023-07-11T00:29:59.979163+0000","last_active":"2023-07-11T00:31:50.930753+0000","last_peered":"2023-07-11T00:31:50.930753+0000","last_clean":"2023-07-11T00:31:50.930753+0000","last_became_active":"2023-07-11T00:29:59.978751+0000","last_became_peered":"2023-07-11T00:29:59.978751+0000","last_unstale":"2023-07-11T00:31:50.930753+0000","last_undegraded":"2023-07-11T00:31:50.930753+0000","last_fullsized":"2023-07-11T00:31:50.930753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:04:45.489808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.930630+0000","last_change":"2023-07-11T00:31:49.465942+0000","last_active":"2023-07-11T00:31:50.930630+0000","last_peered":"2023-07-11T00:31:50.930630+0000","last_clean":"2023-07-11T00:31:50.930630+0000","last_became_active":"2023-07-11T00:31:49.465627+0000","last_became_peered":"2023-07-11T00:31:49.465627+0000","last_unstale":"2023-07-11T00:31:50.930630+0000","last_undegraded":"2023-07-11T00:31:50.930630+0000","last_fullsized":"2023-07-11T00:31:50.930630+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:07.266780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.840640+0000","last_change":"2023-07-11T00:31:48.462834+0000","last_active":"2023-07-11T00:31:50.840640+0000","last_peered":"2023-07-11T00:31:50.840640+0000","last_clean":"2023-07-11T00:31:50.840640+0000","last_became_active":"2023-07-11T00:31:48.462167+0000","last_became_peered":"2023-07-11T00:31:48.462167+0000","last_unstale":"2023-07-11T00:31:50.840640+0000","last_undegraded":"2023-07-11T00:31:50.840640+0000","last_fullsized":"2023-07-11T00:31:50.840640+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:28:20.214160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.463784+0000","last_change":"2023-07-11T00:29:59.978981+0000","last_active":"2023-07-11T00:31:50.463784+0000","last_peered":"2023-07-11T00:31:50.463784+0000","last_clean":"2023-07-11T00:31:50.463784+0000","last_became_active":"2023-07-11T00:29:59.978633+0000","last_became_peered":"2023-07-11T00:29:59.978633+0000","last_unstale":"2023-07-11T00:31:50.463784+0000","last_undegraded":"2023-07-11T00:31:50.463784+0000","last_fullsized":"2023-07-11T00:31:50.463784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T12:07:35.112456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.551938+0000","last_change":"2023-07-11T00:31:49.457970+0000","last_active":"2023-07-11T00:31:50.551938+0000","last_peered":"2023-07-11T00:31:50.551938+0000","last_clean":"2023-07-11T00:31:50.551938+0000","last_became_active":"2023-07-11T00:31:49.457706+0000","last_became_peered":"2023-07-11T00:31:49.457706+0000","last_unstale":"2023-07-11T00:31:50.551938+0000","last_undegraded":"2023-07-11T00:31:50.551938+0000","last_fullsized":"2023-07-11T00:31:50.551938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:48.429265+0000","last_clean_scrub_stamp":"2023-07-11T00:31:48.429265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:57:21.898195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464183+0000","last_change":"2023-07-11T00:31:48.458841+0000","last_active":"2023-07-11T00:31:50.464183+0000","last_peered":"2023-07-11T00:31:50.464183+0000","last_clean":"2023-07-11T00:31:50.464183+0000","last_became_active":"2023-07-11T00:31:48.458577+0000","last_became_peered":"2023-07-11T00:31:48.458577+0000","last_unstale":"2023-07-11T00:31:50.464183+0000","last_undegraded":"2023-07-11T00:31:50.464183+0000","last_fullsized":"2023-07-11T00:31:50.464183+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:31:47.423816+0000","last_clean_scrub_stamp":"2023-07-11T00:31:47.423816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:51:13.554586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-11T00:31:50.464200+0000","last_change":"2023-07-11T00:29:59.585652+0000","last_active":"2023-07-11T00:31:50.464200+0000","last_peered":"2023-07-11T00:31:50.464200+0000","last_clean":"2023-07-11T00:31:50.464200+0000","last_became_active":"2023-07-11T00:29:59.585316+0000","last_became_peered":"2023-07-11T00:29:59.585316+0000","last_unstale":"2023-07-11T00:31:50.464200+0000","last_undegraded":"2023-07-11T00:31:50.464200+0000","last_fullsized":"2023-07-11T00:31:50.464200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:29:58.574431+0000","last_clean_scrub_stamp":"2023-07-11T00:29:58.574431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:06:59.351986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":788075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.85099999999999998}]},{"osd":1,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.90200000000000002}]},{"osd":2,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.76700000000000002}]},{"osd":3,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.875},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.83299999999999996}]},{"osd":4,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.498}]},{"osd":5,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.748},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":196928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":8.9930000000000003,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":4.8150000000000004,"5min":4.8150000000000004,"15min":4.8150000000000004},"last":0.83899999999999997}]},{"osd":1,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":4.9800000000000004,"5min":4.9800000000000004,"15min":4.9800000000000004},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.63700000000000001}]},{"osd":2,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":3.0790000000000002,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":0.68400000000000005}]},{"osd":3,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":10.978999999999999,"5min":10.978999999999999,"15min":10.978999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":4.8300000000000001,"5min":4.8300000000000001,"15min":4.8300000000000001},"last":0.67200000000000004}]},{"osd":4,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.503},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":6.2309999999999999,"5min":6.2309999999999999,"15min":6.2309999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.60799999999999998}]},{"osd":7,"last update":"Tue Jul 11 00:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.70099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":788055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.502},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47599999999999998}]},{"osd":2,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.55500000000000005}]},{"osd":3,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.628},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.65200000000000002}]},{"osd":6,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.61199999999999999}]},{"osd":7,"last update":"Tue Jul 11 00:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.59999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":196290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.438}]},{"osd":2,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.32200000000000001}]},{"osd":3,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.37},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.45900000000000002}]},{"osd":4,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.69199999999999995}]},{"osd":5,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.72999999999999998}]},{"osd":6,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.74099999999999999}]},{"osd":7,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.79000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":199203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":3.2989999999999999,"5min":3.2989999999999999,"15min":3.2989999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.40100000000000002}]},{"osd":1,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.024,"5min":3.024,"15min":3.024},"last":0.46800000000000003}]},{"osd":3,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":3.0779999999999998,"5min":3.0779999999999998,"15min":3.0779999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.3330000000000002,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.2200000000000002,"5min":3.2200000000000002,"15min":3.2200000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.61499999999999999}]},{"osd":5,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":3.2629999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":0.53300000000000003}]},{"osd":6,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.63100000000000001}]},{"osd":7,"last update":"Tue Jul 11 00:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.66100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":196894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":10.938000000000001,"5min":10.938000000000001,"15min":10.938000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.51700000000000002}]},{"osd":1,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.39600000000000002},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":10.874000000000001,"5min":10.874000000000001,"15min":10.874000000000001},"last":0.60399999999999998}]},{"osd":2,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":11.050000000000001,"5min":11.050000000000001,"15min":11.050000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":0.69499999999999995}]},{"osd":5,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":11.015000000000001,"5min":11.015000000000001,"15min":11.015000000000001},"last":0.77800000000000002}]},{"osd":6,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":10.978,"5min":10.978,"15min":10.978},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.58599999999999997}]},{"osd":7,"last update":"Tue Jul 11 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.63700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":199181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.871,"5min":2.871,"15min":2.871},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.69799999999999995}]},{"osd":1,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.84699999999999998}]},{"osd":2,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.76700000000000002}]},{"osd":3,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":7.6790000000000003,"5min":7.6790000000000003,"15min":7.6790000000000003},"last":0.747},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.875}]},{"osd":5,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67700000000000005}]},{"osd":6,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.54500000000000004}]},{"osd":7,"last update":"Tue Jul 11 00:31:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.626}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":196326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.878}]},{"osd":1,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.93799999999999994}]},{"osd":2,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.92100000000000004}]},{"osd":3,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.84599999999999997}]},{"osd":4,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.69499999999999995}]},{"osd":6,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.57399999999999995}]},{"osd":7,"last update":"Tue Jul 11 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.621}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-11T00:31:59.389 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-11T00:31:59.389 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-11T00:31:59.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.624+0000 7f511d5ff700 1 Processor -- start 2023-07-11T00:31:59.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.624+0000 7f511d5ff700 1 -- start start 2023-07-11T00:31:59.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.626+0000 7f511d5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51180b8430 0x7f51180cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:59.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.626+0000 7f511d5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f51180d3730 0x7f51180cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:59.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.626+0000 7f511d5ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51180d0b20 con 0x7f51180cfa90 2023-07-11T00:31:59.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.626+0000 7f511d5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51180b8800 con 0x7f51180d3730 2023-07-11T00:31:59.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.626+0000 7f511d5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51180cfeb0 con 0x7f51180b8430 2023-07-11T00:31:59.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.626+0000 7f51177fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f51180cfa90 0x7f511815feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57328/0 (socket says 172.21.15.22:57328) 2023-07-11T00:31:59.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.626+0000 7f51177fe700 1 -- 172.21.15.22:0/2109163943 learned_addr learned my addr 172.21.15.22:0/2109163943 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:31:59.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.626+0000 7f5116ffd700 1 --2- 172.21.15.22:0/2109163943 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51180b8430 0x7f51180cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:59.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.626+0000 7f51167fc700 1 --2- 172.21.15.22:0/2109163943 >> v2:172.21.15.184:3300/0 conn(0x7f51180d3730 0x7f51180cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.627+0000 7f5115ffb700 1 -- 172.21.15.22:0/2109163943 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222139491 0 0) 0x7f51180d0b20 con 0x7f51180cfa90 2023-07-11T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.627+0000 7f5115ffb700 1 -- 172.21.15.22:0/2109163943 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51000035b0 con 0x7f51180cfa90 2023-07-11T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.627+0000 7f5116ffd700 1 -- 172.21.15.22:0/2109163943 >> v2:172.21.15.184:3300/0 conn(0x7f51180d3730 msgr2=0x7f51180cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.627+0000 7f5116ffd700 1 --2- 172.21.15.22:0/2109163943 >> v2:172.21.15.184:3300/0 conn(0x7f51180d3730 0x7f51180cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.627+0000 7f5116ffd700 1 -- 172.21.15.22:0/2109163943 >> v1:172.21.15.22:6789/0 conn(0x7f51180cfa90 legacy=0x7f511815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.627+0000 7f5116ffd700 1 -- 172.21.15.22:0/2109163943 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51180b4ee0 con 0x7f51180b8430 2023-07-11T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.627+0000 7f51167fc700 1 --2- 172.21.15.22:0/2109163943 >> v2:172.21.15.184:3300/0 conn(0x7f51180d3730 0x7f51180cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.627+0000 7f5116ffd700 1 --2- 172.21.15.22:0/2109163943 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51180b8430 0x7f51180cd320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5108009840 tx=0x7f5108009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49a1af2b0560f58e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.627+0000 7f5115ffb700 1 -- 172.21.15.22:0/2109163943 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108011830 con 0x7f51180b8430 2023-07-11T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.627+0000 7f5115ffb700 1 -- 172.21.15.22:0/2109163943 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5108011990 con 0x7f51180b8430 2023-07-11T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.627+0000 7f5115ffb700 1 -- 172.21.15.22:0/2109163943 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108011d00 con 0x7f51180b8430 2023-07-11T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.628+0000 7f511d5ff700 1 -- 172.21.15.22:0/2109163943 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51180b8430 msgr2=0x7f51180cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.628+0000 7f511d5ff700 1 --2- 172.21.15.22:0/2109163943 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51180b8430 0x7f51180cd320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5108009840 tx=0x7f5108009b50 comp rx=0 tx=0).stop 2023-07-11T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.628+0000 7f511d5ff700 1 -- 172.21.15.22:0/2109163943 shutdown_connections 2023-07-11T00:31:59.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.628+0000 7f511d5ff700 1 --2- 172.21.15.22:0/2109163943 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51180b8430 0x7f51180cd320 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.628+0000 7f511d5ff700 1 --2- 172.21.15.22:0/2109163943 >> v2:172.21.15.184:3300/0 conn(0x7f51180d3730 0x7f51180cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.628+0000 7f511d5ff700 1 -- 172.21.15.22:0/2109163943 >> 172.21.15.22:0/2109163943 conn(0x7f511806b3f0 msgr2=0x7f511806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:59.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.628+0000 7f511d5ff700 1 -- 172.21.15.22:0/2109163943 shutdown_connections 2023-07-11T00:31:59.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.628+0000 7f511d5ff700 1 -- 172.21.15.22:0/2109163943 wait complete. 2023-07-11T00:31:59.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.630+0000 7f511d5ff700 1 Processor -- start 2023-07-11T00:31:59.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.630+0000 7f511d5ff700 1 -- start start 2023-07-11T00:31:59.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.631+0000 7f511d5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51180b8430 0x7f511815f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.631+0000 7f511d5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51180cfa90 0x7f51180c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.631+0000 7f511d5ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51180d3730 0x7f511815d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.631+0000 7f511d5ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51180c6430 con 0x7f51180d3730 2023-07-11T00:31:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.631+0000 7f511d5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511815ef70 con 0x7f51180cfa90 2023-07-11T00:31:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.631+0000 7f511d5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511815e360 con 0x7f51180b8430 2023-07-11T00:31:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.631+0000 7f51177fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51180d3730 0x7f511815d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.631+0000 7f51177fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51180d3730 0x7f511815d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49078/0 (socket says 172.21.15.22:49078) 2023-07-11T00:31:59.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.631+0000 7f51177fe700 1 -- 172.21.15.22:0/957446427 learned_addr learned my addr 172.21.15.22:0/957446427 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:31:59.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.632+0000 7f5116ffd700 1 --2- 172.21.15.22:0/957446427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51180b8430 0x7f511815f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:59.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.632+0000 7f51167fc700 1 --2- 172.21.15.22:0/957446427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51180cfa90 0x7f51180c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:59.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.632+0000 7f51177fe700 1 -- 172.21.15.22:0/957446427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51180b8430 msgr2=0x7f511815f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:59.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.632+0000 7f51177fe700 1 --2- 172.21.15.22:0/957446427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51180b8430 0x7f511815f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.632+0000 7f51177fe700 1 -- 172.21.15.22:0/957446427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51180cfa90 msgr2=0x7f51180c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:59.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.632+0000 7f51177fe700 1 --2- 172.21.15.22:0/957446427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51180cfa90 0x7f51180c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.632+0000 7f51177fe700 1 -- 172.21.15.22:0/957446427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c0094a0 con 0x7f51180d3730 2023-07-11T00:31:59.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.632+0000 7f51177fe700 1 --2- 172.21.15.22:0/957446427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51180d3730 0x7f511815d8e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f511000cb40 tx=0x7f511000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:59.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.632+0000 7f50ff7fe700 1 -- 172.21.15.22:0/957446427 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511000a9e0 con 0x7f51180d3730 2023-07-11T00:31:59.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.632+0000 7f50ff7fe700 1 -- 172.21.15.22:0/957446427 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511000ab40 con 0x7f51180d3730 2023-07-11T00:31:59.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.632+0000 7f50ff7fe700 1 -- 172.21.15.22:0/957446427 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110012400 con 0x7f51180d3730 2023-07-11T00:31:59.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.632+0000 7f511d5ff700 1 -- 172.21.15.22:0/957446427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51080094a0 con 0x7f51180d3730 2023-07-11T00:31:59.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.633+0000 7f511d5ff700 1 -- 172.21.15.22:0/957446427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511815e920 con 0x7f51180d3730 2023-07-11T00:31:59.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.634+0000 7f511d5ff700 1 -- 172.21.15.22:0/957446427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511815f120 con 0x7f51180d3730 2023-07-11T00:31:59.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.635+0000 7f50ff7fe700 1 -- 172.21.15.22:0/957446427 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f511001b3b0 con 0x7f51180d3730 2023-07-11T00:31:59.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.635+0000 7f50ff7fe700 1 --2- 172.21.15.22:0/957446427 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f510406ace0 0x7f510406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:31:59.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.636+0000 7f50ff7fe700 1 -- 172.21.15.22:0/957446427 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5110089280 con 0x7f51180d3730 2023-07-11T00:31:59.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.636+0000 7f5116ffd700 1 --2- 172.21.15.22:0/957446427 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f510406ace0 0x7f510406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:31:59.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.637+0000 7f5116ffd700 1 --2- 172.21.15.22:0/957446427 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f510406ace0 0x7f510406d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5108000c00 tx=0x7f510801c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:31:59.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.640+0000 7f50ff7fe700 1 -- 172.21.15.22:0/957446427 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f511815f120 con 0x7f51180d3730 2023-07-11T00:31:59.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.930+0000 7f511d5ff700 1 -- 172.21.15.22:0/957446427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f511815f0e0 con 0x7f51180d3730 2023-07-11T00:31:59.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.934+0000 7f50ff7fe700 1 -- 172.21.15.22:0/957446427 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f51100170b0 con 0x7f51180d3730 2023-07-11T00:31:59.937 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2023-07-11T00:31:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBWoqxkYp7gEhAAkay8GXLqeoGhPULEEnwHBw== 2023-07-11T00:31:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: caps mds = "allow" 2023-07-11T00:31:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: caps mon = "allow r" 2023-07-11T00:31:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-11T00:31:59.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.936+0000 7f511d5ff700 1 -- 172.21.15.22:0/957446427 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f510406ace0 msgr2=0x7f510406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:59.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.936+0000 7f511d5ff700 1 --2- 172.21.15.22:0/957446427 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f510406ace0 0x7f510406d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5108000c00 tx=0x7f510801c040 comp rx=0 tx=0).stop 2023-07-11T00:31:59.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.936+0000 7f511d5ff700 1 -- 172.21.15.22:0/957446427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51180d3730 msgr2=0x7f511815d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:31:59.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.936+0000 7f511d5ff700 1 --2- 172.21.15.22:0/957446427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51180d3730 0x7f511815d8e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f511000cb40 tx=0x7f511000ce50 comp rx=0 tx=0).stop 2023-07-11T00:31:59.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.937+0000 7f511d5ff700 1 -- 172.21.15.22:0/957446427 shutdown_connections 2023-07-11T00:31:59.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.937+0000 7f511d5ff700 1 --2- 172.21.15.22:0/957446427 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f510406ace0 0x7f510406d190 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.937+0000 7f511d5ff700 1 --2- 172.21.15.22:0/957446427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51180b8430 0x7f511815f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.937+0000 7f511d5ff700 1 --2- 172.21.15.22:0/957446427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51180d3730 0x7f511815d8e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.937+0000 7f511d5ff700 1 --2- 172.21.15.22:0/957446427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51180cfa90 0x7f51180c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:31:59.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.937+0000 7f511d5ff700 1 -- 172.21.15.22:0/957446427 >> 172.21.15.22:0/957446427 conn(0x7f511806b3f0 msgr2=0x7f51180d18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:31:59.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.937+0000 7f511d5ff700 1 -- 172.21.15.22:0/957446427 shutdown_connections 2023-07-11T00:31:59.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:31:59.937+0000 7f511d5ff700 1 -- 172.21.15.22:0/957446427 wait complete. 2023-07-11T00:31:59.941 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2023-07-11T00:31:59.957 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:32:00.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.158+0000 7f1daebff700 1 Processor -- start 2023-07-11T00:32:00.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.158+0000 7f1daebff700 1 -- start start 2023-07-11T00:32:00.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.159+0000 7f1daebff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1da80d2640 0x7f1da80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:00.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.159+0000 7f1daebff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1da80cf8f0 0x7f1da815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:00.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.159+0000 7f1daebff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da80d1790 con 0x7f1da815c460 2023-07-11T00:32:00.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.159+0000 7f1daebff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da80cedd0 con 0x7f1da80cf8f0 2023-07-11T00:32:00.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.159+0000 7f1daebff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da80cd950 con 0x7f1da80d2640 2023-07-11T00:32:00.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.159+0000 7f1dad19c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1da80cf8f0 0x7f1da815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.159+0000 7f1dad19c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1da80cf8f0 0x7f1da815fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55778/0 (socket says 172.21.15.22:55778) 2023-07-11T00:32:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.159+0000 7f1dad19c700 1 -- 172.21.15.22:0/671341265 learned_addr learned my addr 172.21.15.22:0/671341265 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:32:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.159+0000 7f1da7fff700 1 --2- 172.21.15.22:0/671341265 >> v2:172.21.15.184:3300/0 conn(0x7f1da80d2640 0x7f1da80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.160+0000 7f1dad19c700 1 -- 172.21.15.22:0/671341265 >> v2:172.21.15.184:3300/0 conn(0x7f1da80d2640 msgr2=0x7f1da80b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:32:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.160+0000 7f1dad19c700 1 --2- 172.21.15.22:0/671341265 >> v2:172.21.15.184:3300/0 conn(0x7f1da80d2640 0x7f1da80b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.160+0000 7f1dad19c700 1 -- 172.21.15.22:0/671341265 >> v1:172.21.15.184:6789/0 conn(0x7f1da815c460 legacy=0x7f1da80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:00.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.160+0000 7f1dad19c700 1 -- 172.21.15.22:0/671341265 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da80d14b0 con 0x7f1da80cf8f0 2023-07-11T00:32:00.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.160+0000 7f1da77fe700 1 -- 172.21.15.22:0/671341265 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748390621 0 0) 0x7f1da80d1790 con 0x7f1da815c460 2023-07-11T00:32:00.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.160+0000 7f1dad19c700 1 --2- 172.21.15.22:0/671341265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da80cf8f0 0x7f1da815fe20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1da815fd80 tx=0x7f1da000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab12f81c28a6055 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:00.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.160+0000 7f1da77fe700 1 -- 172.21.15.22:0/671341265 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da000e070 con 0x7f1da80cf8f0 2023-07-11T00:32:00.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.160+0000 7f1da77fe700 1 -- 172.21.15.22:0/671341265 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da000b910 con 0x7f1da80cf8f0 2023-07-11T00:32:00.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.160+0000 7f1da77fe700 1 -- 172.21.15.22:0/671341265 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da000bcc0 con 0x7f1da80cf8f0 2023-07-11T00:32:00.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.161+0000 7f1daebff700 1 -- 172.21.15.22:0/671341265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da80cf8f0 msgr2=0x7f1da815fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:00.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.161+0000 7f1daebff700 1 --2- 172.21.15.22:0/671341265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da80cf8f0 0x7f1da815fe20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1da815fd80 tx=0x7f1da000b330 comp rx=0 tx=0).stop 2023-07-11T00:32:00.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.161+0000 7f1daebff700 1 -- 172.21.15.22:0/671341265 shutdown_connections 2023-07-11T00:32:00.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.161+0000 7f1daebff700 1 --2- 172.21.15.22:0/671341265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da80cf8f0 0x7f1da815fe20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:00.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.161+0000 7f1daebff700 1 --2- 172.21.15.22:0/671341265 >> v2:172.21.15.184:3300/0 conn(0x7f1da80d2640 0x7f1da80b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:00.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.161+0000 7f1daebff700 1 -- 172.21.15.22:0/671341265 >> 172.21.15.22:0/671341265 conn(0x7f1da8071660 msgr2=0x7f1da8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:32:00.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.161+0000 7f1daebff700 1 -- 172.21.15.22:0/671341265 shutdown_connections 2023-07-11T00:32:00.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.161+0000 7f1daebff700 1 -- 172.21.15.22:0/671341265 wait complete. 2023-07-11T00:32:00.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.163+0000 7f1daebff700 1 Processor -- start 2023-07-11T00:32:00.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.163+0000 7f1daebff700 1 -- start start 2023-07-11T00:32:00.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.164+0000 7f1daebff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1da80cf8f0 0x7f1da815b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:00.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.164+0000 7f1daebff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1da80d2640 0x7f1da815edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:00.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.164+0000 7f1daebff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da815c460 0x7f1da8159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:00.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.164+0000 7f1daebff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da815afe0 con 0x7f1da815c460 2023-07-11T00:32:00.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.164+0000 7f1daebff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da815a180 con 0x7f1da80cf8f0 2023-07-11T00:32:00.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.164+0000 7f1daebff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da815a360 con 0x7f1da80d2640 2023-07-11T00:32:00.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.164+0000 7f1dac99b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1da80cf8f0 0x7f1da815b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:00.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.164+0000 7f1dac99b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1da80cf8f0 0x7f1da815b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.22:45002/0 (socket says 172.21.15.22:45002) 2023-07-11T00:32:00.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.164+0000 7f1dac99b700 1 -- 172.21.15.22:0/2715861751 learned_addr learned my addr 172.21.15.22:0/2715861751 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:32:00.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.164+0000 7f1dad19c700 1 --2- 172.21.15.22:0/2715861751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da815c460 0x7f1da8159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:00.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.164+0000 7f1da7fff700 1 --2- 172.21.15.22:0/2715861751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1da80d2640 0x7f1da815edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:00.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.165+0000 7f1dad19c700 1 -- 172.21.15.22:0/2715861751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1da80d2640 msgr2=0x7f1da815edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:00.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.165+0000 7f1dad19c700 1 --2- 172.21.15.22:0/2715861751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1da80d2640 0x7f1da815edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:00.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.165+0000 7f1dad19c700 1 -- 172.21.15.22:0/2715861751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1da80cf8f0 msgr2=0x7f1da815b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:00.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.165+0000 7f1dad19c700 1 --2- 172.21.15.22:0/2715861751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1da80cf8f0 0x7f1da815b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:00.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.165+0000 7f1dad19c700 1 -- 172.21.15.22:0/2715861751 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da0009b30 con 0x7f1da815c460 2023-07-11T00:32:00.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.165+0000 7f1dac99b700 1 --2- 172.21.15.22:0/2715861751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1da80cf8f0 0x7f1da815b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:32:00.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.165+0000 7f1dad19c700 1 --2- 172.21.15.22:0/2715861751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da815c460 0x7f1da8159c40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1da0015000 tx=0x7f1da0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:00.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.165+0000 7f1da57fa700 1 -- 172.21.15.22:0/2715861751 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0004630 con 0x7f1da815c460 2023-07-11T00:32:00.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.165+0000 7f1da57fa700 1 -- 172.21.15.22:0/2715861751 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da00047b0 con 0x7f1da815c460 2023-07-11T00:32:00.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.165+0000 7f1daebff700 1 -- 172.21.15.22:0/2715861751 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da815a640 con 0x7f1da815c460 2023-07-11T00:32:00.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.165+0000 7f1da57fa700 1 -- 172.21.15.22:0/2715861751 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da001b670 con 0x7f1da815c460 2023-07-11T00:32:00.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.165+0000 7f1daebff700 1 -- 172.21.15.22:0/2715861751 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da815ac00 con 0x7f1da815c460 2023-07-11T00:32:00.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.166+0000 7f1daebff700 1 -- 172.21.15.22:0/2715861751 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da815b120 con 0x7f1da815c460 2023-07-11T00:32:00.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.167+0000 7f1da57fa700 1 -- 172.21.15.22:0/2715861751 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1da001b7d0 con 0x7f1da815c460 2023-07-11T00:32:00.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.168+0000 7f1da57fa700 1 --2- 172.21.15.22:0/2715861751 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1d8c06ace0 0x7f1d8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:00.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.169+0000 7f1da57fa700 1 -- 172.21.15.22:0/2715861751 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1da008a990 con 0x7f1da815c460 2023-07-11T00:32:00.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.169+0000 7f1dac99b700 1 --2- 172.21.15.22:0/2715861751 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1d8c06ace0 0x7f1d8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:00.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.170+0000 7f1dac99b700 1 --2- 172.21.15.22:0/2715861751 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1d8c06ace0 0x7f1d8c06d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c000f60 tx=0x7f1d9c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:00.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.173+0000 7f1da57fa700 1 -- 172.21.15.22:0/2715861751 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1da00559a0 con 0x7f1da815c460 2023-07-11T00:32:00.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.419+0000 7f1daebff700 1 -- 172.21.15.22:0/2715861751 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1da804ea60 con 0x7f1da815c460 2023-07-11T00:32:00.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.420+0000 7f1da57fa700 1 -- 172.21.15.22:0/2715861751 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f1da0058fc0 con 0x7f1da815c460 2023-07-11T00:32:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:32:00.423 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/2706760734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2706760734},{"type":"v1","addr":"172.21.15.22:6834","nonce":2706760734}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/305167523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":305167523},{"type":"v1","addr":"172.21.15.22:6835","nonce":305167523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5361,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/1347996573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1347996573},{"type":"v1","addr":"172.21.15.184:6836","nonce":1347996573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:31:48.961676+0000","modified":"2023-07-11T00:31:51.968084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5364":{"gid":5364,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.184:6837/2685786652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2685786652},{"type":"v1","addr":"172.21.15.184:6837","nonce":2685786652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-11T00:32:00.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.422+0000 7f1daebff700 1 -- 172.21.15.22:0/2715861751 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1d8c06ace0 msgr2=0x7f1d8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:00.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.422+0000 7f1daebff700 1 --2- 172.21.15.22:0/2715861751 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1d8c06ace0 0x7f1d8c06d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c000f60 tx=0x7f1d9c009040 comp rx=0 tx=0).stop 2023-07-11T00:32:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.422+0000 7f1daebff700 1 -- 172.21.15.22:0/2715861751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da815c460 msgr2=0x7f1da8159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.422+0000 7f1daebff700 1 --2- 172.21.15.22:0/2715861751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da815c460 0x7f1da8159c40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1da0015000 tx=0x7f1da0004ad0 comp rx=0 tx=0).stop 2023-07-11T00:32:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.422+0000 7f1daebff700 1 -- 172.21.15.22:0/2715861751 shutdown_connections 2023-07-11T00:32:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.422+0000 7f1daebff700 1 --2- 172.21.15.22:0/2715861751 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f1d8c06ace0 0x7f1d8c06d190 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.422+0000 7f1daebff700 1 --2- 172.21.15.22:0/2715861751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da815c460 0x7f1da8159c40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.422+0000 7f1daebff700 1 --2- 172.21.15.22:0/2715861751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1da80cf8f0 0x7f1da815b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.422+0000 7f1daebff700 1 --2- 172.21.15.22:0/2715861751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1da80d2640 0x7f1da815edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:00.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.422+0000 7f1daebff700 1 -- 172.21.15.22:0/2715861751 >> 172.21.15.22:0/2715861751 conn(0x7f1da8071660 msgr2=0x7f1da80cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:32:00.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.422+0000 7f1daebff700 1 -- 172.21.15.22:0/2715861751 shutdown_connections 2023-07-11T00:32:00.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:00.422+0000 7f1daebff700 1 -- 172.21.15.22:0/2715861751 wait complete. 2023-07-11T00:32:00.426 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 17 2023-07-11T00:32:00.846 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-11T00:31:48.961676+0000', 'modified': '2023-07-11T00:31:51.968084+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5364}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5364': {'gid': 5364, 'name': 'd', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.184:6837/2685786652', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6835', 'nonce': 2685786652}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 2685786652}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-11T00:32:00.847 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-11T00:32:00.847 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-11T00:32:01.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.050+0000 7f8fe77ff700 1 Processor -- start 2023-07-11T00:32:01.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.050+0000 7f8fe77ff700 1 -- start start 2023-07-11T00:32:01.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.051+0000 7f8fe77ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8fe00cbb60 0x7f8fe00ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.052+0000 7f8fe77ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe006cd50 con 0x7f8fe01588b0 2023-07-11T00:32:01.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.052+0000 7f8fe77ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe00c8ff0 con 0x7f8fe006a640 2023-07-11T00:32:01.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.052+0000 7f8fe77ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe006d280 con 0x7f8fe00cbb60 2023-07-11T00:32:01.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.052+0000 7f8fe559b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8fe01588b0 0x7f8fe0069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53428/0 (socket says 172.21.15.22:53428) 2023-07-11T00:32:01.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.052+0000 7f8fe559b700 1 -- 172.21.15.22:0/3696821129 learned_addr learned my addr 172.21.15.22:0/3696821129 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:32:01.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.052+0000 7f8fe5d9c700 1 --2- 172.21.15.22:0/3696821129 >> v2:172.21.15.184:3300/0 conn(0x7f8fe00cbb60 0x7f8fe00ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.052+0000 7f8fd7fff700 1 -- 172.21.15.22:0/3696821129 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096238005 0 0) 0x7f8fe006cd50 con 0x7f8fe01588b0 2023-07-11T00:32:01.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.052+0000 7f8fd7fff700 1 -- 172.21.15.22:0/3696821129 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fcc0046c0 con 0x7f8fe01588b0 2023-07-11T00:32:01.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.052+0000 7f8fd7fff700 1 -- 172.21.15.22:0/3696821129 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1286199955 0 0) 0x7f8fcc0046c0 con 0x7f8fe01588b0 2023-07-11T00:32:01.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.052+0000 7f8fd7fff700 1 -- 172.21.15.22:0/3696821129 >> v2:172.21.15.184:3300/0 conn(0x7f8fe00cbb60 msgr2=0x7f8fe00ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:32:01.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.052+0000 7f8fd7fff700 1 --2- 172.21.15.22:0/3696821129 >> v2:172.21.15.184:3300/0 conn(0x7f8fe00cbb60 0x7f8fe00ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.052+0000 7f8fd7fff700 1 -- 172.21.15.22:0/3696821129 >> v1:172.21.15.184:6789/0 conn(0x7f8fe006a640 legacy=0x7f8fe00c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:01.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.053+0000 7f8fd7fff700 1 -- 172.21.15.22:0/3696821129 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe006d880 con 0x7f8fe01588b0 2023-07-11T00:32:01.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.053+0000 7f8fd7fff700 1 -- 172.21.15.22:0/3696821129 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7f8fdc001670 con 0x7f8fe01588b0 2023-07-11T00:32:01.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.053+0000 7f8fd7fff700 1 -- 172.21.15.22:0/3696821129 >> v1:172.21.15.22:6789/0 conn(0x7f8fe01588b0 legacy=0x7f8fe0069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:01.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.053+0000 7f8fd7fff700 1 --2- 172.21.15.22:0/3696821129 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fcc004b10 0x7f8fcc004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.053+0000 7f8fd7fff700 1 --2- 172.21.15.22:0/3696821129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fcc005960 0x7f8fcc005dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.053+0000 7f8fd7fff700 1 --2- 172.21.15.22:0/3696821129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fcc006310 0x7f8fcc00cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.053+0000 7f8fd7fff700 1 -- 172.21.15.22:0/3696821129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe006d280 con 0x7f8fcc006310 2023-07-11T00:32:01.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.053+0000 7f8fd7fff700 1 -- 172.21.15.22:0/3696821129 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc00d1f0 con 0x7f8fcc005960 2023-07-11T00:32:01.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.053+0000 7f8fd7fff700 1 -- 172.21.15.22:0/3696821129 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc00d3b0 con 0x7f8fcc004b10 2023-07-11T00:32:01.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.053+0000 7f8fe5d9c700 1 --2- 172.21.15.22:0/3696821129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fcc006310 0x7f8fcc00cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.053+0000 7f8fe559b700 1 --2- 172.21.15.22:0/3696821129 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fcc004b10 0x7f8fcc004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.053+0000 7f8fe4d9a700 1 --2- 172.21.15.22:0/3696821129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fcc005960 0x7f8fcc005dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.053+0000 7f8fe5d9c700 1 -- 172.21.15.22:0/3696821129 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fcc004b10 msgr2=0x7f8fcc004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:32:01.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.053+0000 7f8fe5d9c700 1 --2- 172.21.15.22:0/3696821129 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fcc004b10 0x7f8fcc004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.053+0000 7f8fe5d9c700 1 -- 172.21.15.22:0/3696821129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fcc005960 msgr2=0x7f8fcc005dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:32:01.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.053+0000 7f8fe5d9c700 1 --2- 172.21.15.22:0/3696821129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fcc005960 0x7f8fcc005dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.053+0000 7f8fe5d9c700 1 -- 172.21.15.22:0/3696821129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc0046c0 con 0x7f8fcc006310 2023-07-11T00:32:01.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.054+0000 7f8fe5d9c700 1 -- 172.21.15.22:0/3696821129 reap_dead start 2023-07-11T00:32:01.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.054+0000 7f8fe5d9c700 1 --2- 172.21.15.22:0/3696821129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fcc006310 0x7f8fcc00cb20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00cbfa0 tx=0x7f8fcc006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bc4a2a1a64a7e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:01.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.054+0000 7f8fd7fff700 1 -- 172.21.15.22:0/3696821129 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8003c20 con 0x7f8fcc006310 2023-07-11T00:32:01.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.054+0000 7f8fd7fff700 1 -- 172.21.15.22:0/3696821129 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd800f040 con 0x7f8fcc006310 2023-07-11T00:32:01.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.054+0000 7f8fd7fff700 1 -- 172.21.15.22:0/3696821129 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd800e9d0 con 0x7f8fcc006310 2023-07-11T00:32:01.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.054+0000 7f8fe77ff700 1 -- 172.21.15.22:0/3696821129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fcc006310 msgr2=0x7f8fcc00cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:01.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.054+0000 7f8fe77ff700 1 --2- 172.21.15.22:0/3696821129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fcc006310 0x7f8fcc00cb20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00cbfa0 tx=0x7f8fcc006990 comp rx=0 tx=0).stop 2023-07-11T00:32:01.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.054+0000 7f8fe77ff700 1 -- 172.21.15.22:0/3696821129 shutdown_connections 2023-07-11T00:32:01.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.055+0000 7f8fe77ff700 1 --2- 172.21.15.22:0/3696821129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fcc006310 0x7f8fcc00cb20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.055+0000 7f8fe77ff700 1 -- 172.21.15.22:0/3696821129 >> 172.21.15.22:0/3696821129 conn(0x7f8fe00b0390 msgr2=0x7f8fe00b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:32:01.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.055+0000 7f8fe77ff700 1 -- 172.21.15.22:0/3696821129 shutdown_connections 2023-07-11T00:32:01.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.055+0000 7f8fe77ff700 1 -- 172.21.15.22:0/3696821129 wait complete. 2023-07-11T00:32:01.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.056+0000 7f8fe77ff700 1 Processor -- start 2023-07-11T00:32:01.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.056+0000 7f8fe77ff700 1 -- start start 2023-07-11T00:32:01.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.057+0000 7f8fe77ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fcc006310 0x7f8fe01f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.057+0000 7f8fe77ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe00c8110 0x7f8fe00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.057+0000 7f8fe77ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fe00ab8b0 0x7f8fe00c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.057+0000 7f8fe77ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe01f2280 con 0x7f8fe00c8110 2023-07-11T00:32:01.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.057+0000 7f8fe77ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe01f2560 con 0x7f8fcc006310 2023-07-11T00:32:01.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.057+0000 7f8fe77ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe01f2840 con 0x7f8fe00ab8b0 2023-07-11T00:32:01.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.058+0000 7f8fe4d9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe00c8110 0x7f8fe00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.058+0000 7f8fe4d9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe00c8110 0x7f8fe00ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55798/0 (socket says 172.21.15.22:55798) 2023-07-11T00:32:01.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.058+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/3740529028 learned_addr learned my addr 172.21.15.22:0/3740529028 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:32:01.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.058+0000 7f8fe559b700 1 --2- 172.21.15.22:0/3740529028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fcc006310 0x7f8fe01f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.058+0000 7f8fe5d9c700 1 --2- 172.21.15.22:0/3740529028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fe00ab8b0 0x7f8fe00c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.058+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/3740529028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fe00ab8b0 msgr2=0x7f8fe00c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:01.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.058+0000 7f8fe4d9a700 1 --2- 172.21.15.22:0/3740529028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fe00ab8b0 0x7f8fe00c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.058+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/3740529028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fcc006310 msgr2=0x7f8fe01f1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:01.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.058+0000 7f8fe4d9a700 1 --2- 172.21.15.22:0/3740529028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fcc006310 0x7f8fe01f1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.058+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/3740529028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe00c6980 con 0x7f8fe00c8110 2023-07-11T00:32:01.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.058+0000 7f8fe559b700 1 --2- 172.21.15.22:0/3740529028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fcc006310 0x7f8fe01f1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:32:01.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.058+0000 7f8fe4d9a700 1 --2- 172.21.15.22:0/3740529028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe00c8110 0x7f8fe00ad200 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000f7f0 tx=0x7f8fd000fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:01.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.059+0000 7f8fd5ffb700 1 -- 172.21.15.22:0/3740529028 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0005320 con 0x7f8fe00c8110 2023-07-11T00:32:01.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.059+0000 7f8fd5ffb700 1 -- 172.21.15.22:0/3740529028 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd0005480 con 0x7f8fe00c8110 2023-07-11T00:32:01.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.059+0000 7f8fd5ffb700 1 -- 172.21.15.22:0/3740529028 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0006aa0 con 0x7f8fe00c8110 2023-07-11T00:32:01.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.059+0000 7f8fe77ff700 1 -- 172.21.15.22:0/3740529028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe01f2b20 con 0x7f8fe00c8110 2023-07-11T00:32:01.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.059+0000 7f8fe77ff700 1 -- 172.21.15.22:0/3740529028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe00c8580 con 0x7f8fe00c8110 2023-07-11T00:32:01.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.061+0000 7f8fd5ffb700 1 -- 172.21.15.22:0/3740529028 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8fd0006c00 con 0x7f8fe00c8110 2023-07-11T00:32:01.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.062+0000 7f8fd5ffb700 1 --2- 172.21.15.22:0/3740529028 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f8fc406acd0 0x7f8fc406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.062+0000 7f8fd5ffb700 1 -- 172.21.15.22:0/3740529028 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8fd0088b80 con 0x7f8fe00c8110 2023-07-11T00:32:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.062+0000 7f8fe559b700 1 --2- 172.21.15.22:0/3740529028 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f8fc406acd0 0x7f8fc406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.063+0000 7f8fe559b700 1 --2- 172.21.15.22:0/3740529028 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f8fc406acd0 0x7f8fc406d180 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc007c30 tx=0x7f8fdc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.064+0000 7f8ffb206b80 1 Processor -- start 2023-07-11T00:32:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.064+0000 7f8ffb206b80 1 -- start start 2023-07-11T00:32:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.065+0000 7f8ffb206b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd975d60 0x5653fd976130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.065+0000 7f8ffb206b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd97b1a0 0x5653fd999a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.065+0000 7f8ffb206b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd953120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.065+0000 7f8ffb206b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fd8c7ea0 con 0x5653fd950b60 2023-07-11T00:32:01.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.065+0000 7f8ffb206b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fd83b600 con 0x5653fd97b1a0 2023-07-11T00:32:01.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.065+0000 7f8ffb206b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653fd8aa910 con 0x5653fd975d60 2023-07-11T00:32:01.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.065+0000 7f8fe5d9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd953120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.065+0000 7f8fe559b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd975d60 0x5653fd976130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.065+0000 7f8fe4d9a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd97b1a0 0x5653fd999a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.065+0000 7f8fe5d9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd953120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55804/0 (socket says 172.21.15.22:55804) 2023-07-11T00:32:01.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.065+0000 7f8fe5d9c700 1 -- 172.21.15.22:0/1058727810 learned_addr learned my addr 172.21.15.22:0/1058727810 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:32:01.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.066+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/1058727810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd975d60 msgr2=0x5653fd976130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:32:01.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.066+0000 7f8fe4d9a700 1 --2- 172.21.15.22:0/1058727810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd975d60 0x5653fd976130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.066+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/1058727810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 msgr2=0x5653fd953120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:32:01.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.066+0000 7f8fe4d9a700 1 --2- 172.21.15.22:0/1058727810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd953120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.066+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/1058727810 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653fd697790 con 0x5653fd97b1a0 2023-07-11T00:32:01.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.066+0000 7f8fe5d9c700 1 --2- 172.21.15.22:0/1058727810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd953120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:32:01.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.066+0000 7f8fe4d9a700 1 --2- 172.21.15.22:0/1058727810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd97b1a0 0x5653fd999a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0086d40 tx=0x7f8fd0057070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a57899468b625b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:01.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.067+0000 7f8fc2ffd700 1 -- 172.21.15.22:0/1058727810 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd005fa60 con 0x5653fd97b1a0 2023-07-11T00:32:01.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.067+0000 7f8fc2ffd700 1 -- 172.21.15.22:0/1058727810 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd0055850 con 0x5653fd97b1a0 2023-07-11T00:32:01.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.067+0000 7f8fc2ffd700 1 -- 172.21.15.22:0/1058727810 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0056c00 con 0x5653fd97b1a0 2023-07-11T00:32:01.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.068+0000 7f8ffb206b80 1 -- 172.21.15.22:0/1058727810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd97b1a0 msgr2=0x5653fd999a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:01.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.068+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/1058727810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd97b1a0 0x5653fd999a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0086d40 tx=0x7f8fd0057070 comp rx=0 tx=0).stop 2023-07-11T00:32:01.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.068+0000 7f8ffb206b80 1 -- 172.21.15.22:0/1058727810 shutdown_connections 2023-07-11T00:32:01.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.068+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/1058727810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd975d60 0x5653fd976130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.068+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/1058727810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd953120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.068+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/1058727810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd97b1a0 0x5653fd999a40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.068+0000 7f8ffb206b80 1 -- 172.21.15.22:0/1058727810 >> 172.21.15.22:0/1058727810 conn(0x5653fd948320 msgr2=0x5653fd9985c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:32:01.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.068+0000 7f8ffb206b80 1 -- 172.21.15.22:0/1058727810 shutdown_connections 2023-07-11T00:32:01.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.068+0000 7f8ffb206b80 1 -- 172.21.15.22:0/1058727810 wait complete. 2023-07-11T00:32:01.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.069+0000 7f8ffb206b80 1 -- start start 2023-07-11T00:32:01.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.069+0000 7f8ffb206b80 1 Processor -- start 2023-07-11T00:32:01.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.070+0000 7f8ffb206b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd950b60 0x5653fd9a8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.070+0000 7f8ffb206b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd975d60 0x5653fd991ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.070+0000 7f8ffb206b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd97b1a0 0x5653fd9a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.070+0000 7f8ffb206b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fd8a3be0 con 0x5653fd975d60 2023-07-11T00:32:01.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.070+0000 7f8ffb206b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fd8615b0 con 0x5653fd97b1a0 2023-07-11T00:32:01.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.070+0000 7f8ffb206b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653fd847910 con 0x5653fd950b60 2023-07-11T00:32:01.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.070+0000 7f8ffb206b80 10 client.0 _ll_register_callbacks cb 0x5653fd85fb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-11T00:32:01.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.071+0000 7f8fe4d9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd975d60 0x5653fd991ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.071+0000 7f8fe4d9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd975d60 0x5653fd991ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55806/0 (socket says 172.21.15.22:55806) 2023-07-11T00:32:01.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.071+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/3608273703 learned_addr learned my addr 172.21.15.22:0/3608273703 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:32:01.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.071+0000 7f8fe559b700 1 --2- 172.21.15.22:0/3608273703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd950b60 0x5653fd9a8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.071+0000 7f8fe5d9c700 1 --2- 172.21.15.22:0/3608273703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd97b1a0 0x5653fd9a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.071+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/3608273703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd950b60 msgr2=0x5653fd9a8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:32:01.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.071+0000 7f8fe4d9a700 1 --2- 172.21.15.22:0/3608273703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd950b60 0x5653fd9a8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.071+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/3608273703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd97b1a0 msgr2=0x5653fd9a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:32:01.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.071+0000 7f8fe4d9a700 1 --2- 172.21.15.22:0/3608273703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd97b1a0 0x5653fd9a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.071+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/3608273703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fcc0046c0 con 0x5653fd975d60 2023-07-11T00:32:01.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.071+0000 7f8fe559b700 1 --2- 172.21.15.22:0/3608273703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd950b60 0x5653fd9a8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:32:01.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.071+0000 7f8fe4d9a700 1 --2- 172.21.15.22:0/3608273703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd975d60 0x5653fd991ff0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0053c10 tx=0x7f8fd0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a5c5ed60341809 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:01.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.071+0000 7f8fbbfff700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-07-11T00:32:01.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.072+0000 7f8fbbfff700 1 -- 172.21.15.22:0/3608273703 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd005f7e0 con 0x5653fd975d60 2023-07-11T00:32:01.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.072+0000 7f8fbbfff700 1 -- 172.21.15.22:0/3608273703 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8fd0058b00 con 0x5653fd975d60 2023-07-11T00:32:01.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.072+0000 7f8ffb206b80 1 -- 172.21.15.22:0/3608273703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653fd945930 con 0x5653fd975d60 2023-07-11T00:32:01.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.072+0000 7f8fbbfff700 1 -- 172.21.15.22:0/3608273703 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fd0058cc0 con 0x5653fd975d60 2023-07-11T00:32:01.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.072+0000 7f8ffb206b80 10 client.5568 fetch_fsmap learned FSMap version 17 2023-07-11T00:32:01.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.072+0000 7f8ffb206b80 1 -- 172.21.15.22:0/3608273703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7f8fe00c8580 con 0x5653fd975d60 2023-07-11T00:32:01.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.072+0000 7f8fbbfff700 1 -- 172.21.15.22:0/3608273703 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd007a020 con 0x5653fd975d60 2023-07-11T00:32:01.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.072+0000 7f8fbbfff700 1 -- 172.21.15.22:0/3608273703 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8fd005b160 con 0x5653fd975d60 2023-07-11T00:32:01.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.072+0000 7f8ffb206b80 10 client.5568 fetch_fsmap finished waiting for FSMap version 17 2023-07-11T00:32:01.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.072+0000 7f8ffb206b80 10 client.5568 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-11T00:32:01.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.072+0000 7f8ffb206b80 20 client.5568 populate_metadata read hostname 'smithi022' 2023-07-11T00:32:01.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.072+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/3608273703 >> [v2:172.21.15.184:6835/2685786652,v1:172.21.15.184:6837/2685786652] conn(0x5653fd951000 0x5653fd9513d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.072+0000 7f8ffb206b80 4 client.5568 mds_command: new command op to 5364 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-11T00:32:01.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.072+0000 7f8ffb206b80 1 -- 172.21.15.22:0/3608273703 --> [v2:172.21.15.184:6835/2685786652,v1:172.21.15.184:6837/2685786652] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653fd9220e0 con 0x5653fd951000 2023-07-11T00:32:01.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.073+0000 7f8fe559b700 1 --2- 172.21.15.22:0/3608273703 >> [v2:172.21.15.184:6835/2685786652,v1:172.21.15.184:6837/2685786652] conn(0x5653fd951000 0x5653fd9513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.073+0000 7f8fe559b700 1 --2- 172.21.15.22:0/3608273703 >> [v2:172.21.15.184:6835/2685786652,v1:172.21.15.184:6837/2685786652] conn(0x5653fd951000 0x5653fd9513d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94c2fca0c7a5cdad server_cookie=96435a27e69f3c2 in_seq=0 out_seq=0 2023-07-11T00:32:01.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.073+0000 7f8fbbfff700 10 client.5568 ms_handle_connect on v2:172.21.15.184:6835/2685786652 2023-07-11T00:32:01.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.074+0000 7f8fbbfff700 1 -- 172.21.15.22:0/3608273703 <== mds.0 v2:172.21.15.184:6835/2685786652 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5653fd9220e0 con 0x5653fd951000 2023-07-11T00:32:01.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.074+0000 7f8fbbfff700 10 client.5568 handle_command_reply: tid=0 2023-07-11T00:32:01.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.074+0000 7f8ffb206b80 1 client.5568 shutdown 2023-07-11T00:32:01.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.074+0000 7f8ffb206b80 1 -- 172.21.15.22:0/3608273703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd975d60 msgr2=0x5653fd991ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:01.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.074+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/3608273703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd975d60 0x5653fd991ff0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0053c10 tx=0x7f8fd0007d30 comp rx=0 tx=0).stop 2023-07-11T00:32:01.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.074+0000 7f8ffb206b80 1 -- 172.21.15.22:0/3608273703 shutdown_connections 2023-07-11T00:32:01.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.074+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/3608273703 >> [v2:172.21.15.184:6835/2685786652,v1:172.21.15.184:6837/2685786652] conn(0x5653fd951000 0x5653fd9513d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.074+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/3608273703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd950b60 0x5653fd9a8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.074+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/3608273703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd97b1a0 0x5653fd9a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.074+0000 7f8fbbfff700 0 client.5568 ms_handle_reset on v2:172.21.15.184:6835/2685786652 2023-07-11T00:32:01.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.074+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/3608273703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd975d60 0x5653fd991ff0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.074+0000 7f8ffb206b80 1 -- 172.21.15.22:0/3608273703 >> 172.21.15.22:0/3608273703 conn(0x5653fd948320 msgr2=0x5653fd951c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:32:01.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.075+0000 7f8ffb206b80 1 -- 172.21.15.22:0/3608273703 shutdown_connections 2023-07-11T00:32:01.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.075+0000 7f8ffb206b80 1 -- 172.21.15.22:0/3608273703 wait complete. 2023-07-11T00:32:01.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.075+0000 7f8ffb206b80 20 client.5568 trim_cache size 0 max 16384 2023-07-11T00:32:01.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.093+0000 7f8ffb206b80 1 Processor -- start 2023-07-11T00:32:01.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.093+0000 7f8ffb206b80 1 -- start start 2023-07-11T00:32:01.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.094+0000 7f8ffb206b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd948320 0x5653fd998900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.094+0000 7f8ffb206b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd9a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.094+0000 7f8ffb206b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd975d60 0x5653fd98ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.094+0000 7f8ffb206b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fd698390 con 0x5653fd950b60 2023-07-11T00:32:01.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.094+0000 7f8ffb206b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fd96b230 con 0x5653fd975d60 2023-07-11T00:32:01.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.094+0000 7f8ffb206b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653fd94d7c0 con 0x5653fd948320 2023-07-11T00:32:01.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.094+0000 7f8fe4d9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd9a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.094+0000 7f8fe4d9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd9a88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55822/0 (socket says 172.21.15.22:55822) 2023-07-11T00:32:01.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.094+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/3032182467 learned_addr learned my addr 172.21.15.22:0/3032182467 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:32:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.094+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/3032182467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd948320 msgr2=0x5653fd998900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:32:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.094+0000 7f8fe5d9c700 1 --2- 172.21.15.22:0/3032182467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd975d60 0x5653fd98ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.094+0000 7f8fe559b700 1 --2- 172.21.15.22:0/3032182467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd948320 0x5653fd998900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.094+0000 7f8fe4d9a700 1 --2- 172.21.15.22:0/3032182467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd948320 0x5653fd998900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.095+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/3032182467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd975d60 msgr2=0x5653fd98ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:32:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.095+0000 7f8fe4d9a700 1 --2- 172.21.15.22:0/3032182467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd975d60 0x5653fd98ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.095+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/3032182467 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653fd7840a0 con 0x5653fd950b60 2023-07-11T00:32:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.095+0000 7f8fe5d9c700 1 --2- 172.21.15.22:0/3032182467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd975d60 0x5653fd98ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:32:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.095+0000 7f8fe559b700 1 --2- 172.21.15.22:0/3032182467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd948320 0x5653fd998900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:32:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.095+0000 7f8fe4d9a700 1 --2- 172.21.15.22:0/3032182467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd9a88b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8fd00576a0 tx=0x7f8fd0081000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db5a7778b3530d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.095+0000 7f8fc37fe700 1 -- 172.21.15.22:0/3032182467 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd005f7e0 con 0x5653fd950b60 2023-07-11T00:32:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.095+0000 7f8fc37fe700 1 -- 172.21.15.22:0/3032182467 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd007a070 con 0x5653fd950b60 2023-07-11T00:32:01.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.095+0000 7f8fc37fe700 1 -- 172.21.15.22:0/3032182467 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0058b00 con 0x5653fd950b60 2023-07-11T00:32:01.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.095+0000 7f8ffb206b80 1 -- 172.21.15.22:0/3032182467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 msgr2=0x5653fd9a88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:01.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.095+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/3032182467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd9a88b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8fd00576a0 tx=0x7f8fd0081000 comp rx=0 tx=0).stop 2023-07-11T00:32:01.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.096+0000 7f8ffb206b80 1 -- 172.21.15.22:0/3032182467 shutdown_connections 2023-07-11T00:32:01.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.096+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/3032182467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd948320 0x5653fd998900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.096+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/3032182467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd975d60 0x5653fd98ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.096+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/3032182467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd9a88b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.096+0000 7f8ffb206b80 1 -- 172.21.15.22:0/3032182467 >> 172.21.15.22:0/3032182467 conn(0x5653fd94ddd0 msgr2=0x5653fd949890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:32:01.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.096+0000 7f8ffb206b80 1 -- 172.21.15.22:0/3032182467 shutdown_connections 2023-07-11T00:32:01.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.096+0000 7f8ffb206b80 1 -- 172.21.15.22:0/3032182467 wait complete. 2023-07-11T00:32:01.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.096+0000 7f8ffb206b80 1 -- start start 2023-07-11T00:32:01.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.096+0000 7f8ffb206b80 1 Processor -- start 2023-07-11T00:32:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.097+0000 7f8ffb206b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd948320 0x5653fd97b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.097+0000 7f8ffb206b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd9a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.097+0000 7f8ffb206b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd975d60 0x5653fd9694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.097+0000 7f8ffb206b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fd96a980 con 0x5653fd950b60 2023-07-11T00:32:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.097+0000 7f8ffb206b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fd9b1c40 con 0x5653fd975d60 2023-07-11T00:32:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.097+0000 7f8ffb206b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653fd97bea0 con 0x5653fd948320 2023-07-11T00:32:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.097+0000 7f8ffb206b80 10 client.0 _ll_register_callbacks cb 0x7f8fcc005790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-11T00:32:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.098+0000 7f8fe4d9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd9a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.098+0000 7f8fe4d9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd9a9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55838/0 (socket says 172.21.15.22:55838) 2023-07-11T00:32:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.098+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/1331455247 learned_addr learned my addr 172.21.15.22:0/1331455247 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:32:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.098+0000 7f8fe559b700 1 --2- 172.21.15.22:0/1331455247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd948320 0x5653fd97b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.098+0000 7f8fe5d9c700 1 --2- 172.21.15.22:0/1331455247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd975d60 0x5653fd9694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.098+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/1331455247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd948320 msgr2=0x5653fd97b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:32:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.098+0000 7f8fe4d9a700 1 --2- 172.21.15.22:0/1331455247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd948320 0x5653fd97b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.098+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/1331455247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd975d60 msgr2=0x5653fd9694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:32:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.098+0000 7f8fe4d9a700 1 --2- 172.21.15.22:0/1331455247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd975d60 0x5653fd9694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.098+0000 7f8fe4d9a700 1 -- 172.21.15.22:0/1331455247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe00c8580 con 0x5653fd950b60 2023-07-11T00:32:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.098+0000 7f8fe5d9c700 1 --2- 172.21.15.22:0/1331455247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd975d60 0x5653fd9694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:32:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.098+0000 7f8fe4d9a700 1 --2- 172.21.15.22:0/1331455247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd9a9c90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000f7c0 tx=0x7f8fd0006f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47dbc70fbc65c949 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.098+0000 7f8fbbfff700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-07-11T00:32:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.099+0000 7f8fbbfff700 1 -- 172.21.15.22:0/1331455247 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd005b160 con 0x5653fd950b60 2023-07-11T00:32:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.099+0000 7f8fbbfff700 1 -- 172.21.15.22:0/1331455247 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8fd0088040 con 0x5653fd950b60 2023-07-11T00:32:01.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.099+0000 7f8ffb206b80 1 -- 172.21.15.22:0/1331455247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8fd0055850 con 0x5653fd950b60 2023-07-11T00:32:01.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.099+0000 7f8fbbfff700 1 -- 172.21.15.22:0/1331455247 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fd005b2c0 con 0x5653fd950b60 2023-07-11T00:32:01.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.099+0000 7f8ffb206b80 10 client.5574 fetch_fsmap learned FSMap version 17 2023-07-11T00:32:01.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.099+0000 7f8ffb206b80 1 -- 172.21.15.22:0/1331455247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5653fd869b10 con 0x5653fd950b60 2023-07-11T00:32:01.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.099+0000 7f8fbbfff700 1 -- 172.21.15.22:0/1331455247 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd0055850 con 0x5653fd950b60 2023-07-11T00:32:01.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.099+0000 7f8fbbfff700 1 -- 172.21.15.22:0/1331455247 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8fd0053710 con 0x5653fd950b60 2023-07-11T00:32:01.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.099+0000 7f8ffb206b80 10 client.5574 fetch_fsmap finished waiting for FSMap version 17 2023-07-11T00:32:01.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.099+0000 7f8ffb206b80 10 client.5574 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-11T00:32:01.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.099+0000 7f8ffb206b80 20 client.5574 populate_metadata read hostname 'smithi022' 2023-07-11T00:32:01.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.099+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/1331455247 >> [v2:172.21.15.184:6835/2685786652,v1:172.21.15.184:6837/2685786652] conn(0x5653fd97b1a0 0x5653fd9699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.099+0000 7f8ffb206b80 4 client.5574 mds_command: new command op to 5364 tid=0[{"prefix": "status"}] 2023-07-11T00:32:01.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.099+0000 7f8ffb206b80 1 -- 172.21.15.22:0/1331455247 --> [v2:172.21.15.184:6835/2685786652,v1:172.21.15.184:6837/2685786652] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5653fd89cd20 con 0x5653fd97b1a0 2023-07-11T00:32:01.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.099+0000 7f8fe559b700 1 --2- 172.21.15.22:0/1331455247 >> [v2:172.21.15.184:6835/2685786652,v1:172.21.15.184:6837/2685786652] conn(0x5653fd97b1a0 0x5653fd9699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.100+0000 7f8fe559b700 1 --2- 172.21.15.22:0/1331455247 >> [v2:172.21.15.184:6835/2685786652,v1:172.21.15.184:6837/2685786652] conn(0x5653fd97b1a0 0x5653fd9699e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de714304420b5c9 server_cookie=48989d5614a1cdec in_seq=0 out_seq=0 2023-07-11T00:32:01.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.100+0000 7f8fbbfff700 10 client.5574 ms_handle_connect on v2:172.21.15.184:6835/2685786652 2023-07-11T00:32:01.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.100+0000 7f8fbbfff700 1 -- 172.21.15.22:0/1331455247 <== mds.0 v2:172.21.15.184:6835/2685786652 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5653fd89cd20 con 0x5653fd97b1a0 2023-07-11T00:32:01.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.100+0000 7f8fbbfff700 10 client.5574 handle_command_reply: tid=0 2023-07-11T00:32:01.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.100+0000 7f8ffb206b80 1 client.5574 shutdown 2023-07-11T00:32:01.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.100+0000 7f8ffb206b80 1 -- 172.21.15.22:0/1331455247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 msgr2=0x5653fd9a9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:01.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.100+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/1331455247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd9a9c90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000f7c0 tx=0x7f8fd0006f60 comp rx=0 tx=0).stop 2023-07-11T00:32:01.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.100+0000 7f8ffb206b80 1 -- 172.21.15.22:0/1331455247 shutdown_connections 2023-07-11T00:32:01.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.100+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/1331455247 >> [v2:172.21.15.184:6835/2685786652,v1:172.21.15.184:6837/2685786652] conn(0x5653fd97b1a0 0x5653fd9699e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.101+0000 7f8fbbfff700 0 client.5574 ms_handle_reset on v2:172.21.15.184:6835/2685786652 2023-07-11T00:32:01.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.100+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/1331455247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5653fd948320 0x5653fd97b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.101+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/1331455247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5653fd975d60 0x5653fd9694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.101+0000 7f8ffb206b80 1 --2- 172.21.15.22:0/1331455247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653fd950b60 0x5653fd9a9c90 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.101+0000 7f8ffb206b80 1 -- 172.21.15.22:0/1331455247 >> 172.21.15.22:0/1331455247 conn(0x5653fd94ddd0 msgr2=0x5653fd9a8860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:32:01.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.101+0000 7f8ffb206b80 1 -- 172.21.15.22:0/1331455247 shutdown_connections 2023-07-11T00:32:01.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.101+0000 7f8ffb206b80 1 -- 172.21.15.22:0/1331455247 wait complete. 2023-07-11T00:32:01.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.101+0000 7f8ffb206b80 20 client.5574 trim_cache size 0 max 16384 2023-07-11T00:32:01.112 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-07-11T00:32:01.112 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "c306ab0a-3faf-4f52-9dba-c4f0807b892e", 2023-07-11T00:32:01.112 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-07-11T00:32:01.113 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 5364, 2023-07-11T00:32:01.113 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-07-11T00:32:01.113 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-07-11T00:32:01.113 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-07-11T00:32:01.113 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 11.662685067, 2023-07-11T00:32:01.113 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 17, 2023-07-11T00:32:01.113 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 38, 2023-07-11T00:32:01.114 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 38, 2023-07-11T00:32:01.114 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 20.559443095999999 2023-07-11T00:32:01.114 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-07-11T00:32:01.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.101+0000 7f8fe77ff700 1 -- 172.21.15.22:0/3740529028 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f8fc406acd0 msgr2=0x7f8fc406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:01.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.101+0000 7f8fe77ff700 1 --2- 172.21.15.22:0/3740529028 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f8fc406acd0 0x7f8fc406d180 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc007c30 tx=0x7f8fdc009040 comp rx=0 tx=0).stop 2023-07-11T00:32:01.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.101+0000 7f8fe77ff700 1 -- 172.21.15.22:0/3740529028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe00c8110 msgr2=0x7f8fe00ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:01.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.101+0000 7f8fe77ff700 1 --2- 172.21.15.22:0/3740529028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe00c8110 0x7f8fe00ad200 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000f7f0 tx=0x7f8fd000fbb0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.101+0000 7f8fe77ff700 1 -- 172.21.15.22:0/3740529028 shutdown_connections 2023-07-11T00:32:01.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.101+0000 7f8fe77ff700 1 --2- 172.21.15.22:0/3740529028 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f8fc406acd0 0x7f8fc406d180 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.101+0000 7f8fe77ff700 1 --2- 172.21.15.22:0/3740529028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fe00ab8b0 0x7f8fe00c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.101+0000 7f8fe77ff700 1 --2- 172.21.15.22:0/3740529028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fcc006310 0x7f8fe01f1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.101+0000 7f8fe77ff700 1 --2- 172.21.15.22:0/3740529028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fe00c8110 0x7f8fe00ad200 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.101+0000 7f8fe77ff700 1 -- 172.21.15.22:0/3740529028 >> 172.21.15.22:0/3740529028 conn(0x7f8fe00b0390 msgr2=0x7f8fe0153ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:32:01.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.102+0000 7f8fe77ff700 1 -- 172.21.15.22:0/3740529028 shutdown_connections 2023-07-11T00:32:01.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.102+0000 7f8fe77ff700 1 -- 172.21.15.22:0/3740529028 wait complete. 2023-07-11T00:32:01.121 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-11T00:32:01.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.320+0000 7f76eb5ff700 1 Processor -- start 2023-07-11T00:32:01.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.320+0000 7f76eb5ff700 1 -- start start 2023-07-11T00:32:01.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.321+0000 7f76eb5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76e415fe00 0x7f76e40cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.321+0000 7f76eb5ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f76e41601d0 0x7f76e4160640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.321+0000 7f76eb5ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e40cd120 con 0x7f76e40d29b0 2023-07-11T00:32:01.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.321+0000 7f76eb5ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e40cd930 con 0x7f76e41601d0 2023-07-11T00:32:01.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.321+0000 7f76eb5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40d06a0 con 0x7f76e415fe00 2023-07-11T00:32:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.321+0000 7f76e9b9c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f76e40d29b0 0x7f76e40d2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53438/0 (socket says 172.21.15.22:53438) 2023-07-11T00:32:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.321+0000 7f76e9b9c700 1 -- 172.21.15.22:0/2343314246 learned_addr learned my addr 172.21.15.22:0/2343314246 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:32:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.322+0000 7f76e939b700 1 --2- 172.21.15.22:0/2343314246 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76e415fe00 0x7f76e40cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.322+0000 7f76e8b9a700 1 --2- 172.21.15.22:0/2343314246 >> v2:172.21.15.184:3300/0 conn(0x7f76e41601d0 0x7f76e4160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.322+0000 7f76dbfff700 1 -- 172.21.15.22:0/2343314246 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729900627 0 0) 0x7f76e40cd120 con 0x7f76e40d29b0 2023-07-11T00:32:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.322+0000 7f76e939b700 1 -- 172.21.15.22:0/2343314246 >> v2:172.21.15.184:3300/0 conn(0x7f76e41601d0 msgr2=0x7f76e4160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:32:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.322+0000 7f76e939b700 1 --2- 172.21.15.22:0/2343314246 >> v2:172.21.15.184:3300/0 conn(0x7f76e41601d0 0x7f76e4160640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.322+0000 7f76e939b700 1 -- 172.21.15.22:0/2343314246 >> v1:172.21.15.22:6789/0 conn(0x7f76e40d29b0 legacy=0x7f76e40d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.322+0000 7f76e939b700 1 -- 172.21.15.22:0/2343314246 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e40d0940 con 0x7f76e415fe00 2023-07-11T00:32:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.322+0000 7f76e939b700 1 --2- 172.21.15.22:0/2343314246 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76e415fe00 0x7f76e40cf810 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009840 tx=0x7f76e0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19e8b81f937db3d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.322+0000 7f76dbfff700 1 -- 172.21.15.22:0/2343314246 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e0011830 con 0x7f76e415fe00 2023-07-11T00:32:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.323+0000 7f76dbfff700 1 -- 172.21.15.22:0/2343314246 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e0011990 con 0x7f76e415fe00 2023-07-11T00:32:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.323+0000 7f76dbfff700 1 -- 172.21.15.22:0/2343314246 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e0011d20 con 0x7f76e415fe00 2023-07-11T00:32:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.323+0000 7f76eb5ff700 1 -- 172.21.15.22:0/2343314246 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76e415fe00 msgr2=0x7f76e40cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.323+0000 7f76eb5ff700 1 --2- 172.21.15.22:0/2343314246 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76e415fe00 0x7f76e40cf810 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009840 tx=0x7f76e0009b50 comp rx=0 tx=0).stop 2023-07-11T00:32:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.323+0000 7f76eb5ff700 1 -- 172.21.15.22:0/2343314246 shutdown_connections 2023-07-11T00:32:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.323+0000 7f76eb5ff700 1 --2- 172.21.15.22:0/2343314246 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76e415fe00 0x7f76e40cf810 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.323+0000 7f76eb5ff700 1 --2- 172.21.15.22:0/2343314246 >> v2:172.21.15.184:3300/0 conn(0x7f76e41601d0 0x7f76e4160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.323+0000 7f76eb5ff700 1 -- 172.21.15.22:0/2343314246 >> 172.21.15.22:0/2343314246 conn(0x7f76e4071660 msgr2=0x7f76e4071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:32:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.323+0000 7f76eb5ff700 1 -- 172.21.15.22:0/2343314246 shutdown_connections 2023-07-11T00:32:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.323+0000 7f76eb5ff700 1 -- 172.21.15.22:0/2343314246 wait complete. 2023-07-11T00:32:01.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.325+0000 7f76eb5ff700 1 Processor -- start 2023-07-11T00:32:01.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.325+0000 7f76eb5ff700 1 -- start start 2023-07-11T00:32:01.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.326+0000 7f76eb5ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76e40d29b0 0x7f76e40c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.326+0000 7f76eb5ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76e415fe00 0x7f76e40c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.326+0000 7f76eb5ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76e41601d0 0x7f76e40b6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.326+0000 7f76eb5ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40c8410 con 0x7f76e415fe00 2023-07-11T00:32:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.326+0000 7f76eb5ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40c86f0 con 0x7f76e41601d0 2023-07-11T00:32:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.326+0000 7f76eb5ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40c89d0 con 0x7f76e40d29b0 2023-07-11T00:32:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.326+0000 7f76e8b9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76e415fe00 0x7f76e40c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.326+0000 7f76e8b9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76e415fe00 0x7f76e40c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55846/0 (socket says 172.21.15.22:55846) 2023-07-11T00:32:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.326+0000 7f76e8b9a700 1 -- 172.21.15.22:0/589627802 learned_addr learned my addr 172.21.15.22:0/589627802 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:32:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.326+0000 7f76e939b700 1 --2- 172.21.15.22:0/589627802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76e40d29b0 0x7f76e40c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.326+0000 7f76e9b9c700 1 --2- 172.21.15.22:0/589627802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76e41601d0 0x7f76e40b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.327+0000 7f76e8b9a700 1 -- 172.21.15.22:0/589627802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76e40d29b0 msgr2=0x7f76e40c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.327+0000 7f76e8b9a700 1 --2- 172.21.15.22:0/589627802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76e40d29b0 0x7f76e40c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.327+0000 7f76e8b9a700 1 -- 172.21.15.22:0/589627802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76e41601d0 msgr2=0x7f76e40b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.327+0000 7f76e8b9a700 1 --2- 172.21.15.22:0/589627802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76e41601d0 0x7f76e40b6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.327+0000 7f76e8b9a700 1 -- 172.21.15.22:0/589627802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e00094a0 con 0x7f76e415fe00 2023-07-11T00:32:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.327+0000 7f76e8b9a700 1 --2- 172.21.15.22:0/589627802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76e415fe00 0x7f76e40c6600 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f76d400e870 tx=0x7f76d400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.327+0000 7f76d9ffb700 1 -- 172.21.15.22:0/589627802 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4009590 con 0x7f76e415fe00 2023-07-11T00:32:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.327+0000 7f76d9ffb700 1 -- 172.21.15.22:0/589627802 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d4013680 con 0x7f76e415fe00 2023-07-11T00:32:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.327+0000 7f76eb5ff700 1 -- 172.21.15.22:0/589627802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e40c8cb0 con 0x7f76e415fe00 2023-07-11T00:32:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.327+0000 7f76d9ffb700 1 -- 172.21.15.22:0/589627802 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d40139f0 con 0x7f76e415fe00 2023-07-11T00:32:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.327+0000 7f76eb5ff700 1 -- 172.21.15.22:0/589627802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e40c6b40 con 0x7f76e415fe00 2023-07-11T00:32:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.328+0000 7f76eb5ff700 1 -- 172.21.15.22:0/589627802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e40c9300 con 0x7f76e415fe00 2023-07-11T00:32:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.329+0000 7f76d9ffb700 1 -- 172.21.15.22:0/589627802 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76d4013b50 con 0x7f76e415fe00 2023-07-11T00:32:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.331+0000 7f76d9ffb700 1 --2- 172.21.15.22:0/589627802 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f76c806ace0 0x7f76c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.331+0000 7f76d9ffb700 1 -- 172.21.15.22:0/589627802 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f76d4089460 con 0x7f76e415fe00 2023-07-11T00:32:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.331+0000 7f76e939b700 1 --2- 172.21.15.22:0/589627802 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f76c806ace0 0x7f76c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:01.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.332+0000 7f76e939b700 1 --2- 172.21.15.22:0/589627802 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f76c806ace0 0x7f76c806d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f76e00090b0 tx=0x7f76e001c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.335+0000 7f76d9ffb700 1 -- 172.21.15.22:0/589627802 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f76d4057dc0 con 0x7f76e415fe00 2023-07-11T00:32:01.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.585+0000 7f76eb5ff700 1 -- 172.21.15.22:0/589627802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f76e404ea60 con 0x7f76e415fe00 2023-07-11T00:32:01.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.586+0000 7f76d9ffb700 1 -- 172.21.15.22:0/589627802 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f76d4057950 con 0x7f76e415fe00 2023-07-11T00:32:01.589 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-11T00:32:01.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.588+0000 7f76eb5ff700 1 -- 172.21.15.22:0/589627802 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f76c806ace0 msgr2=0x7f76c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:01.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.588+0000 7f76eb5ff700 1 --2- 172.21.15.22:0/589627802 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f76c806ace0 0x7f76c806d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f76e00090b0 tx=0x7f76e001c040 comp rx=0 tx=0).stop 2023-07-11T00:32:01.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.588+0000 7f76eb5ff700 1 -- 172.21.15.22:0/589627802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76e415fe00 msgr2=0x7f76e40c6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:01.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.588+0000 7f76eb5ff700 1 --2- 172.21.15.22:0/589627802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76e415fe00 0x7f76e40c6600 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f76d400e870 tx=0x7f76d400eb80 comp rx=0 tx=0).stop 2023-07-11T00:32:01.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.588+0000 7f76eb5ff700 1 -- 172.21.15.22:0/589627802 shutdown_connections 2023-07-11T00:32:01.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.588+0000 7f76eb5ff700 1 --2- 172.21.15.22:0/589627802 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f76c806ace0 0x7f76c806d190 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.588+0000 7f76eb5ff700 1 --2- 172.21.15.22:0/589627802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76e40d29b0 0x7f76e40c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.588+0000 7f76eb5ff700 1 --2- 172.21.15.22:0/589627802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76e41601d0 0x7f76e40b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.588+0000 7f76eb5ff700 1 --2- 172.21.15.22:0/589627802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76e415fe00 0x7f76e40c6600 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:01.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.588+0000 7f76eb5ff700 1 -- 172.21.15.22:0/589627802 >> 172.21.15.22:0/589627802 conn(0x7f76e4071660 msgr2=0x7f76e40d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:32:01.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.588+0000 7f76eb5ff700 1 -- 172.21.15.22:0/589627802 shutdown_connections 2023-07-11T00:32:01.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:01.588+0000 7f76eb5ff700 1 -- 172.21.15.22:0/589627802 wait complete. 2023-07-11T00:32:01.608 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-11T00:32:01.609 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-11T00:32:01.609 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-07-11T00:32:01.610 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-11T00:32:01.610 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-11T00:32:01.611 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-11T00:32:01.611 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-11T00:32:01.612 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-11T00:32:01.613 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-11T00:32:01.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:32:01.614 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-07-11T00:32:01.661 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-11T00:32:01.662 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-11T00:32:01.662 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-07-11T00:32:01.662 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:32:01.662 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-07-11T00:32:01.662 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:32:01.663 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:32:01.663 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-07-11T00:32:01.663 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-07-11T00:32:01.663 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:32:01.663 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-07-11T00:32:01.663 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-07-11T00:32:01.663 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-11T00:32:01.663 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:32:01.664 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-07-11T00:32:01.664 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-11T00:32:01.664 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42218sec preferred_lft 42218sec 2023-07-11T00:32:01.664 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-07-11T00:32:01.664 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:32:01.664 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:32:01.664 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:32:01.665 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-07-11T00:32:01.665 INFO:teuthology.orchestra.run.smithi022.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-11T00:32:01.665 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 5e:cc:7b:30:0f:a9 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:32:01.665 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-11T00:32:01.665 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:32:01.665 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::c4a2:20ff:fe26:3621/64 scope link 2023-07-11T00:32:01.665 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:32:01.666 INFO:teuthology.orchestra.run.smithi022.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-11T00:32:01.666 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:8e:86:c3:8d:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-11T00:32:01.666 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec8e:86ff:fec3:8d07/64 scope link 2023-07-11T00:32:01.666 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:32:01.666 INFO:teuthology.orchestra.run.smithi022.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-11T00:32:01.666 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 5e:cc:7b:30:0f:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-11T00:32:01.666 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::5ccc:7bff:fe30:fa9/64 scope link 2023-07-11T00:32:01.666 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:32:01.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:32:01.668 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-11T00:32:01.735 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-07-11T00:32:01.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:32:01.739 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-07-11T00:32:01.788 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-07-11T00:32:01.789 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-11T00:32:01.789 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-11T00:32:01.789 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-11T00:32:01.789 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-11T00:32:01.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:32:01.790 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-07-11T00:32:01.790 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-07-11T00:32:01.790 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-11T00:32:01.791 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-11T00:32:01.791 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-11T00:32:01.791 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-07-11T00:32:01.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:32:01.962 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-07-11T00:32:02.009 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-11T00:32:02.009 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-11T00:32:02.010 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-11T00:32:02.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:32:02.011 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-07-11T00:32:02.084 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-11T00:32:02.085 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-11T00:32:02.132 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-11T00:32:02.132 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-11T00:32:02.133 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-11T00:32:02.218 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-11T00:32:02.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:32:02.219 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-11T00:32:02.364 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-11T00:32:02.364 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-11T00:32:02.364 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2023-07-11T00:32:02.380 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-11T00:32:02.380 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-11T00:32:02.380 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2023-07-11T00:32:02.380 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-11T00:32:02.380 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-11T00:32:02.402 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-11T00:32:02.403 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-11T00:32:02.403 INFO:teuthology.orchestra.run.smithi022.stdout:invalid new device string format 2023-07-11T00:32:02.403 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-07-11T00:32:02.403 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-11T00:32:02.403 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-07-11T00:32:02.403 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-07-11T00:32:02.404 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c306ab0a-3faf-4f52-9dba-c4f0807b892e" will pass to kernel 2023-07-11T00:32:02.408 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-11T00:32:02.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:32:02.408 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-11T00:32:02.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:32:02.480 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-11T00:32:02.591 INFO:teuthology.orchestra.run.smithi022.stdout:client5583 2023-07-11T00:32:02.591 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:32:02.591 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:32:02.638 DEBUG:teuthology.orchestra.run.smithi022:> mktemp -d --suffix=xfstests-dev 2023-07-11T00:32:02.725 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.QzQkhuoEboxfstests-dev 2023-07-11T00:32:02.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:32:02.726 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.QzQkhuoEboxfstests-dev) 2023-07-11T00:32:02.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:32:02.838 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.QzQkhuoEboxfstests-dev) 2023-07-11T00:32:02.890 INFO:teuthology.orchestra.run.smithi022.stderr:Cloning into '/tmp/tmp.QzQkhuoEboxfstests-dev'... 2023-07-11T00:32:03.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:32:03.818 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-07-11T00:32:03.874 DEBUG:teuthology.orchestra.run.smithi022:> mktemp -d --suffix=test 2023-07-11T00:32:03.919 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.pzJBEiZFlJtest 2023-07-11T00:32:03.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:32:03.920 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-07-11T00:32:04.010 DEBUG:teuthology.orchestra.run.smithi022:> mktemp -d --suffix=scratch 2023-07-11T00:32:04.056 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:32:04.057 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "8". 2023-07-11T00:32:04.057 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-07-11T00:32:05.217 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:05:08 ago on Tue 11 Jul 2023 12:26:57 AM UTC. 2023-07-11T00:32:05.842 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:32:05.847 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:32:06.532 INFO:teuthology.orchestra.run.smithi022.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-07-11T00:32:06.533 INFO:teuthology.orchestra.run.smithi022.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-07-11T00:32:06.534 INFO:teuthology.orchestra.run.smithi022.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-07-11T00:32:06.536 INFO:teuthology.orchestra.run.smithi022.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-07-11T00:32:06.537 INFO:teuthology.orchestra.run.smithi022.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-07-11T00:32:06.539 INFO:teuthology.orchestra.run.smithi022.stdout:Package e2fsprogs-1.45.6-5.el8.x86_64 is already installed. 2023-07-11T00:32:06.541 INFO:teuthology.orchestra.run.smithi022.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-07-11T00:32:06.542 INFO:teuthology.orchestra.run.smithi022.stdout:Package gcc-8.5.0-19.el8.x86_64 is already installed. 2023-07-11T00:32:06.544 INFO:teuthology.orchestra.run.smithi022.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-07-11T00:32:06.545 INFO:teuthology.orchestra.run.smithi022.stdout:Package lvm2-8:2.03.14-9.el8.x86_64 is already installed. 2023-07-11T00:32:06.546 INFO:teuthology.orchestra.run.smithi022.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-07-11T00:32:06.547 INFO:teuthology.orchestra.run.smithi022.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-07-11T00:32:06.548 INFO:teuthology.orchestra.run.smithi022.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-07-11T00:32:06.549 INFO:teuthology.orchestra.run.smithi022.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-07-11T00:32:06.550 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsdump-3.1.8-6.el8.x86_64 is already installed. 2023-07-11T00:32:06.552 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-07-11T00:32:06.553 INFO:teuthology.orchestra.run.smithi022.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-11T00:32:06.554 INFO:teuthology.orchestra.run.smithi022.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-11T00:32:06.555 INFO:teuthology.orchestra.run.smithi022.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-07-11T00:32:06.556 INFO:teuthology.orchestra.run.smithi022.stdout:Package libuuid-devel-2.32.1-42.el8.x86_64 is already installed. 2023-07-11T00:32:06.557 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsprogs-devel-5.0.0-12.el8.x86_64 is already installed. 2023-07-11T00:32:06.559 INFO:teuthology.orchestra.run.smithi022.stdout:Package sqlite-3.26.0-17.el8.x86_64 is already installed. 2023-07-11T00:32:06.564 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-07-11T00:32:06.752 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-07-11T00:32:06.755 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2023-07-11T00:32:06.755 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-07-11T00:32:06.755 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2023-07-11T00:32:06.756 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-07-11T00:32:06.756 INFO:teuthology.orchestra.run.smithi022.stdout: dump x86_64 1:0.4-0.36.b46.el8 baseos 164 k 2023-07-11T00:32:06.756 INFO:teuthology.orchestra.run.smithi022.stdout: fio x86_64 3.19-4.el8 appstream 538 k 2023-07-11T00:32:06.757 INFO:teuthology.orchestra.run.smithi022.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-07-11T00:32:06.757 INFO:teuthology.orchestra.run.smithi022.stdout: python2 x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 110 k 2023-07-11T00:32:06.757 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2023-07-11T00:32:06.757 INFO:teuthology.orchestra.run.smithi022.stdout: cpp x86_64 8.5.0-20.el8 baseos 10 M 2023-07-11T00:32:06.757 INFO:teuthology.orchestra.run.smithi022.stdout: gcc x86_64 8.5.0-20.el8 baseos 24 M 2023-07-11T00:32:06.757 INFO:teuthology.orchestra.run.smithi022.stdout: gcc-gdb-plugin x86_64 8.5.0-20.el8 appstream 121 k 2023-07-11T00:32:06.757 INFO:teuthology.orchestra.run.smithi022.stdout: gcc-plugin-annobin x86_64 8.5.0-20.el8 baseos 36 k 2023-07-11T00:32:06.758 INFO:teuthology.orchestra.run.smithi022.stdout: libgcc x86_64 8.5.0-20.el8 baseos 81 k 2023-07-11T00:32:06.758 INFO:teuthology.orchestra.run.smithi022.stdout: libgomp x86_64 8.5.0-20.el8 baseos 208 k 2023-07-11T00:32:06.758 INFO:teuthology.orchestra.run.smithi022.stdout: sqlite x86_64 3.26.0-18.el8 baseos 668 k 2023-07-11T00:32:06.758 INFO:teuthology.orchestra.run.smithi022.stdout: sqlite-libs x86_64 3.26.0-18.el8 baseos 581 k 2023-07-11T00:32:06.758 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2023-07-11T00:32:06.758 INFO:teuthology.orchestra.run.smithi022.stdout: daxctl-libs x86_64 71.1-7.el8 baseos 42 k 2023-07-11T00:32:06.758 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemblk x86_64 1.6.1-1.el8 appstream 92 k 2023-07-11T00:32:06.759 INFO:teuthology.orchestra.run.smithi022.stdout: ndctl-libs x86_64 71.1-7.el8 baseos 80 k 2023-07-11T00:32:06.759 INFO:teuthology.orchestra.run.smithi022.stdout: python2-libs x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 6.5 M 2023-07-11T00:32:06.759 INFO:teuthology.orchestra.run.smithi022.stdout: python2-pip-wheel noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 892 k 2023-07-11T00:32:06.759 INFO:teuthology.orchestra.run.smithi022.stdout: python2-setuptools-wheel noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 287 k 2023-07-11T00:32:06.759 INFO:teuthology.orchestra.run.smithi022.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module_el8+299+aa6e9afa appstream 44 k 2023-07-11T00:32:06.759 INFO:teuthology.orchestra.run.smithi022.stdout: rmt x86_64 2:1.5.3-13.el8 baseos 51 k 2023-07-11T00:32:06.759 INFO:teuthology.orchestra.run.smithi022.stdout:Installing weak dependencies: 2023-07-11T00:32:06.759 INFO:teuthology.orchestra.run.smithi022.stdout: python2-pip noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 1.8 M 2023-07-11T00:32:06.760 INFO:teuthology.orchestra.run.smithi022.stdout: python2-setuptools noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 702 k 2023-07-11T00:32:06.760 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling module streams: 2023-07-11T00:32:06.760 INFO:teuthology.orchestra.run.smithi022.stdout: python27 2.7 2023-07-11T00:32:06.760 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:32:06.760 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-07-11T00:32:06.760 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2023-07-11T00:32:06.760 INFO:teuthology.orchestra.run.smithi022.stdout:Install 14 Packages 2023-07-11T00:32:06.760 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 8 Packages 2023-07-11T00:32:06.761 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:32:06.761 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 47 M 2023-07-11T00:32:06.761 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-07-11T00:32:07.282 INFO:teuthology.orchestra.run.smithi022.stdout:(1/22): libpmemblk-1.6.1-1.el8.x86_64.rpm 982 kB/s | 92 kB 00:00 2023-07-11T00:32:07.308 INFO:teuthology.orchestra.run.smithi022.stdout:(2/22): python2-2.7.18-12.module_el8+299+aa6e9a 930 kB/s | 110 kB 00:00 2023-07-11T00:32:07.391 INFO:teuthology.orchestra.run.smithi022.stdout:(3/22): fio-3.19-4.el8.x86_64.rpm 2.6 MB/s | 538 kB 00:00 2023-07-11T00:32:07.541 INFO:teuthology.orchestra.run.smithi022.stdout:(4/22): python2-pip-wheel-9.0.3-19.module_el8+2 5.8 MB/s | 892 kB 00:00 2023-07-11T00:32:07.617 INFO:teuthology.orchestra.run.smithi022.stdout:(5/22): python2-pip-9.0.3-19.module_el8+299+aa6 5.9 MB/s | 1.8 MB 00:00 2023-07-11T00:32:07.675 INFO:teuthology.orchestra.run.smithi022.stdout:(6/22): python2-setuptools-wheel-39.0.1-13.modu 4.8 MB/s | 287 kB 00:00 2023-07-11T00:32:07.709 INFO:teuthology.orchestra.run.smithi022.stdout:(7/22): python2-setuptools-39.0.1-13.module_el8 4.1 MB/s | 702 kB 00:00 2023-07-11T00:32:07.734 INFO:teuthology.orchestra.run.smithi022.stdout:(8/22): python2-wheel-wheel-0.31.1-3.module_el8 761 kB/s | 44 kB 00:00 2023-07-11T00:32:07.876 INFO:teuthology.orchestra.run.smithi022.stdout:(9/22): daxctl-libs-71.1-7.el8.x86_64.rpm 253 kB/s | 42 kB 00:00 2023-07-11T00:32:07.952 INFO:teuthology.orchestra.run.smithi022.stdout:(10/22): dump-0.4-0.36.b46.el8.x86_64.rpm 756 kB/s | 164 kB 00:00 2023-07-11T00:32:08.085 INFO:teuthology.orchestra.run.smithi022.stdout:(11/22): python2-libs-2.7.18-12.module_el8+299+ 8.1 MB/s | 6.5 MB 00:00 2023-07-11T00:32:08.110 INFO:teuthology.orchestra.run.smithi022.stdout:(12/22): ndctl-libs-71.1-7.el8.x86_64.rpm 343 kB/s | 80 kB 00:00 2023-07-11T00:32:08.136 INFO:teuthology.orchestra.run.smithi022.stdout:(13/22): rmt-1.5.3-13.el8.x86_64.rpm 280 kB/s | 51 kB 00:00 2023-07-11T00:32:08.170 INFO:teuthology.orchestra.run.smithi022.stdout:(14/22): gcc-gdb-plugin-8.5.0-20.el8.x86_64.rpm 2.0 MB/s | 121 kB 00:00 2023-07-11T00:32:08.886 INFO:teuthology.orchestra.run.smithi022.stdout:(15/22): indent-2.2.13-2.el8.x86_64.rpm 233 kB/s | 187 kB 00:00 2023-07-11T00:32:09.045 INFO:teuthology.orchestra.run.smithi022.stdout:(16/22): gcc-plugin-annobin-8.5.0-20.el8.x86_64 226 kB/s | 36 kB 00:00 2023-07-11T00:32:09.271 INFO:teuthology.orchestra.run.smithi022.stdout:(17/22): libgcc-8.5.0-20.el8.x86_64.rpm 362 kB/s | 81 kB 00:00 2023-07-11T00:32:09.479 INFO:teuthology.orchestra.run.smithi022.stdout:(18/22): libgomp-8.5.0-20.el8.x86_64.rpm 1.0 MB/s | 208 kB 00:00 2023-07-11T00:32:09.700 INFO:teuthology.orchestra.run.smithi022.stdout:(19/22): cpp-8.5.0-20.el8.x86_64.rpm 6.7 MB/s | 10 MB 00:01 2023-07-11T00:32:09.988 INFO:teuthology.orchestra.run.smithi022.stdout:(20/22): sqlite-libs-3.26.0-18.el8.x86_64.rpm 2.0 MB/s | 581 kB 00:00 2023-07-11T00:32:10.072 INFO:teuthology.orchestra.run.smithi022.stdout:(21/22): sqlite-3.26.0-18.el8.x86_64.rpm 1.1 MB/s | 668 kB 00:00 2023-07-11T00:32:11.172 INFO:teuthology.orchestra.run.smithi022.stdout:(22/22): gcc-8.5.0-20.el8.x86_64.rpm 7.8 MB/s | 24 MB 00:03 2023-07-11T00:32:11.173 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-07-11T00:32:11.173 INFO:teuthology.orchestra.run.smithi022.stdout:Total 11 MB/s | 47 MB 00:04 2023-07-11T00:32:11.889 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-07-11T00:32:12.011 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-07-11T00:32:12.012 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-07-11T00:32:12.509 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-07-11T00:32:12.513 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-07-11T00:32:13.715 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-07-11T00:32:13.863 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libgcc-8.5.0-20.el8.x86_64 1/30 2023-07-11T00:32:13.987 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libgcc-8.5.0-20.el8.x86_64 1/30 2023-07-11T00:32:14.153 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : sqlite-libs-3.26.0-18.el8.x86_64 2/30 2023-07-11T00:32:14.313 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : daxctl-libs-71.1-7.el8.x86_64 3/30 2023-07-11T00:32:14.404 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: daxctl-libs-71.1-7.el8.x86_64 3/30 2023-07-11T00:32:14.579 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ndctl-libs-71.1-7.el8.x86_64 4/30 2023-07-11T00:32:14.664 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ndctl-libs-71.1-7.el8.x86_64 4/30 2023-07-11T00:32:14.795 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 5/30 2023-07-11T00:32:14.893 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 5/30 2023-07-11T00:32:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libgomp-8.5.0-20.el8.x86_64 6/30 2023-07-11T00:32:16.205 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libgomp-8.5.0-20.el8.x86_64 6/30 2023-07-11T00:32:16.495 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : cpp-8.5.0-20.el8.x86_64 7/30 2023-07-11T00:32:18.455 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cpp-8.5.0-20.el8.x86_64 7/30 2023-07-11T00:32:18.695 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : gcc-8.5.0-20.el8.x86_64 8/30 2023-07-11T00:32:18.806 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: gcc-8.5.0-20.el8.x86_64 8/30 2023-07-11T00:32:19.010 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 9/30 2023-07-11T00:32:19.145 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 10/30 2023-07-11T00:32:20.691 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 11/30 2023-07-11T00:32:21.487 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 12/30 2023-07-11T00:32:22.214 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 13/30 2023-07-11T00:32:22.447 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 14/30 2023-07-11T00:32:22.607 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 15/30 2023-07-11T00:32:22.757 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 15/30 2023-07-11T00:32:22.944 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 16/30 2023-07-11T00:32:23.112 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : gcc-gdb-plugin-8.5.0-20.el8.x86_64 17/30 2023-07-11T00:32:23.185 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-20.el8.x86_64 17/30 2023-07-11T00:32:23.312 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : gcc-plugin-annobin-8.5.0-20.el8.x86_64 18/30 2023-07-11T00:32:23.447 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: gcc-plugin-annobin-8.5.0-20.el8.x86_64 18/30 2023-07-11T00:32:23.706 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fio-3.19-4.el8.x86_64 19/30 2023-07-11T00:32:24.064 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : sqlite-3.26.0-18.el8.x86_64 20/30 2023-07-11T00:32:24.299 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : indent-2.2.13-2.el8.x86_64 21/30 2023-07-11T00:32:24.454 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 22/30 2023-07-11T00:32:24.458 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : gcc-gdb-plugin-8.5.0-19.el8.x86_64 23/30 2023-07-11T00:32:24.713 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-19.el8.x86_64 23/30 2023-07-11T00:32:24.713 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : gcc-plugin-annobin-8.5.0-19.el8.x86_64 24/30 2023-07-11T00:32:24.871 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: gcc-plugin-annobin-8.5.0-19.el8.x86_64 24/30 2023-07-11T00:32:24.895 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: gcc-8.5.0-19.el8.x86_64 25/30 2023-07-11T00:32:25.104 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : gcc-8.5.0-19.el8.x86_64 25/30 2023-07-11T00:32:25.262 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : sqlite-3.26.0-17.el8.x86_64 26/30 2023-07-11T00:32:25.411 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : sqlite-libs-3.26.0-17.el8.x86_64 27/30 2023-07-11T00:32:25.429 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cpp-8.5.0-19.el8.x86_64 28/30 2023-07-11T00:32:25.562 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : cpp-8.5.0-19.el8.x86_64 28/30 2023-07-11T00:32:25.563 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libgcc-8.5.0-19.el8.x86_64 29/30 2023-07-11T00:32:25.771 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libgcc-8.5.0-19.el8.x86_64 29/30 2023-07-11T00:32:25.787 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libgomp-8.5.0-19.el8.x86_64 30/30 2023-07-11T00:32:25.788 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libgomp-8.5.0-19.el8.x86_64 30/30 2023-07-11T00:32:26.605 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libgomp-8.5.0-19.el8.x86_64 30/30 2023-07-11T00:32:26.606 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fio-3.19-4.el8.x86_64 1/30 2023-07-11T00:32:26.606 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 2/30 2023-07-11T00:32:26.606 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 3/30 2023-07-11T00:32:26.606 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 4/30 2023-07-11T00:32:26.606 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 5/30 2023-07-11T00:32:26.606 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/30 2023-07-11T00:32:26.607 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 7/30 2023-07-11T00:32:26.607 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 8/30 2023-07-11T00:32:26.607 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 9/30 2023-07-11T00:32:26.607 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : daxctl-libs-71.1-7.el8.x86_64 10/30 2023-07-11T00:32:26.607 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/30 2023-07-11T00:32:26.607 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ndctl-libs-71.1-7.el8.x86_64 12/30 2023-07-11T00:32:26.607 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 13/30 2023-07-11T00:32:26.608 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : indent-2.2.13-2.el8.x86_64 14/30 2023-07-11T00:32:26.609 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gcc-gdb-plugin-8.5.0-20.el8.x86_64 15/30 2023-07-11T00:32:26.609 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gcc-gdb-plugin-8.5.0-19.el8.x86_64 16/30 2023-07-11T00:32:26.609 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cpp-8.5.0-20.el8.x86_64 17/30 2023-07-11T00:32:26.609 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cpp-8.5.0-19.el8.x86_64 18/30 2023-07-11T00:32:26.609 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gcc-8.5.0-20.el8.x86_64 19/30 2023-07-11T00:32:26.609 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gcc-8.5.0-19.el8.x86_64 20/30 2023-07-11T00:32:26.610 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gcc-plugin-annobin-8.5.0-20.el8.x86_64 21/30 2023-07-11T00:32:26.610 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gcc-plugin-annobin-8.5.0-19.el8.x86_64 22/30 2023-07-11T00:32:26.610 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgcc-8.5.0-20.el8.x86_64 23/30 2023-07-11T00:32:26.610 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgcc-8.5.0-19.el8.x86_64 24/30 2023-07-11T00:32:26.610 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgomp-8.5.0-20.el8.x86_64 25/30 2023-07-11T00:32:26.610 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgomp-8.5.0-19.el8.x86_64 26/30 2023-07-11T00:32:26.610 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : sqlite-3.26.0-18.el8.x86_64 27/30 2023-07-11T00:32:26.610 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : sqlite-3.26.0-17.el8.x86_64 28/30 2023-07-11T00:32:26.611 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : sqlite-libs-3.26.0-18.el8.x86_64 29/30 2023-07-11T00:32:27.590 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : sqlite-libs-3.26.0-17.el8.x86_64 30/30 2023-07-11T00:32:27.590 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:32:27.591 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2023-07-11T00:32:27.591 INFO:teuthology.orchestra.run.smithi022.stdout: cpp-8.5.0-20.el8.x86_64 gcc-8.5.0-20.el8.x86_64 2023-07-11T00:32:27.591 INFO:teuthology.orchestra.run.smithi022.stdout: gcc-gdb-plugin-8.5.0-20.el8.x86_64 gcc-plugin-annobin-8.5.0-20.el8.x86_64 2023-07-11T00:32:27.591 INFO:teuthology.orchestra.run.smithi022.stdout: libgcc-8.5.0-20.el8.x86_64 libgomp-8.5.0-20.el8.x86_64 2023-07-11T00:32:27.591 INFO:teuthology.orchestra.run.smithi022.stdout: sqlite-3.26.0-18.el8.x86_64 sqlite-libs-3.26.0-18.el8.x86_64 2023-07-11T00:32:27.591 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-07-11T00:32:27.591 INFO:teuthology.orchestra.run.smithi022.stdout: daxctl-libs-71.1-7.el8.x86_64 2023-07-11T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-07-11T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stdout: fio-3.19-4.el8.x86_64 2023-07-11T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stdout: indent-2.2.13-2.el8.x86_64 2023-07-11T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-07-11T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stdout: ndctl-libs-71.1-7.el8.x86_64 2023-07-11T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stdout: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-07-11T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stdout: python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-07-11T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stdout: python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-07-11T00:32:27.593 INFO:teuthology.orchestra.run.smithi022.stdout: python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-07-11T00:32:27.593 INFO:teuthology.orchestra.run.smithi022.stdout: python2-setuptools-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-07-11T00:32:27.593 INFO:teuthology.orchestra.run.smithi022.stdout: python2-setuptools-wheel-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-07-11T00:32:27.593 INFO:teuthology.orchestra.run.smithi022.stdout: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e9afa.noarch 2023-07-11T00:32:27.593 INFO:teuthology.orchestra.run.smithi022.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-07-11T00:32:27.593 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:32:27.593 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-07-11T00:32:27.798 DEBUG:teuthology.orchestra.run.smithi022:> sudo useradd -m fsgqa 2023-07-11T00:32:27.870 INFO:teuthology.orchestra.run.smithi022.stderr:useradd: user 'fsgqa' already exists 2023-07-11T00:32:27.873 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-11T00:32:27.874 DEBUG:teuthology.orchestra.run.smithi022:> sudo groupadd fsgqa 2023-07-11T00:32:27.943 INFO:teuthology.orchestra.run.smithi022.stderr:groupadd: group 'fsgqa' already exists 2023-07-11T00:32:27.945 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-11T00:32:27.946 DEBUG:teuthology.orchestra.run.smithi022:> sudo useradd fsgqa2 2023-07-11T00:32:28.813 DEBUG:teuthology.orchestra.run.smithi022:> sudo useradd 123456-fsgqa 2023-07-11T00:32:29.587 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-07-11T00:32:29.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.787+0000 7f24d77ff700 1 Processor -- start 2023-07-11T00:32:29.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.787+0000 7f24d77ff700 1 -- start start 2023-07-11T00:32:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.788+0000 7f24d77ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f24d00cd7d0 0x7f24d00cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.788+0000 7f24d77ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d00cbc00 con 0x7f24d00cb4f0 2023-07-11T00:32:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.788+0000 7f24d77ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d00cb990 con 0x7f24d0156be0 2023-07-11T00:32:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.788+0000 7f24d77ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d0156fb0 con 0x7f24d00cd7d0 2023-07-11T00:32:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.789+0000 7f24d5d9c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f24d00cb4f0 0x7f24d01595d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51300/0 (socket says 172.21.15.22:51300) 2023-07-11T00:32:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.789+0000 7f24d5d9c700 1 -- 172.21.15.22:0/2820473205 learned_addr learned my addr 172.21.15.22:0/2820473205 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:32:29.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.789+0000 7f24d4d9a700 1 --2- 172.21.15.22:0/2820473205 >> v2:172.21.15.184:3300/0 conn(0x7f24d00cd7d0 0x7f24d00cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:29.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.789+0000 7f24c7fff700 1 -- 172.21.15.22:0/2820473205 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553810066 0 0) 0x7f24d00cbc00 con 0x7f24d00cb4f0 2023-07-11T00:32:29.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.789+0000 7f24c7fff700 1 -- 172.21.15.22:0/2820473205 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24bc0035b0 con 0x7f24d00cb4f0 2023-07-11T00:32:29.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.789+0000 7f24c7fff700 1 -- 172.21.15.22:0/2820473205 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551190831 0 0) 0x7f24d00cb990 con 0x7f24d0156be0 2023-07-11T00:32:29.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.789+0000 7f24c7fff700 1 -- 172.21.15.22:0/2820473205 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24d00cbc00 con 0x7f24d0156be0 2023-07-11T00:32:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24c7fff700 1 -- 172.21.15.22:0/2820473205 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2075660400 0 0) 0x7f24bc0035b0 con 0x7f24d00cb4f0 2023-07-11T00:32:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24c7fff700 1 -- 172.21.15.22:0/2820473205 >> v2:172.21.15.184:3300/0 conn(0x7f24d00cd7d0 msgr2=0x7f24d00cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:32:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24c7fff700 1 --2- 172.21.15.22:0/2820473205 >> v2:172.21.15.184:3300/0 conn(0x7f24d00cd7d0 0x7f24d00cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24c7fff700 1 -- 172.21.15.22:0/2820473205 >> v1:172.21.15.184:6789/0 conn(0x7f24d0156be0 legacy=0x7f24d00cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24c7fff700 1 -- 172.21.15.22:0/2820473205 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d015cc80 con 0x7f24d00cb4f0 2023-07-11T00:32:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24c7fff700 1 -- 172.21.15.22:0/2820473205 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 209779281 0 0) 0x7f24c80019f0 con 0x7f24d00cb4f0 2023-07-11T00:32:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24c7fff700 1 -- 172.21.15.22:0/2820473205 >> v1:172.21.15.22:6789/0 conn(0x7f24d00cb4f0 legacy=0x7f24d01595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24c7fff700 1 --2- 172.21.15.22:0/2820473205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24bc003be0 0x7f24bc003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:29.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24c7fff700 1 --2- 172.21.15.22:0/2820473205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24bc004850 0x7f24bc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:29.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24c7fff700 1 --2- 172.21.15.22:0/2820473205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24bc005250 0x7f24bc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:29.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24c7fff700 1 -- 172.21.15.22:0/2820473205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d0156fb0 con 0x7f24bc005250 2023-07-11T00:32:29.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24c7fff700 1 -- 172.21.15.22:0/2820473205 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc00c160 con 0x7f24bc003be0 2023-07-11T00:32:29.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24c7fff700 1 -- 172.21.15.22:0/2820473205 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc00c320 con 0x7f24bc004850 2023-07-11T00:32:29.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24d559b700 1 --2- 172.21.15.22:0/2820473205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24bc003be0 0x7f24bc003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:29.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24d5d9c700 1 --2- 172.21.15.22:0/2820473205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24bc005250 0x7f24bc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:29.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24d4d9a700 1 --2- 172.21.15.22:0/2820473205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24bc004850 0x7f24bc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:29.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24d559b700 1 -- 172.21.15.22:0/2820473205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24bc004850 msgr2=0x7f24bc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:32:29.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24d559b700 1 --2- 172.21.15.22:0/2820473205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24bc004850 0x7f24bc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24d559b700 1 -- 172.21.15.22:0/2820473205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24bc005250 msgr2=0x7f24bc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:32:29.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.790+0000 7f24d559b700 1 --2- 172.21.15.22:0/2820473205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24bc005250 0x7f24bc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:29.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.791+0000 7f24d559b700 1 -- 172.21.15.22:0/2820473205 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc0035b0 con 0x7f24bc003be0 2023-07-11T00:32:29.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.791+0000 7f24d5d9c700 1 -- 172.21.15.22:0/2820473205 reap_dead start 2023-07-11T00:32:29.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.791+0000 7f24d559b700 1 --2- 172.21.15.22:0/2820473205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24bc003be0 0x7f24bc003fd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f24cc007fd0 tx=0x7f24bc005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=249fc010d5769f22 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:29.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.791+0000 7f24c7fff700 1 -- 172.21.15.22:0/2820473205 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc001430 con 0x7f24bc003be0 2023-07-11T00:32:29.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.791+0000 7f24c7fff700 1 -- 172.21.15.22:0/2820473205 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24cc0052f0 con 0x7f24bc003be0 2023-07-11T00:32:29.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.791+0000 7f24c7fff700 1 -- 172.21.15.22:0/2820473205 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc001d40 con 0x7f24bc003be0 2023-07-11T00:32:29.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.792+0000 7f24d77ff700 1 -- 172.21.15.22:0/2820473205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24bc003be0 msgr2=0x7f24bc003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:29.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.792+0000 7f24d77ff700 1 --2- 172.21.15.22:0/2820473205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24bc003be0 0x7f24bc003fd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f24cc007fd0 tx=0x7f24bc005880 comp rx=0 tx=0).stop 2023-07-11T00:32:29.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.792+0000 7f24d77ff700 1 -- 172.21.15.22:0/2820473205 shutdown_connections 2023-07-11T00:32:29.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.792+0000 7f24d77ff700 1 --2- 172.21.15.22:0/2820473205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24bc003be0 0x7f24bc003fd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:29.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.792+0000 7f24d77ff700 1 -- 172.21.15.22:0/2820473205 >> 172.21.15.22:0/2820473205 conn(0x7f24d00b0390 msgr2=0x7f24d00b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:32:29.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.792+0000 7f24d77ff700 1 -- 172.21.15.22:0/2820473205 shutdown_connections 2023-07-11T00:32:29.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.792+0000 7f24d77ff700 1 -- 172.21.15.22:0/2820473205 wait complete. 2023-07-11T00:32:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.794+0000 7f24d77ff700 1 Processor -- start 2023-07-11T00:32:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.794+0000 7f24d77ff700 1 -- start start 2023-07-11T00:32:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.795+0000 7f24d77ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24bc003be0 0x7f24d0150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:29.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.795+0000 7f24d77ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24d00c5320 0x7f24d00c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:29.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.795+0000 7f24d77ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24d0151a80 0x7f24d00c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:29.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.795+0000 7f24d77ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d0153100 con 0x7f24d00c5320 2023-07-11T00:32:29.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.795+0000 7f24d77ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d0152440 con 0x7f24bc003be0 2023-07-11T00:32:29.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.795+0000 7f24d77ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d0152db0 con 0x7f24d0151a80 2023-07-11T00:32:29.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.795+0000 7f24d4d9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24d00c5320 0x7f24d00c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:29.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.795+0000 7f24d4d9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24d00c5320 0x7f24d00c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40672/0 (socket says 172.21.15.22:40672) 2023-07-11T00:32:29.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.795+0000 7f24d4d9a700 1 -- 172.21.15.22:0/3258260440 learned_addr learned my addr 172.21.15.22:0/3258260440 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:32:29.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.795+0000 7f24d559b700 1 --2- 172.21.15.22:0/3258260440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24bc003be0 0x7f24d0150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:29.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.796+0000 7f24d5d9c700 1 --2- 172.21.15.22:0/3258260440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24d0151a80 0x7f24d00c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:29.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.796+0000 7f24d4d9a700 1 -- 172.21.15.22:0/3258260440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24d0151a80 msgr2=0x7f24d00c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:29.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.796+0000 7f24d4d9a700 1 --2- 172.21.15.22:0/3258260440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24d0151a80 0x7f24d00c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:29.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.796+0000 7f24d4d9a700 1 -- 172.21.15.22:0/3258260440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24bc003be0 msgr2=0x7f24d0150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:29.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.796+0000 7f24d4d9a700 1 --2- 172.21.15.22:0/3258260440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24bc003be0 0x7f24d0150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:29.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.796+0000 7f24d4d9a700 1 -- 172.21.15.22:0/3258260440 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d00ccda0 con 0x7f24d00c5320 2023-07-11T00:32:29.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.796+0000 7f24d4d9a700 1 --2- 172.21.15.22:0/3258260440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24d00c5320 0x7f24d00c78a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f24c0011920 tx=0x7f24c0011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:29.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.796+0000 7f24c5ffb700 1 -- 172.21.15.22:0/3258260440 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0004240 con 0x7f24d00c5320 2023-07-11T00:32:29.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.796+0000 7f24c5ffb700 1 -- 172.21.15.22:0/3258260440 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c00043a0 con 0x7f24d00c5320 2023-07-11T00:32:29.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.796+0000 7f24c5ffb700 1 -- 172.21.15.22:0/3258260440 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c00036a0 con 0x7f24d00c5320 2023-07-11T00:32:29.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.796+0000 7f24d77ff700 1 -- 172.21.15.22:0/3258260440 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d0153520 con 0x7f24d00c5320 2023-07-11T00:32:29.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.797+0000 7f24d77ff700 1 -- 172.21.15.22:0/3258260440 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d0152650 con 0x7f24d00c5320 2023-07-11T00:32:29.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.798+0000 7f24d77ff700 1 -- 172.21.15.22:0/3258260440 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d0152810 con 0x7f24d00c5320 2023-07-11T00:32:29.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.799+0000 7f24c5ffb700 1 -- 172.21.15.22:0/3258260440 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f24c0003800 con 0x7f24d00c5320 2023-07-11T00:32:29.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.799+0000 7f24c5ffb700 1 --2- 172.21.15.22:0/3258260440 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f24b406ace0 0x7f24b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:29.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.799+0000 7f24c5ffb700 1 -- 172.21.15.22:0/3258260440 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f24c0089a30 con 0x7f24d00c5320 2023-07-11T00:32:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.800+0000 7f24d559b700 1 --2- 172.21.15.22:0/3258260440 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f24b406ace0 0x7f24b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.800+0000 7f24d559b700 1 --2- 172.21.15.22:0/3258260440 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f24b406ace0 0x7f24b406d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f24cc005040 tx=0x7f24cc00a000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:29.804+0000 7f24c5ffb700 1 -- 172.21.15.22:0/3258260440 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f24c0054870 con 0x7f24d00c5320 2023-07-11T00:32:30.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.092+0000 7f24d77ff700 1 -- 172.21.15.22:0/3258260440 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f24d004ea60 con 0x7f24d00c5320 2023-07-11T00:32:30.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.092+0000 7f24c5ffb700 1 -- 172.21.15.22:0/3258260440 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f24c0023020 con 0x7f24d00c5320 2023-07-11T00:32:30.095 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:32:30.095 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":1,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","modified":"2023-07-11T00:29:07.507672Z","created":"2023-07-11T00:29:07.507672Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:3300","nonce":0},{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:3301","nonce":0},{"type":"v1","addr":"172.21.15.184:6790","nonce":0}]},"addr":"172.21.15.184:6790/0","public_addr":"172.21.15.184:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-07-11T00:32:30.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.095+0000 7f24d77ff700 1 -- 172.21.15.22:0/3258260440 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f24b406ace0 msgr2=0x7f24b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.095+0000 7f24d77ff700 1 --2- 172.21.15.22:0/3258260440 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f24b406ace0 0x7f24b406d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f24cc005040 tx=0x7f24cc00a000 comp rx=0 tx=0).stop 2023-07-11T00:32:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.095+0000 7f24d77ff700 1 -- 172.21.15.22:0/3258260440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24d00c5320 msgr2=0x7f24d00c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.095+0000 7f24d77ff700 1 --2- 172.21.15.22:0/3258260440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24d00c5320 0x7f24d00c78a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f24c0011920 tx=0x7f24c0011c30 comp rx=0 tx=0).stop 2023-07-11T00:32:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.095+0000 7f24d77ff700 1 -- 172.21.15.22:0/3258260440 shutdown_connections 2023-07-11T00:32:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.095+0000 7f24d77ff700 1 --2- 172.21.15.22:0/3258260440 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f24b406ace0 0x7f24b406d190 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:30.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.095+0000 7f24d77ff700 1 --2- 172.21.15.22:0/3258260440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24d0151a80 0x7f24d00c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:30.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.095+0000 7f24d77ff700 1 --2- 172.21.15.22:0/3258260440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24bc003be0 0x7f24d0150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:30.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.095+0000 7f24d77ff700 1 --2- 172.21.15.22:0/3258260440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24d00c5320 0x7f24d00c78a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:30.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.095+0000 7f24d77ff700 1 -- 172.21.15.22:0/3258260440 >> 172.21.15.22:0/3258260440 conn(0x7f24d00b0390 msgr2=0x7f24d0070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:32:30.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.095+0000 7f24d77ff700 1 -- 172.21.15.22:0/3258260440 shutdown_connections 2023-07-11T00:32:30.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.095+0000 7f24d77ff700 1 -- 172.21.15.22:0/3258260440 wait complete. 2023-07-11T00:32:30.100 INFO:teuthology.orchestra.run.smithi022.stderr:dumped monmap epoch 1 2023-07-11T00:32:30.116 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-07-11T00:32:30.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.317+0000 7fbaa3dff700 1 Processor -- start 2023-07-11T00:32:30.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.317+0000 7fbaa3dff700 1 -- start start 2023-07-11T00:32:30.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.318+0000 7fbaa3dff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fba9c15c460 0x7fba9c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:30.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.318+0000 7fbaa3dff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fba9c0d2640 0x7fba9c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:30.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.318+0000 7fbaa3dff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9c0d1790 con 0x7fba9c0cf720 2023-07-11T00:32:30.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.318+0000 7fbaa3dff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba9c0cedd0 con 0x7fba9c0d2640 2023-07-11T00:32:30.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.318+0000 7fbaa3dff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba9c0cd950 con 0x7fba9c15c460 2023-07-11T00:32:30.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.318+0000 7fbaa139a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fba9c0d2640 0x7fba9c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:30.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.319+0000 7fbaa139a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fba9c0d2640 0x7fba9c0cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45188/0 (socket says 172.21.15.22:45188) 2023-07-11T00:32:30.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.319+0000 7fbaa139a700 1 -- 172.21.15.22:0/2707701997 learned_addr learned my addr 172.21.15.22:0/2707701997 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:32:30.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.319+0000 7fbaa1b9b700 1 --2- 172.21.15.22:0/2707701997 >> v2:172.21.15.184:3300/0 conn(0x7fba9c15c460 0x7fba9c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:30.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.319+0000 7fbaa139a700 1 -- 172.21.15.22:0/2707701997 >> v2:172.21.15.184:3300/0 conn(0x7fba9c15c460 msgr2=0x7fba9c0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:32:30.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.319+0000 7fbaa139a700 1 --2- 172.21.15.22:0/2707701997 >> v2:172.21.15.184:3300/0 conn(0x7fba9c15c460 0x7fba9c0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:30.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.319+0000 7fbaa139a700 1 -- 172.21.15.22:0/2707701997 >> v1:172.21.15.184:6789/0 conn(0x7fba9c0cf720 legacy=0x7fba9c0d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:30.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.319+0000 7fbaa139a700 1 -- 172.21.15.22:0/2707701997 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c0d14b0 con 0x7fba9c0d2640 2023-07-11T00:32:30.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.319+0000 7fbaa139a700 1 --2- 172.21.15.22:0/2707701997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba9c0d2640 0x7fba9c0cf1e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0b4f00 tx=0x7fba8c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450e99df6ef7268a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:30.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.319+0000 7fbaa0b99700 1 -- 172.21.15.22:0/2707701997 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c00b870 con 0x7fba9c0d2640 2023-07-11T00:32:30.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.320+0000 7fbaa0b99700 1 -- 172.21.15.22:0/2707701997 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c00b9d0 con 0x7fba9c0d2640 2023-07-11T00:32:30.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.320+0000 7fbaa0b99700 1 -- 172.21.15.22:0/2707701997 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c00bd60 con 0x7fba9c0d2640 2023-07-11T00:32:30.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.320+0000 7fbaa3dff700 1 -- 172.21.15.22:0/2707701997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba9c0d2640 msgr2=0x7fba9c0cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:30.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.320+0000 7fbaa3dff700 1 --2- 172.21.15.22:0/2707701997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba9c0d2640 0x7fba9c0cf1e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0b4f00 tx=0x7fba8c009bd0 comp rx=0 tx=0).stop 2023-07-11T00:32:30.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.320+0000 7fbaa3dff700 1 -- 172.21.15.22:0/2707701997 shutdown_connections 2023-07-11T00:32:30.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.320+0000 7fbaa3dff700 1 --2- 172.21.15.22:0/2707701997 >> v2:172.21.15.184:3300/0 conn(0x7fba9c15c460 0x7fba9c0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:30.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.320+0000 7fbaa3dff700 1 --2- 172.21.15.22:0/2707701997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba9c0d2640 0x7fba9c0cf1e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:30.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.320+0000 7fbaa3dff700 1 -- 172.21.15.22:0/2707701997 >> 172.21.15.22:0/2707701997 conn(0x7fba9c071660 msgr2=0x7fba9c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:32:30.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.320+0000 7fbaa3dff700 1 -- 172.21.15.22:0/2707701997 shutdown_connections 2023-07-11T00:32:30.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.320+0000 7fbaa3dff700 1 -- 172.21.15.22:0/2707701997 wait complete. 2023-07-11T00:32:30.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.323+0000 7fbaa3dff700 1 Processor -- start 2023-07-11T00:32:30.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.323+0000 7fbaa3dff700 1 -- start start 2023-07-11T00:32:30.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.324+0000 7fbaa3dff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0cf720 0x7fba9c14dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:30.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.324+0000 7fbaa3dff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba9c0d2640 0x7fba9c1e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:30.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.324+0000 7fbaa3dff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba9c15c460 0x7fba9c0c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:30.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.324+0000 7fbaa3dff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c1e6d10 con 0x7fba9c15c460 2023-07-11T00:32:30.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.324+0000 7fbaa3dff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c14e510 con 0x7fba9c0cf720 2023-07-11T00:32:30.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.324+0000 7fbaa3dff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c1e6470 con 0x7fba9c0d2640 2023-07-11T00:32:30.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.324+0000 7fbaa239c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba9c15c460 0x7fba9c0c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:30.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.324+0000 7fbaa239c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba9c15c460 0x7fba9c0c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45202/0 (socket says 172.21.15.22:45202) 2023-07-11T00:32:30.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.324+0000 7fbaa239c700 1 -- 172.21.15.22:0/3258248233 learned_addr learned my addr 172.21.15.22:0/3258248233 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:32:30.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.324+0000 7fbaa1b9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0cf720 0x7fba9c14dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:30.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.325+0000 7fbaa139a700 1 --2- 172.21.15.22:0/3258248233 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba9c0d2640 0x7fba9c1e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:30.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.325+0000 7fbaa239c700 1 -- 172.21.15.22:0/3258248233 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba9c0d2640 msgr2=0x7fba9c1e5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:30.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.325+0000 7fbaa239c700 1 --2- 172.21.15.22:0/3258248233 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba9c0d2640 0x7fba9c1e5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:30.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.325+0000 7fbaa239c700 1 -- 172.21.15.22:0/3258248233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0cf720 msgr2=0x7fba9c14dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:30.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.325+0000 7fbaa239c700 1 --2- 172.21.15.22:0/3258248233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0cf720 0x7fba9c14dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:30.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.325+0000 7fbaa239c700 1 -- 172.21.15.22:0/3258248233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c009550 con 0x7fba9c15c460 2023-07-11T00:32:30.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.325+0000 7fbaa239c700 1 --2- 172.21.15.22:0/3258248233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba9c15c460 0x7fba9c0c8880 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fba9400cb50 tx=0x7fba9400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:30.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.325+0000 7fba927fc700 1 -- 172.21.15.22:0/3258248233 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94003c00 con 0x7fba9c15c460 2023-07-11T00:32:30.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.325+0000 7fba927fc700 1 -- 172.21.15.22:0/3258248233 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba94003d60 con 0x7fba9c15c460 2023-07-11T00:32:30.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.325+0000 7fba927fc700 1 -- 172.21.15.22:0/3258248233 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9400aa20 con 0x7fba9c15c460 2023-07-11T00:32:30.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.325+0000 7fbaa3dff700 1 -- 172.21.15.22:0/3258248233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9c1e6750 con 0x7fba9c15c460 2023-07-11T00:32:30.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.326+0000 7fbaa3dff700 1 -- 172.21.15.22:0/3258248233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9c1f2010 con 0x7fba9c15c460 2023-07-11T00:32:30.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.327+0000 7fbaa3dff700 1 -- 172.21.15.22:0/3258248233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9c1f1e40 con 0x7fba9c15c460 2023-07-11T00:32:30.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.328+0000 7fba927fc700 1 -- 172.21.15.22:0/3258248233 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba9400ab80 con 0x7fba9c15c460 2023-07-11T00:32:30.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.329+0000 7fba927fc700 1 --2- 172.21.15.22:0/3258248233 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fba8006ace0 0x7fba8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:32:30.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.329+0000 7fba927fc700 1 -- 172.21.15.22:0/3258248233 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fba94089540 con 0x7fba9c15c460 2023-07-11T00:32:30.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.329+0000 7fbaa1b9b700 1 --2- 172.21.15.22:0/3258248233 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fba8006ace0 0x7fba8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:32:30.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.330+0000 7fbaa1b9b700 1 --2- 172.21.15.22:0/3258248233 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fba8006ace0 0x7fba8006d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fba98006b20 tx=0x7fba98008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:32:30.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.333+0000 7fba927fc700 1 -- 172.21.15.22:0/3258248233 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fba94054540 con 0x7fba9c15c460 2023-07-11T00:32:30.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.623+0000 7fbaa3dff700 1 -- 172.21.15.22:0/3258248233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7fba9c04ea60 con 0x7fba9c15c460 2023-07-11T00:32:30.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.624+0000 7fba927fc700 1 -- 172.21.15.22:0/3258248233 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7fba94057b60 con 0x7fba9c15c460 2023-07-11T00:32:30.628 INFO:teuthology.orchestra.run.smithi022.stdout:[client.admin] 2023-07-11T00:32:30.628 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== 2023-07-11T00:32:30.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.626+0000 7fbaa3dff700 1 -- 172.21.15.22:0/3258248233 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fba8006ace0 msgr2=0x7fba8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:30.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.626+0000 7fbaa3dff700 1 --2- 172.21.15.22:0/3258248233 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fba8006ace0 0x7fba8006d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fba98006b20 tx=0x7fba98008040 comp rx=0 tx=0).stop 2023-07-11T00:32:30.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.626+0000 7fbaa3dff700 1 -- 172.21.15.22:0/3258248233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba9c15c460 msgr2=0x7fba9c0c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:32:30.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.626+0000 7fbaa3dff700 1 --2- 172.21.15.22:0/3258248233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba9c15c460 0x7fba9c0c8880 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fba9400cb50 tx=0x7fba9400ce60 comp rx=0 tx=0).stop 2023-07-11T00:32:30.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.626+0000 7fbaa3dff700 1 -- 172.21.15.22:0/3258248233 shutdown_connections 2023-07-11T00:32:30.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.626+0000 7fbaa3dff700 1 --2- 172.21.15.22:0/3258248233 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fba8006ace0 0x7fba8006d190 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:30.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.626+0000 7fbaa3dff700 1 --2- 172.21.15.22:0/3258248233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba9c15c460 0x7fba9c0c8880 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:30.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.626+0000 7fbaa3dff700 1 --2- 172.21.15.22:0/3258248233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0cf720 0x7fba9c14dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:30.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.626+0000 7fbaa3dff700 1 --2- 172.21.15.22:0/3258248233 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba9c0d2640 0x7fba9c1e5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:32:30.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.626+0000 7fbaa3dff700 1 -- 172.21.15.22:0/3258248233 >> 172.21.15.22:0/3258248233 conn(0x7fba9c071660 msgr2=0x7fba9c0b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:32:30.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.626+0000 7fbaa3dff700 1 -- 172.21.15.22:0/3258248233 shutdown_connections 2023-07-11T00:32:30.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:32:30.626+0000 7fbaa3dff700 1 -- 172.21.15.22:0/3258248233 wait complete. 2023-07-11T00:32:30.647 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:32:30.648 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/tmp/tmp.QzQkhuoEboxfstests-dev/local.config 2023-07-11T00:32:30.718 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.22:6789:/test export TEST_DIR=/tmp/tmp.pzJBEiZFlJtest export SCRATCH_DEV=172.21.15.22:6789:/scratch export SCRATCH_MNT=/tmp/tmp.v9PKeVhYmRscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g==" 2023-07-11T00:32:30.719 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:32:30.719 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/tmp/tmp.QzQkhuoEboxfstests-dev/ceph.exclude 2023-07-11T00:32:30.829 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo make) 2023-07-11T00:32:30.959 INFO:teuthology.orchestra.run.smithi022.stdout:libtoolize -cfi 2023-07-11T00:32:31.442 INFO:teuthology.orchestra.run.smithi022.stdout:libtoolize: putting auxiliary files in '.'. 2023-07-11T00:32:31.442 INFO:teuthology.orchestra.run.smithi022.stdout:libtoolize: copying file './config.guess' 2023-07-11T00:32:31.452 INFO:teuthology.orchestra.run.smithi022.stdout:libtoolize: copying file './config.sub' 2023-07-11T00:32:31.462 INFO:teuthology.orchestra.run.smithi022.stdout:libtoolize: copying file './install-sh' 2023-07-11T00:32:31.473 INFO:teuthology.orchestra.run.smithi022.stdout:libtoolize: copying file './ltmain.sh' 2023-07-11T00:32:31.534 INFO:teuthology.orchestra.run.smithi022.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-07-11T00:32:31.534 INFO:teuthology.orchestra.run.smithi022.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-07-11T00:32:31.546 INFO:teuthology.orchestra.run.smithi022.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-07-11T00:32:31.560 INFO:teuthology.orchestra.run.smithi022.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-07-11T00:32:31.572 INFO:teuthology.orchestra.run.smithi022.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-07-11T00:32:31.584 INFO:teuthology.orchestra.run.smithi022.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-07-11T00:32:31.601 INFO:teuthology.orchestra.run.smithi022.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-07-11T00:32:31.603 INFO:teuthology.orchestra.run.smithi022.stdout:cp include/install-sh . 2023-07-11T00:32:31.606 INFO:teuthology.orchestra.run.smithi022.stdout:aclocal -I m4 2023-07-11T00:32:32.896 INFO:teuthology.orchestra.run.smithi022.stdout:autoheader 2023-07-11T00:32:33.274 INFO:teuthology.orchestra.run.smithi022.stdout:autoconf 2023-07-11T00:32:33.488 INFO:teuthology.orchestra.run.smithi022.stdout:./configure \ 2023-07-11T00:32:33.488 INFO:teuthology.orchestra.run.smithi022.stdout: --libexecdir=/usr/lib \ 2023-07-11T00:32:33.489 INFO:teuthology.orchestra.run.smithi022.stdout: --exec_prefix=/var/lib 2023-07-11T00:32:33.847 INFO:teuthology.orchestra.run.smithi022.stdout:checking build system type... x86_64-pc-linux-gnu 2023-07-11T00:32:33.847 INFO:teuthology.orchestra.run.smithi022.stdout:checking host system type... x86_64-pc-linux-gnu 2023-07-11T00:32:33.851 INFO:teuthology.orchestra.run.smithi022.stdout:checking how to print strings... printf 2023-07-11T00:32:33.851 INFO:teuthology.orchestra.run.smithi022.stdout:checking for gcc... gcc 2023-07-11T00:32:33.982 INFO:teuthology.orchestra.run.smithi022.stdout:checking whether the C compiler works... yes 2023-07-11T00:32:33.982 INFO:teuthology.orchestra.run.smithi022.stdout:checking for C compiler default output file name... a.out 2023-07-11T00:32:34.033 INFO:teuthology.orchestra.run.smithi022.stdout:checking for suffix of executables... 2023-07-11T00:32:34.105 INFO:teuthology.orchestra.run.smithi022.stdout:checking whether we are cross compiling... no 2023-07-11T00:32:34.143 INFO:teuthology.orchestra.run.smithi022.stdout:checking for suffix of object files... o 2023-07-11T00:32:34.178 INFO:teuthology.orchestra.run.smithi022.stdout:checking whether we are using the GNU C compiler... yes 2023-07-11T00:32:34.212 INFO:teuthology.orchestra.run.smithi022.stdout:checking whether gcc accepts -g... yes 2023-07-11T00:32:34.260 INFO:teuthology.orchestra.run.smithi022.stdout:checking for gcc option to accept ISO C89... none needed 2023-07-11T00:32:34.268 INFO:teuthology.orchestra.run.smithi022.stdout:checking for a sed that does not truncate output... /bin/sed 2023-07-11T00:32:34.273 INFO:teuthology.orchestra.run.smithi022.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-07-11T00:32:34.276 INFO:teuthology.orchestra.run.smithi022.stdout:checking for egrep... /bin/grep -E 2023-07-11T00:32:34.279 INFO:teuthology.orchestra.run.smithi022.stdout:checking for fgrep... /bin/grep -F 2023-07-11T00:32:34.287 INFO:teuthology.orchestra.run.smithi022.stdout:checking for ld used by gcc... /bin/ld 2023-07-11T00:32:34.291 INFO:teuthology.orchestra.run.smithi022.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-07-11T00:32:34.300 INFO:teuthology.orchestra.run.smithi022.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-07-11T00:32:34.340 INFO:teuthology.orchestra.run.smithi022.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-07-11T00:32:34.340 INFO:teuthology.orchestra.run.smithi022.stdout:checking whether ln -s works... yes 2023-07-11T00:32:34.354 INFO:teuthology.orchestra.run.smithi022.stdout:checking the maximum length of command line arguments... 1572864 2023-07-11T00:32:34.360 INFO:teuthology.orchestra.run.smithi022.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-07-11T00:32:34.360 INFO:teuthology.orchestra.run.smithi022.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-07-11T00:32:34.360 INFO:teuthology.orchestra.run.smithi022.stdout:checking for /bin/ld option to reload object files... -r 2023-07-11T00:32:34.361 INFO:teuthology.orchestra.run.smithi022.stdout:checking for objdump... objdump 2023-07-11T00:32:34.361 INFO:teuthology.orchestra.run.smithi022.stdout:checking how to recognize dependent libraries... pass_all 2023-07-11T00:32:34.362 INFO:teuthology.orchestra.run.smithi022.stdout:checking for dlltool... no 2023-07-11T00:32:34.362 INFO:teuthology.orchestra.run.smithi022.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-07-11T00:32:34.362 INFO:teuthology.orchestra.run.smithi022.stdout:checking for ar... ar 2023-07-11T00:32:34.425 INFO:teuthology.orchestra.run.smithi022.stdout:checking for archiver @FILE support... @ 2023-07-11T00:32:34.426 INFO:teuthology.orchestra.run.smithi022.stdout:checking for strip... strip 2023-07-11T00:32:34.427 INFO:teuthology.orchestra.run.smithi022.stdout:checking for ranlib... ranlib 2023-07-11T00:32:34.427 INFO:teuthology.orchestra.run.smithi022.stdout:checking for gawk... gawk 2023-07-11T00:32:34.536 INFO:teuthology.orchestra.run.smithi022.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-07-11T00:32:34.539 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sysroot... no 2023-07-11T00:32:34.547 INFO:teuthology.orchestra.run.smithi022.stdout:checking for a working dd... /bin/dd 2023-07-11T00:32:34.554 INFO:teuthology.orchestra.run.smithi022.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-07-11T00:32:34.583 INFO:teuthology.orchestra.run.smithi022.stdout:checking for mt... no 2023-07-11T00:32:34.589 INFO:teuthology.orchestra.run.smithi022.stdout:checking if : is a manifest tool... no 2023-07-11T00:32:34.643 INFO:teuthology.orchestra.run.smithi022.stdout:checking how to run the C preprocessor... gcc -E 2023-07-11T00:32:34.878 INFO:teuthology.orchestra.run.smithi022.stdout:checking for ANSI C header files... yes 2023-07-11T00:32:34.922 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/types.h... yes 2023-07-11T00:32:34.978 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/stat.h... yes 2023-07-11T00:32:35.031 INFO:teuthology.orchestra.run.smithi022.stdout:checking for stdlib.h... yes 2023-07-11T00:32:35.086 INFO:teuthology.orchestra.run.smithi022.stdout:checking for string.h... yes 2023-07-11T00:32:35.140 INFO:teuthology.orchestra.run.smithi022.stdout:checking for memory.h... yes 2023-07-11T00:32:35.193 INFO:teuthology.orchestra.run.smithi022.stdout:checking for strings.h... yes 2023-07-11T00:32:35.251 INFO:teuthology.orchestra.run.smithi022.stdout:checking for inttypes.h... yes 2023-07-11T00:32:35.306 INFO:teuthology.orchestra.run.smithi022.stdout:checking for stdint.h... yes 2023-07-11T00:32:35.364 INFO:teuthology.orchestra.run.smithi022.stdout:checking for unistd.h... yes 2023-07-11T00:32:35.428 INFO:teuthology.orchestra.run.smithi022.stdout:checking for dlfcn.h... yes 2023-07-11T00:32:35.437 INFO:teuthology.orchestra.run.smithi022.stdout:checking for objdir... .libs 2023-07-11T00:32:35.573 INFO:teuthology.orchestra.run.smithi022.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-07-11T00:32:35.573 INFO:teuthology.orchestra.run.smithi022.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-07-11T00:32:35.611 INFO:teuthology.orchestra.run.smithi022.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-07-11T00:32:35.650 INFO:teuthology.orchestra.run.smithi022.stdout:checking if gcc static flag -static works... no 2023-07-11T00:32:35.703 INFO:teuthology.orchestra.run.smithi022.stdout:checking if gcc supports -c -o file.o... yes 2023-07-11T00:32:35.704 INFO:teuthology.orchestra.run.smithi022.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-07-11T00:32:35.718 INFO:teuthology.orchestra.run.smithi022.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-07-11T00:32:35.768 INFO:teuthology.orchestra.run.smithi022.stdout:checking whether -lc should be explicitly linked in... no 2023-07-11T00:32:35.867 INFO:teuthology.orchestra.run.smithi022.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-07-11T00:32:35.868 INFO:teuthology.orchestra.run.smithi022.stdout:checking how to hardcode library paths into programs... immediate 2023-07-11T00:32:35.874 INFO:teuthology.orchestra.run.smithi022.stdout:checking whether stripping libraries is possible... yes 2023-07-11T00:32:35.874 INFO:teuthology.orchestra.run.smithi022.stdout:checking if libtool supports shared libraries... yes 2023-07-11T00:32:35.874 INFO:teuthology.orchestra.run.smithi022.stdout:checking whether to build shared libraries... yes 2023-07-11T00:32:35.875 INFO:teuthology.orchestra.run.smithi022.stdout:checking whether to build static libraries... yes 2023-07-11T00:32:35.886 INFO:teuthology.orchestra.run.smithi022.stdout:checking for gcc... (cached) gcc 2023-07-11T00:32:35.924 INFO:teuthology.orchestra.run.smithi022.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-11T00:32:35.925 INFO:teuthology.orchestra.run.smithi022.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-11T00:32:35.925 INFO:teuthology.orchestra.run.smithi022.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-11T00:32:35.925 INFO:teuthology.orchestra.run.smithi022.stdout:checking for gmake... /usr/bin/gmake 2023-07-11T00:32:35.925 INFO:teuthology.orchestra.run.smithi022.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-07-11T00:32:35.926 INFO:teuthology.orchestra.run.smithi022.stdout:checking for tar... /bin/tar 2023-07-11T00:32:35.926 INFO:teuthology.orchestra.run.smithi022.stdout:checking for gzip... /bin/gzip 2023-07-11T00:32:35.942 INFO:teuthology.orchestra.run.smithi022.stdout:checking whether gcc -MM is supported... yes 2023-07-11T00:32:35.943 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sort... /bin/sort 2023-07-11T00:32:35.943 INFO:teuthology.orchestra.run.smithi022.stdout:checking whether ln -s works... yes 2023-07-11T00:32:35.943 INFO:teuthology.orchestra.run.smithi022.stdout:checking for rpm... /bin/rpm 2023-07-11T00:32:35.952 INFO:teuthology.orchestra.run.smithi022.stdout:checking for rpmbuild... no 2023-07-11T00:32:36.013 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:32:36.018 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:32:36.019 INFO:teuthology.orchestra.run.smithi022.stdout:checking assert.h usability... yes 2023-07-11T00:32:36.034 INFO:teuthology.orchestra.run.smithi022.stdout:checking assert.h presence... yes 2023-07-11T00:32:36.034 INFO:teuthology.orchestra.run.smithi022.stdout:checking for assert.h... yes 2023-07-11T00:32:36.112 INFO:teuthology.orchestra.run.smithi022.stdout:checking bstring.h usability... no 2023-07-11T00:32:36.138 INFO:teuthology.orchestra.run.smithi022.stdout:checking bstring.h presence... no 2023-07-11T00:32:36.138 INFO:teuthology.orchestra.run.smithi022.stdout:checking for bstring.h... no 2023-07-11T00:32:36.188 INFO:teuthology.orchestra.run.smithi022.stdout:checking libgen.h usability... yes 2023-07-11T00:32:36.205 INFO:teuthology.orchestra.run.smithi022.stdout:checking libgen.h presence... yes 2023-07-11T00:32:36.205 INFO:teuthology.orchestra.run.smithi022.stdout:checking for libgen.h... yes 2023-07-11T00:32:36.264 INFO:teuthology.orchestra.run.smithi022.stdout:checking dirent.h usability... yes 2023-07-11T00:32:36.281 INFO:teuthology.orchestra.run.smithi022.stdout:checking dirent.h presence... yes 2023-07-11T00:32:36.281 INFO:teuthology.orchestra.run.smithi022.stdout:checking for dirent.h... yes 2023-07-11T00:32:36.354 INFO:teuthology.orchestra.run.smithi022.stdout:checking errno.h usability... yes 2023-07-11T00:32:36.371 INFO:teuthology.orchestra.run.smithi022.stdout:checking errno.h presence... yes 2023-07-11T00:32:36.371 INFO:teuthology.orchestra.run.smithi022.stdout:checking for errno.h... yes 2023-07-11T00:32:36.432 INFO:teuthology.orchestra.run.smithi022.stdout:checking malloc.h usability... yes 2023-07-11T00:32:36.450 INFO:teuthology.orchestra.run.smithi022.stdout:checking malloc.h presence... yes 2023-07-11T00:32:36.451 INFO:teuthology.orchestra.run.smithi022.stdout:checking for malloc.h... yes 2023-07-11T00:32:36.509 INFO:teuthology.orchestra.run.smithi022.stdout:checking uuid.h usability... no 2023-07-11T00:32:36.534 INFO:teuthology.orchestra.run.smithi022.stdout:checking uuid.h presence... no 2023-07-11T00:32:36.534 INFO:teuthology.orchestra.run.smithi022.stdout:checking for uuid.h... no 2023-07-11T00:32:36.596 INFO:teuthology.orchestra.run.smithi022.stdout:checking uuid/uuid.h usability... yes 2023-07-11T00:32:36.615 INFO:teuthology.orchestra.run.smithi022.stdout:checking uuid/uuid.h presence... yes 2023-07-11T00:32:36.616 INFO:teuthology.orchestra.run.smithi022.stdout:checking for uuid/uuid.h... yes 2023-07-11T00:32:36.672 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/uuid.h usability... no 2023-07-11T00:32:36.696 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/uuid.h presence... no 2023-07-11T00:32:36.697 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/uuid.h... no 2023-07-11T00:32:36.747 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/file.h usability... yes 2023-07-11T00:32:36.764 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/file.h presence... yes 2023-07-11T00:32:36.765 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/file.h... yes 2023-07-11T00:32:36.822 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/fcntl.h usability... yes 2023-07-11T00:32:36.839 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/fcntl.h presence... yes 2023-07-11T00:32:36.840 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/fcntl.h... yes 2023-07-11T00:32:36.896 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/syssgi.h usability... no 2023-07-11T00:32:36.921 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/syssgi.h presence... no 2023-07-11T00:32:36.921 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/syssgi.h... no 2023-07-11T00:32:36.988 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/param.h usability... yes 2023-07-11T00:32:37.009 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/param.h presence... yes 2023-07-11T00:32:37.010 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/param.h... yes 2023-07-11T00:32:37.023 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/stat.h... (cached) yes 2023-07-11T00:32:37.085 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/statvfs.h usability... yes 2023-07-11T00:32:37.101 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/statvfs.h presence... yes 2023-07-11T00:32:37.102 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/statvfs.h... yes 2023-07-11T00:32:37.160 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/time.h usability... yes 2023-07-11T00:32:37.177 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/time.h presence... yes 2023-07-11T00:32:37.177 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/time.h... yes 2023-07-11T00:32:37.239 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/ioctl.h usability... yes 2023-07-11T00:32:37.256 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/ioctl.h presence... yes 2023-07-11T00:32:37.256 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/ioctl.h... yes 2023-07-11T00:32:37.317 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/wait.h usability... yes 2023-07-11T00:32:37.337 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/wait.h presence... yes 2023-07-11T00:32:37.337 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/wait.h... yes 2023-07-11T00:32:37.351 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/types.h... (cached) yes 2023-07-11T00:32:37.365 INFO:teuthology.orchestra.run.smithi022.stdout:checking for strings.h... (cached) yes 2023-07-11T00:32:37.429 INFO:teuthology.orchestra.run.smithi022.stdout:checking err.h usability... yes 2023-07-11T00:32:37.445 INFO:teuthology.orchestra.run.smithi022.stdout:checking err.h presence... yes 2023-07-11T00:32:37.446 INFO:teuthology.orchestra.run.smithi022.stdout:checking for err.h... yes 2023-07-11T00:32:37.506 INFO:teuthology.orchestra.run.smithi022.stdout:checking linux/falloc.h usability... yes 2023-07-11T00:32:37.522 INFO:teuthology.orchestra.run.smithi022.stdout:checking linux/falloc.h presence... yes 2023-07-11T00:32:37.522 INFO:teuthology.orchestra.run.smithi022.stdout:checking for linux/falloc.h... yes 2023-07-11T00:32:37.579 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-07-11T00:32:37.603 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-07-11T00:32:37.604 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/fs/xfs_fsops.h... no 2023-07-11T00:32:37.652 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/fs/xfs_itable.h usability... no 2023-07-11T00:32:37.676 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/fs/xfs_itable.h presence... no 2023-07-11T00:32:37.676 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/fs/xfs_itable.h... no 2023-07-11T00:32:37.725 INFO:teuthology.orchestra.run.smithi022.stdout:checking xfs/platform_defs.h usability... no 2023-07-11T00:32:37.749 INFO:teuthology.orchestra.run.smithi022.stdout:checking xfs/platform_defs.h presence... no 2023-07-11T00:32:37.750 INFO:teuthology.orchestra.run.smithi022.stdout:checking for xfs/platform_defs.h... no 2023-07-11T00:32:37.798 INFO:teuthology.orchestra.run.smithi022.stdout:checking btrfs/ioctl.h usability... no 2023-07-11T00:32:37.822 INFO:teuthology.orchestra.run.smithi022.stdout:checking btrfs/ioctl.h presence... no 2023-07-11T00:32:37.822 INFO:teuthology.orchestra.run.smithi022.stdout:checking for btrfs/ioctl.h... no 2023-07-11T00:32:37.871 INFO:teuthology.orchestra.run.smithi022.stdout:checking cifs/ioctl.h usability... no 2023-07-11T00:32:37.895 INFO:teuthology.orchestra.run.smithi022.stdout:checking cifs/ioctl.h presence... no 2023-07-11T00:32:37.896 INFO:teuthology.orchestra.run.smithi022.stdout:checking for cifs/ioctl.h... no 2023-07-11T00:32:37.948 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/mman.h usability... yes 2023-07-11T00:32:37.964 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/mman.h presence... yes 2023-07-11T00:32:37.965 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/mman.h... yes 2023-07-11T00:32:38.003 INFO:teuthology.orchestra.run.smithi022.stdout:checking for xfs/xfs_log_format.h... no 2023-07-11T00:32:38.071 INFO:teuthology.orchestra.run.smithi022.stdout:checking for uuid_compare... no 2023-07-11T00:32:38.128 INFO:teuthology.orchestra.run.smithi022.stdout:checking for uuid_compare in -luuid... yes 2023-07-11T00:32:38.214 INFO:teuthology.orchestra.run.smithi022.stdout:checking for xfs/xfs.h... yes 2023-07-11T00:32:38.246 INFO:teuthology.orchestra.run.smithi022.stdout:checking for xfs/libxfs.h... no 2023-07-11T00:32:38.284 INFO:teuthology.orchestra.run.smithi022.stdout:checking whether xlog_assign_lsn is declared... no 2023-07-11T00:32:38.337 INFO:teuthology.orchestra.run.smithi022.stdout:checking for xfs/xqm.h... yes 2023-07-11T00:32:38.418 INFO:teuthology.orchestra.run.smithi022.stdout:checking xfsctl from xfs/xfs.h... ok 2023-07-11T00:32:38.464 INFO:teuthology.orchestra.run.smithi022.stdout:checking xfs/handle.h usability... yes 2023-07-11T00:32:38.479 INFO:teuthology.orchestra.run.smithi022.stdout:checking xfs/handle.h presence... yes 2023-07-11T00:32:38.479 INFO:teuthology.orchestra.run.smithi022.stdout:checking for xfs/handle.h... yes 2023-07-11T00:32:38.540 INFO:teuthology.orchestra.run.smithi022.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-07-11T00:32:38.590 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/acl.h usability... yes 2023-07-11T00:32:38.609 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/acl.h presence... yes 2023-07-11T00:32:38.609 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/acl.h... yes 2023-07-11T00:32:38.670 INFO:teuthology.orchestra.run.smithi022.stdout:checking acl/libacl.h usability... yes 2023-07-11T00:32:38.688 INFO:teuthology.orchestra.run.smithi022.stdout:checking acl/libacl.h presence... yes 2023-07-11T00:32:38.689 INFO:teuthology.orchestra.run.smithi022.stdout:checking for acl/libacl.h... yes 2023-07-11T00:32:38.749 INFO:teuthology.orchestra.run.smithi022.stdout:checking for acl_init in -lacl... yes 2023-07-11T00:32:38.795 INFO:teuthology.orchestra.run.smithi022.stdout:checking gdbm-ndbm.h usability... no 2023-07-11T00:32:38.820 INFO:teuthology.orchestra.run.smithi022.stdout:checking gdbm-ndbm.h presence... no 2023-07-11T00:32:38.820 INFO:teuthology.orchestra.run.smithi022.stdout:checking for gdbm-ndbm.h... no 2023-07-11T00:32:38.863 INFO:teuthology.orchestra.run.smithi022.stdout:checking gdbm/ndbm.h usability... no 2023-07-11T00:32:38.887 INFO:teuthology.orchestra.run.smithi022.stdout:checking gdbm/ndbm.h presence... no 2023-07-11T00:32:38.888 INFO:teuthology.orchestra.run.smithi022.stdout:checking for gdbm/ndbm.h... no 2023-07-11T00:32:38.930 INFO:teuthology.orchestra.run.smithi022.stdout:checking ndbm.h usability... no 2023-07-11T00:32:38.954 INFO:teuthology.orchestra.run.smithi022.stdout:checking ndbm.h presence... no 2023-07-11T00:32:38.955 INFO:teuthology.orchestra.run.smithi022.stdout:checking for ndbm.h... no 2023-07-11T00:32:39.003 INFO:teuthology.orchestra.run.smithi022.stdout:checking libaio.h usability... yes 2023-07-11T00:32:39.025 INFO:teuthology.orchestra.run.smithi022.stdout:checking libaio.h presence... yes 2023-07-11T00:32:39.025 INFO:teuthology.orchestra.run.smithi022.stdout:checking for libaio.h... yes 2023-07-11T00:32:39.071 INFO:teuthology.orchestra.run.smithi022.stdout:checking liburing.h usability... no 2023-07-11T00:32:39.095 INFO:teuthology.orchestra.run.smithi022.stdout:checking liburing.h presence... no 2023-07-11T00:32:39.095 INFO:teuthology.orchestra.run.smithi022.stdout:checking for liburing.h... no 2023-07-11T00:32:39.138 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/capability.h usability... no 2023-07-11T00:32:39.163 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/capability.h presence... no 2023-07-11T00:32:39.164 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/capability.h... no 2023-07-11T00:32:39.209 INFO:teuthology.orchestra.run.smithi022.stdout:checking linux/fiemap.h usability... yes 2023-07-11T00:32:39.224 INFO:teuthology.orchestra.run.smithi022.stdout:checking linux/fiemap.h presence... yes 2023-07-11T00:32:39.224 INFO:teuthology.orchestra.run.smithi022.stdout:checking for linux/fiemap.h... yes 2023-07-11T00:32:39.285 INFO:teuthology.orchestra.run.smithi022.stdout:checking for fallocate... yes 2023-07-11T00:32:39.346 INFO:teuthology.orchestra.run.smithi022.stdout:checking for open_by_handle_at... yes 2023-07-11T00:32:39.394 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/prctl.h usability... yes 2023-07-11T00:32:39.413 INFO:teuthology.orchestra.run.smithi022.stdout:checking sys/prctl.h presence... yes 2023-07-11T00:32:39.414 INFO:teuthology.orchestra.run.smithi022.stdout:checking for sys/prctl.h... yes 2023-07-11T00:32:39.460 INFO:teuthology.orchestra.run.smithi022.stdout:checking linux/fs.h usability... yes 2023-07-11T00:32:39.476 INFO:teuthology.orchestra.run.smithi022.stdout:checking linux/fs.h presence... yes 2023-07-11T00:32:39.477 INFO:teuthology.orchestra.run.smithi022.stdout:checking for linux/fs.h... yes 2023-07-11T00:32:39.520 INFO:teuthology.orchestra.run.smithi022.stdout:checking btrfsutil.h usability... no 2023-07-11T00:32:39.545 INFO:teuthology.orchestra.run.smithi022.stdout:checking btrfsutil.h presence... no 2023-07-11T00:32:39.545 INFO:teuthology.orchestra.run.smithi022.stdout:checking for btrfsutil.h... no 2023-07-11T00:32:39.611 INFO:teuthology.orchestra.run.smithi022.stdout:checking for copy_file_range... yes 2023-07-11T00:32:39.675 INFO:teuthology.orchestra.run.smithi022.stdout:checking for SEEK_DATA... yes 2023-07-11T00:32:39.757 INFO:teuthology.orchestra.run.smithi022.stdout:checking for BMV_OF_SHARED... yes 2023-07-11T00:32:39.821 INFO:teuthology.orchestra.run.smithi022.stdout:checking for nftw... yes 2023-07-11T00:32:39.890 INFO:teuthology.orchestra.run.smithi022.stdout:checking for RLIMIT_NOFILE... yes 2023-07-11T00:32:39.929 INFO:teuthology.orchestra.run.smithi022.stdout:checking for FIEXCHANGE_RANGE... no 2023-07-11T00:32:39.991 INFO:teuthology.orchestra.run.smithi022.stdout:checking for renameat2... yes 2023-07-11T00:32:40.053 INFO:teuthology.orchestra.run.smithi022.stdout:checking for reallocarray... yes 2023-07-11T00:32:40.086 INFO:teuthology.orchestra.run.smithi022.stdout:checking for struct mount_attr... no 2023-07-11T00:32:40.158 INFO:teuthology.orchestra.run.smithi022.stdout:checking for struct btrfs_qgroup_limit... yes 2023-07-11T00:32:40.231 INFO:teuthology.orchestra.run.smithi022.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-07-11T00:32:40.305 INFO:teuthology.orchestra.run.smithi022.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-07-11T00:32:40.379 INFO:teuthology.orchestra.run.smithi022.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-07-11T00:32:40.452 INFO:teuthology.orchestra.run.smithi022.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-07-11T00:32:40.527 INFO:teuthology.orchestra.run.smithi022.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-07-11T00:32:40.601 INFO:teuthology.orchestra.run.smithi022.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-07-11T00:32:40.656 INFO:teuthology.orchestra.run.smithi022.stdout:checking linux/btrfs.h usability... yes 2023-07-11T00:32:40.673 INFO:teuthology.orchestra.run.smithi022.stdout:checking linux/btrfs.h presence... yes 2023-07-11T00:32:40.673 INFO:teuthology.orchestra.run.smithi022.stdout:checking for linux/btrfs.h... yes 2023-07-11T00:32:40.734 INFO:teuthology.orchestra.run.smithi022.stdout:checking linux/btrfs_tree.h usability... yes 2023-07-11T00:32:40.751 INFO:teuthology.orchestra.run.smithi022.stdout:checking linux/btrfs_tree.h presence... yes 2023-07-11T00:32:40.751 INFO:teuthology.orchestra.run.smithi022.stdout:checking for linux/btrfs_tree.h... yes 2023-07-11T00:32:40.824 INFO:teuthology.orchestra.run.smithi022.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-07-11T00:32:40.853 INFO:teuthology.orchestra.run.smithi022.stdout:configure: creating ./config.status 2023-07-11T00:32:41.758 INFO:teuthology.orchestra.run.smithi022.stdout:config.status: creating include/builddefs 2023-07-11T00:32:41.788 INFO:teuthology.orchestra.run.smithi022.stdout:config.status: creating include/config.h 2023-07-11T00:32:41.810 INFO:teuthology.orchestra.run.smithi022.stdout:config.status: executing libtool commands 2023-07-11T00:32:41.890 INFO:teuthology.orchestra.run.smithi022.stdout:Building include 2023-07-11T00:32:41.897 INFO:teuthology.orchestra.run.smithi022.stdout:Building lib 2023-07-11T00:32:41.903 INFO:teuthology.orchestra.run.smithi022.stdout: [LTDEP] 2023-07-11T00:32:42.115 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] dataascii.lo 2023-07-11T00:32:42.320 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] databin.lo 2023-07-11T00:32:42.559 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] datapid.lo 2023-07-11T00:32:42.751 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] file_lock.lo 2023-07-11T00:32:42.991 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] forker.lo 2023-07-11T00:32:43.215 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] pattern.lo 2023-07-11T00:32:43.418 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] open_flags.lo 2023-07-11T00:32:43.652 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] random_range.lo 2023-07-11T00:32:43.966 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] string_to_tokens.lo 2023-07-11T00:32:44.155 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] str_to_bytes.lo 2023-07-11T00:32:44.375 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] tlibio.lo 2023-07-11T00:32:44.707 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] write_log.lo 2023-07-11T00:32:45.042 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] random.lo 2023-07-11T00:32:45.243 INFO:teuthology.orchestra.run.smithi022.stdout: [LD] 2023-07-11T00:32:45.394 INFO:teuthology.orchestra.run.smithi022.stdout:Building ltp 2023-07-11T00:32:45.401 INFO:teuthology.orchestra.run.smithi022.stdout: [DEP] 2023-07-11T00:32:45.620 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] doio 2023-07-11T00:32:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] fsstress 2023-07-11T00:32:47.830 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] fsx 2023-07-11T00:32:48.811 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] growfiles 2023-07-11T00:32:49.429 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] iogen 2023-07-11T00:32:49.894 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aio-stress 2023-07-11T00:32:50.420 INFO:teuthology.orchestra.run.smithi022.stdout:Building src 2023-07-11T00:32:50.429 INFO:teuthology.orchestra.run.smithi022.stdout: [DEP] 2023-07-11T00:32:53.057 INFO:teuthology.orchestra.run.smithi022.stdout: [DEP] 2023-07-11T00:32:53.108 INFO:teuthology.orchestra.run.smithi022.stdout: [DEP] 2023-07-11T00:32:53.125 INFO:teuthology.orchestra.run.smithi022.stdout: [DEP] 2023-07-11T00:32:53.476 INFO:teuthology.orchestra.run.smithi022.stdout: [DEP] 2023-07-11T00:32:53.518 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] dirstress 2023-07-11T00:32:53.867 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] fill 2023-07-11T00:32:54.123 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] fill2 2023-07-11T00:32:54.461 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] getpagesize 2023-07-11T00:32:54.696 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] holes 2023-07-11T00:32:54.997 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] lstat64 2023-07-11T00:32:55.286 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] nametest 2023-07-11T00:32:55.632 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] permname 2023-07-11T00:32:55.937 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] randholes 2023-07-11T00:32:56.293 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] runas 2023-07-11T00:32:56.577 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] truncfile 2023-07-11T00:32:56.865 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] usemem 2023-07-11T00:32:57.117 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] mmapcat 2023-07-11T00:32:57.370 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] append_reader 2023-07-11T00:32:57.624 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] append_writer 2023-07-11T00:32:57.880 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] dirperf 2023-07-11T00:32:58.211 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] metaperf 2023-07-11T00:32:58.570 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] devzero 2023-07-11T00:32:58.855 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] feature 2023-07-11T00:32:59.180 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] alloc 2023-07-11T00:32:59.501 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] fault 2023-07-11T00:32:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] fstest 2023-07-11T00:33:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_access_root 2023-07-11T00:33:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] godown 2023-07-11T00:33:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] resvtest 2023-07-11T00:33:00.946 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] writemod 2023-07-11T00:33:01.193 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] writev_on_pagefault 2023-07-11T00:33:01.455 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] makeextents 2023-07-11T00:33:01.743 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] itrash 2023-07-11T00:33:02.000 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] rename 2023-07-11T00:33:02.240 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] multi_open_unlink 2023-07-11T00:33:02.508 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] unwritten_sync 2023-07-11T00:33:02.796 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] genhashnames 2023-07-11T00:33:03.087 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_holes 2023-07-11T00:33:03.339 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_mmap_writev 2023-07-11T00:33:03.589 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_truncate_cmtime 2023-07-11T00:33:03.851 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] dirhash_collide 2023-07-11T00:33:04.139 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_rename_overwrite 2023-07-11T00:33:04.382 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] holetest 2023-07-11T00:33:04.705 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_truncate_self 2023-07-11T00:33:04.946 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] af_unix 2023-07-11T00:33:05.204 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_mmap_stale_pmd 2023-07-11T00:33:05.460 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_mmap_cow_race 2023-07-11T00:33:05.728 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_mmap_fallocate 2023-07-11T00:33:05.980 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] fsync-err 2023-07-11T00:33:06.141 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:33:06.147 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:33:06.271 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_mmap_write_ro 2023-07-11T00:33:06.526 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_ext4_dax_journal_corruption 2023-07-11T00:33:06.790 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_ext4_dax_inline_corruption 2023-07-11T00:33:07.049 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_ofd_locks 2023-07-11T00:33:07.354 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_mmap_collision 2023-07-11T00:33:07.655 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] mmap-write-concurrent 2023-07-11T00:33:07.929 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_get_file_time 2023-07-11T00:33:08.179 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_create_short_dirs 2023-07-11T00:33:08.448 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_create_long_dirs 2023-07-11T00:33:08.716 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_enospc 2023-07-11T00:33:09.005 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_mmap_writev_overlap 2023-07-11T00:33:09.279 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] checkpoint_journal 2023-07-11T00:33:09.539 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] mmap-rw-fault 2023-07-11T00:33:09.828 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] allocstale 2023-07-11T00:33:10.104 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_mmap_cow_memory_failure 2023-07-11T00:33:10.378 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] fake-dump-rootino 2023-07-11T00:33:10.633 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] dio-buf-fault 2023-07-11T00:33:10.889 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] xfsctl 2023-07-11T00:33:11.185 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] bstat 2023-07-11T00:33:11.496 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_mtab 2023-07-11T00:33:11.786 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] getdevicesize 2023-07-11T00:33:12.031 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] preallo_rw_pattern_reader 2023-07-11T00:33:12.296 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] preallo_rw_pattern_writer 2023-07-11T00:33:12.560 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] ftrunc 2023-07-11T00:33:12.812 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] trunc 2023-07-11T00:33:13.078 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] fs_perms 2023-07-11T00:33:13.346 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] testx 2023-07-11T00:33:13.578 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] looptest 2023-07-11T00:33:13.875 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] locktest 2023-07-11T00:33:14.290 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] unwritten_mmap 2023-07-11T00:33:14.560 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] bulkstat_unlink_test 2023-07-11T00:33:14.869 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] deduperace 2023-07-11T00:33:15.170 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] bulkstat_unlink_test_modified 2023-07-11T00:33:15.475 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_dir_offset 2023-07-11T00:33:15.728 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_futimens 2023-07-11T00:33:15.970 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_immutable 2023-07-11T00:33:16.689 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] stale_handle 2023-07-11T00:33:16.967 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] pwrite_mmap_blocked 2023-07-11T00:33:17.226 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_dir_offset2 2023-07-11T00:33:17.527 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] seek_sanity_test 2023-07-11T00:33:18.050 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] seek_copy_test 2023-07-11T00:33:18.333 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_readdir_1 2023-07-11T00:33:18.584 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_readdir_2 2023-07-11T00:33:18.838 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] fsync-tester 2023-07-11T00:33:19.193 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] nsexec 2023-07-11T00:33:19.472 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] cloner 2023-07-11T00:33:19.754 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] renameat2 2023-07-11T00:33:20.028 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_getcwd 2023-07-11T00:33:20.290 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] e4compact 2023-07-11T00:33:20.597 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] test-nextquota 2023-07-11T00:33:20.875 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] punch-alternating 2023-07-11T00:33:21.155 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] attr-list-by-handle-cursor-test 2023-07-11T00:33:21.428 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] listxattr 2023-07-11T00:33:21.677 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] dio-interleaved 2023-07-11T00:33:21.941 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_dir_type 2023-07-11T00:33:22.204 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] dio-invalidate-cache 2023-07-11T00:33:22.511 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] stat_test 2023-07-11T00:33:22.914 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_encrypted_d_revalidate 2023-07-11T00:33:23.186 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] attr_replace_test 2023-07-11T00:33:23.453 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] swapon 2023-07-11T00:33:23.723 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] mkswap 2023-07-11T00:33:23.978 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_attr_corruption 2023-07-11T00:33:24.233 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_open_tmpfiles 2023-07-11T00:33:24.522 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] fscrypt-crypt-util 2023-07-11T00:33:25.270 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] bulkstat_null_ocount 2023-07-11T00:33:25.538 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] splice-test 2023-07-11T00:33:25.824 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] chprojid_fail 2023-07-11T00:33:26.094 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] detached_mounts_propagation 2023-07-11T00:33:26.387 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] ext4_resize 2023-07-11T00:33:26.640 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_readdir_3 2023-07-11T00:33:26.939 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] splice2pipe 2023-07-11T00:33:27.211 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] uuid_ioctl 2023-07-11T00:33:27.471 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] fiemap-tester 2023-07-11T00:33:27.845 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_stripealign 2023-07-11T00:33:28.103 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] open_by_handle 2023-07-11T00:33:28.465 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] t_mmap_dio 2023-07-11T00:33:28.732 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] xfsfind 2023-07-11T00:33:29.034 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] fssum 2023-07-11T00:33:29.577 INFO:teuthology.orchestra.run.smithi022.stdout:Building log-writes 2023-07-11T00:33:29.586 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] replay-log 2023-07-11T00:33:30.011 INFO:teuthology.orchestra.run.smithi022.stdout:Building perf 2023-07-11T00:33:30.018 INFO:teuthology.orchestra.run.smithi022.stdout:Building aio-dio-regress 2023-07-11T00:33:30.029 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aio-dio-append-write-fallocate-race 2023-07-11T00:33:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aio-dio-fcntl-race 2023-07-11T00:33:30.585 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aio-dio-subblock-eof-read 2023-07-11T00:33:30.838 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aio-dio-append-write-read-race 2023-07-11T00:33:31.124 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aio-dio-invalidate-readahead 2023-07-11T00:33:31.397 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aio-dio-hole-filling-race 2023-07-11T00:33:31.655 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-07-11T00:33:31.896 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aio-last-ref-held-by-io 2023-07-11T00:33:32.180 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aio-dio-cycle-write 2023-07-11T00:33:32.475 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aio-dio-extend-stat 2023-07-11T00:33:32.749 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-07-11T00:33:32.989 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aio-dio-invalidate-failure 2023-07-11T00:33:33.258 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aiodio_sparse2 2023-07-11T00:33:33.585 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aiocp 2023-07-11T00:33:33.918 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aio-dio-cow-race 2023-07-11T00:33:34.179 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aio-dio-write-verify 2023-07-11T00:33:34.480 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] aio-dio-eof-race 2023-07-11T00:33:34.772 INFO:teuthology.orchestra.run.smithi022.stdout:Building vfs 2023-07-11T00:33:34.783 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] vfstest 2023-07-11T00:33:36.247 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:33:36.252 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:33:36.924 INFO:teuthology.orchestra.run.smithi022.stdout: [CC] mount-idmapped 2023-07-11T00:33:37.414 INFO:teuthology.orchestra.run.smithi022.stdout:Building m4 2023-07-11T00:33:37.422 INFO:teuthology.orchestra.run.smithi022.stdout:Building common 2023-07-11T00:33:37.429 INFO:teuthology.orchestra.run.smithi022.stdout:Building tests 2023-07-11T00:33:37.439 INFO:teuthology.orchestra.run.smithi022.stdout:Building perf 2023-07-11T00:33:37.450 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/perf/group.list 2023-07-11T00:33:37.479 INFO:teuthology.orchestra.run.smithi022.stdout:Building ext4 2023-07-11T00:33:37.489 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/ext4/group.list 2023-07-11T00:33:37.585 INFO:teuthology.orchestra.run.smithi022.stdout:Building ocfs2 2023-07-11T00:33:37.595 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/ocfs2/group.list 2023-07-11T00:33:37.630 INFO:teuthology.orchestra.run.smithi022.stdout:Building overlay 2023-07-11T00:33:37.640 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/overlay/group.list 2023-07-11T00:33:37.737 INFO:teuthology.orchestra.run.smithi022.stdout:Building cifs 2023-07-11T00:33:37.747 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/cifs/group.list 2023-07-11T00:33:37.779 INFO:teuthology.orchestra.run.smithi022.stdout:Building generic 2023-07-11T00:33:37.791 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/generic/group.list 2023-07-11T00:33:38.039 INFO:teuthology.orchestra.run.smithi022.stdout:Building shared 2023-07-11T00:33:38.048 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/shared/group.list 2023-07-11T00:33:38.093 INFO:teuthology.orchestra.run.smithi022.stdout:Building nfs 2023-07-11T00:33:38.103 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/nfs/group.list 2023-07-11T00:33:38.140 INFO:teuthology.orchestra.run.smithi022.stdout:Building f2fs 2023-07-11T00:33:38.150 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/f2fs/group.list 2023-07-11T00:33:38.194 INFO:teuthology.orchestra.run.smithi022.stdout:Building udf 2023-07-11T00:33:38.204 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/udf/group.list 2023-07-11T00:33:38.234 INFO:teuthology.orchestra.run.smithi022.stdout:Building ceph 2023-07-11T00:33:38.244 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/ceph/group.list 2023-07-11T00:33:38.281 INFO:teuthology.orchestra.run.smithi022.stdout:Building xfs 2023-07-11T00:33:38.293 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/xfs/group.list 2023-07-11T00:33:38.543 INFO:teuthology.orchestra.run.smithi022.stdout:Building btrfs 2023-07-11T00:33:38.555 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/btrfs/group.list 2023-07-11T00:33:38.707 INFO:teuthology.orchestra.run.smithi022.stdout:Building tmpfs 2023-07-11T00:33:38.717 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/tmpfs/group.list 2023-07-11T00:33:38.751 INFO:teuthology.orchestra.run.smithi022.stdout:Building selftest 2023-07-11T00:33:38.761 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/selftest/group.list 2023-07-11T00:33:38.796 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo make install) 2023-07-11T00:33:38.889 INFO:teuthology.orchestra.run.smithi022.stdout:Building include 2023-07-11T00:33:38.897 INFO:teuthology.orchestra.run.smithi022.stdout:Building lib 2023-07-11T00:33:38.905 INFO:teuthology.orchestra.run.smithi022.stdout:Building ltp 2023-07-11T00:33:38.913 INFO:teuthology.orchestra.run.smithi022.stdout:Building src 2023-07-11T00:33:38.976 INFO:teuthology.orchestra.run.smithi022.stdout:Building log-writes 2023-07-11T00:33:38.984 INFO:teuthology.orchestra.run.smithi022.stdout:Building perf 2023-07-11T00:33:38.991 INFO:teuthology.orchestra.run.smithi022.stdout:Building aio-dio-regress 2023-07-11T00:33:38.999 INFO:teuthology.orchestra.run.smithi022.stdout:Building vfs 2023-07-11T00:33:39.007 INFO:teuthology.orchestra.run.smithi022.stdout:Building m4 2023-07-11T00:33:39.015 INFO:teuthology.orchestra.run.smithi022.stdout:Building common 2023-07-11T00:33:39.022 INFO:teuthology.orchestra.run.smithi022.stdout:Building tests 2023-07-11T00:33:39.032 INFO:teuthology.orchestra.run.smithi022.stdout:Building perf 2023-07-11T00:33:39.042 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/perf/group.list 2023-07-11T00:33:39.072 INFO:teuthology.orchestra.run.smithi022.stdout:Building ext4 2023-07-11T00:33:39.082 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/ext4/group.list 2023-07-11T00:33:39.178 INFO:teuthology.orchestra.run.smithi022.stdout:Building ocfs2 2023-07-11T00:33:39.188 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/ocfs2/group.list 2023-07-11T00:33:39.222 INFO:teuthology.orchestra.run.smithi022.stdout:Building overlay 2023-07-11T00:33:39.232 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/overlay/group.list 2023-07-11T00:33:39.329 INFO:teuthology.orchestra.run.smithi022.stdout:Building cifs 2023-07-11T00:33:39.339 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/cifs/group.list 2023-07-11T00:33:39.371 INFO:teuthology.orchestra.run.smithi022.stdout:Building generic 2023-07-11T00:33:39.383 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/generic/group.list 2023-07-11T00:33:39.623 INFO:teuthology.orchestra.run.smithi022.stdout:Building shared 2023-07-11T00:33:39.633 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/shared/group.list 2023-07-11T00:33:39.677 INFO:teuthology.orchestra.run.smithi022.stdout:Building nfs 2023-07-11T00:33:39.687 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/nfs/group.list 2023-07-11T00:33:39.723 INFO:teuthology.orchestra.run.smithi022.stdout:Building f2fs 2023-07-11T00:33:39.733 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/f2fs/group.list 2023-07-11T00:33:39.777 INFO:teuthology.orchestra.run.smithi022.stdout:Building udf 2023-07-11T00:33:39.787 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/udf/group.list 2023-07-11T00:33:39.817 INFO:teuthology.orchestra.run.smithi022.stdout:Building ceph 2023-07-11T00:33:39.827 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/ceph/group.list 2023-07-11T00:33:39.864 INFO:teuthology.orchestra.run.smithi022.stdout:Building xfs 2023-07-11T00:33:39.876 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/xfs/group.list 2023-07-11T00:33:40.122 INFO:teuthology.orchestra.run.smithi022.stdout:Building btrfs 2023-07-11T00:33:40.133 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/btrfs/group.list 2023-07-11T00:33:40.281 INFO:teuthology.orchestra.run.smithi022.stdout:Building tmpfs 2023-07-11T00:33:40.291 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/tmpfs/group.list 2023-07-11T00:33:40.326 INFO:teuthology.orchestra.run.smithi022.stdout:Building selftest 2023-07-11T00:33:40.336 INFO:teuthology.orchestra.run.smithi022.stdout: [GROUP] /tmp/tmp.QzQkhuoEboxfstests-dev/tests/selftest/group.list 2023-07-11T00:33:40.367 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-07-11T00:33:40.369 INFO:teuthology.orchestra.run.smithi022.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-11T00:33:40.370 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-07-11T00:33:40.373 INFO:teuthology.orchestra.run.smithi022.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-11T00:33:40.373 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-07-11T00:33:40.377 INFO:teuthology.orchestra.run.smithi022.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-07-11T00:33:40.400 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-07-11T00:33:40.580 INFO:teuthology.orchestra.run.smithi022.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-07-11T00:33:40.603 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-07-11T00:33:40.634 INFO:teuthology.orchestra.run.smithi022.stdout:Building log-writes 2023-07-11T00:33:40.641 INFO:teuthology.orchestra.run.smithi022.stdout:Building perf 2023-07-11T00:33:40.649 INFO:teuthology.orchestra.run.smithi022.stdout:Building aio-dio-regress 2023-07-11T00:33:40.657 INFO:teuthology.orchestra.run.smithi022.stdout:Building vfs 2023-07-11T00:33:40.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake -C log-writes install 2023-07-11T00:33:40.665 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-07-11T00:33:40.688 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-07-11T00:33:40.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake -C perf install 2023-07-11T00:33:40.715 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-07-11T00:33:40.739 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-07-11T00:33:40.798 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-07-11T00:33:40.802 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-07-11T00:33:40.825 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-dio-append-write-fallocate-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-07-11T00:33:40.969 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake -C vfs install 2023-07-11T00:33:40.971 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-07-11T00:33:40.995 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-07-11T00:33:41.027 INFO:teuthology.orchestra.run.smithi022.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-07-11T00:33:41.050 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-07-11T00:33:44.048 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-07-11T00:33:44.269 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-07-11T00:33:44.326 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-07-11T00:33:44.328 INFO:teuthology.orchestra.run.smithi022.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-11T00:33:44.329 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-07-11T00:33:44.331 INFO:teuthology.orchestra.run.smithi022.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-07-11T00:33:44.355 INFO:teuthology.orchestra.run.smithi022.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-07-11T00:33:44.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-07-11T00:33:44.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.QzQkhuoEboxfstests-dev/tests/btrfs/ install 2023-07-11T00:33:44.719 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-07-11T00:33:44.743 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 299 /var/lib/xfstests/tests/btrfs 2023-07-11T00:33:46.912 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-07-11T00:33:46.935 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 036.out 275.out 016.out 175.out 240.out 180.out 069.out 282.out 015.out 280.out 140.out 056.out 008.out 004.out 199.out 233.out 194.out 234.out 248.out 109.out 033.out 252.out 270.out 040.out 176.out 202.out 137.out 125.out 078.out 152.out 003.out 264.out 243.out 192.out 148.out 075.out 178.out 284.out 052.out 256.out 207.out 228.out 128.out 028.out 183.out 225.out 094.out 046.out 273.out 090.out 251.out 089.out 206.out 215.out 115.out 197.out 250.out 266.out 051.out 246.out 219.out 119.out 244.out 232.out 121.out 112.out 012.out 195.out 107.out 162.out 083.out 147.out 288.out 242.out 187.out 024.out 220.out 153.out 020.out 102.out 002.out 171.out 261.out 135.out 156.out 092.out 255.out 072.out 068.out 143.out 048.out 062.out 084.out 129.out 029.out 229.out 103.out 254.out 111.out 011.out 155.out 134.out 170.out 260.out 034.out 161.out 043.out 247.out 216.out 116.out 157.out 274.out 110.out 101.out 238.out 276.out 114.out 138.out 095.out 038.out 145.out 160.out 091.out 081.out 071.out 061.out 085.out 265.out 200.out 100.out 025.out 258.out 286.out 269.out 039.out 196.out 098.out 080.out 070.out 060.out 208.out 106.out 009.out 167.out 217.out 120.out 191.out 117.out 017.out 211.out 158.out 182.out 066.out 146.out 212.out 188.out 065.out 204.out 104.out 041.out 177.out 279.out 241.out 235.out 253.out 257.out 124.out 035.out 172.out 278.out 058.out 262.out 169.out 042.out 193.out 097.out 271.out 283.out 236.out 186.out 053.out 133.out 164.out 154.out 239.out 189.out 037.out 139.out 267.out 141.out 214.out 014.out 223.out 086.out 132.out 179.out 144.out 032.out 277.out 205.out 136.out 005.out 096.out 198.out 108.out 190.out 173.out 050.out 105.out 291.out 185.out 067.out 088.out 285.out 209.out 123.out 044.out 201.out 019.out 001.out 287.out 142.out 237.out 151.out 231.out 163.out 131.out 213.out 113.out 013.out 031.out 027.out 057.out 272.out 268.out 184.out 259.out 210.out 227.out 010.out 263.out 127.out 230.out 166.out 130.out 023.out 073.out 099.out 082.out 030.out 203.out 063.out 055.out 076.out 245.out 122.out 074.out 222.out 159.out 249.out 022.out 289.out 174.out 006.out 045.out 281.out 290.out 299.out 224.out 181.out 149.out 064.out 218.out 118.out 018.out 047.out 168.out 007.out 093.out 079.out 054.out 059.out 150.out 049.out 226.out 126.out 165.out 026.out 021.out 077.out 221.out 087.out /var/lib/xfstests/tests/btrfs 2023-07-11T00:33:49.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.QzQkhuoEboxfstests-dev/tests/ceph/ install 2023-07-11T00:33:49.112 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-07-11T00:33:49.136 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-07-11T00:33:49.189 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-07-11T00:33:49.212 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-07-11T00:33:49.266 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.QzQkhuoEboxfstests-dev/tests/cifs/ install 2023-07-11T00:33:49.268 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-07-11T00:33:49.292 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-07-11T00:33:49.315 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-07-11T00:33:49.339 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-07-11T00:33:49.362 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.QzQkhuoEboxfstests-dev/tests/ext4/ install 2023-07-11T00:33:49.365 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-07-11T00:33:49.389 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-07-11T00:33:49.904 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-07-11T00:33:49.928 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 005.out 026.out 308.out 008.out 040.out 304.out 007.out 021.out 016.out 037.out 044.out 012.out 009.out 033.out 057.out 050.out 301.out 019.out 034.out 046.out 058.out 047.out 302.out 020.out 002.out 024.out 013.out 031.out 025.out 306.out 017.out 004.out 048.out 038.out 056.out 042.out 052.out 307.out 029.out 011.out 027.out 303.out 003.out 045.out 055.out 053.out 035.out 043.out 059.out 010.out 023.out 022.out 014.out 006.out 015.out 305.out 036.out 271.out 051.out 041.out 030.out 018.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-07-11T00:33:50.468 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.QzQkhuoEboxfstests-dev/tests/f2fs/ install 2023-07-11T00:33:50.471 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-07-11T00:33:50.494 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-07-11T00:33:50.525 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-07-11T00:33:50.549 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-07-11T00:33:50.580 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.QzQkhuoEboxfstests-dev/tests/generic/ install 2023-07-11T00:33:50.586 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-07-11T00:33:50.609 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 /var/lib/xfstests/tests/generic 2023-07-11T00:33:56.000 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-07-11T00:33:56.025 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 537.out 194.out 133.out 683.out 033.out 489.out 696.out 237.out 502.out 310.out 202.out 137.out 586.out 181.out 664.out 571.out 126.out 243.out 592.out 282.out 272.out 728.out 178.out 628.out 528.out 607.out 428.out 507.out 407.out 328.out 171.out 028.out 620.out 273.out 570.out 468.out 182.out 265.out 420.out 492.out 120.out 059.out 595.out 346.out 466.out 443.out 700.out 632.out 652.out 311.out 655.out 591.out 064.out 471.out 432.out 255.out 623.out 371.out 319.out 177.out 523.out 119.out 423.out 232.out 673.out 260.out 312.out 718.out 034.out 465.out 716.out 616.out 246.out 416.out 247.out 216.out 116.out 041.out 358.out 338.out 287.out 238.out 295.out 390.out 497.out 160.out 691.out 274.out 061.out 239.out 457.out 025.out 530.out 258.out 362.out 039.out 098.out 690.out 573.out 706.out 606.out 506.out 406.out 306.out 106.out 642.out 217.out 446.out 017.out 211.out 130.out 158.out 370.out 442.out 188.out 640.out 199.out 467.out 281.out 174.out 163.out 324.out 224.out 355.out 124.out 672.out 278.out 058.out 384.out 296.out 042.out 193.out 097.out 271.out 283.out 541.out 709.out 609.out 045.out 509.out 309.out 391.out 441.out 009.out 356.out 341.out 494.out 189.out 037.out 555.out 712.out 241.out 501.out 612.out 540.out 365.out 412.out 614.out 514.out 414.out 314.out 440.out 114.out 316.out 014.out 026.out 012.out 634.out 340.out 156.out 572.out 240.out 180.out 549.out 473.out 633.out 321.out 140.out 348.out 568.out 185.out 408.out 308.out 566.out 433.out 704.out 108.out 504.out 404.out 304.out 104.out 175.out 297.out 393.out 333.out 599.out 476.out 099.out 233.out 639.out 107.out 086.out 053.out 500.out 164.out 339.out 294.out 352.out 498.out 139.out 267.out 317.out 399.out 220.out 552.out 695.out 480.out 436.out 544.out 169.out 593.out 067.out 186.out 187.out 679.out 252.out 585.out 003.out 376.out 724.out 206.out 663.out 651.out 248.out 625.out 525.out 670.out 488.out 040.out 325.out 551.out 225.out 636.out 125.out 142.out 715.out 279.out 222.out 515.out 650.out 152.out 658.out 563.out 215.out 451.out 015.out 392.out 682.out 472.out 684.out 674.out 550.out 052.out 351.out 430.out 276.out 094.out 266.out 450.out 463.out 157.out 600.out 349.out 444.out 644.out 487.out 688.out 643.out 615.out 395.out 151.out 415.out 315.out 344.out 115.out 539.out 179.out 542.out 250.out 705.out 475.out 536.out 228.out 518.out 101.out 030.out 244.out 128.out 385.out 005.out 336.out 579.out 236.out 405.out 667.out 205.out 136.out 598.out 036.out 198.out 723.out 008.out 680.out 605.out 505.out 305.out 105.out 263.out 144.out 291.out 437.out 044.out 719.out 619.out 721.out 323.out 685.out 088.out 382.out 337.out 219.out 527.out 019.out 577.out 481.out 574.out 556.out 332.out 060.out 521.out 027.out 191.out 582.out 372.out 478.out 584.out 462.out 597.out 350.out 132.out 693.out 638.out 448.out 660.out 063.out 561.out 214.out 074.out 648.out 387.out 594.out 335.out 438.out 076.out 289.out 699.out 545.out 516.out 477.out 621.out 519.out 290.out 548.out 560.out 166.out 707.out 461.out 381.out 445.out 647.out 626.out 380.out 562.out 526.out 479.out 426.out 192.out 150.out 613.out 326.out 082.out 226.out 668.out 454.out 121.out 447.out 499.out 580.out 460.out 485.out 694.out 347.out 077.out 361.out 564.out 455.out 089.out 558.out 162.out 686.out 147.out 173.out 197.out 396.out 051.out 354.out 298.out 024.out 148.out 360.out 543.out 270.out 261.out 251.out 657.out 692.out 482.out 046.out 726.out 729.out 378.out 004.out 458.out 062.out 529.out 231.out 343.out 662.out 503.out 329.out 334.out 590.out 254.out 363.out 131.out 155.out 661.out 547.out 368.out 486.out 223.out 123.out 669.out 023.out 459.out 032.out 277.out 398.out 366.out 161.out 190.out 280.out 470.out 484.out 257.out 006.out 016.out 091.out 201.out 656.out 227.out 676.out 374.out 583.out 285.out 127.out 256.out 654.out 389.out 649.out 301.out 431.out 635.out 288.out 722.out 331.out 377.out 713.out 535.out 513.out 554.out 622.out 313.out 213.out 113.out 013.out 031.out 435.out 630.out 645.out 057.out 727.out 078.out 510.out 627.out 184.out 534.out 427.out 210.out 449.out 327.out 330.out 493.out 604.out 419.out 230.out 071.out 083.out 292.out 299.out 434.out 575.out 073.out 603.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 532.out 245.out 522.out 422.out 624.out 322.out 394.out 159.out 524.out 122.out 689.out 234.out 022.out 424.out 637.out 578.out 490.out 439.out 517.out 154.out 149.out 618.out 675.out 418.out 318.out 264.out 218.out 118.out 018.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 569.out 456.out 268.out 421.out 533.out 512.out 221.out 087.out 212.out 538.out 112.out 342.out 021.out 195.out 388.out 483.out 397.out 070.out 596.out 720.out 565.out 196.out 520.out 242.out 576.out 587.out 320.out 629.out 702.out 602.out 153.out 402.out 302.out 020.out 102.out 002.out 717.out 617.out 129.out 429.out 417.out 138.out 167.out 092.out 117.out 357.out 072.out 068.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 611.out 511.out 411.out 029.out 111.out 011.out 659.out 183.out 170.out 065.out 286.out 043.out 056.out 714.out 559.out 710.out 610.out 687.out 413.out 410.out 701.out 601.out 401.out 110.out 010.out 001.out 141.out 495.out 048.out 665.out 589.out 095.out 581.out 697.out 145.out 641.out 464.out 491.out 081.out 075.out 653.out 671.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 677.out 698.out 553.out 375.out 259.out 090.out 080.out 708.out 608.out 508.out 409.out 307.out 209.out 109.out 007.out 567.out 284.out 557.out 453.out 666.out 364.out 725.out 383.out 085.out 066.out 588.out 146.out 631.out 204.out 353.out 425.out 069.out 093.out 681.out 249.out 207.out 531.out 235.out 646.out 474.out 703.out 253.out 275.out 678.out 496.out 373.out 176.out 134.out 452.out 096.out /var/lib/xfstests/tests/generic 2023-07-11T00:34:01.472 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.QzQkhuoEboxfstests-dev/tests/nfs/ install 2023-07-11T00:34:01.475 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-07-11T00:34:01.498 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-07-11T00:34:01.524 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-07-11T00:34:01.545 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-07-11T00:34:01.568 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.QzQkhuoEboxfstests-dev/tests/ocfs2/ install 2023-07-11T00:34:01.571 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-07-11T00:34:01.594 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-07-11T00:34:01.618 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-07-11T00:34:01.641 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-07-11T00:34:01.665 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.QzQkhuoEboxfstests-dev/tests/overlay/ install 2023-07-11T00:34:01.668 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-07-11T00:34:01.691 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-07-11T00:34:02.416 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-07-11T00:34:02.440 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 110.out 067.out 018.out 024.out 010.out 065.out 020.out 102.out 002.out 113.out 013.out 031.out 045.out 117.out 046.out 075.out 072.out 068.out 063.out 014.out 062.out 038.out 042.out 052.out 029.out 027.out 043.out 112.out 023.out 073.out 078.out 030.out 058.out 003.out 004.out 055.out 053.out 109.out 035.out 116.out 016.out 059.out 101.out 001.out 009.out 047.out 076.out 022.out 074.out 006.out 044.out 115.out 015.out 064.out 114.out 026.out 071.out 111.out 061.out 011.out 041.out 048.out 100.out 019.out 107.out 007.out 028.out 069.out 054.out 049.out 032.out 039.out 077.out 105.out 025.out 056.out 057.out 108.out 070.out 060.out 008.out 040.out 106.out 005.out 021.out 017.out 012.out 037.out 103.out 033.out 066.out 050.out 036.out 051.out 034.out 104.out /var/lib/xfstests/tests/overlay 2023-07-11T00:34:03.166 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.QzQkhuoEboxfstests-dev/tests/perf/ install 2023-07-11T00:34:03.169 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-07-11T00:34:03.192 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-07-11T00:34:03.216 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-07-11T00:34:03.240 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-07-11T00:34:03.263 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.QzQkhuoEboxfstests-dev/tests/selftest/ install 2023-07-11T00:34:03.266 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-07-11T00:34:03.289 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-07-11T00:34:03.349 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-07-11T00:34:03.373 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-07-11T00:34:03.433 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.QzQkhuoEboxfstests-dev/tests/shared/ install 2023-07-11T00:34:03.436 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-07-11T00:34:03.459 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-07-11T00:34:03.497 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-07-11T00:34:03.522 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-07-11T00:34:03.559 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.QzQkhuoEboxfstests-dev/tests/tmpfs/ install 2023-07-11T00:34:03.562 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-07-11T00:34:03.585 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-07-11T00:34:03.609 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-07-11T00:34:03.632 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-07-11T00:34:03.656 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.QzQkhuoEboxfstests-dev/tests/udf/ install 2023-07-11T00:34:03.658 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-07-11T00:34:03.681 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-07-11T00:34:03.705 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-07-11T00:34:03.728 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-07-11T00:34:03.752 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.QzQkhuoEboxfstests-dev/tests/xfs/ install 2023-07-11T00:34:03.758 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-07-11T00:34:03.781 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-07-11T00:34:06.385 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:34:06.389 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:34:08.879 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-07-11T00:34:08.903 INFO:teuthology.orchestra.run.smithi022.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 308.out 737.out 108.out 504.out 404.out 104.out 004.out 377.out 537.out 194.out 158.out 337.out 082.out 237.out 759.out 502.out 088.out 202.out 137.out 102.out 746.out 110.out 586.out 181.out 571.out 567.out 592.out 282.out 266.out 728.out 178.out 528.out 769.out 428.out 507.out 407.out 328.out 171.out 028.out 046.out 273.out 570.out 468.out 474.out 059.out 346.out 732.out 784.out 443.out 411.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 371.out 319.out 177.out 523.out 119.out 775.out 232.out 363.out 131.out 243.out 183.out 547.out 738.out 260.out 718.out 034.out 465.out 716.out 161.out 246.out 416.out 247.out 116.out 016.out 041.out 358.out 338.out 287.out 099.out 238.out 065.out 566.out 295.out 138.out 765.out 160.out 291.out 274.out 722.out 061.out 239.out 085.out 457.out 025.out 772.out 530.out 258.out 322.out 039.out 498.out 098.out 517.out 573.out 060.out 506.out 406.out 306.out 106.out 006.out 003.out 217.out 120.out 191.out 133.out 455.out 130.out 442.out 188.out 030.out 199.out 595.out 467.out 281.out 242.out 163.out 771.out 324.out 224.out 050.out 764.out 124.out 382.out 278.out 058.out 741.out 384.out 042.out 497.out 466.out 193.out 097.out 392.out 283.out 541.out 770.out 709.out 755.out 309.out 441.out 157.out 740.out 356.out 341.out 494.out 189.out 555.out 241.out 540.out 077.out 412.out 514.out 414.out 314.out 440.out 114.out 316.out 074.out 147.out 012.out 155.out 340.out 793.out 156.out 572.out 568.out 240.out 279.out 180.out 733.out 280.out 434.out 140.out 766.out 185.out 408.out 383.out 066.out 552.out 304.out 204.out 353.out 425.out 069.out 254.out 335.out 531.out 235.out 556.out 253.out 503.out 418.out 275.out 272.out 496.out 751.out 433.out 176.out 134.out 393.out 333.out 476.out 535.out 739.out 233.out 752.out 736.out 107.out 053.out 164.out 587.out 339.out 294.out 521.out 352.out 799.out 489.out 139.out 774.out 267.out 390.out 399.out 781.out 017.out 169.out 593.out 186.out 452.out 252.out 585.out 167.out 724.out 206.out 794.out 348.out 394.out 509.out 248.out 785.out 424.out 750.out 525.out 488.out 040.out 325.out 551.out 225.out 125.out 142.out 715.out 789.out 581.out 152.out 563.out 215.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 351.out 430.out 276.out 290.out 094.out 451.out 450.out 744.out 043.out 086.out 349.out 444.out 500.out 487.out 762.out 544.out 305.out 395.out 515.out 415.out 389.out 315.out 344.out 115.out 015.out 542.out 250.out 791.out 464.out 475.out 536.out 228.out 439.out 244.out 128.out 385.out 005.out 336.out 150.out 579.out 236.out 342.out 580.out 136.out 036.out 198.out 723.out 008.out 790.out 505.out 405.out 588.out 205.out 105.out 144.out 768.out 437.out 037.out 044.out 719.out 381.out 721.out 323.out 519.out 562.out 419.out 219.out 123.out 056.out 019.out 577.out 151.out 760.out 574.out 332.out 796.out 027.out 372.out 584.out 462.out 220.out 350.out 312.out 492.out 745.out 076.out 112.out 063.out 561.out 214.out 776.out 014.out 758.out 362.out 387.out 594.out 438.out 265.out 289.out 554.out 516.out 477.out 548.out 560.out 166.out 461.out 445.out 296.out 207.out 493.out 786.out 007.out 251.out 380.out 093.out 526.out 479.out 426.out 192.out 326.out 226.out 454.out 126.out 121.out 447.out 761.out 773.out 460.out 485.out 347.out 035.out 361.out 564.out 788.out 795.out 089.out 747.out 558.out 162.out 743.out 288.out 197.out 396.out 576.out 051.out 354.out 355.out 575.out 148.out 301.out 360.out 543.out 263.out 270.out 261.out 734.out 045.out 292.out 482.out 726.out 729.out 378.out 458.out 062.out 249.out 231.out 343.out 334.out 590.out 368.out 486.out 223.out 132.out 023.out 459.out 032.out 798.out 277.out 748.out 527.out 146.out 398.out 366.out 427.out 190.out 173.out 470.out 484.out 754.out 767.out 749.out 187.out 091.out 201.out 725.out 731.out 782.out 374.out 583.out 285.out 127.out 256.out 501.out 376.out 431.out 068.out 331.out 179.out 713.out 024.out 513.out 413.out 313.out 549.out 213.out 730.out 113.out 013.out 031.out 435.out 182.out 057.out 727.out 078.out 510.out 184.out 797.out 534.out 545.out 210.out 449.out 327.out 330.out 067.out 227.out 010.out 230.out 083.out 473.out 299.out 073.out 370.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 742.out 245.out 026.out 522.out 787.out 422.out 222.out 159.out 539.out 524.out 122.out 448.out 234.out 022.out 174.out 779.out 490.out 565.out 090.out 423.out 154.out 271.out 149.out 518.out 318.out 264.out 218.out 118.out 018.out 329.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 569.out 456.out 268.out 421.out 712.out 321.out 533.out 512.out 221.out 087.out 212.out 538.out 021.out 195.out 388.out 483.out 397.out 070.out 373.out 720.out 481.out 196.out 520.out 129.out 446.out 420.out 478.out 320.out 499.out 153.out 402.out 302.out 020.out 529.out 002.out 717.out 429.out 417.out 317.out 365.out 092.out 117.out 357.out 072.out 778.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 511.out 029.out 311.out 211.out 011.out 783.out 170.out 286.out 756.out 175.out 714.out 559.out 710.out 410.out 310.out 401.out 101.out 001.out 141.out 495.out 048.out 589.out 753.out 095.out 297.out 480.out 145.out 257.out 757.out 491.out 081.out 800.out 777.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 780.out 553.out 763.out 375.out 298.out 259.out 080.out 708.out 508.out 409.out 307.out 209.out 109.out 009.out 391.out 284.out 557.out 453.out 364.out 582.out 735.out /var/lib/xfstests/tests/xfs 2023-07-11T00:34:14.064 INFO:teuthology.orchestra.run.smithi022.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-07-11T00:34:14.087 INFO:teuthology.orchestra.run.smithi022.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-07-11T00:34:14.111 INFO:teuthology.orchestra.run.smithi022.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-07-11T00:34:14.134 INFO:teuthology.orchestra.run.smithi022.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-07-11T00:34:14.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:34:14.166 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec ls tests/generic) 2023-07-11T00:34:14.215 INFO:teuthology.orchestra.run.smithi022.stdout:001 2023-07-11T00:34:14.216 INFO:teuthology.orchestra.run.smithi022.stdout:001.out 2023-07-11T00:34:14.216 INFO:teuthology.orchestra.run.smithi022.stdout:002 2023-07-11T00:34:14.216 INFO:teuthology.orchestra.run.smithi022.stdout:002.out 2023-07-11T00:34:14.217 INFO:teuthology.orchestra.run.smithi022.stdout:003 2023-07-11T00:34:14.217 INFO:teuthology.orchestra.run.smithi022.stdout:003.out 2023-07-11T00:34:14.217 INFO:teuthology.orchestra.run.smithi022.stdout:004 2023-07-11T00:34:14.217 INFO:teuthology.orchestra.run.smithi022.stdout:004.out 2023-07-11T00:34:14.217 INFO:teuthology.orchestra.run.smithi022.stdout:005 2023-07-11T00:34:14.217 INFO:teuthology.orchestra.run.smithi022.stdout:005.out 2023-07-11T00:34:14.217 INFO:teuthology.orchestra.run.smithi022.stdout:006 2023-07-11T00:34:14.218 INFO:teuthology.orchestra.run.smithi022.stdout:006.out 2023-07-11T00:34:14.218 INFO:teuthology.orchestra.run.smithi022.stdout:007 2023-07-11T00:34:14.218 INFO:teuthology.orchestra.run.smithi022.stdout:007.out 2023-07-11T00:34:14.218 INFO:teuthology.orchestra.run.smithi022.stdout:008 2023-07-11T00:34:14.218 INFO:teuthology.orchestra.run.smithi022.stdout:008.out 2023-07-11T00:34:14.218 INFO:teuthology.orchestra.run.smithi022.stdout:009 2023-07-11T00:34:14.218 INFO:teuthology.orchestra.run.smithi022.stdout:009.out 2023-07-11T00:34:14.219 INFO:teuthology.orchestra.run.smithi022.stdout:010 2023-07-11T00:34:14.219 INFO:teuthology.orchestra.run.smithi022.stdout:010.out 2023-07-11T00:34:14.219 INFO:teuthology.orchestra.run.smithi022.stdout:011 2023-07-11T00:34:14.219 INFO:teuthology.orchestra.run.smithi022.stdout:011.out 2023-07-11T00:34:14.219 INFO:teuthology.orchestra.run.smithi022.stdout:012 2023-07-11T00:34:14.219 INFO:teuthology.orchestra.run.smithi022.stdout:012.out 2023-07-11T00:34:14.219 INFO:teuthology.orchestra.run.smithi022.stdout:013 2023-07-11T00:34:14.220 INFO:teuthology.orchestra.run.smithi022.stdout:013.out 2023-07-11T00:34:14.220 INFO:teuthology.orchestra.run.smithi022.stdout:014 2023-07-11T00:34:14.220 INFO:teuthology.orchestra.run.smithi022.stdout:014.out 2023-07-11T00:34:14.220 INFO:teuthology.orchestra.run.smithi022.stdout:015 2023-07-11T00:34:14.220 INFO:teuthology.orchestra.run.smithi022.stdout:015.out 2023-07-11T00:34:14.220 INFO:teuthology.orchestra.run.smithi022.stdout:016 2023-07-11T00:34:14.220 INFO:teuthology.orchestra.run.smithi022.stdout:016.out 2023-07-11T00:34:14.221 INFO:teuthology.orchestra.run.smithi022.stdout:017 2023-07-11T00:34:14.221 INFO:teuthology.orchestra.run.smithi022.stdout:017.out 2023-07-11T00:34:14.221 INFO:teuthology.orchestra.run.smithi022.stdout:018 2023-07-11T00:34:14.221 INFO:teuthology.orchestra.run.smithi022.stdout:018.out 2023-07-11T00:34:14.221 INFO:teuthology.orchestra.run.smithi022.stdout:019 2023-07-11T00:34:14.221 INFO:teuthology.orchestra.run.smithi022.stdout:019.out 2023-07-11T00:34:14.221 INFO:teuthology.orchestra.run.smithi022.stdout:020 2023-07-11T00:34:14.222 INFO:teuthology.orchestra.run.smithi022.stdout:020.out 2023-07-11T00:34:14.222 INFO:teuthology.orchestra.run.smithi022.stdout:021 2023-07-11T00:34:14.222 INFO:teuthology.orchestra.run.smithi022.stdout:021.out 2023-07-11T00:34:14.222 INFO:teuthology.orchestra.run.smithi022.stdout:022 2023-07-11T00:34:14.222 INFO:teuthology.orchestra.run.smithi022.stdout:022.out 2023-07-11T00:34:14.222 INFO:teuthology.orchestra.run.smithi022.stdout:023 2023-07-11T00:34:14.223 INFO:teuthology.orchestra.run.smithi022.stdout:023.out 2023-07-11T00:34:14.223 INFO:teuthology.orchestra.run.smithi022.stdout:024 2023-07-11T00:34:14.223 INFO:teuthology.orchestra.run.smithi022.stdout:024.out 2023-07-11T00:34:14.223 INFO:teuthology.orchestra.run.smithi022.stdout:025 2023-07-11T00:34:14.223 INFO:teuthology.orchestra.run.smithi022.stdout:025.out 2023-07-11T00:34:14.223 INFO:teuthology.orchestra.run.smithi022.stdout:026 2023-07-11T00:34:14.223 INFO:teuthology.orchestra.run.smithi022.stdout:026.out 2023-07-11T00:34:14.224 INFO:teuthology.orchestra.run.smithi022.stdout:027 2023-07-11T00:34:14.224 INFO:teuthology.orchestra.run.smithi022.stdout:027.out 2023-07-11T00:34:14.224 INFO:teuthology.orchestra.run.smithi022.stdout:028 2023-07-11T00:34:14.224 INFO:teuthology.orchestra.run.smithi022.stdout:028.out 2023-07-11T00:34:14.224 INFO:teuthology.orchestra.run.smithi022.stdout:029 2023-07-11T00:34:14.224 INFO:teuthology.orchestra.run.smithi022.stdout:029.out 2023-07-11T00:34:14.225 INFO:teuthology.orchestra.run.smithi022.stdout:030 2023-07-11T00:34:14.225 INFO:teuthology.orchestra.run.smithi022.stdout:030.out 2023-07-11T00:34:14.225 INFO:teuthology.orchestra.run.smithi022.stdout:031 2023-07-11T00:34:14.225 INFO:teuthology.orchestra.run.smithi022.stdout:031.out 2023-07-11T00:34:14.225 INFO:teuthology.orchestra.run.smithi022.stdout:032 2023-07-11T00:34:14.225 INFO:teuthology.orchestra.run.smithi022.stdout:032.out 2023-07-11T00:34:14.225 INFO:teuthology.orchestra.run.smithi022.stdout:033 2023-07-11T00:34:14.226 INFO:teuthology.orchestra.run.smithi022.stdout:033.out 2023-07-11T00:34:14.226 INFO:teuthology.orchestra.run.smithi022.stdout:034 2023-07-11T00:34:14.226 INFO:teuthology.orchestra.run.smithi022.stdout:034.out 2023-07-11T00:34:14.226 INFO:teuthology.orchestra.run.smithi022.stdout:035 2023-07-11T00:34:14.226 INFO:teuthology.orchestra.run.smithi022.stdout:035.cfg 2023-07-11T00:34:14.226 INFO:teuthology.orchestra.run.smithi022.stdout:035.out.default 2023-07-11T00:34:14.227 INFO:teuthology.orchestra.run.smithi022.stdout:035.out.nfs 2023-07-11T00:34:14.227 INFO:teuthology.orchestra.run.smithi022.stdout:036 2023-07-11T00:34:14.227 INFO:teuthology.orchestra.run.smithi022.stdout:036.out 2023-07-11T00:34:14.227 INFO:teuthology.orchestra.run.smithi022.stdout:037 2023-07-11T00:34:14.227 INFO:teuthology.orchestra.run.smithi022.stdout:037.out 2023-07-11T00:34:14.227 INFO:teuthology.orchestra.run.smithi022.stdout:038 2023-07-11T00:34:14.227 INFO:teuthology.orchestra.run.smithi022.stdout:038.out 2023-07-11T00:34:14.228 INFO:teuthology.orchestra.run.smithi022.stdout:039 2023-07-11T00:34:14.228 INFO:teuthology.orchestra.run.smithi022.stdout:039.out 2023-07-11T00:34:14.228 INFO:teuthology.orchestra.run.smithi022.stdout:040 2023-07-11T00:34:14.228 INFO:teuthology.orchestra.run.smithi022.stdout:040.out 2023-07-11T00:34:14.228 INFO:teuthology.orchestra.run.smithi022.stdout:041 2023-07-11T00:34:14.228 INFO:teuthology.orchestra.run.smithi022.stdout:041.out 2023-07-11T00:34:14.229 INFO:teuthology.orchestra.run.smithi022.stdout:042 2023-07-11T00:34:14.229 INFO:teuthology.orchestra.run.smithi022.stdout:042.out 2023-07-11T00:34:14.229 INFO:teuthology.orchestra.run.smithi022.stdout:043 2023-07-11T00:34:14.229 INFO:teuthology.orchestra.run.smithi022.stdout:043.out 2023-07-11T00:34:14.229 INFO:teuthology.orchestra.run.smithi022.stdout:044 2023-07-11T00:34:14.229 INFO:teuthology.orchestra.run.smithi022.stdout:044.out 2023-07-11T00:34:14.229 INFO:teuthology.orchestra.run.smithi022.stdout:045 2023-07-11T00:34:14.230 INFO:teuthology.orchestra.run.smithi022.stdout:045.out 2023-07-11T00:34:14.230 INFO:teuthology.orchestra.run.smithi022.stdout:046 2023-07-11T00:34:14.230 INFO:teuthology.orchestra.run.smithi022.stdout:046.out 2023-07-11T00:34:14.230 INFO:teuthology.orchestra.run.smithi022.stdout:047 2023-07-11T00:34:14.230 INFO:teuthology.orchestra.run.smithi022.stdout:047.out 2023-07-11T00:34:14.230 INFO:teuthology.orchestra.run.smithi022.stdout:048 2023-07-11T00:34:14.230 INFO:teuthology.orchestra.run.smithi022.stdout:048.out 2023-07-11T00:34:14.231 INFO:teuthology.orchestra.run.smithi022.stdout:049 2023-07-11T00:34:14.231 INFO:teuthology.orchestra.run.smithi022.stdout:049.out 2023-07-11T00:34:14.231 INFO:teuthology.orchestra.run.smithi022.stdout:050 2023-07-11T00:34:14.231 INFO:teuthology.orchestra.run.smithi022.stdout:050.cfg 2023-07-11T00:34:14.231 INFO:teuthology.orchestra.run.smithi022.stdout:050.out.default 2023-07-11T00:34:14.231 INFO:teuthology.orchestra.run.smithi022.stdout:050.out.nojournal 2023-07-11T00:34:14.231 INFO:teuthology.orchestra.run.smithi022.stdout:050.out.xfsquota 2023-07-11T00:34:14.232 INFO:teuthology.orchestra.run.smithi022.stdout:051 2023-07-11T00:34:14.232 INFO:teuthology.orchestra.run.smithi022.stdout:051.out 2023-07-11T00:34:14.232 INFO:teuthology.orchestra.run.smithi022.stdout:052 2023-07-11T00:34:14.232 INFO:teuthology.orchestra.run.smithi022.stdout:052.out 2023-07-11T00:34:14.232 INFO:teuthology.orchestra.run.smithi022.stdout:053 2023-07-11T00:34:14.232 INFO:teuthology.orchestra.run.smithi022.stdout:053.out 2023-07-11T00:34:14.232 INFO:teuthology.orchestra.run.smithi022.stdout:054 2023-07-11T00:34:14.233 INFO:teuthology.orchestra.run.smithi022.stdout:054.out 2023-07-11T00:34:14.233 INFO:teuthology.orchestra.run.smithi022.stdout:055 2023-07-11T00:34:14.233 INFO:teuthology.orchestra.run.smithi022.stdout:055.out 2023-07-11T00:34:14.233 INFO:teuthology.orchestra.run.smithi022.stdout:056 2023-07-11T00:34:14.233 INFO:teuthology.orchestra.run.smithi022.stdout:056.out 2023-07-11T00:34:14.234 INFO:teuthology.orchestra.run.smithi022.stdout:057 2023-07-11T00:34:14.234 INFO:teuthology.orchestra.run.smithi022.stdout:057.out 2023-07-11T00:34:14.234 INFO:teuthology.orchestra.run.smithi022.stdout:058 2023-07-11T00:34:14.234 INFO:teuthology.orchestra.run.smithi022.stdout:058.out 2023-07-11T00:34:14.234 INFO:teuthology.orchestra.run.smithi022.stdout:059 2023-07-11T00:34:14.234 INFO:teuthology.orchestra.run.smithi022.stdout:059.out 2023-07-11T00:34:14.234 INFO:teuthology.orchestra.run.smithi022.stdout:060 2023-07-11T00:34:14.235 INFO:teuthology.orchestra.run.smithi022.stdout:060.out 2023-07-11T00:34:14.235 INFO:teuthology.orchestra.run.smithi022.stdout:061 2023-07-11T00:34:14.235 INFO:teuthology.orchestra.run.smithi022.stdout:061.out 2023-07-11T00:34:14.235 INFO:teuthology.orchestra.run.smithi022.stdout:062 2023-07-11T00:34:14.235 INFO:teuthology.orchestra.run.smithi022.stdout:062.out 2023-07-11T00:34:14.235 INFO:teuthology.orchestra.run.smithi022.stdout:063 2023-07-11T00:34:14.235 INFO:teuthology.orchestra.run.smithi022.stdout:063.out 2023-07-11T00:34:14.235 INFO:teuthology.orchestra.run.smithi022.stdout:064 2023-07-11T00:34:14.236 INFO:teuthology.orchestra.run.smithi022.stdout:064.out 2023-07-11T00:34:14.236 INFO:teuthology.orchestra.run.smithi022.stdout:065 2023-07-11T00:34:14.236 INFO:teuthology.orchestra.run.smithi022.stdout:065.out 2023-07-11T00:34:14.236 INFO:teuthology.orchestra.run.smithi022.stdout:066 2023-07-11T00:34:14.236 INFO:teuthology.orchestra.run.smithi022.stdout:066.out 2023-07-11T00:34:14.236 INFO:teuthology.orchestra.run.smithi022.stdout:067 2023-07-11T00:34:14.237 INFO:teuthology.orchestra.run.smithi022.stdout:067.out 2023-07-11T00:34:14.237 INFO:teuthology.orchestra.run.smithi022.stdout:068 2023-07-11T00:34:14.237 INFO:teuthology.orchestra.run.smithi022.stdout:068.out 2023-07-11T00:34:14.237 INFO:teuthology.orchestra.run.smithi022.stdout:069 2023-07-11T00:34:14.237 INFO:teuthology.orchestra.run.smithi022.stdout:069.out 2023-07-11T00:34:14.237 INFO:teuthology.orchestra.run.smithi022.stdout:070 2023-07-11T00:34:14.238 INFO:teuthology.orchestra.run.smithi022.stdout:070.out 2023-07-11T00:34:14.238 INFO:teuthology.orchestra.run.smithi022.stdout:071 2023-07-11T00:34:14.238 INFO:teuthology.orchestra.run.smithi022.stdout:071.out 2023-07-11T00:34:14.238 INFO:teuthology.orchestra.run.smithi022.stdout:072 2023-07-11T00:34:14.238 INFO:teuthology.orchestra.run.smithi022.stdout:072.out 2023-07-11T00:34:14.238 INFO:teuthology.orchestra.run.smithi022.stdout:073 2023-07-11T00:34:14.239 INFO:teuthology.orchestra.run.smithi022.stdout:073.out 2023-07-11T00:34:14.239 INFO:teuthology.orchestra.run.smithi022.stdout:074 2023-07-11T00:34:14.239 INFO:teuthology.orchestra.run.smithi022.stdout:074.out 2023-07-11T00:34:14.239 INFO:teuthology.orchestra.run.smithi022.stdout:075 2023-07-11T00:34:14.239 INFO:teuthology.orchestra.run.smithi022.stdout:075.out 2023-07-11T00:34:14.239 INFO:teuthology.orchestra.run.smithi022.stdout:076 2023-07-11T00:34:14.240 INFO:teuthology.orchestra.run.smithi022.stdout:076.out 2023-07-11T00:34:14.240 INFO:teuthology.orchestra.run.smithi022.stdout:077 2023-07-11T00:34:14.240 INFO:teuthology.orchestra.run.smithi022.stdout:077.out 2023-07-11T00:34:14.240 INFO:teuthology.orchestra.run.smithi022.stdout:078 2023-07-11T00:34:14.240 INFO:teuthology.orchestra.run.smithi022.stdout:078.out 2023-07-11T00:34:14.240 INFO:teuthology.orchestra.run.smithi022.stdout:079 2023-07-11T00:34:14.241 INFO:teuthology.orchestra.run.smithi022.stdout:079.out 2023-07-11T00:34:14.241 INFO:teuthology.orchestra.run.smithi022.stdout:080 2023-07-11T00:34:14.241 INFO:teuthology.orchestra.run.smithi022.stdout:080.out 2023-07-11T00:34:14.241 INFO:teuthology.orchestra.run.smithi022.stdout:081 2023-07-11T00:34:14.241 INFO:teuthology.orchestra.run.smithi022.stdout:081.out 2023-07-11T00:34:14.242 INFO:teuthology.orchestra.run.smithi022.stdout:082 2023-07-11T00:34:14.242 INFO:teuthology.orchestra.run.smithi022.stdout:082.out 2023-07-11T00:34:14.242 INFO:teuthology.orchestra.run.smithi022.stdout:083 2023-07-11T00:34:14.242 INFO:teuthology.orchestra.run.smithi022.stdout:083.out 2023-07-11T00:34:14.243 INFO:teuthology.orchestra.run.smithi022.stdout:084 2023-07-11T00:34:14.243 INFO:teuthology.orchestra.run.smithi022.stdout:084.out 2023-07-11T00:34:14.243 INFO:teuthology.orchestra.run.smithi022.stdout:085 2023-07-11T00:34:14.243 INFO:teuthology.orchestra.run.smithi022.stdout:085.out 2023-07-11T00:34:14.244 INFO:teuthology.orchestra.run.smithi022.stdout:086 2023-07-11T00:34:14.244 INFO:teuthology.orchestra.run.smithi022.stdout:086.out 2023-07-11T00:34:14.244 INFO:teuthology.orchestra.run.smithi022.stdout:087 2023-07-11T00:34:14.245 INFO:teuthology.orchestra.run.smithi022.stdout:087.out 2023-07-11T00:34:14.245 INFO:teuthology.orchestra.run.smithi022.stdout:088 2023-07-11T00:34:14.245 INFO:teuthology.orchestra.run.smithi022.stdout:088.out 2023-07-11T00:34:14.246 INFO:teuthology.orchestra.run.smithi022.stdout:089 2023-07-11T00:34:14.246 INFO:teuthology.orchestra.run.smithi022.stdout:089.out 2023-07-11T00:34:14.246 INFO:teuthology.orchestra.run.smithi022.stdout:090 2023-07-11T00:34:14.246 INFO:teuthology.orchestra.run.smithi022.stdout:090.out 2023-07-11T00:34:14.247 INFO:teuthology.orchestra.run.smithi022.stdout:091 2023-07-11T00:34:14.247 INFO:teuthology.orchestra.run.smithi022.stdout:091.out 2023-07-11T00:34:14.247 INFO:teuthology.orchestra.run.smithi022.stdout:092 2023-07-11T00:34:14.247 INFO:teuthology.orchestra.run.smithi022.stdout:092.out 2023-07-11T00:34:14.248 INFO:teuthology.orchestra.run.smithi022.stdout:093 2023-07-11T00:34:14.248 INFO:teuthology.orchestra.run.smithi022.stdout:093.out 2023-07-11T00:34:14.248 INFO:teuthology.orchestra.run.smithi022.stdout:094 2023-07-11T00:34:14.248 INFO:teuthology.orchestra.run.smithi022.stdout:094.out 2023-07-11T00:34:14.249 INFO:teuthology.orchestra.run.smithi022.stdout:095 2023-07-11T00:34:14.249 INFO:teuthology.orchestra.run.smithi022.stdout:095.out 2023-07-11T00:34:14.249 INFO:teuthology.orchestra.run.smithi022.stdout:096 2023-07-11T00:34:14.249 INFO:teuthology.orchestra.run.smithi022.stdout:096.out 2023-07-11T00:34:14.249 INFO:teuthology.orchestra.run.smithi022.stdout:097 2023-07-11T00:34:14.249 INFO:teuthology.orchestra.run.smithi022.stdout:097.out 2023-07-11T00:34:14.249 INFO:teuthology.orchestra.run.smithi022.stdout:098 2023-07-11T00:34:14.250 INFO:teuthology.orchestra.run.smithi022.stdout:098.out 2023-07-11T00:34:14.250 INFO:teuthology.orchestra.run.smithi022.stdout:099 2023-07-11T00:34:14.250 INFO:teuthology.orchestra.run.smithi022.stdout:099.out 2023-07-11T00:34:14.250 INFO:teuthology.orchestra.run.smithi022.stdout:100 2023-07-11T00:34:14.250 INFO:teuthology.orchestra.run.smithi022.stdout:100.out 2023-07-11T00:34:14.250 INFO:teuthology.orchestra.run.smithi022.stdout:101 2023-07-11T00:34:14.250 INFO:teuthology.orchestra.run.smithi022.stdout:101.out 2023-07-11T00:34:14.251 INFO:teuthology.orchestra.run.smithi022.stdout:102 2023-07-11T00:34:14.251 INFO:teuthology.orchestra.run.smithi022.stdout:102.out 2023-07-11T00:34:14.251 INFO:teuthology.orchestra.run.smithi022.stdout:103 2023-07-11T00:34:14.251 INFO:teuthology.orchestra.run.smithi022.stdout:103.out 2023-07-11T00:34:14.251 INFO:teuthology.orchestra.run.smithi022.stdout:104 2023-07-11T00:34:14.251 INFO:teuthology.orchestra.run.smithi022.stdout:104.out 2023-07-11T00:34:14.251 INFO:teuthology.orchestra.run.smithi022.stdout:105 2023-07-11T00:34:14.252 INFO:teuthology.orchestra.run.smithi022.stdout:105.out 2023-07-11T00:34:14.252 INFO:teuthology.orchestra.run.smithi022.stdout:106 2023-07-11T00:34:14.252 INFO:teuthology.orchestra.run.smithi022.stdout:106.out 2023-07-11T00:34:14.252 INFO:teuthology.orchestra.run.smithi022.stdout:107 2023-07-11T00:34:14.252 INFO:teuthology.orchestra.run.smithi022.stdout:107.out 2023-07-11T00:34:14.252 INFO:teuthology.orchestra.run.smithi022.stdout:108 2023-07-11T00:34:14.252 INFO:teuthology.orchestra.run.smithi022.stdout:108.out 2023-07-11T00:34:14.253 INFO:teuthology.orchestra.run.smithi022.stdout:109 2023-07-11T00:34:14.253 INFO:teuthology.orchestra.run.smithi022.stdout:109.out 2023-07-11T00:34:14.253 INFO:teuthology.orchestra.run.smithi022.stdout:110 2023-07-11T00:34:14.253 INFO:teuthology.orchestra.run.smithi022.stdout:110.out 2023-07-11T00:34:14.253 INFO:teuthology.orchestra.run.smithi022.stdout:111 2023-07-11T00:34:14.253 INFO:teuthology.orchestra.run.smithi022.stdout:111.out 2023-07-11T00:34:14.253 INFO:teuthology.orchestra.run.smithi022.stdout:112 2023-07-11T00:34:14.254 INFO:teuthology.orchestra.run.smithi022.stdout:112.out 2023-07-11T00:34:14.254 INFO:teuthology.orchestra.run.smithi022.stdout:113 2023-07-11T00:34:14.254 INFO:teuthology.orchestra.run.smithi022.stdout:113.out 2023-07-11T00:34:14.254 INFO:teuthology.orchestra.run.smithi022.stdout:114 2023-07-11T00:34:14.254 INFO:teuthology.orchestra.run.smithi022.stdout:114.out 2023-07-11T00:34:14.254 INFO:teuthology.orchestra.run.smithi022.stdout:115 2023-07-11T00:34:14.254 INFO:teuthology.orchestra.run.smithi022.stdout:115.out 2023-07-11T00:34:14.254 INFO:teuthology.orchestra.run.smithi022.stdout:116 2023-07-11T00:34:14.255 INFO:teuthology.orchestra.run.smithi022.stdout:116.out 2023-07-11T00:34:14.255 INFO:teuthology.orchestra.run.smithi022.stdout:117 2023-07-11T00:34:14.255 INFO:teuthology.orchestra.run.smithi022.stdout:117.out 2023-07-11T00:34:14.255 INFO:teuthology.orchestra.run.smithi022.stdout:118 2023-07-11T00:34:14.255 INFO:teuthology.orchestra.run.smithi022.stdout:118.out 2023-07-11T00:34:14.255 INFO:teuthology.orchestra.run.smithi022.stdout:119 2023-07-11T00:34:14.255 INFO:teuthology.orchestra.run.smithi022.stdout:119.out 2023-07-11T00:34:14.256 INFO:teuthology.orchestra.run.smithi022.stdout:120 2023-07-11T00:34:14.256 INFO:teuthology.orchestra.run.smithi022.stdout:120.out 2023-07-11T00:34:14.256 INFO:teuthology.orchestra.run.smithi022.stdout:121 2023-07-11T00:34:14.256 INFO:teuthology.orchestra.run.smithi022.stdout:121.out 2023-07-11T00:34:14.256 INFO:teuthology.orchestra.run.smithi022.stdout:122 2023-07-11T00:34:14.256 INFO:teuthology.orchestra.run.smithi022.stdout:122.out 2023-07-11T00:34:14.256 INFO:teuthology.orchestra.run.smithi022.stdout:123 2023-07-11T00:34:14.257 INFO:teuthology.orchestra.run.smithi022.stdout:123.out 2023-07-11T00:34:14.257 INFO:teuthology.orchestra.run.smithi022.stdout:124 2023-07-11T00:34:14.257 INFO:teuthology.orchestra.run.smithi022.stdout:124.out 2023-07-11T00:34:14.257 INFO:teuthology.orchestra.run.smithi022.stdout:125 2023-07-11T00:34:14.257 INFO:teuthology.orchestra.run.smithi022.stdout:125.out 2023-07-11T00:34:14.257 INFO:teuthology.orchestra.run.smithi022.stdout:126 2023-07-11T00:34:14.257 INFO:teuthology.orchestra.run.smithi022.stdout:126.out 2023-07-11T00:34:14.258 INFO:teuthology.orchestra.run.smithi022.stdout:127 2023-07-11T00:34:14.258 INFO:teuthology.orchestra.run.smithi022.stdout:127.out 2023-07-11T00:34:14.258 INFO:teuthology.orchestra.run.smithi022.stdout:128 2023-07-11T00:34:14.258 INFO:teuthology.orchestra.run.smithi022.stdout:128.out 2023-07-11T00:34:14.259 INFO:teuthology.orchestra.run.smithi022.stdout:129 2023-07-11T00:34:14.259 INFO:teuthology.orchestra.run.smithi022.stdout:129.out 2023-07-11T00:34:14.259 INFO:teuthology.orchestra.run.smithi022.stdout:130 2023-07-11T00:34:14.259 INFO:teuthology.orchestra.run.smithi022.stdout:130.out 2023-07-11T00:34:14.259 INFO:teuthology.orchestra.run.smithi022.stdout:131 2023-07-11T00:34:14.259 INFO:teuthology.orchestra.run.smithi022.stdout:131.out 2023-07-11T00:34:14.259 INFO:teuthology.orchestra.run.smithi022.stdout:132 2023-07-11T00:34:14.260 INFO:teuthology.orchestra.run.smithi022.stdout:132.out 2023-07-11T00:34:14.260 INFO:teuthology.orchestra.run.smithi022.stdout:133 2023-07-11T00:34:14.260 INFO:teuthology.orchestra.run.smithi022.stdout:133.out 2023-07-11T00:34:14.260 INFO:teuthology.orchestra.run.smithi022.stdout:134 2023-07-11T00:34:14.260 INFO:teuthology.orchestra.run.smithi022.stdout:134.out 2023-07-11T00:34:14.260 INFO:teuthology.orchestra.run.smithi022.stdout:135 2023-07-11T00:34:14.260 INFO:teuthology.orchestra.run.smithi022.stdout:135.out 2023-07-11T00:34:14.261 INFO:teuthology.orchestra.run.smithi022.stdout:136 2023-07-11T00:34:14.261 INFO:teuthology.orchestra.run.smithi022.stdout:136.out 2023-07-11T00:34:14.261 INFO:teuthology.orchestra.run.smithi022.stdout:137 2023-07-11T00:34:14.261 INFO:teuthology.orchestra.run.smithi022.stdout:137.out 2023-07-11T00:34:14.261 INFO:teuthology.orchestra.run.smithi022.stdout:138 2023-07-11T00:34:14.261 INFO:teuthology.orchestra.run.smithi022.stdout:138.out 2023-07-11T00:34:14.261 INFO:teuthology.orchestra.run.smithi022.stdout:139 2023-07-11T00:34:14.262 INFO:teuthology.orchestra.run.smithi022.stdout:139.out 2023-07-11T00:34:14.262 INFO:teuthology.orchestra.run.smithi022.stdout:140 2023-07-11T00:34:14.262 INFO:teuthology.orchestra.run.smithi022.stdout:140.out 2023-07-11T00:34:14.262 INFO:teuthology.orchestra.run.smithi022.stdout:141 2023-07-11T00:34:14.262 INFO:teuthology.orchestra.run.smithi022.stdout:141.out 2023-07-11T00:34:14.262 INFO:teuthology.orchestra.run.smithi022.stdout:142 2023-07-11T00:34:14.262 INFO:teuthology.orchestra.run.smithi022.stdout:142.out 2023-07-11T00:34:14.263 INFO:teuthology.orchestra.run.smithi022.stdout:143 2023-07-11T00:34:14.263 INFO:teuthology.orchestra.run.smithi022.stdout:143.out 2023-07-11T00:34:14.263 INFO:teuthology.orchestra.run.smithi022.stdout:144 2023-07-11T00:34:14.263 INFO:teuthology.orchestra.run.smithi022.stdout:144.out 2023-07-11T00:34:14.263 INFO:teuthology.orchestra.run.smithi022.stdout:145 2023-07-11T00:34:14.263 INFO:teuthology.orchestra.run.smithi022.stdout:145.out 2023-07-11T00:34:14.264 INFO:teuthology.orchestra.run.smithi022.stdout:146 2023-07-11T00:34:14.264 INFO:teuthology.orchestra.run.smithi022.stdout:146.out 2023-07-11T00:34:14.264 INFO:teuthology.orchestra.run.smithi022.stdout:147 2023-07-11T00:34:14.264 INFO:teuthology.orchestra.run.smithi022.stdout:147.out 2023-07-11T00:34:14.265 INFO:teuthology.orchestra.run.smithi022.stdout:148 2023-07-11T00:34:14.265 INFO:teuthology.orchestra.run.smithi022.stdout:148.out 2023-07-11T00:34:14.265 INFO:teuthology.orchestra.run.smithi022.stdout:149 2023-07-11T00:34:14.265 INFO:teuthology.orchestra.run.smithi022.stdout:149.out 2023-07-11T00:34:14.265 INFO:teuthology.orchestra.run.smithi022.stdout:150 2023-07-11T00:34:14.266 INFO:teuthology.orchestra.run.smithi022.stdout:150.out 2023-07-11T00:34:14.266 INFO:teuthology.orchestra.run.smithi022.stdout:151 2023-07-11T00:34:14.266 INFO:teuthology.orchestra.run.smithi022.stdout:151.out 2023-07-11T00:34:14.267 INFO:teuthology.orchestra.run.smithi022.stdout:152 2023-07-11T00:34:14.267 INFO:teuthology.orchestra.run.smithi022.stdout:152.out 2023-07-11T00:34:14.267 INFO:teuthology.orchestra.run.smithi022.stdout:153 2023-07-11T00:34:14.267 INFO:teuthology.orchestra.run.smithi022.stdout:153.out 2023-07-11T00:34:14.267 INFO:teuthology.orchestra.run.smithi022.stdout:154 2023-07-11T00:34:14.267 INFO:teuthology.orchestra.run.smithi022.stdout:154.out 2023-07-11T00:34:14.268 INFO:teuthology.orchestra.run.smithi022.stdout:155 2023-07-11T00:34:14.268 INFO:teuthology.orchestra.run.smithi022.stdout:155.out 2023-07-11T00:34:14.268 INFO:teuthology.orchestra.run.smithi022.stdout:156 2023-07-11T00:34:14.268 INFO:teuthology.orchestra.run.smithi022.stdout:156.out 2023-07-11T00:34:14.268 INFO:teuthology.orchestra.run.smithi022.stdout:157 2023-07-11T00:34:14.268 INFO:teuthology.orchestra.run.smithi022.stdout:157.out 2023-07-11T00:34:14.268 INFO:teuthology.orchestra.run.smithi022.stdout:158 2023-07-11T00:34:14.269 INFO:teuthology.orchestra.run.smithi022.stdout:158.out 2023-07-11T00:34:14.269 INFO:teuthology.orchestra.run.smithi022.stdout:159 2023-07-11T00:34:14.269 INFO:teuthology.orchestra.run.smithi022.stdout:159.out 2023-07-11T00:34:14.269 INFO:teuthology.orchestra.run.smithi022.stdout:160 2023-07-11T00:34:14.269 INFO:teuthology.orchestra.run.smithi022.stdout:160.out 2023-07-11T00:34:14.269 INFO:teuthology.orchestra.run.smithi022.stdout:161 2023-07-11T00:34:14.269 INFO:teuthology.orchestra.run.smithi022.stdout:161.out 2023-07-11T00:34:14.270 INFO:teuthology.orchestra.run.smithi022.stdout:162 2023-07-11T00:34:14.270 INFO:teuthology.orchestra.run.smithi022.stdout:162.out 2023-07-11T00:34:14.270 INFO:teuthology.orchestra.run.smithi022.stdout:163 2023-07-11T00:34:14.270 INFO:teuthology.orchestra.run.smithi022.stdout:163.out 2023-07-11T00:34:14.271 INFO:teuthology.orchestra.run.smithi022.stdout:164 2023-07-11T00:34:14.271 INFO:teuthology.orchestra.run.smithi022.stdout:164.out 2023-07-11T00:34:14.271 INFO:teuthology.orchestra.run.smithi022.stdout:165 2023-07-11T00:34:14.271 INFO:teuthology.orchestra.run.smithi022.stdout:165.out 2023-07-11T00:34:14.271 INFO:teuthology.orchestra.run.smithi022.stdout:166 2023-07-11T00:34:14.271 INFO:teuthology.orchestra.run.smithi022.stdout:166.out 2023-07-11T00:34:14.271 INFO:teuthology.orchestra.run.smithi022.stdout:167 2023-07-11T00:34:14.272 INFO:teuthology.orchestra.run.smithi022.stdout:167.out 2023-07-11T00:34:14.272 INFO:teuthology.orchestra.run.smithi022.stdout:168 2023-07-11T00:34:14.272 INFO:teuthology.orchestra.run.smithi022.stdout:168.out 2023-07-11T00:34:14.272 INFO:teuthology.orchestra.run.smithi022.stdout:169 2023-07-11T00:34:14.272 INFO:teuthology.orchestra.run.smithi022.stdout:169.out 2023-07-11T00:34:14.272 INFO:teuthology.orchestra.run.smithi022.stdout:170 2023-07-11T00:34:14.272 INFO:teuthology.orchestra.run.smithi022.stdout:170.out 2023-07-11T00:34:14.273 INFO:teuthology.orchestra.run.smithi022.stdout:171 2023-07-11T00:34:14.273 INFO:teuthology.orchestra.run.smithi022.stdout:171.out 2023-07-11T00:34:14.273 INFO:teuthology.orchestra.run.smithi022.stdout:172 2023-07-11T00:34:14.273 INFO:teuthology.orchestra.run.smithi022.stdout:172.out 2023-07-11T00:34:14.273 INFO:teuthology.orchestra.run.smithi022.stdout:173 2023-07-11T00:34:14.273 INFO:teuthology.orchestra.run.smithi022.stdout:173.out 2023-07-11T00:34:14.273 INFO:teuthology.orchestra.run.smithi022.stdout:174 2023-07-11T00:34:14.274 INFO:teuthology.orchestra.run.smithi022.stdout:174.out 2023-07-11T00:34:14.274 INFO:teuthology.orchestra.run.smithi022.stdout:175 2023-07-11T00:34:14.274 INFO:teuthology.orchestra.run.smithi022.stdout:175.out 2023-07-11T00:34:14.274 INFO:teuthology.orchestra.run.smithi022.stdout:176 2023-07-11T00:34:14.274 INFO:teuthology.orchestra.run.smithi022.stdout:176.out 2023-07-11T00:34:14.275 INFO:teuthology.orchestra.run.smithi022.stdout:177 2023-07-11T00:34:14.275 INFO:teuthology.orchestra.run.smithi022.stdout:177.out 2023-07-11T00:34:14.275 INFO:teuthology.orchestra.run.smithi022.stdout:178 2023-07-11T00:34:14.275 INFO:teuthology.orchestra.run.smithi022.stdout:178.out 2023-07-11T00:34:14.275 INFO:teuthology.orchestra.run.smithi022.stdout:179 2023-07-11T00:34:14.275 INFO:teuthology.orchestra.run.smithi022.stdout:179.out 2023-07-11T00:34:14.275 INFO:teuthology.orchestra.run.smithi022.stdout:180 2023-07-11T00:34:14.276 INFO:teuthology.orchestra.run.smithi022.stdout:180.out 2023-07-11T00:34:14.276 INFO:teuthology.orchestra.run.smithi022.stdout:181 2023-07-11T00:34:14.276 INFO:teuthology.orchestra.run.smithi022.stdout:181.out 2023-07-11T00:34:14.276 INFO:teuthology.orchestra.run.smithi022.stdout:182 2023-07-11T00:34:14.276 INFO:teuthology.orchestra.run.smithi022.stdout:182.out 2023-07-11T00:34:14.276 INFO:teuthology.orchestra.run.smithi022.stdout:183 2023-07-11T00:34:14.276 INFO:teuthology.orchestra.run.smithi022.stdout:183.out 2023-07-11T00:34:14.277 INFO:teuthology.orchestra.run.smithi022.stdout:184 2023-07-11T00:34:14.277 INFO:teuthology.orchestra.run.smithi022.stdout:184.out 2023-07-11T00:34:14.277 INFO:teuthology.orchestra.run.smithi022.stdout:185 2023-07-11T00:34:14.277 INFO:teuthology.orchestra.run.smithi022.stdout:185.out 2023-07-11T00:34:14.277 INFO:teuthology.orchestra.run.smithi022.stdout:186 2023-07-11T00:34:14.277 INFO:teuthology.orchestra.run.smithi022.stdout:186.out 2023-07-11T00:34:14.278 INFO:teuthology.orchestra.run.smithi022.stdout:187 2023-07-11T00:34:14.278 INFO:teuthology.orchestra.run.smithi022.stdout:187.out 2023-07-11T00:34:14.278 INFO:teuthology.orchestra.run.smithi022.stdout:188 2023-07-11T00:34:14.278 INFO:teuthology.orchestra.run.smithi022.stdout:188.out 2023-07-11T00:34:14.279 INFO:teuthology.orchestra.run.smithi022.stdout:189 2023-07-11T00:34:14.279 INFO:teuthology.orchestra.run.smithi022.stdout:189.out 2023-07-11T00:34:14.279 INFO:teuthology.orchestra.run.smithi022.stdout:190 2023-07-11T00:34:14.279 INFO:teuthology.orchestra.run.smithi022.stdout:190.out 2023-07-11T00:34:14.280 INFO:teuthology.orchestra.run.smithi022.stdout:191 2023-07-11T00:34:14.280 INFO:teuthology.orchestra.run.smithi022.stdout:191.out 2023-07-11T00:34:14.280 INFO:teuthology.orchestra.run.smithi022.stdout:192 2023-07-11T00:34:14.281 INFO:teuthology.orchestra.run.smithi022.stdout:192.out 2023-07-11T00:34:14.281 INFO:teuthology.orchestra.run.smithi022.stdout:193 2023-07-11T00:34:14.281 INFO:teuthology.orchestra.run.smithi022.stdout:193.out 2023-07-11T00:34:14.281 INFO:teuthology.orchestra.run.smithi022.stdout:194 2023-07-11T00:34:14.282 INFO:teuthology.orchestra.run.smithi022.stdout:194.out 2023-07-11T00:34:14.282 INFO:teuthology.orchestra.run.smithi022.stdout:195 2023-07-11T00:34:14.282 INFO:teuthology.orchestra.run.smithi022.stdout:195.out 2023-07-11T00:34:14.282 INFO:teuthology.orchestra.run.smithi022.stdout:196 2023-07-11T00:34:14.283 INFO:teuthology.orchestra.run.smithi022.stdout:196.out 2023-07-11T00:34:14.283 INFO:teuthology.orchestra.run.smithi022.stdout:197 2023-07-11T00:34:14.283 INFO:teuthology.orchestra.run.smithi022.stdout:197.out 2023-07-11T00:34:14.284 INFO:teuthology.orchestra.run.smithi022.stdout:198 2023-07-11T00:34:14.284 INFO:teuthology.orchestra.run.smithi022.stdout:198.out 2023-07-11T00:34:14.284 INFO:teuthology.orchestra.run.smithi022.stdout:199 2023-07-11T00:34:14.284 INFO:teuthology.orchestra.run.smithi022.stdout:199.out 2023-07-11T00:34:14.285 INFO:teuthology.orchestra.run.smithi022.stdout:200 2023-07-11T00:34:14.285 INFO:teuthology.orchestra.run.smithi022.stdout:200.out 2023-07-11T00:34:14.285 INFO:teuthology.orchestra.run.smithi022.stdout:201 2023-07-11T00:34:14.286 INFO:teuthology.orchestra.run.smithi022.stdout:201.out 2023-07-11T00:34:14.286 INFO:teuthology.orchestra.run.smithi022.stdout:202 2023-07-11T00:34:14.286 INFO:teuthology.orchestra.run.smithi022.stdout:202.out 2023-07-11T00:34:14.286 INFO:teuthology.orchestra.run.smithi022.stdout:203 2023-07-11T00:34:14.287 INFO:teuthology.orchestra.run.smithi022.stdout:203.out 2023-07-11T00:34:14.287 INFO:teuthology.orchestra.run.smithi022.stdout:204 2023-07-11T00:34:14.287 INFO:teuthology.orchestra.run.smithi022.stdout:204.out 2023-07-11T00:34:14.288 INFO:teuthology.orchestra.run.smithi022.stdout:205 2023-07-11T00:34:14.288 INFO:teuthology.orchestra.run.smithi022.stdout:205.out 2023-07-11T00:34:14.288 INFO:teuthology.orchestra.run.smithi022.stdout:206 2023-07-11T00:34:14.288 INFO:teuthology.orchestra.run.smithi022.stdout:206.out 2023-07-11T00:34:14.289 INFO:teuthology.orchestra.run.smithi022.stdout:207 2023-07-11T00:34:14.289 INFO:teuthology.orchestra.run.smithi022.stdout:207.out 2023-07-11T00:34:14.289 INFO:teuthology.orchestra.run.smithi022.stdout:208 2023-07-11T00:34:14.289 INFO:teuthology.orchestra.run.smithi022.stdout:208.out 2023-07-11T00:34:14.289 INFO:teuthology.orchestra.run.smithi022.stdout:209 2023-07-11T00:34:14.290 INFO:teuthology.orchestra.run.smithi022.stdout:209.out 2023-07-11T00:34:14.290 INFO:teuthology.orchestra.run.smithi022.stdout:210 2023-07-11T00:34:14.290 INFO:teuthology.orchestra.run.smithi022.stdout:210.out 2023-07-11T00:34:14.290 INFO:teuthology.orchestra.run.smithi022.stdout:211 2023-07-11T00:34:14.290 INFO:teuthology.orchestra.run.smithi022.stdout:211.out 2023-07-11T00:34:14.290 INFO:teuthology.orchestra.run.smithi022.stdout:212 2023-07-11T00:34:14.290 INFO:teuthology.orchestra.run.smithi022.stdout:212.out 2023-07-11T00:34:14.291 INFO:teuthology.orchestra.run.smithi022.stdout:213 2023-07-11T00:34:14.291 INFO:teuthology.orchestra.run.smithi022.stdout:213.out 2023-07-11T00:34:14.291 INFO:teuthology.orchestra.run.smithi022.stdout:214 2023-07-11T00:34:14.291 INFO:teuthology.orchestra.run.smithi022.stdout:214.out 2023-07-11T00:34:14.291 INFO:teuthology.orchestra.run.smithi022.stdout:215 2023-07-11T00:34:14.291 INFO:teuthology.orchestra.run.smithi022.stdout:215.out 2023-07-11T00:34:14.291 INFO:teuthology.orchestra.run.smithi022.stdout:216 2023-07-11T00:34:14.292 INFO:teuthology.orchestra.run.smithi022.stdout:216.out 2023-07-11T00:34:14.292 INFO:teuthology.orchestra.run.smithi022.stdout:217 2023-07-11T00:34:14.292 INFO:teuthology.orchestra.run.smithi022.stdout:217.out 2023-07-11T00:34:14.292 INFO:teuthology.orchestra.run.smithi022.stdout:218 2023-07-11T00:34:14.292 INFO:teuthology.orchestra.run.smithi022.stdout:218.out 2023-07-11T00:34:14.292 INFO:teuthology.orchestra.run.smithi022.stdout:219 2023-07-11T00:34:14.293 INFO:teuthology.orchestra.run.smithi022.stdout:219.out 2023-07-11T00:34:14.293 INFO:teuthology.orchestra.run.smithi022.stdout:220 2023-07-11T00:34:14.293 INFO:teuthology.orchestra.run.smithi022.stdout:220.out 2023-07-11T00:34:14.293 INFO:teuthology.orchestra.run.smithi022.stdout:221 2023-07-11T00:34:14.293 INFO:teuthology.orchestra.run.smithi022.stdout:221.out 2023-07-11T00:34:14.294 INFO:teuthology.orchestra.run.smithi022.stdout:222 2023-07-11T00:34:14.294 INFO:teuthology.orchestra.run.smithi022.stdout:222.out 2023-07-11T00:34:14.294 INFO:teuthology.orchestra.run.smithi022.stdout:223 2023-07-11T00:34:14.294 INFO:teuthology.orchestra.run.smithi022.stdout:223.out 2023-07-11T00:34:14.294 INFO:teuthology.orchestra.run.smithi022.stdout:224 2023-07-11T00:34:14.294 INFO:teuthology.orchestra.run.smithi022.stdout:224.out 2023-07-11T00:34:14.294 INFO:teuthology.orchestra.run.smithi022.stdout:225 2023-07-11T00:34:14.295 INFO:teuthology.orchestra.run.smithi022.stdout:225.out 2023-07-11T00:34:14.295 INFO:teuthology.orchestra.run.smithi022.stdout:226 2023-07-11T00:34:14.295 INFO:teuthology.orchestra.run.smithi022.stdout:226.out 2023-07-11T00:34:14.295 INFO:teuthology.orchestra.run.smithi022.stdout:227 2023-07-11T00:34:14.296 INFO:teuthology.orchestra.run.smithi022.stdout:227.out 2023-07-11T00:34:14.296 INFO:teuthology.orchestra.run.smithi022.stdout:228 2023-07-11T00:34:14.296 INFO:teuthology.orchestra.run.smithi022.stdout:228.out 2023-07-11T00:34:14.296 INFO:teuthology.orchestra.run.smithi022.stdout:229 2023-07-11T00:34:14.297 INFO:teuthology.orchestra.run.smithi022.stdout:229.out 2023-07-11T00:34:14.297 INFO:teuthology.orchestra.run.smithi022.stdout:230 2023-07-11T00:34:14.297 INFO:teuthology.orchestra.run.smithi022.stdout:230.out 2023-07-11T00:34:14.297 INFO:teuthology.orchestra.run.smithi022.stdout:231 2023-07-11T00:34:14.297 INFO:teuthology.orchestra.run.smithi022.stdout:231.out 2023-07-11T00:34:14.298 INFO:teuthology.orchestra.run.smithi022.stdout:232 2023-07-11T00:34:14.298 INFO:teuthology.orchestra.run.smithi022.stdout:232.out 2023-07-11T00:34:14.298 INFO:teuthology.orchestra.run.smithi022.stdout:233 2023-07-11T00:34:14.298 INFO:teuthology.orchestra.run.smithi022.stdout:233.out 2023-07-11T00:34:14.298 INFO:teuthology.orchestra.run.smithi022.stdout:234 2023-07-11T00:34:14.298 INFO:teuthology.orchestra.run.smithi022.stdout:234.out 2023-07-11T00:34:14.298 INFO:teuthology.orchestra.run.smithi022.stdout:235 2023-07-11T00:34:14.299 INFO:teuthology.orchestra.run.smithi022.stdout:235.out 2023-07-11T00:34:14.299 INFO:teuthology.orchestra.run.smithi022.stdout:236 2023-07-11T00:34:14.299 INFO:teuthology.orchestra.run.smithi022.stdout:236.out 2023-07-11T00:34:14.299 INFO:teuthology.orchestra.run.smithi022.stdout:237 2023-07-11T00:34:14.299 INFO:teuthology.orchestra.run.smithi022.stdout:237.out 2023-07-11T00:34:14.299 INFO:teuthology.orchestra.run.smithi022.stdout:238 2023-07-11T00:34:14.299 INFO:teuthology.orchestra.run.smithi022.stdout:238.out 2023-07-11T00:34:14.300 INFO:teuthology.orchestra.run.smithi022.stdout:239 2023-07-11T00:34:14.300 INFO:teuthology.orchestra.run.smithi022.stdout:239.out 2023-07-11T00:34:14.300 INFO:teuthology.orchestra.run.smithi022.stdout:240 2023-07-11T00:34:14.300 INFO:teuthology.orchestra.run.smithi022.stdout:240.out 2023-07-11T00:34:14.300 INFO:teuthology.orchestra.run.smithi022.stdout:241 2023-07-11T00:34:14.300 INFO:teuthology.orchestra.run.smithi022.stdout:241.out 2023-07-11T00:34:14.301 INFO:teuthology.orchestra.run.smithi022.stdout:242 2023-07-11T00:34:14.301 INFO:teuthology.orchestra.run.smithi022.stdout:242.out 2023-07-11T00:34:14.301 INFO:teuthology.orchestra.run.smithi022.stdout:243 2023-07-11T00:34:14.301 INFO:teuthology.orchestra.run.smithi022.stdout:243.out 2023-07-11T00:34:14.301 INFO:teuthology.orchestra.run.smithi022.stdout:244 2023-07-11T00:34:14.301 INFO:teuthology.orchestra.run.smithi022.stdout:244.out 2023-07-11T00:34:14.301 INFO:teuthology.orchestra.run.smithi022.stdout:245 2023-07-11T00:34:14.301 INFO:teuthology.orchestra.run.smithi022.stdout:245.out 2023-07-11T00:34:14.302 INFO:teuthology.orchestra.run.smithi022.stdout:246 2023-07-11T00:34:14.302 INFO:teuthology.orchestra.run.smithi022.stdout:246.out 2023-07-11T00:34:14.302 INFO:teuthology.orchestra.run.smithi022.stdout:247 2023-07-11T00:34:14.302 INFO:teuthology.orchestra.run.smithi022.stdout:247.out 2023-07-11T00:34:14.302 INFO:teuthology.orchestra.run.smithi022.stdout:248 2023-07-11T00:34:14.302 INFO:teuthology.orchestra.run.smithi022.stdout:248.out 2023-07-11T00:34:14.302 INFO:teuthology.orchestra.run.smithi022.stdout:249 2023-07-11T00:34:14.303 INFO:teuthology.orchestra.run.smithi022.stdout:249.out 2023-07-11T00:34:14.303 INFO:teuthology.orchestra.run.smithi022.stdout:250 2023-07-11T00:34:14.303 INFO:teuthology.orchestra.run.smithi022.stdout:250.out 2023-07-11T00:34:14.303 INFO:teuthology.orchestra.run.smithi022.stdout:251 2023-07-11T00:34:14.303 INFO:teuthology.orchestra.run.smithi022.stdout:251.out 2023-07-11T00:34:14.303 INFO:teuthology.orchestra.run.smithi022.stdout:252 2023-07-11T00:34:14.303 INFO:teuthology.orchestra.run.smithi022.stdout:252.out 2023-07-11T00:34:14.304 INFO:teuthology.orchestra.run.smithi022.stdout:253 2023-07-11T00:34:14.304 INFO:teuthology.orchestra.run.smithi022.stdout:253.out 2023-07-11T00:34:14.304 INFO:teuthology.orchestra.run.smithi022.stdout:254 2023-07-11T00:34:14.304 INFO:teuthology.orchestra.run.smithi022.stdout:254.out 2023-07-11T00:34:14.304 INFO:teuthology.orchestra.run.smithi022.stdout:255 2023-07-11T00:34:14.304 INFO:teuthology.orchestra.run.smithi022.stdout:255.out 2023-07-11T00:34:14.304 INFO:teuthology.orchestra.run.smithi022.stdout:256 2023-07-11T00:34:14.305 INFO:teuthology.orchestra.run.smithi022.stdout:256.out 2023-07-11T00:34:14.305 INFO:teuthology.orchestra.run.smithi022.stdout:257 2023-07-11T00:34:14.305 INFO:teuthology.orchestra.run.smithi022.stdout:257.out 2023-07-11T00:34:14.305 INFO:teuthology.orchestra.run.smithi022.stdout:258 2023-07-11T00:34:14.305 INFO:teuthology.orchestra.run.smithi022.stdout:258.out 2023-07-11T00:34:14.305 INFO:teuthology.orchestra.run.smithi022.stdout:259 2023-07-11T00:34:14.305 INFO:teuthology.orchestra.run.smithi022.stdout:259.out 2023-07-11T00:34:14.306 INFO:teuthology.orchestra.run.smithi022.stdout:260 2023-07-11T00:34:14.306 INFO:teuthology.orchestra.run.smithi022.stdout:260.out 2023-07-11T00:34:14.306 INFO:teuthology.orchestra.run.smithi022.stdout:261 2023-07-11T00:34:14.306 INFO:teuthology.orchestra.run.smithi022.stdout:261.out 2023-07-11T00:34:14.306 INFO:teuthology.orchestra.run.smithi022.stdout:262 2023-07-11T00:34:14.306 INFO:teuthology.orchestra.run.smithi022.stdout:262.out 2023-07-11T00:34:14.307 INFO:teuthology.orchestra.run.smithi022.stdout:263 2023-07-11T00:34:14.307 INFO:teuthology.orchestra.run.smithi022.stdout:263.out 2023-07-11T00:34:14.307 INFO:teuthology.orchestra.run.smithi022.stdout:264 2023-07-11T00:34:14.307 INFO:teuthology.orchestra.run.smithi022.stdout:264.out 2023-07-11T00:34:14.307 INFO:teuthology.orchestra.run.smithi022.stdout:265 2023-07-11T00:34:14.307 INFO:teuthology.orchestra.run.smithi022.stdout:265.out 2023-07-11T00:34:14.308 INFO:teuthology.orchestra.run.smithi022.stdout:266 2023-07-11T00:34:14.308 INFO:teuthology.orchestra.run.smithi022.stdout:266.out 2023-07-11T00:34:14.308 INFO:teuthology.orchestra.run.smithi022.stdout:267 2023-07-11T00:34:14.308 INFO:teuthology.orchestra.run.smithi022.stdout:267.out 2023-07-11T00:34:14.308 INFO:teuthology.orchestra.run.smithi022.stdout:268 2023-07-11T00:34:14.309 INFO:teuthology.orchestra.run.smithi022.stdout:268.out 2023-07-11T00:34:14.309 INFO:teuthology.orchestra.run.smithi022.stdout:269 2023-07-11T00:34:14.309 INFO:teuthology.orchestra.run.smithi022.stdout:269.out 2023-07-11T00:34:14.309 INFO:teuthology.orchestra.run.smithi022.stdout:270 2023-07-11T00:34:14.309 INFO:teuthology.orchestra.run.smithi022.stdout:270.out 2023-07-11T00:34:14.309 INFO:teuthology.orchestra.run.smithi022.stdout:271 2023-07-11T00:34:14.309 INFO:teuthology.orchestra.run.smithi022.stdout:271.out 2023-07-11T00:34:14.310 INFO:teuthology.orchestra.run.smithi022.stdout:272 2023-07-11T00:34:14.310 INFO:teuthology.orchestra.run.smithi022.stdout:272.out 2023-07-11T00:34:14.310 INFO:teuthology.orchestra.run.smithi022.stdout:273 2023-07-11T00:34:14.310 INFO:teuthology.orchestra.run.smithi022.stdout:273.out 2023-07-11T00:34:14.310 INFO:teuthology.orchestra.run.smithi022.stdout:274 2023-07-11T00:34:14.310 INFO:teuthology.orchestra.run.smithi022.stdout:274.out 2023-07-11T00:34:14.310 INFO:teuthology.orchestra.run.smithi022.stdout:275 2023-07-11T00:34:14.311 INFO:teuthology.orchestra.run.smithi022.stdout:275.out 2023-07-11T00:34:14.311 INFO:teuthology.orchestra.run.smithi022.stdout:276 2023-07-11T00:34:14.311 INFO:teuthology.orchestra.run.smithi022.stdout:276.out 2023-07-11T00:34:14.311 INFO:teuthology.orchestra.run.smithi022.stdout:277 2023-07-11T00:34:14.311 INFO:teuthology.orchestra.run.smithi022.stdout:277.out 2023-07-11T00:34:14.311 INFO:teuthology.orchestra.run.smithi022.stdout:278 2023-07-11T00:34:14.311 INFO:teuthology.orchestra.run.smithi022.stdout:278.out 2023-07-11T00:34:14.312 INFO:teuthology.orchestra.run.smithi022.stdout:279 2023-07-11T00:34:14.312 INFO:teuthology.orchestra.run.smithi022.stdout:279.out 2023-07-11T00:34:14.312 INFO:teuthology.orchestra.run.smithi022.stdout:280 2023-07-11T00:34:14.312 INFO:teuthology.orchestra.run.smithi022.stdout:280.out 2023-07-11T00:34:14.312 INFO:teuthology.orchestra.run.smithi022.stdout:281 2023-07-11T00:34:14.312 INFO:teuthology.orchestra.run.smithi022.stdout:281.out 2023-07-11T00:34:14.312 INFO:teuthology.orchestra.run.smithi022.stdout:282 2023-07-11T00:34:14.313 INFO:teuthology.orchestra.run.smithi022.stdout:282.out 2023-07-11T00:34:14.313 INFO:teuthology.orchestra.run.smithi022.stdout:283 2023-07-11T00:34:14.313 INFO:teuthology.orchestra.run.smithi022.stdout:283.out 2023-07-11T00:34:14.313 INFO:teuthology.orchestra.run.smithi022.stdout:284 2023-07-11T00:34:14.313 INFO:teuthology.orchestra.run.smithi022.stdout:284.out 2023-07-11T00:34:14.313 INFO:teuthology.orchestra.run.smithi022.stdout:285 2023-07-11T00:34:14.313 INFO:teuthology.orchestra.run.smithi022.stdout:285.out 2023-07-11T00:34:14.314 INFO:teuthology.orchestra.run.smithi022.stdout:286 2023-07-11T00:34:14.314 INFO:teuthology.orchestra.run.smithi022.stdout:286.out 2023-07-11T00:34:14.314 INFO:teuthology.orchestra.run.smithi022.stdout:287 2023-07-11T00:34:14.314 INFO:teuthology.orchestra.run.smithi022.stdout:287.out 2023-07-11T00:34:14.314 INFO:teuthology.orchestra.run.smithi022.stdout:288 2023-07-11T00:34:14.314 INFO:teuthology.orchestra.run.smithi022.stdout:288.out 2023-07-11T00:34:14.314 INFO:teuthology.orchestra.run.smithi022.stdout:289 2023-07-11T00:34:14.315 INFO:teuthology.orchestra.run.smithi022.stdout:289.out 2023-07-11T00:34:14.315 INFO:teuthology.orchestra.run.smithi022.stdout:290 2023-07-11T00:34:14.315 INFO:teuthology.orchestra.run.smithi022.stdout:290.out 2023-07-11T00:34:14.315 INFO:teuthology.orchestra.run.smithi022.stdout:291 2023-07-11T00:34:14.315 INFO:teuthology.orchestra.run.smithi022.stdout:291.out 2023-07-11T00:34:14.315 INFO:teuthology.orchestra.run.smithi022.stdout:292 2023-07-11T00:34:14.316 INFO:teuthology.orchestra.run.smithi022.stdout:292.out 2023-07-11T00:34:14.316 INFO:teuthology.orchestra.run.smithi022.stdout:293 2023-07-11T00:34:14.316 INFO:teuthology.orchestra.run.smithi022.stdout:293.out 2023-07-11T00:34:14.316 INFO:teuthology.orchestra.run.smithi022.stdout:294 2023-07-11T00:34:14.317 INFO:teuthology.orchestra.run.smithi022.stdout:294.out 2023-07-11T00:34:14.317 INFO:teuthology.orchestra.run.smithi022.stdout:295 2023-07-11T00:34:14.317 INFO:teuthology.orchestra.run.smithi022.stdout:295.out 2023-07-11T00:34:14.317 INFO:teuthology.orchestra.run.smithi022.stdout:296 2023-07-11T00:34:14.317 INFO:teuthology.orchestra.run.smithi022.stdout:296.out 2023-07-11T00:34:14.318 INFO:teuthology.orchestra.run.smithi022.stdout:297 2023-07-11T00:34:14.318 INFO:teuthology.orchestra.run.smithi022.stdout:297.out 2023-07-11T00:34:14.318 INFO:teuthology.orchestra.run.smithi022.stdout:298 2023-07-11T00:34:14.318 INFO:teuthology.orchestra.run.smithi022.stdout:298.out 2023-07-11T00:34:14.318 INFO:teuthology.orchestra.run.smithi022.stdout:299 2023-07-11T00:34:14.318 INFO:teuthology.orchestra.run.smithi022.stdout:299.out 2023-07-11T00:34:14.318 INFO:teuthology.orchestra.run.smithi022.stdout:300 2023-07-11T00:34:14.319 INFO:teuthology.orchestra.run.smithi022.stdout:300.out 2023-07-11T00:34:14.319 INFO:teuthology.orchestra.run.smithi022.stdout:301 2023-07-11T00:34:14.319 INFO:teuthology.orchestra.run.smithi022.stdout:301.out 2023-07-11T00:34:14.319 INFO:teuthology.orchestra.run.smithi022.stdout:302 2023-07-11T00:34:14.319 INFO:teuthology.orchestra.run.smithi022.stdout:302.out 2023-07-11T00:34:14.319 INFO:teuthology.orchestra.run.smithi022.stdout:303 2023-07-11T00:34:14.319 INFO:teuthology.orchestra.run.smithi022.stdout:303.out 2023-07-11T00:34:14.320 INFO:teuthology.orchestra.run.smithi022.stdout:304 2023-07-11T00:34:14.320 INFO:teuthology.orchestra.run.smithi022.stdout:304.out 2023-07-11T00:34:14.320 INFO:teuthology.orchestra.run.smithi022.stdout:305 2023-07-11T00:34:14.320 INFO:teuthology.orchestra.run.smithi022.stdout:305.out 2023-07-11T00:34:14.320 INFO:teuthology.orchestra.run.smithi022.stdout:306 2023-07-11T00:34:14.320 INFO:teuthology.orchestra.run.smithi022.stdout:306.out 2023-07-11T00:34:14.321 INFO:teuthology.orchestra.run.smithi022.stdout:307 2023-07-11T00:34:14.321 INFO:teuthology.orchestra.run.smithi022.stdout:307.out 2023-07-11T00:34:14.321 INFO:teuthology.orchestra.run.smithi022.stdout:308 2023-07-11T00:34:14.321 INFO:teuthology.orchestra.run.smithi022.stdout:308.out 2023-07-11T00:34:14.321 INFO:teuthology.orchestra.run.smithi022.stdout:309 2023-07-11T00:34:14.321 INFO:teuthology.orchestra.run.smithi022.stdout:309.out 2023-07-11T00:34:14.322 INFO:teuthology.orchestra.run.smithi022.stdout:310 2023-07-11T00:34:14.322 INFO:teuthology.orchestra.run.smithi022.stdout:310.out 2023-07-11T00:34:14.322 INFO:teuthology.orchestra.run.smithi022.stdout:311 2023-07-11T00:34:14.322 INFO:teuthology.orchestra.run.smithi022.stdout:311.out 2023-07-11T00:34:14.322 INFO:teuthology.orchestra.run.smithi022.stdout:312 2023-07-11T00:34:14.322 INFO:teuthology.orchestra.run.smithi022.stdout:312.out 2023-07-11T00:34:14.323 INFO:teuthology.orchestra.run.smithi022.stdout:313 2023-07-11T00:34:14.323 INFO:teuthology.orchestra.run.smithi022.stdout:313.out 2023-07-11T00:34:14.323 INFO:teuthology.orchestra.run.smithi022.stdout:314 2023-07-11T00:34:14.323 INFO:teuthology.orchestra.run.smithi022.stdout:314.out 2023-07-11T00:34:14.324 INFO:teuthology.orchestra.run.smithi022.stdout:315 2023-07-11T00:34:14.324 INFO:teuthology.orchestra.run.smithi022.stdout:315.out 2023-07-11T00:34:14.324 INFO:teuthology.orchestra.run.smithi022.stdout:316 2023-07-11T00:34:14.325 INFO:teuthology.orchestra.run.smithi022.stdout:316.out 2023-07-11T00:34:14.325 INFO:teuthology.orchestra.run.smithi022.stdout:317 2023-07-11T00:34:14.325 INFO:teuthology.orchestra.run.smithi022.stdout:317.out 2023-07-11T00:34:14.326 INFO:teuthology.orchestra.run.smithi022.stdout:318 2023-07-11T00:34:14.326 INFO:teuthology.orchestra.run.smithi022.stdout:318.out 2023-07-11T00:34:14.326 INFO:teuthology.orchestra.run.smithi022.stdout:319 2023-07-11T00:34:14.327 INFO:teuthology.orchestra.run.smithi022.stdout:319.out 2023-07-11T00:34:14.327 INFO:teuthology.orchestra.run.smithi022.stdout:320 2023-07-11T00:34:14.327 INFO:teuthology.orchestra.run.smithi022.stdout:320.out 2023-07-11T00:34:14.327 INFO:teuthology.orchestra.run.smithi022.stdout:321 2023-07-11T00:34:14.328 INFO:teuthology.orchestra.run.smithi022.stdout:321.out 2023-07-11T00:34:14.328 INFO:teuthology.orchestra.run.smithi022.stdout:322 2023-07-11T00:34:14.328 INFO:teuthology.orchestra.run.smithi022.stdout:322.out 2023-07-11T00:34:14.329 INFO:teuthology.orchestra.run.smithi022.stdout:323 2023-07-11T00:34:14.329 INFO:teuthology.orchestra.run.smithi022.stdout:323.out 2023-07-11T00:34:14.329 INFO:teuthology.orchestra.run.smithi022.stdout:324 2023-07-11T00:34:14.330 INFO:teuthology.orchestra.run.smithi022.stdout:324.out 2023-07-11T00:34:14.330 INFO:teuthology.orchestra.run.smithi022.stdout:325 2023-07-11T00:34:14.330 INFO:teuthology.orchestra.run.smithi022.stdout:325.out 2023-07-11T00:34:14.331 INFO:teuthology.orchestra.run.smithi022.stdout:326 2023-07-11T00:34:14.331 INFO:teuthology.orchestra.run.smithi022.stdout:326.out 2023-07-11T00:34:14.331 INFO:teuthology.orchestra.run.smithi022.stdout:327 2023-07-11T00:34:14.331 INFO:teuthology.orchestra.run.smithi022.stdout:327.out 2023-07-11T00:34:14.331 INFO:teuthology.orchestra.run.smithi022.stdout:328 2023-07-11T00:34:14.332 INFO:teuthology.orchestra.run.smithi022.stdout:328.out 2023-07-11T00:34:14.332 INFO:teuthology.orchestra.run.smithi022.stdout:329 2023-07-11T00:34:14.332 INFO:teuthology.orchestra.run.smithi022.stdout:329.out 2023-07-11T00:34:14.333 INFO:teuthology.orchestra.run.smithi022.stdout:330 2023-07-11T00:34:14.333 INFO:teuthology.orchestra.run.smithi022.stdout:330.out 2023-07-11T00:34:14.333 INFO:teuthology.orchestra.run.smithi022.stdout:331 2023-07-11T00:34:14.333 INFO:teuthology.orchestra.run.smithi022.stdout:331.out 2023-07-11T00:34:14.334 INFO:teuthology.orchestra.run.smithi022.stdout:332 2023-07-11T00:34:14.334 INFO:teuthology.orchestra.run.smithi022.stdout:332.out 2023-07-11T00:34:14.334 INFO:teuthology.orchestra.run.smithi022.stdout:333 2023-07-11T00:34:14.334 INFO:teuthology.orchestra.run.smithi022.stdout:333.out 2023-07-11T00:34:14.334 INFO:teuthology.orchestra.run.smithi022.stdout:334 2023-07-11T00:34:14.334 INFO:teuthology.orchestra.run.smithi022.stdout:334.out 2023-07-11T00:34:14.334 INFO:teuthology.orchestra.run.smithi022.stdout:335 2023-07-11T00:34:14.335 INFO:teuthology.orchestra.run.smithi022.stdout:335.out 2023-07-11T00:34:14.335 INFO:teuthology.orchestra.run.smithi022.stdout:336 2023-07-11T00:34:14.335 INFO:teuthology.orchestra.run.smithi022.stdout:336.out 2023-07-11T00:34:14.335 INFO:teuthology.orchestra.run.smithi022.stdout:337 2023-07-11T00:34:14.335 INFO:teuthology.orchestra.run.smithi022.stdout:337.out 2023-07-11T00:34:14.335 INFO:teuthology.orchestra.run.smithi022.stdout:338 2023-07-11T00:34:14.335 INFO:teuthology.orchestra.run.smithi022.stdout:338.out 2023-07-11T00:34:14.336 INFO:teuthology.orchestra.run.smithi022.stdout:339 2023-07-11T00:34:14.336 INFO:teuthology.orchestra.run.smithi022.stdout:339.out 2023-07-11T00:34:14.336 INFO:teuthology.orchestra.run.smithi022.stdout:340 2023-07-11T00:34:14.336 INFO:teuthology.orchestra.run.smithi022.stdout:340.out 2023-07-11T00:34:14.336 INFO:teuthology.orchestra.run.smithi022.stdout:341 2023-07-11T00:34:14.336 INFO:teuthology.orchestra.run.smithi022.stdout:341.out 2023-07-11T00:34:14.336 INFO:teuthology.orchestra.run.smithi022.stdout:342 2023-07-11T00:34:14.337 INFO:teuthology.orchestra.run.smithi022.stdout:342.out 2023-07-11T00:34:14.337 INFO:teuthology.orchestra.run.smithi022.stdout:343 2023-07-11T00:34:14.337 INFO:teuthology.orchestra.run.smithi022.stdout:343.out 2023-07-11T00:34:14.337 INFO:teuthology.orchestra.run.smithi022.stdout:344 2023-07-11T00:34:14.337 INFO:teuthology.orchestra.run.smithi022.stdout:344.out 2023-07-11T00:34:14.337 INFO:teuthology.orchestra.run.smithi022.stdout:345 2023-07-11T00:34:14.337 INFO:teuthology.orchestra.run.smithi022.stdout:345.out 2023-07-11T00:34:14.338 INFO:teuthology.orchestra.run.smithi022.stdout:346 2023-07-11T00:34:14.338 INFO:teuthology.orchestra.run.smithi022.stdout:346.out 2023-07-11T00:34:14.338 INFO:teuthology.orchestra.run.smithi022.stdout:347 2023-07-11T00:34:14.338 INFO:teuthology.orchestra.run.smithi022.stdout:347.out 2023-07-11T00:34:14.338 INFO:teuthology.orchestra.run.smithi022.stdout:348 2023-07-11T00:34:14.338 INFO:teuthology.orchestra.run.smithi022.stdout:348.out 2023-07-11T00:34:14.338 INFO:teuthology.orchestra.run.smithi022.stdout:349 2023-07-11T00:34:14.339 INFO:teuthology.orchestra.run.smithi022.stdout:349.out 2023-07-11T00:34:14.339 INFO:teuthology.orchestra.run.smithi022.stdout:350 2023-07-11T00:34:14.339 INFO:teuthology.orchestra.run.smithi022.stdout:350.out 2023-07-11T00:34:14.339 INFO:teuthology.orchestra.run.smithi022.stdout:351 2023-07-11T00:34:14.339 INFO:teuthology.orchestra.run.smithi022.stdout:351.out 2023-07-11T00:34:14.339 INFO:teuthology.orchestra.run.smithi022.stdout:352 2023-07-11T00:34:14.339 INFO:teuthology.orchestra.run.smithi022.stdout:352.out 2023-07-11T00:34:14.340 INFO:teuthology.orchestra.run.smithi022.stdout:353 2023-07-11T00:34:14.340 INFO:teuthology.orchestra.run.smithi022.stdout:353.out 2023-07-11T00:34:14.340 INFO:teuthology.orchestra.run.smithi022.stdout:354 2023-07-11T00:34:14.340 INFO:teuthology.orchestra.run.smithi022.stdout:354.out 2023-07-11T00:34:14.340 INFO:teuthology.orchestra.run.smithi022.stdout:355 2023-07-11T00:34:14.340 INFO:teuthology.orchestra.run.smithi022.stdout:355.out 2023-07-11T00:34:14.340 INFO:teuthology.orchestra.run.smithi022.stdout:356 2023-07-11T00:34:14.341 INFO:teuthology.orchestra.run.smithi022.stdout:356.out 2023-07-11T00:34:14.341 INFO:teuthology.orchestra.run.smithi022.stdout:357 2023-07-11T00:34:14.341 INFO:teuthology.orchestra.run.smithi022.stdout:357.out 2023-07-11T00:34:14.341 INFO:teuthology.orchestra.run.smithi022.stdout:358 2023-07-11T00:34:14.342 INFO:teuthology.orchestra.run.smithi022.stdout:358.out 2023-07-11T00:34:14.342 INFO:teuthology.orchestra.run.smithi022.stdout:359 2023-07-11T00:34:14.342 INFO:teuthology.orchestra.run.smithi022.stdout:359.out 2023-07-11T00:34:14.342 INFO:teuthology.orchestra.run.smithi022.stdout:360 2023-07-11T00:34:14.342 INFO:teuthology.orchestra.run.smithi022.stdout:360.out 2023-07-11T00:34:14.343 INFO:teuthology.orchestra.run.smithi022.stdout:361 2023-07-11T00:34:14.343 INFO:teuthology.orchestra.run.smithi022.stdout:361.out 2023-07-11T00:34:14.343 INFO:teuthology.orchestra.run.smithi022.stdout:362 2023-07-11T00:34:14.343 INFO:teuthology.orchestra.run.smithi022.stdout:362.out 2023-07-11T00:34:14.343 INFO:teuthology.orchestra.run.smithi022.stdout:363 2023-07-11T00:34:14.343 INFO:teuthology.orchestra.run.smithi022.stdout:363.out 2023-07-11T00:34:14.344 INFO:teuthology.orchestra.run.smithi022.stdout:364 2023-07-11T00:34:14.344 INFO:teuthology.orchestra.run.smithi022.stdout:364.out 2023-07-11T00:34:14.344 INFO:teuthology.orchestra.run.smithi022.stdout:365 2023-07-11T00:34:14.344 INFO:teuthology.orchestra.run.smithi022.stdout:365.out 2023-07-11T00:34:14.344 INFO:teuthology.orchestra.run.smithi022.stdout:366 2023-07-11T00:34:14.344 INFO:teuthology.orchestra.run.smithi022.stdout:366.out 2023-07-11T00:34:14.345 INFO:teuthology.orchestra.run.smithi022.stdout:367 2023-07-11T00:34:14.345 INFO:teuthology.orchestra.run.smithi022.stdout:367.out 2023-07-11T00:34:14.345 INFO:teuthology.orchestra.run.smithi022.stdout:368 2023-07-11T00:34:14.345 INFO:teuthology.orchestra.run.smithi022.stdout:368.out 2023-07-11T00:34:14.345 INFO:teuthology.orchestra.run.smithi022.stdout:369 2023-07-11T00:34:14.345 INFO:teuthology.orchestra.run.smithi022.stdout:369.out 2023-07-11T00:34:14.345 INFO:teuthology.orchestra.run.smithi022.stdout:370 2023-07-11T00:34:14.345 INFO:teuthology.orchestra.run.smithi022.stdout:370.out 2023-07-11T00:34:14.346 INFO:teuthology.orchestra.run.smithi022.stdout:371 2023-07-11T00:34:14.346 INFO:teuthology.orchestra.run.smithi022.stdout:371.out 2023-07-11T00:34:14.346 INFO:teuthology.orchestra.run.smithi022.stdout:372 2023-07-11T00:34:14.346 INFO:teuthology.orchestra.run.smithi022.stdout:372.out 2023-07-11T00:34:14.346 INFO:teuthology.orchestra.run.smithi022.stdout:373 2023-07-11T00:34:14.346 INFO:teuthology.orchestra.run.smithi022.stdout:373.out 2023-07-11T00:34:14.347 INFO:teuthology.orchestra.run.smithi022.stdout:374 2023-07-11T00:34:14.347 INFO:teuthology.orchestra.run.smithi022.stdout:374.out 2023-07-11T00:34:14.347 INFO:teuthology.orchestra.run.smithi022.stdout:375 2023-07-11T00:34:14.347 INFO:teuthology.orchestra.run.smithi022.stdout:375.out 2023-07-11T00:34:14.347 INFO:teuthology.orchestra.run.smithi022.stdout:376 2023-07-11T00:34:14.347 INFO:teuthology.orchestra.run.smithi022.stdout:376.out 2023-07-11T00:34:14.347 INFO:teuthology.orchestra.run.smithi022.stdout:377 2023-07-11T00:34:14.347 INFO:teuthology.orchestra.run.smithi022.stdout:377.out 2023-07-11T00:34:14.348 INFO:teuthology.orchestra.run.smithi022.stdout:378 2023-07-11T00:34:14.348 INFO:teuthology.orchestra.run.smithi022.stdout:378.out 2023-07-11T00:34:14.348 INFO:teuthology.orchestra.run.smithi022.stdout:379 2023-07-11T00:34:14.349 INFO:teuthology.orchestra.run.smithi022.stdout:379.out 2023-07-11T00:34:14.349 INFO:teuthology.orchestra.run.smithi022.stdout:380 2023-07-11T00:34:14.349 INFO:teuthology.orchestra.run.smithi022.stdout:380.out 2023-07-11T00:34:14.349 INFO:teuthology.orchestra.run.smithi022.stdout:381 2023-07-11T00:34:14.350 INFO:teuthology.orchestra.run.smithi022.stdout:381.out 2023-07-11T00:34:14.350 INFO:teuthology.orchestra.run.smithi022.stdout:382 2023-07-11T00:34:14.350 INFO:teuthology.orchestra.run.smithi022.stdout:382.out 2023-07-11T00:34:14.350 INFO:teuthology.orchestra.run.smithi022.stdout:383 2023-07-11T00:34:14.351 INFO:teuthology.orchestra.run.smithi022.stdout:383.out 2023-07-11T00:34:14.351 INFO:teuthology.orchestra.run.smithi022.stdout:384 2023-07-11T00:34:14.351 INFO:teuthology.orchestra.run.smithi022.stdout:384.out 2023-07-11T00:34:14.351 INFO:teuthology.orchestra.run.smithi022.stdout:385 2023-07-11T00:34:14.351 INFO:teuthology.orchestra.run.smithi022.stdout:385.out 2023-07-11T00:34:14.351 INFO:teuthology.orchestra.run.smithi022.stdout:386 2023-07-11T00:34:14.352 INFO:teuthology.orchestra.run.smithi022.stdout:386.out 2023-07-11T00:34:14.352 INFO:teuthology.orchestra.run.smithi022.stdout:387 2023-07-11T00:34:14.352 INFO:teuthology.orchestra.run.smithi022.stdout:387.out 2023-07-11T00:34:14.352 INFO:teuthology.orchestra.run.smithi022.stdout:388 2023-07-11T00:34:14.352 INFO:teuthology.orchestra.run.smithi022.stdout:388.out 2023-07-11T00:34:14.352 INFO:teuthology.orchestra.run.smithi022.stdout:389 2023-07-11T00:34:14.353 INFO:teuthology.orchestra.run.smithi022.stdout:389.out 2023-07-11T00:34:14.353 INFO:teuthology.orchestra.run.smithi022.stdout:390 2023-07-11T00:34:14.353 INFO:teuthology.orchestra.run.smithi022.stdout:390.out 2023-07-11T00:34:14.353 INFO:teuthology.orchestra.run.smithi022.stdout:391 2023-07-11T00:34:14.353 INFO:teuthology.orchestra.run.smithi022.stdout:391.out 2023-07-11T00:34:14.353 INFO:teuthology.orchestra.run.smithi022.stdout:392 2023-07-11T00:34:14.353 INFO:teuthology.orchestra.run.smithi022.stdout:392.out 2023-07-11T00:34:14.354 INFO:teuthology.orchestra.run.smithi022.stdout:393 2023-07-11T00:34:14.354 INFO:teuthology.orchestra.run.smithi022.stdout:393.out 2023-07-11T00:34:14.354 INFO:teuthology.orchestra.run.smithi022.stdout:394 2023-07-11T00:34:14.354 INFO:teuthology.orchestra.run.smithi022.stdout:394.out 2023-07-11T00:34:14.354 INFO:teuthology.orchestra.run.smithi022.stdout:395 2023-07-11T00:34:14.354 INFO:teuthology.orchestra.run.smithi022.stdout:395.out 2023-07-11T00:34:14.355 INFO:teuthology.orchestra.run.smithi022.stdout:396 2023-07-11T00:34:14.355 INFO:teuthology.orchestra.run.smithi022.stdout:396.out 2023-07-11T00:34:14.355 INFO:teuthology.orchestra.run.smithi022.stdout:397 2023-07-11T00:34:14.356 INFO:teuthology.orchestra.run.smithi022.stdout:397.out 2023-07-11T00:34:14.356 INFO:teuthology.orchestra.run.smithi022.stdout:398 2023-07-11T00:34:14.356 INFO:teuthology.orchestra.run.smithi022.stdout:398.out 2023-07-11T00:34:14.357 INFO:teuthology.orchestra.run.smithi022.stdout:399 2023-07-11T00:34:14.357 INFO:teuthology.orchestra.run.smithi022.stdout:399.out 2023-07-11T00:34:14.357 INFO:teuthology.orchestra.run.smithi022.stdout:400 2023-07-11T00:34:14.357 INFO:teuthology.orchestra.run.smithi022.stdout:400.out 2023-07-11T00:34:14.358 INFO:teuthology.orchestra.run.smithi022.stdout:401 2023-07-11T00:34:14.358 INFO:teuthology.orchestra.run.smithi022.stdout:401.out 2023-07-11T00:34:14.358 INFO:teuthology.orchestra.run.smithi022.stdout:402 2023-07-11T00:34:14.359 INFO:teuthology.orchestra.run.smithi022.stdout:402.out 2023-07-11T00:34:14.359 INFO:teuthology.orchestra.run.smithi022.stdout:403 2023-07-11T00:34:14.359 INFO:teuthology.orchestra.run.smithi022.stdout:403.out 2023-07-11T00:34:14.359 INFO:teuthology.orchestra.run.smithi022.stdout:404 2023-07-11T00:34:14.360 INFO:teuthology.orchestra.run.smithi022.stdout:404.out 2023-07-11T00:34:14.360 INFO:teuthology.orchestra.run.smithi022.stdout:405 2023-07-11T00:34:14.361 INFO:teuthology.orchestra.run.smithi022.stdout:405.out 2023-07-11T00:34:14.361 INFO:teuthology.orchestra.run.smithi022.stdout:406 2023-07-11T00:34:14.361 INFO:teuthology.orchestra.run.smithi022.stdout:406.out 2023-07-11T00:34:14.361 INFO:teuthology.orchestra.run.smithi022.stdout:407 2023-07-11T00:34:14.362 INFO:teuthology.orchestra.run.smithi022.stdout:407.out 2023-07-11T00:34:14.362 INFO:teuthology.orchestra.run.smithi022.stdout:408 2023-07-11T00:34:14.362 INFO:teuthology.orchestra.run.smithi022.stdout:408.out 2023-07-11T00:34:14.363 INFO:teuthology.orchestra.run.smithi022.stdout:409 2023-07-11T00:34:14.363 INFO:teuthology.orchestra.run.smithi022.stdout:409.out 2023-07-11T00:34:14.363 INFO:teuthology.orchestra.run.smithi022.stdout:410 2023-07-11T00:34:14.363 INFO:teuthology.orchestra.run.smithi022.stdout:410.out 2023-07-11T00:34:14.364 INFO:teuthology.orchestra.run.smithi022.stdout:411 2023-07-11T00:34:14.364 INFO:teuthology.orchestra.run.smithi022.stdout:411.out 2023-07-11T00:34:14.364 INFO:teuthology.orchestra.run.smithi022.stdout:412 2023-07-11T00:34:14.364 INFO:teuthology.orchestra.run.smithi022.stdout:412.out 2023-07-11T00:34:14.365 INFO:teuthology.orchestra.run.smithi022.stdout:413 2023-07-11T00:34:14.365 INFO:teuthology.orchestra.run.smithi022.stdout:413.out 2023-07-11T00:34:14.365 INFO:teuthology.orchestra.run.smithi022.stdout:414 2023-07-11T00:34:14.366 INFO:teuthology.orchestra.run.smithi022.stdout:414.out 2023-07-11T00:34:14.366 INFO:teuthology.orchestra.run.smithi022.stdout:415 2023-07-11T00:34:14.366 INFO:teuthology.orchestra.run.smithi022.stdout:415.out 2023-07-11T00:34:14.366 INFO:teuthology.orchestra.run.smithi022.stdout:416 2023-07-11T00:34:14.366 INFO:teuthology.orchestra.run.smithi022.stdout:416.out 2023-07-11T00:34:14.367 INFO:teuthology.orchestra.run.smithi022.stdout:417 2023-07-11T00:34:14.367 INFO:teuthology.orchestra.run.smithi022.stdout:417.out 2023-07-11T00:34:14.367 INFO:teuthology.orchestra.run.smithi022.stdout:418 2023-07-11T00:34:14.367 INFO:teuthology.orchestra.run.smithi022.stdout:418.out 2023-07-11T00:34:14.367 INFO:teuthology.orchestra.run.smithi022.stdout:419 2023-07-11T00:34:14.368 INFO:teuthology.orchestra.run.smithi022.stdout:419.out 2023-07-11T00:34:14.368 INFO:teuthology.orchestra.run.smithi022.stdout:420 2023-07-11T00:34:14.368 INFO:teuthology.orchestra.run.smithi022.stdout:420.out 2023-07-11T00:34:14.368 INFO:teuthology.orchestra.run.smithi022.stdout:421 2023-07-11T00:34:14.368 INFO:teuthology.orchestra.run.smithi022.stdout:421.out 2023-07-11T00:34:14.368 INFO:teuthology.orchestra.run.smithi022.stdout:422 2023-07-11T00:34:14.369 INFO:teuthology.orchestra.run.smithi022.stdout:422.out 2023-07-11T00:34:14.369 INFO:teuthology.orchestra.run.smithi022.stdout:423 2023-07-11T00:34:14.369 INFO:teuthology.orchestra.run.smithi022.stdout:423.out 2023-07-11T00:34:14.369 INFO:teuthology.orchestra.run.smithi022.stdout:424 2023-07-11T00:34:14.369 INFO:teuthology.orchestra.run.smithi022.stdout:424.out 2023-07-11T00:34:14.370 INFO:teuthology.orchestra.run.smithi022.stdout:425 2023-07-11T00:34:14.370 INFO:teuthology.orchestra.run.smithi022.stdout:425.out 2023-07-11T00:34:14.370 INFO:teuthology.orchestra.run.smithi022.stdout:426 2023-07-11T00:34:14.370 INFO:teuthology.orchestra.run.smithi022.stdout:426.out 2023-07-11T00:34:14.370 INFO:teuthology.orchestra.run.smithi022.stdout:427 2023-07-11T00:34:14.370 INFO:teuthology.orchestra.run.smithi022.stdout:427.out 2023-07-11T00:34:14.370 INFO:teuthology.orchestra.run.smithi022.stdout:428 2023-07-11T00:34:14.370 INFO:teuthology.orchestra.run.smithi022.stdout:428.out 2023-07-11T00:34:14.371 INFO:teuthology.orchestra.run.smithi022.stdout:429 2023-07-11T00:34:14.371 INFO:teuthology.orchestra.run.smithi022.stdout:429.out 2023-07-11T00:34:14.371 INFO:teuthology.orchestra.run.smithi022.stdout:430 2023-07-11T00:34:14.371 INFO:teuthology.orchestra.run.smithi022.stdout:430.out 2023-07-11T00:34:14.372 INFO:teuthology.orchestra.run.smithi022.stdout:431 2023-07-11T00:34:14.372 INFO:teuthology.orchestra.run.smithi022.stdout:431.out 2023-07-11T00:34:14.372 INFO:teuthology.orchestra.run.smithi022.stdout:432 2023-07-11T00:34:14.372 INFO:teuthology.orchestra.run.smithi022.stdout:432.out 2023-07-11T00:34:14.372 INFO:teuthology.orchestra.run.smithi022.stdout:433 2023-07-11T00:34:14.373 INFO:teuthology.orchestra.run.smithi022.stdout:433.out 2023-07-11T00:34:14.373 INFO:teuthology.orchestra.run.smithi022.stdout:434 2023-07-11T00:34:14.373 INFO:teuthology.orchestra.run.smithi022.stdout:434.out 2023-07-11T00:34:14.373 INFO:teuthology.orchestra.run.smithi022.stdout:435 2023-07-11T00:34:14.374 INFO:teuthology.orchestra.run.smithi022.stdout:435.out 2023-07-11T00:34:14.374 INFO:teuthology.orchestra.run.smithi022.stdout:436 2023-07-11T00:34:14.374 INFO:teuthology.orchestra.run.smithi022.stdout:436.out 2023-07-11T00:34:14.374 INFO:teuthology.orchestra.run.smithi022.stdout:437 2023-07-11T00:34:14.375 INFO:teuthology.orchestra.run.smithi022.stdout:437.out 2023-07-11T00:34:14.375 INFO:teuthology.orchestra.run.smithi022.stdout:438 2023-07-11T00:34:14.375 INFO:teuthology.orchestra.run.smithi022.stdout:438.out 2023-07-11T00:34:14.375 INFO:teuthology.orchestra.run.smithi022.stdout:439 2023-07-11T00:34:14.376 INFO:teuthology.orchestra.run.smithi022.stdout:439.out 2023-07-11T00:34:14.376 INFO:teuthology.orchestra.run.smithi022.stdout:440 2023-07-11T00:34:14.376 INFO:teuthology.orchestra.run.smithi022.stdout:440.out 2023-07-11T00:34:14.376 INFO:teuthology.orchestra.run.smithi022.stdout:441 2023-07-11T00:34:14.376 INFO:teuthology.orchestra.run.smithi022.stdout:441.out 2023-07-11T00:34:14.376 INFO:teuthology.orchestra.run.smithi022.stdout:442 2023-07-11T00:34:14.376 INFO:teuthology.orchestra.run.smithi022.stdout:442.out 2023-07-11T00:34:14.377 INFO:teuthology.orchestra.run.smithi022.stdout:443 2023-07-11T00:34:14.377 INFO:teuthology.orchestra.run.smithi022.stdout:443.out 2023-07-11T00:34:14.377 INFO:teuthology.orchestra.run.smithi022.stdout:444 2023-07-11T00:34:14.377 INFO:teuthology.orchestra.run.smithi022.stdout:444.out 2023-07-11T00:34:14.377 INFO:teuthology.orchestra.run.smithi022.stdout:445 2023-07-11T00:34:14.377 INFO:teuthology.orchestra.run.smithi022.stdout:445.out 2023-07-11T00:34:14.377 INFO:teuthology.orchestra.run.smithi022.stdout:446 2023-07-11T00:34:14.377 INFO:teuthology.orchestra.run.smithi022.stdout:446.out 2023-07-11T00:34:14.378 INFO:teuthology.orchestra.run.smithi022.stdout:447 2023-07-11T00:34:14.378 INFO:teuthology.orchestra.run.smithi022.stdout:447.out 2023-07-11T00:34:14.378 INFO:teuthology.orchestra.run.smithi022.stdout:448 2023-07-11T00:34:14.378 INFO:teuthology.orchestra.run.smithi022.stdout:448.out 2023-07-11T00:34:14.378 INFO:teuthology.orchestra.run.smithi022.stdout:449 2023-07-11T00:34:14.378 INFO:teuthology.orchestra.run.smithi022.stdout:449.out 2023-07-11T00:34:14.378 INFO:teuthology.orchestra.run.smithi022.stdout:450 2023-07-11T00:34:14.379 INFO:teuthology.orchestra.run.smithi022.stdout:450.out 2023-07-11T00:34:14.379 INFO:teuthology.orchestra.run.smithi022.stdout:451 2023-07-11T00:34:14.379 INFO:teuthology.orchestra.run.smithi022.stdout:451.out 2023-07-11T00:34:14.379 INFO:teuthology.orchestra.run.smithi022.stdout:452 2023-07-11T00:34:14.379 INFO:teuthology.orchestra.run.smithi022.stdout:452.out 2023-07-11T00:34:14.379 INFO:teuthology.orchestra.run.smithi022.stdout:453 2023-07-11T00:34:14.379 INFO:teuthology.orchestra.run.smithi022.stdout:453.out 2023-07-11T00:34:14.380 INFO:teuthology.orchestra.run.smithi022.stdout:454 2023-07-11T00:34:14.380 INFO:teuthology.orchestra.run.smithi022.stdout:454.out 2023-07-11T00:34:14.380 INFO:teuthology.orchestra.run.smithi022.stdout:455 2023-07-11T00:34:14.380 INFO:teuthology.orchestra.run.smithi022.stdout:455.out 2023-07-11T00:34:14.380 INFO:teuthology.orchestra.run.smithi022.stdout:456 2023-07-11T00:34:14.380 INFO:teuthology.orchestra.run.smithi022.stdout:456.out 2023-07-11T00:34:14.380 INFO:teuthology.orchestra.run.smithi022.stdout:457 2023-07-11T00:34:14.381 INFO:teuthology.orchestra.run.smithi022.stdout:457.out 2023-07-11T00:34:14.381 INFO:teuthology.orchestra.run.smithi022.stdout:458 2023-07-11T00:34:14.381 INFO:teuthology.orchestra.run.smithi022.stdout:458.out 2023-07-11T00:34:14.381 INFO:teuthology.orchestra.run.smithi022.stdout:459 2023-07-11T00:34:14.381 INFO:teuthology.orchestra.run.smithi022.stdout:459.out 2023-07-11T00:34:14.381 INFO:teuthology.orchestra.run.smithi022.stdout:460 2023-07-11T00:34:14.381 INFO:teuthology.orchestra.run.smithi022.stdout:460.out 2023-07-11T00:34:14.382 INFO:teuthology.orchestra.run.smithi022.stdout:461 2023-07-11T00:34:14.382 INFO:teuthology.orchestra.run.smithi022.stdout:461.out 2023-07-11T00:34:14.382 INFO:teuthology.orchestra.run.smithi022.stdout:462 2023-07-11T00:34:14.382 INFO:teuthology.orchestra.run.smithi022.stdout:462.out 2023-07-11T00:34:14.382 INFO:teuthology.orchestra.run.smithi022.stdout:463 2023-07-11T00:34:14.382 INFO:teuthology.orchestra.run.smithi022.stdout:463.out 2023-07-11T00:34:14.382 INFO:teuthology.orchestra.run.smithi022.stdout:464 2023-07-11T00:34:14.383 INFO:teuthology.orchestra.run.smithi022.stdout:464.out 2023-07-11T00:34:14.383 INFO:teuthology.orchestra.run.smithi022.stdout:465 2023-07-11T00:34:14.383 INFO:teuthology.orchestra.run.smithi022.stdout:465.out 2023-07-11T00:34:14.383 INFO:teuthology.orchestra.run.smithi022.stdout:466 2023-07-11T00:34:14.383 INFO:teuthology.orchestra.run.smithi022.stdout:466.out 2023-07-11T00:34:14.383 INFO:teuthology.orchestra.run.smithi022.stdout:467 2023-07-11T00:34:14.383 INFO:teuthology.orchestra.run.smithi022.stdout:467.out 2023-07-11T00:34:14.384 INFO:teuthology.orchestra.run.smithi022.stdout:468 2023-07-11T00:34:14.384 INFO:teuthology.orchestra.run.smithi022.stdout:468.out 2023-07-11T00:34:14.384 INFO:teuthology.orchestra.run.smithi022.stdout:469 2023-07-11T00:34:14.384 INFO:teuthology.orchestra.run.smithi022.stdout:469.out 2023-07-11T00:34:14.384 INFO:teuthology.orchestra.run.smithi022.stdout:470 2023-07-11T00:34:14.384 INFO:teuthology.orchestra.run.smithi022.stdout:470.out 2023-07-11T00:34:14.384 INFO:teuthology.orchestra.run.smithi022.stdout:471 2023-07-11T00:34:14.385 INFO:teuthology.orchestra.run.smithi022.stdout:471.out 2023-07-11T00:34:14.385 INFO:teuthology.orchestra.run.smithi022.stdout:472 2023-07-11T00:34:14.385 INFO:teuthology.orchestra.run.smithi022.stdout:472.out 2023-07-11T00:34:14.385 INFO:teuthology.orchestra.run.smithi022.stdout:473 2023-07-11T00:34:14.385 INFO:teuthology.orchestra.run.smithi022.stdout:473.out 2023-07-11T00:34:14.385 INFO:teuthology.orchestra.run.smithi022.stdout:474 2023-07-11T00:34:14.385 INFO:teuthology.orchestra.run.smithi022.stdout:474.out 2023-07-11T00:34:14.386 INFO:teuthology.orchestra.run.smithi022.stdout:475 2023-07-11T00:34:14.386 INFO:teuthology.orchestra.run.smithi022.stdout:475.out 2023-07-11T00:34:14.386 INFO:teuthology.orchestra.run.smithi022.stdout:476 2023-07-11T00:34:14.386 INFO:teuthology.orchestra.run.smithi022.stdout:476.out 2023-07-11T00:34:14.386 INFO:teuthology.orchestra.run.smithi022.stdout:477 2023-07-11T00:34:14.386 INFO:teuthology.orchestra.run.smithi022.stdout:477.out 2023-07-11T00:34:14.386 INFO:teuthology.orchestra.run.smithi022.stdout:478 2023-07-11T00:34:14.387 INFO:teuthology.orchestra.run.smithi022.stdout:478.out 2023-07-11T00:34:14.387 INFO:teuthology.orchestra.run.smithi022.stdout:479 2023-07-11T00:34:14.387 INFO:teuthology.orchestra.run.smithi022.stdout:479.out 2023-07-11T00:34:14.387 INFO:teuthology.orchestra.run.smithi022.stdout:480 2023-07-11T00:34:14.387 INFO:teuthology.orchestra.run.smithi022.stdout:480.out 2023-07-11T00:34:14.387 INFO:teuthology.orchestra.run.smithi022.stdout:481 2023-07-11T00:34:14.387 INFO:teuthology.orchestra.run.smithi022.stdout:481.out 2023-07-11T00:34:14.388 INFO:teuthology.orchestra.run.smithi022.stdout:482 2023-07-11T00:34:14.388 INFO:teuthology.orchestra.run.smithi022.stdout:482.out 2023-07-11T00:34:14.388 INFO:teuthology.orchestra.run.smithi022.stdout:483 2023-07-11T00:34:14.388 INFO:teuthology.orchestra.run.smithi022.stdout:483.out 2023-07-11T00:34:14.388 INFO:teuthology.orchestra.run.smithi022.stdout:484 2023-07-11T00:34:14.388 INFO:teuthology.orchestra.run.smithi022.stdout:484.out 2023-07-11T00:34:14.388 INFO:teuthology.orchestra.run.smithi022.stdout:485 2023-07-11T00:34:14.389 INFO:teuthology.orchestra.run.smithi022.stdout:485.out 2023-07-11T00:34:14.389 INFO:teuthology.orchestra.run.smithi022.stdout:486 2023-07-11T00:34:14.389 INFO:teuthology.orchestra.run.smithi022.stdout:486.out 2023-07-11T00:34:14.389 INFO:teuthology.orchestra.run.smithi022.stdout:487 2023-07-11T00:34:14.389 INFO:teuthology.orchestra.run.smithi022.stdout:487.out 2023-07-11T00:34:14.389 INFO:teuthology.orchestra.run.smithi022.stdout:488 2023-07-11T00:34:14.389 INFO:teuthology.orchestra.run.smithi022.stdout:488.out 2023-07-11T00:34:14.390 INFO:teuthology.orchestra.run.smithi022.stdout:489 2023-07-11T00:34:14.390 INFO:teuthology.orchestra.run.smithi022.stdout:489.out 2023-07-11T00:34:14.390 INFO:teuthology.orchestra.run.smithi022.stdout:490 2023-07-11T00:34:14.390 INFO:teuthology.orchestra.run.smithi022.stdout:490.out 2023-07-11T00:34:14.390 INFO:teuthology.orchestra.run.smithi022.stdout:491 2023-07-11T00:34:14.390 INFO:teuthology.orchestra.run.smithi022.stdout:491.out 2023-07-11T00:34:14.390 INFO:teuthology.orchestra.run.smithi022.stdout:492 2023-07-11T00:34:14.391 INFO:teuthology.orchestra.run.smithi022.stdout:492.out 2023-07-11T00:34:14.391 INFO:teuthology.orchestra.run.smithi022.stdout:493 2023-07-11T00:34:14.391 INFO:teuthology.orchestra.run.smithi022.stdout:493.out 2023-07-11T00:34:14.391 INFO:teuthology.orchestra.run.smithi022.stdout:494 2023-07-11T00:34:14.391 INFO:teuthology.orchestra.run.smithi022.stdout:494.out 2023-07-11T00:34:14.391 INFO:teuthology.orchestra.run.smithi022.stdout:495 2023-07-11T00:34:14.391 INFO:teuthology.orchestra.run.smithi022.stdout:495.out 2023-07-11T00:34:14.391 INFO:teuthology.orchestra.run.smithi022.stdout:496 2023-07-11T00:34:14.392 INFO:teuthology.orchestra.run.smithi022.stdout:496.out 2023-07-11T00:34:14.392 INFO:teuthology.orchestra.run.smithi022.stdout:497 2023-07-11T00:34:14.392 INFO:teuthology.orchestra.run.smithi022.stdout:497.out 2023-07-11T00:34:14.392 INFO:teuthology.orchestra.run.smithi022.stdout:498 2023-07-11T00:34:14.392 INFO:teuthology.orchestra.run.smithi022.stdout:498.out 2023-07-11T00:34:14.392 INFO:teuthology.orchestra.run.smithi022.stdout:499 2023-07-11T00:34:14.392 INFO:teuthology.orchestra.run.smithi022.stdout:499.out 2023-07-11T00:34:14.393 INFO:teuthology.orchestra.run.smithi022.stdout:500 2023-07-11T00:34:14.393 INFO:teuthology.orchestra.run.smithi022.stdout:500.out 2023-07-11T00:34:14.393 INFO:teuthology.orchestra.run.smithi022.stdout:501 2023-07-11T00:34:14.393 INFO:teuthology.orchestra.run.smithi022.stdout:501.out 2023-07-11T00:34:14.393 INFO:teuthology.orchestra.run.smithi022.stdout:502 2023-07-11T00:34:14.393 INFO:teuthology.orchestra.run.smithi022.stdout:502.out 2023-07-11T00:34:14.393 INFO:teuthology.orchestra.run.smithi022.stdout:503 2023-07-11T00:34:14.394 INFO:teuthology.orchestra.run.smithi022.stdout:503.out 2023-07-11T00:34:14.394 INFO:teuthology.orchestra.run.smithi022.stdout:504 2023-07-11T00:34:14.394 INFO:teuthology.orchestra.run.smithi022.stdout:504.out 2023-07-11T00:34:14.394 INFO:teuthology.orchestra.run.smithi022.stdout:505 2023-07-11T00:34:14.394 INFO:teuthology.orchestra.run.smithi022.stdout:505.out 2023-07-11T00:34:14.394 INFO:teuthology.orchestra.run.smithi022.stdout:506 2023-07-11T00:34:14.394 INFO:teuthology.orchestra.run.smithi022.stdout:506.out 2023-07-11T00:34:14.395 INFO:teuthology.orchestra.run.smithi022.stdout:507 2023-07-11T00:34:14.395 INFO:teuthology.orchestra.run.smithi022.stdout:507.out 2023-07-11T00:34:14.395 INFO:teuthology.orchestra.run.smithi022.stdout:508 2023-07-11T00:34:14.395 INFO:teuthology.orchestra.run.smithi022.stdout:508.out 2023-07-11T00:34:14.395 INFO:teuthology.orchestra.run.smithi022.stdout:509 2023-07-11T00:34:14.395 INFO:teuthology.orchestra.run.smithi022.stdout:509.out 2023-07-11T00:34:14.395 INFO:teuthology.orchestra.run.smithi022.stdout:510 2023-07-11T00:34:14.395 INFO:teuthology.orchestra.run.smithi022.stdout:510.out 2023-07-11T00:34:14.396 INFO:teuthology.orchestra.run.smithi022.stdout:511 2023-07-11T00:34:14.396 INFO:teuthology.orchestra.run.smithi022.stdout:511.out 2023-07-11T00:34:14.396 INFO:teuthology.orchestra.run.smithi022.stdout:512 2023-07-11T00:34:14.396 INFO:teuthology.orchestra.run.smithi022.stdout:512.out 2023-07-11T00:34:14.396 INFO:teuthology.orchestra.run.smithi022.stdout:513 2023-07-11T00:34:14.396 INFO:teuthology.orchestra.run.smithi022.stdout:513.out 2023-07-11T00:34:14.396 INFO:teuthology.orchestra.run.smithi022.stdout:514 2023-07-11T00:34:14.397 INFO:teuthology.orchestra.run.smithi022.stdout:514.out 2023-07-11T00:34:14.397 INFO:teuthology.orchestra.run.smithi022.stdout:515 2023-07-11T00:34:14.397 INFO:teuthology.orchestra.run.smithi022.stdout:515.out 2023-07-11T00:34:14.397 INFO:teuthology.orchestra.run.smithi022.stdout:516 2023-07-11T00:34:14.397 INFO:teuthology.orchestra.run.smithi022.stdout:516.out 2023-07-11T00:34:14.397 INFO:teuthology.orchestra.run.smithi022.stdout:517 2023-07-11T00:34:14.397 INFO:teuthology.orchestra.run.smithi022.stdout:517.out 2023-07-11T00:34:14.398 INFO:teuthology.orchestra.run.smithi022.stdout:518 2023-07-11T00:34:14.398 INFO:teuthology.orchestra.run.smithi022.stdout:518.out 2023-07-11T00:34:14.398 INFO:teuthology.orchestra.run.smithi022.stdout:519 2023-07-11T00:34:14.398 INFO:teuthology.orchestra.run.smithi022.stdout:519.out 2023-07-11T00:34:14.398 INFO:teuthology.orchestra.run.smithi022.stdout:520 2023-07-11T00:34:14.398 INFO:teuthology.orchestra.run.smithi022.stdout:520.out 2023-07-11T00:34:14.398 INFO:teuthology.orchestra.run.smithi022.stdout:521 2023-07-11T00:34:14.399 INFO:teuthology.orchestra.run.smithi022.stdout:521.out 2023-07-11T00:34:14.399 INFO:teuthology.orchestra.run.smithi022.stdout:522 2023-07-11T00:34:14.399 INFO:teuthology.orchestra.run.smithi022.stdout:522.out 2023-07-11T00:34:14.399 INFO:teuthology.orchestra.run.smithi022.stdout:523 2023-07-11T00:34:14.399 INFO:teuthology.orchestra.run.smithi022.stdout:523.out 2023-07-11T00:34:14.399 INFO:teuthology.orchestra.run.smithi022.stdout:524 2023-07-11T00:34:14.399 INFO:teuthology.orchestra.run.smithi022.stdout:524.out 2023-07-11T00:34:14.400 INFO:teuthology.orchestra.run.smithi022.stdout:525 2023-07-11T00:34:14.400 INFO:teuthology.orchestra.run.smithi022.stdout:525.out 2023-07-11T00:34:14.400 INFO:teuthology.orchestra.run.smithi022.stdout:526 2023-07-11T00:34:14.400 INFO:teuthology.orchestra.run.smithi022.stdout:526.out 2023-07-11T00:34:14.400 INFO:teuthology.orchestra.run.smithi022.stdout:527 2023-07-11T00:34:14.400 INFO:teuthology.orchestra.run.smithi022.stdout:527.out 2023-07-11T00:34:14.400 INFO:teuthology.orchestra.run.smithi022.stdout:528 2023-07-11T00:34:14.400 INFO:teuthology.orchestra.run.smithi022.stdout:528.out 2023-07-11T00:34:14.401 INFO:teuthology.orchestra.run.smithi022.stdout:529 2023-07-11T00:34:14.401 INFO:teuthology.orchestra.run.smithi022.stdout:529.out 2023-07-11T00:34:14.401 INFO:teuthology.orchestra.run.smithi022.stdout:530 2023-07-11T00:34:14.401 INFO:teuthology.orchestra.run.smithi022.stdout:530.out 2023-07-11T00:34:14.401 INFO:teuthology.orchestra.run.smithi022.stdout:531 2023-07-11T00:34:14.401 INFO:teuthology.orchestra.run.smithi022.stdout:531.out 2023-07-11T00:34:14.401 INFO:teuthology.orchestra.run.smithi022.stdout:532 2023-07-11T00:34:14.402 INFO:teuthology.orchestra.run.smithi022.stdout:532.out 2023-07-11T00:34:14.402 INFO:teuthology.orchestra.run.smithi022.stdout:533 2023-07-11T00:34:14.402 INFO:teuthology.orchestra.run.smithi022.stdout:533.out 2023-07-11T00:34:14.402 INFO:teuthology.orchestra.run.smithi022.stdout:534 2023-07-11T00:34:14.402 INFO:teuthology.orchestra.run.smithi022.stdout:534.out 2023-07-11T00:34:14.402 INFO:teuthology.orchestra.run.smithi022.stdout:535 2023-07-11T00:34:14.402 INFO:teuthology.orchestra.run.smithi022.stdout:535.out 2023-07-11T00:34:14.403 INFO:teuthology.orchestra.run.smithi022.stdout:536 2023-07-11T00:34:14.403 INFO:teuthology.orchestra.run.smithi022.stdout:536.out 2023-07-11T00:34:14.403 INFO:teuthology.orchestra.run.smithi022.stdout:537 2023-07-11T00:34:14.403 INFO:teuthology.orchestra.run.smithi022.stdout:537.out 2023-07-11T00:34:14.403 INFO:teuthology.orchestra.run.smithi022.stdout:538 2023-07-11T00:34:14.403 INFO:teuthology.orchestra.run.smithi022.stdout:538.out 2023-07-11T00:34:14.403 INFO:teuthology.orchestra.run.smithi022.stdout:539 2023-07-11T00:34:14.404 INFO:teuthology.orchestra.run.smithi022.stdout:539.out 2023-07-11T00:34:14.404 INFO:teuthology.orchestra.run.smithi022.stdout:540 2023-07-11T00:34:14.404 INFO:teuthology.orchestra.run.smithi022.stdout:540.out 2023-07-11T00:34:14.404 INFO:teuthology.orchestra.run.smithi022.stdout:541 2023-07-11T00:34:14.404 INFO:teuthology.orchestra.run.smithi022.stdout:541.out 2023-07-11T00:34:14.404 INFO:teuthology.orchestra.run.smithi022.stdout:542 2023-07-11T00:34:14.404 INFO:teuthology.orchestra.run.smithi022.stdout:542.out 2023-07-11T00:34:14.405 INFO:teuthology.orchestra.run.smithi022.stdout:543 2023-07-11T00:34:14.405 INFO:teuthology.orchestra.run.smithi022.stdout:543.out 2023-07-11T00:34:14.405 INFO:teuthology.orchestra.run.smithi022.stdout:544 2023-07-11T00:34:14.405 INFO:teuthology.orchestra.run.smithi022.stdout:544.out 2023-07-11T00:34:14.405 INFO:teuthology.orchestra.run.smithi022.stdout:545 2023-07-11T00:34:14.405 INFO:teuthology.orchestra.run.smithi022.stdout:545.out 2023-07-11T00:34:14.405 INFO:teuthology.orchestra.run.smithi022.stdout:546 2023-07-11T00:34:14.405 INFO:teuthology.orchestra.run.smithi022.stdout:546.out 2023-07-11T00:34:14.406 INFO:teuthology.orchestra.run.smithi022.stdout:547 2023-07-11T00:34:14.406 INFO:teuthology.orchestra.run.smithi022.stdout:547.out 2023-07-11T00:34:14.406 INFO:teuthology.orchestra.run.smithi022.stdout:548 2023-07-11T00:34:14.406 INFO:teuthology.orchestra.run.smithi022.stdout:548.out 2023-07-11T00:34:14.406 INFO:teuthology.orchestra.run.smithi022.stdout:549 2023-07-11T00:34:14.406 INFO:teuthology.orchestra.run.smithi022.stdout:549.out 2023-07-11T00:34:14.406 INFO:teuthology.orchestra.run.smithi022.stdout:550 2023-07-11T00:34:14.407 INFO:teuthology.orchestra.run.smithi022.stdout:550.out 2023-07-11T00:34:14.407 INFO:teuthology.orchestra.run.smithi022.stdout:551 2023-07-11T00:34:14.407 INFO:teuthology.orchestra.run.smithi022.stdout:551.out 2023-07-11T00:34:14.407 INFO:teuthology.orchestra.run.smithi022.stdout:552 2023-07-11T00:34:14.407 INFO:teuthology.orchestra.run.smithi022.stdout:552.out 2023-07-11T00:34:14.407 INFO:teuthology.orchestra.run.smithi022.stdout:553 2023-07-11T00:34:14.407 INFO:teuthology.orchestra.run.smithi022.stdout:553.out 2023-07-11T00:34:14.408 INFO:teuthology.orchestra.run.smithi022.stdout:554 2023-07-11T00:34:14.408 INFO:teuthology.orchestra.run.smithi022.stdout:554.out 2023-07-11T00:34:14.408 INFO:teuthology.orchestra.run.smithi022.stdout:555 2023-07-11T00:34:14.408 INFO:teuthology.orchestra.run.smithi022.stdout:555.out 2023-07-11T00:34:14.408 INFO:teuthology.orchestra.run.smithi022.stdout:556 2023-07-11T00:34:14.408 INFO:teuthology.orchestra.run.smithi022.stdout:556.out 2023-07-11T00:34:14.408 INFO:teuthology.orchestra.run.smithi022.stdout:557 2023-07-11T00:34:14.409 INFO:teuthology.orchestra.run.smithi022.stdout:557.out 2023-07-11T00:34:14.409 INFO:teuthology.orchestra.run.smithi022.stdout:558 2023-07-11T00:34:14.409 INFO:teuthology.orchestra.run.smithi022.stdout:558.out 2023-07-11T00:34:14.409 INFO:teuthology.orchestra.run.smithi022.stdout:559 2023-07-11T00:34:14.409 INFO:teuthology.orchestra.run.smithi022.stdout:559.out 2023-07-11T00:34:14.409 INFO:teuthology.orchestra.run.smithi022.stdout:560 2023-07-11T00:34:14.409 INFO:teuthology.orchestra.run.smithi022.stdout:560.out 2023-07-11T00:34:14.409 INFO:teuthology.orchestra.run.smithi022.stdout:561 2023-07-11T00:34:14.410 INFO:teuthology.orchestra.run.smithi022.stdout:561.out 2023-07-11T00:34:14.410 INFO:teuthology.orchestra.run.smithi022.stdout:562 2023-07-11T00:34:14.410 INFO:teuthology.orchestra.run.smithi022.stdout:562.out 2023-07-11T00:34:14.410 INFO:teuthology.orchestra.run.smithi022.stdout:563 2023-07-11T00:34:14.410 INFO:teuthology.orchestra.run.smithi022.stdout:563.out 2023-07-11T00:34:14.410 INFO:teuthology.orchestra.run.smithi022.stdout:564 2023-07-11T00:34:14.410 INFO:teuthology.orchestra.run.smithi022.stdout:564.out 2023-07-11T00:34:14.411 INFO:teuthology.orchestra.run.smithi022.stdout:565 2023-07-11T00:34:14.411 INFO:teuthology.orchestra.run.smithi022.stdout:565.out 2023-07-11T00:34:14.411 INFO:teuthology.orchestra.run.smithi022.stdout:566 2023-07-11T00:34:14.411 INFO:teuthology.orchestra.run.smithi022.stdout:566.out 2023-07-11T00:34:14.411 INFO:teuthology.orchestra.run.smithi022.stdout:567 2023-07-11T00:34:14.411 INFO:teuthology.orchestra.run.smithi022.stdout:567.out 2023-07-11T00:34:14.411 INFO:teuthology.orchestra.run.smithi022.stdout:568 2023-07-11T00:34:14.412 INFO:teuthology.orchestra.run.smithi022.stdout:568.out 2023-07-11T00:34:14.412 INFO:teuthology.orchestra.run.smithi022.stdout:569 2023-07-11T00:34:14.412 INFO:teuthology.orchestra.run.smithi022.stdout:569.out 2023-07-11T00:34:14.412 INFO:teuthology.orchestra.run.smithi022.stdout:570 2023-07-11T00:34:14.412 INFO:teuthology.orchestra.run.smithi022.stdout:570.out 2023-07-11T00:34:14.412 INFO:teuthology.orchestra.run.smithi022.stdout:571 2023-07-11T00:34:14.412 INFO:teuthology.orchestra.run.smithi022.stdout:571.out 2023-07-11T00:34:14.413 INFO:teuthology.orchestra.run.smithi022.stdout:572 2023-07-11T00:34:14.413 INFO:teuthology.orchestra.run.smithi022.stdout:572.out 2023-07-11T00:34:14.413 INFO:teuthology.orchestra.run.smithi022.stdout:573 2023-07-11T00:34:14.413 INFO:teuthology.orchestra.run.smithi022.stdout:573.out 2023-07-11T00:34:14.413 INFO:teuthology.orchestra.run.smithi022.stdout:574 2023-07-11T00:34:14.413 INFO:teuthology.orchestra.run.smithi022.stdout:574.out 2023-07-11T00:34:14.413 INFO:teuthology.orchestra.run.smithi022.stdout:575 2023-07-11T00:34:14.413 INFO:teuthology.orchestra.run.smithi022.stdout:575.out 2023-07-11T00:34:14.414 INFO:teuthology.orchestra.run.smithi022.stdout:576 2023-07-11T00:34:14.414 INFO:teuthology.orchestra.run.smithi022.stdout:576.out 2023-07-11T00:34:14.414 INFO:teuthology.orchestra.run.smithi022.stdout:577 2023-07-11T00:34:14.414 INFO:teuthology.orchestra.run.smithi022.stdout:577.out 2023-07-11T00:34:14.414 INFO:teuthology.orchestra.run.smithi022.stdout:578 2023-07-11T00:34:14.414 INFO:teuthology.orchestra.run.smithi022.stdout:578.out 2023-07-11T00:34:14.414 INFO:teuthology.orchestra.run.smithi022.stdout:579 2023-07-11T00:34:14.415 INFO:teuthology.orchestra.run.smithi022.stdout:579.out 2023-07-11T00:34:14.415 INFO:teuthology.orchestra.run.smithi022.stdout:580 2023-07-11T00:34:14.415 INFO:teuthology.orchestra.run.smithi022.stdout:580.out 2023-07-11T00:34:14.415 INFO:teuthology.orchestra.run.smithi022.stdout:581 2023-07-11T00:34:14.415 INFO:teuthology.orchestra.run.smithi022.stdout:581.out 2023-07-11T00:34:14.415 INFO:teuthology.orchestra.run.smithi022.stdout:582 2023-07-11T00:34:14.415 INFO:teuthology.orchestra.run.smithi022.stdout:582.out 2023-07-11T00:34:14.416 INFO:teuthology.orchestra.run.smithi022.stdout:583 2023-07-11T00:34:14.416 INFO:teuthology.orchestra.run.smithi022.stdout:583.out 2023-07-11T00:34:14.416 INFO:teuthology.orchestra.run.smithi022.stdout:584 2023-07-11T00:34:14.416 INFO:teuthology.orchestra.run.smithi022.stdout:584.out 2023-07-11T00:34:14.416 INFO:teuthology.orchestra.run.smithi022.stdout:585 2023-07-11T00:34:14.416 INFO:teuthology.orchestra.run.smithi022.stdout:585.out 2023-07-11T00:34:14.416 INFO:teuthology.orchestra.run.smithi022.stdout:586 2023-07-11T00:34:14.417 INFO:teuthology.orchestra.run.smithi022.stdout:586.out 2023-07-11T00:34:14.417 INFO:teuthology.orchestra.run.smithi022.stdout:587 2023-07-11T00:34:14.417 INFO:teuthology.orchestra.run.smithi022.stdout:587.out 2023-07-11T00:34:14.417 INFO:teuthology.orchestra.run.smithi022.stdout:588 2023-07-11T00:34:14.417 INFO:teuthology.orchestra.run.smithi022.stdout:588.out 2023-07-11T00:34:14.417 INFO:teuthology.orchestra.run.smithi022.stdout:589 2023-07-11T00:34:14.417 INFO:teuthology.orchestra.run.smithi022.stdout:589.out 2023-07-11T00:34:14.417 INFO:teuthology.orchestra.run.smithi022.stdout:590 2023-07-11T00:34:14.418 INFO:teuthology.orchestra.run.smithi022.stdout:590.out 2023-07-11T00:34:14.418 INFO:teuthology.orchestra.run.smithi022.stdout:591 2023-07-11T00:34:14.418 INFO:teuthology.orchestra.run.smithi022.stdout:591.out 2023-07-11T00:34:14.418 INFO:teuthology.orchestra.run.smithi022.stdout:592 2023-07-11T00:34:14.418 INFO:teuthology.orchestra.run.smithi022.stdout:592.out 2023-07-11T00:34:14.418 INFO:teuthology.orchestra.run.smithi022.stdout:593 2023-07-11T00:34:14.418 INFO:teuthology.orchestra.run.smithi022.stdout:593.out 2023-07-11T00:34:14.419 INFO:teuthology.orchestra.run.smithi022.stdout:594 2023-07-11T00:34:14.419 INFO:teuthology.orchestra.run.smithi022.stdout:594.out 2023-07-11T00:34:14.419 INFO:teuthology.orchestra.run.smithi022.stdout:595 2023-07-11T00:34:14.419 INFO:teuthology.orchestra.run.smithi022.stdout:595.out 2023-07-11T00:34:14.419 INFO:teuthology.orchestra.run.smithi022.stdout:596 2023-07-11T00:34:14.419 INFO:teuthology.orchestra.run.smithi022.stdout:596.out 2023-07-11T00:34:14.419 INFO:teuthology.orchestra.run.smithi022.stdout:597 2023-07-11T00:34:14.420 INFO:teuthology.orchestra.run.smithi022.stdout:597.out 2023-07-11T00:34:14.420 INFO:teuthology.orchestra.run.smithi022.stdout:598 2023-07-11T00:34:14.420 INFO:teuthology.orchestra.run.smithi022.stdout:598.out 2023-07-11T00:34:14.420 INFO:teuthology.orchestra.run.smithi022.stdout:599 2023-07-11T00:34:14.420 INFO:teuthology.orchestra.run.smithi022.stdout:599.out 2023-07-11T00:34:14.420 INFO:teuthology.orchestra.run.smithi022.stdout:600 2023-07-11T00:34:14.420 INFO:teuthology.orchestra.run.smithi022.stdout:600.out 2023-07-11T00:34:14.421 INFO:teuthology.orchestra.run.smithi022.stdout:601 2023-07-11T00:34:14.421 INFO:teuthology.orchestra.run.smithi022.stdout:601.out 2023-07-11T00:34:14.421 INFO:teuthology.orchestra.run.smithi022.stdout:602 2023-07-11T00:34:14.421 INFO:teuthology.orchestra.run.smithi022.stdout:602.out 2023-07-11T00:34:14.421 INFO:teuthology.orchestra.run.smithi022.stdout:603 2023-07-11T00:34:14.421 INFO:teuthology.orchestra.run.smithi022.stdout:603.out 2023-07-11T00:34:14.421 INFO:teuthology.orchestra.run.smithi022.stdout:604 2023-07-11T00:34:14.421 INFO:teuthology.orchestra.run.smithi022.stdout:604.out 2023-07-11T00:34:14.422 INFO:teuthology.orchestra.run.smithi022.stdout:605 2023-07-11T00:34:14.422 INFO:teuthology.orchestra.run.smithi022.stdout:605.out 2023-07-11T00:34:14.422 INFO:teuthology.orchestra.run.smithi022.stdout:606 2023-07-11T00:34:14.422 INFO:teuthology.orchestra.run.smithi022.stdout:606.out 2023-07-11T00:34:14.422 INFO:teuthology.orchestra.run.smithi022.stdout:607 2023-07-11T00:34:14.422 INFO:teuthology.orchestra.run.smithi022.stdout:607.out 2023-07-11T00:34:14.422 INFO:teuthology.orchestra.run.smithi022.stdout:608 2023-07-11T00:34:14.423 INFO:teuthology.orchestra.run.smithi022.stdout:608.out 2023-07-11T00:34:14.423 INFO:teuthology.orchestra.run.smithi022.stdout:609 2023-07-11T00:34:14.423 INFO:teuthology.orchestra.run.smithi022.stdout:609.out 2023-07-11T00:34:14.423 INFO:teuthology.orchestra.run.smithi022.stdout:610 2023-07-11T00:34:14.423 INFO:teuthology.orchestra.run.smithi022.stdout:610.out 2023-07-11T00:34:14.423 INFO:teuthology.orchestra.run.smithi022.stdout:611 2023-07-11T00:34:14.423 INFO:teuthology.orchestra.run.smithi022.stdout:611.out 2023-07-11T00:34:14.424 INFO:teuthology.orchestra.run.smithi022.stdout:612 2023-07-11T00:34:14.424 INFO:teuthology.orchestra.run.smithi022.stdout:612.out 2023-07-11T00:34:14.424 INFO:teuthology.orchestra.run.smithi022.stdout:613 2023-07-11T00:34:14.424 INFO:teuthology.orchestra.run.smithi022.stdout:613.out 2023-07-11T00:34:14.424 INFO:teuthology.orchestra.run.smithi022.stdout:614 2023-07-11T00:34:14.424 INFO:teuthology.orchestra.run.smithi022.stdout:614.out 2023-07-11T00:34:14.424 INFO:teuthology.orchestra.run.smithi022.stdout:615 2023-07-11T00:34:14.425 INFO:teuthology.orchestra.run.smithi022.stdout:615.out 2023-07-11T00:34:14.425 INFO:teuthology.orchestra.run.smithi022.stdout:616 2023-07-11T00:34:14.425 INFO:teuthology.orchestra.run.smithi022.stdout:616.out 2023-07-11T00:34:14.425 INFO:teuthology.orchestra.run.smithi022.stdout:617 2023-07-11T00:34:14.425 INFO:teuthology.orchestra.run.smithi022.stdout:617.out 2023-07-11T00:34:14.425 INFO:teuthology.orchestra.run.smithi022.stdout:618 2023-07-11T00:34:14.425 INFO:teuthology.orchestra.run.smithi022.stdout:618.out 2023-07-11T00:34:14.426 INFO:teuthology.orchestra.run.smithi022.stdout:619 2023-07-11T00:34:14.426 INFO:teuthology.orchestra.run.smithi022.stdout:619.out 2023-07-11T00:34:14.426 INFO:teuthology.orchestra.run.smithi022.stdout:620 2023-07-11T00:34:14.426 INFO:teuthology.orchestra.run.smithi022.stdout:620.out 2023-07-11T00:34:14.426 INFO:teuthology.orchestra.run.smithi022.stdout:621 2023-07-11T00:34:14.426 INFO:teuthology.orchestra.run.smithi022.stdout:621.out 2023-07-11T00:34:14.426 INFO:teuthology.orchestra.run.smithi022.stdout:622 2023-07-11T00:34:14.426 INFO:teuthology.orchestra.run.smithi022.stdout:622.out 2023-07-11T00:34:14.427 INFO:teuthology.orchestra.run.smithi022.stdout:623 2023-07-11T00:34:14.427 INFO:teuthology.orchestra.run.smithi022.stdout:623.out 2023-07-11T00:34:14.427 INFO:teuthology.orchestra.run.smithi022.stdout:624 2023-07-11T00:34:14.427 INFO:teuthology.orchestra.run.smithi022.stdout:624.out 2023-07-11T00:34:14.427 INFO:teuthology.orchestra.run.smithi022.stdout:625 2023-07-11T00:34:14.427 INFO:teuthology.orchestra.run.smithi022.stdout:625.out 2023-07-11T00:34:14.427 INFO:teuthology.orchestra.run.smithi022.stdout:626 2023-07-11T00:34:14.428 INFO:teuthology.orchestra.run.smithi022.stdout:626.out 2023-07-11T00:34:14.428 INFO:teuthology.orchestra.run.smithi022.stdout:627 2023-07-11T00:34:14.428 INFO:teuthology.orchestra.run.smithi022.stdout:627.out 2023-07-11T00:34:14.428 INFO:teuthology.orchestra.run.smithi022.stdout:628 2023-07-11T00:34:14.428 INFO:teuthology.orchestra.run.smithi022.stdout:628.out 2023-07-11T00:34:14.428 INFO:teuthology.orchestra.run.smithi022.stdout:629 2023-07-11T00:34:14.428 INFO:teuthology.orchestra.run.smithi022.stdout:629.out 2023-07-11T00:34:14.429 INFO:teuthology.orchestra.run.smithi022.stdout:630 2023-07-11T00:34:14.429 INFO:teuthology.orchestra.run.smithi022.stdout:630.out 2023-07-11T00:34:14.429 INFO:teuthology.orchestra.run.smithi022.stdout:631 2023-07-11T00:34:14.429 INFO:teuthology.orchestra.run.smithi022.stdout:631.out 2023-07-11T00:34:14.429 INFO:teuthology.orchestra.run.smithi022.stdout:632 2023-07-11T00:34:14.429 INFO:teuthology.orchestra.run.smithi022.stdout:632.out 2023-07-11T00:34:14.429 INFO:teuthology.orchestra.run.smithi022.stdout:633 2023-07-11T00:34:14.429 INFO:teuthology.orchestra.run.smithi022.stdout:633.out 2023-07-11T00:34:14.430 INFO:teuthology.orchestra.run.smithi022.stdout:634 2023-07-11T00:34:14.430 INFO:teuthology.orchestra.run.smithi022.stdout:634.out 2023-07-11T00:34:14.430 INFO:teuthology.orchestra.run.smithi022.stdout:635 2023-07-11T00:34:14.430 INFO:teuthology.orchestra.run.smithi022.stdout:635.out 2023-07-11T00:34:14.430 INFO:teuthology.orchestra.run.smithi022.stdout:636 2023-07-11T00:34:14.430 INFO:teuthology.orchestra.run.smithi022.stdout:636.out 2023-07-11T00:34:14.430 INFO:teuthology.orchestra.run.smithi022.stdout:637 2023-07-11T00:34:14.431 INFO:teuthology.orchestra.run.smithi022.stdout:637.out 2023-07-11T00:34:14.431 INFO:teuthology.orchestra.run.smithi022.stdout:638 2023-07-11T00:34:14.431 INFO:teuthology.orchestra.run.smithi022.stdout:638.out 2023-07-11T00:34:14.431 INFO:teuthology.orchestra.run.smithi022.stdout:639 2023-07-11T00:34:14.431 INFO:teuthology.orchestra.run.smithi022.stdout:639.out 2023-07-11T00:34:14.431 INFO:teuthology.orchestra.run.smithi022.stdout:640 2023-07-11T00:34:14.431 INFO:teuthology.orchestra.run.smithi022.stdout:640.out 2023-07-11T00:34:14.432 INFO:teuthology.orchestra.run.smithi022.stdout:641 2023-07-11T00:34:14.432 INFO:teuthology.orchestra.run.smithi022.stdout:641.out 2023-07-11T00:34:14.432 INFO:teuthology.orchestra.run.smithi022.stdout:642 2023-07-11T00:34:14.432 INFO:teuthology.orchestra.run.smithi022.stdout:642.out 2023-07-11T00:34:14.432 INFO:teuthology.orchestra.run.smithi022.stdout:643 2023-07-11T00:34:14.432 INFO:teuthology.orchestra.run.smithi022.stdout:643.out 2023-07-11T00:34:14.432 INFO:teuthology.orchestra.run.smithi022.stdout:644 2023-07-11T00:34:14.433 INFO:teuthology.orchestra.run.smithi022.stdout:644.out 2023-07-11T00:34:14.433 INFO:teuthology.orchestra.run.smithi022.stdout:645 2023-07-11T00:34:14.433 INFO:teuthology.orchestra.run.smithi022.stdout:645.out 2023-07-11T00:34:14.433 INFO:teuthology.orchestra.run.smithi022.stdout:646 2023-07-11T00:34:14.433 INFO:teuthology.orchestra.run.smithi022.stdout:646.out 2023-07-11T00:34:14.433 INFO:teuthology.orchestra.run.smithi022.stdout:647 2023-07-11T00:34:14.433 INFO:teuthology.orchestra.run.smithi022.stdout:647.out 2023-07-11T00:34:14.434 INFO:teuthology.orchestra.run.smithi022.stdout:648 2023-07-11T00:34:14.434 INFO:teuthology.orchestra.run.smithi022.stdout:648.out 2023-07-11T00:34:14.434 INFO:teuthology.orchestra.run.smithi022.stdout:649 2023-07-11T00:34:14.434 INFO:teuthology.orchestra.run.smithi022.stdout:649.out 2023-07-11T00:34:14.434 INFO:teuthology.orchestra.run.smithi022.stdout:650 2023-07-11T00:34:14.434 INFO:teuthology.orchestra.run.smithi022.stdout:650.out 2023-07-11T00:34:14.434 INFO:teuthology.orchestra.run.smithi022.stdout:651 2023-07-11T00:34:14.434 INFO:teuthology.orchestra.run.smithi022.stdout:651.out 2023-07-11T00:34:14.435 INFO:teuthology.orchestra.run.smithi022.stdout:652 2023-07-11T00:34:14.435 INFO:teuthology.orchestra.run.smithi022.stdout:652.out 2023-07-11T00:34:14.435 INFO:teuthology.orchestra.run.smithi022.stdout:653 2023-07-11T00:34:14.435 INFO:teuthology.orchestra.run.smithi022.stdout:653.out 2023-07-11T00:34:14.435 INFO:teuthology.orchestra.run.smithi022.stdout:654 2023-07-11T00:34:14.435 INFO:teuthology.orchestra.run.smithi022.stdout:654.out 2023-07-11T00:34:14.435 INFO:teuthology.orchestra.run.smithi022.stdout:655 2023-07-11T00:34:14.436 INFO:teuthology.orchestra.run.smithi022.stdout:655.out 2023-07-11T00:34:14.436 INFO:teuthology.orchestra.run.smithi022.stdout:656 2023-07-11T00:34:14.436 INFO:teuthology.orchestra.run.smithi022.stdout:656.out 2023-07-11T00:34:14.436 INFO:teuthology.orchestra.run.smithi022.stdout:657 2023-07-11T00:34:14.436 INFO:teuthology.orchestra.run.smithi022.stdout:657.out 2023-07-11T00:34:14.436 INFO:teuthology.orchestra.run.smithi022.stdout:658 2023-07-11T00:34:14.436 INFO:teuthology.orchestra.run.smithi022.stdout:658.out 2023-07-11T00:34:14.437 INFO:teuthology.orchestra.run.smithi022.stdout:659 2023-07-11T00:34:14.437 INFO:teuthology.orchestra.run.smithi022.stdout:659.out 2023-07-11T00:34:14.437 INFO:teuthology.orchestra.run.smithi022.stdout:660 2023-07-11T00:34:14.437 INFO:teuthology.orchestra.run.smithi022.stdout:660.out 2023-07-11T00:34:14.437 INFO:teuthology.orchestra.run.smithi022.stdout:661 2023-07-11T00:34:14.437 INFO:teuthology.orchestra.run.smithi022.stdout:661.out 2023-07-11T00:34:14.437 INFO:teuthology.orchestra.run.smithi022.stdout:662 2023-07-11T00:34:14.437 INFO:teuthology.orchestra.run.smithi022.stdout:662.out 2023-07-11T00:34:14.438 INFO:teuthology.orchestra.run.smithi022.stdout:663 2023-07-11T00:34:14.438 INFO:teuthology.orchestra.run.smithi022.stdout:663.out 2023-07-11T00:34:14.438 INFO:teuthology.orchestra.run.smithi022.stdout:664 2023-07-11T00:34:14.438 INFO:teuthology.orchestra.run.smithi022.stdout:664.out 2023-07-11T00:34:14.438 INFO:teuthology.orchestra.run.smithi022.stdout:665 2023-07-11T00:34:14.438 INFO:teuthology.orchestra.run.smithi022.stdout:665.out 2023-07-11T00:34:14.438 INFO:teuthology.orchestra.run.smithi022.stdout:666 2023-07-11T00:34:14.439 INFO:teuthology.orchestra.run.smithi022.stdout:666.out 2023-07-11T00:34:14.439 INFO:teuthology.orchestra.run.smithi022.stdout:667 2023-07-11T00:34:14.439 INFO:teuthology.orchestra.run.smithi022.stdout:667.out 2023-07-11T00:34:14.439 INFO:teuthology.orchestra.run.smithi022.stdout:668 2023-07-11T00:34:14.439 INFO:teuthology.orchestra.run.smithi022.stdout:668.out 2023-07-11T00:34:14.439 INFO:teuthology.orchestra.run.smithi022.stdout:669 2023-07-11T00:34:14.439 INFO:teuthology.orchestra.run.smithi022.stdout:669.out 2023-07-11T00:34:14.440 INFO:teuthology.orchestra.run.smithi022.stdout:670 2023-07-11T00:34:14.440 INFO:teuthology.orchestra.run.smithi022.stdout:670.out 2023-07-11T00:34:14.440 INFO:teuthology.orchestra.run.smithi022.stdout:671 2023-07-11T00:34:14.440 INFO:teuthology.orchestra.run.smithi022.stdout:671.out 2023-07-11T00:34:14.440 INFO:teuthology.orchestra.run.smithi022.stdout:672 2023-07-11T00:34:14.440 INFO:teuthology.orchestra.run.smithi022.stdout:672.out 2023-07-11T00:34:14.440 INFO:teuthology.orchestra.run.smithi022.stdout:673 2023-07-11T00:34:14.441 INFO:teuthology.orchestra.run.smithi022.stdout:673.out 2023-07-11T00:34:14.441 INFO:teuthology.orchestra.run.smithi022.stdout:674 2023-07-11T00:34:14.441 INFO:teuthology.orchestra.run.smithi022.stdout:674.out 2023-07-11T00:34:14.441 INFO:teuthology.orchestra.run.smithi022.stdout:675 2023-07-11T00:34:14.441 INFO:teuthology.orchestra.run.smithi022.stdout:675.out 2023-07-11T00:34:14.441 INFO:teuthology.orchestra.run.smithi022.stdout:676 2023-07-11T00:34:14.441 INFO:teuthology.orchestra.run.smithi022.stdout:676.out 2023-07-11T00:34:14.441 INFO:teuthology.orchestra.run.smithi022.stdout:677 2023-07-11T00:34:14.442 INFO:teuthology.orchestra.run.smithi022.stdout:677.out 2023-07-11T00:34:14.442 INFO:teuthology.orchestra.run.smithi022.stdout:678 2023-07-11T00:34:14.442 INFO:teuthology.orchestra.run.smithi022.stdout:678.out 2023-07-11T00:34:14.442 INFO:teuthology.orchestra.run.smithi022.stdout:679 2023-07-11T00:34:14.442 INFO:teuthology.orchestra.run.smithi022.stdout:679.out 2023-07-11T00:34:14.442 INFO:teuthology.orchestra.run.smithi022.stdout:680 2023-07-11T00:34:14.442 INFO:teuthology.orchestra.run.smithi022.stdout:680.out 2023-07-11T00:34:14.443 INFO:teuthology.orchestra.run.smithi022.stdout:681 2023-07-11T00:34:14.443 INFO:teuthology.orchestra.run.smithi022.stdout:681.out 2023-07-11T00:34:14.443 INFO:teuthology.orchestra.run.smithi022.stdout:682 2023-07-11T00:34:14.443 INFO:teuthology.orchestra.run.smithi022.stdout:682.out 2023-07-11T00:34:14.443 INFO:teuthology.orchestra.run.smithi022.stdout:683 2023-07-11T00:34:14.443 INFO:teuthology.orchestra.run.smithi022.stdout:683.out 2023-07-11T00:34:14.443 INFO:teuthology.orchestra.run.smithi022.stdout:684 2023-07-11T00:34:14.444 INFO:teuthology.orchestra.run.smithi022.stdout:684.out 2023-07-11T00:34:14.444 INFO:teuthology.orchestra.run.smithi022.stdout:685 2023-07-11T00:34:14.444 INFO:teuthology.orchestra.run.smithi022.stdout:685.out 2023-07-11T00:34:14.444 INFO:teuthology.orchestra.run.smithi022.stdout:686 2023-07-11T00:34:14.444 INFO:teuthology.orchestra.run.smithi022.stdout:686.out 2023-07-11T00:34:14.444 INFO:teuthology.orchestra.run.smithi022.stdout:687 2023-07-11T00:34:14.444 INFO:teuthology.orchestra.run.smithi022.stdout:687.out 2023-07-11T00:34:14.445 INFO:teuthology.orchestra.run.smithi022.stdout:688 2023-07-11T00:34:14.445 INFO:teuthology.orchestra.run.smithi022.stdout:688.out 2023-07-11T00:34:14.445 INFO:teuthology.orchestra.run.smithi022.stdout:689 2023-07-11T00:34:14.445 INFO:teuthology.orchestra.run.smithi022.stdout:689.out 2023-07-11T00:34:14.445 INFO:teuthology.orchestra.run.smithi022.stdout:690 2023-07-11T00:34:14.445 INFO:teuthology.orchestra.run.smithi022.stdout:690.out 2023-07-11T00:34:14.445 INFO:teuthology.orchestra.run.smithi022.stdout:691 2023-07-11T00:34:14.445 INFO:teuthology.orchestra.run.smithi022.stdout:691.out 2023-07-11T00:34:14.446 INFO:teuthology.orchestra.run.smithi022.stdout:692 2023-07-11T00:34:14.446 INFO:teuthology.orchestra.run.smithi022.stdout:692.out 2023-07-11T00:34:14.446 INFO:teuthology.orchestra.run.smithi022.stdout:693 2023-07-11T00:34:14.446 INFO:teuthology.orchestra.run.smithi022.stdout:693.out 2023-07-11T00:34:14.446 INFO:teuthology.orchestra.run.smithi022.stdout:694 2023-07-11T00:34:14.446 INFO:teuthology.orchestra.run.smithi022.stdout:694.out 2023-07-11T00:34:14.446 INFO:teuthology.orchestra.run.smithi022.stdout:695 2023-07-11T00:34:14.447 INFO:teuthology.orchestra.run.smithi022.stdout:695.out 2023-07-11T00:34:14.447 INFO:teuthology.orchestra.run.smithi022.stdout:696 2023-07-11T00:34:14.447 INFO:teuthology.orchestra.run.smithi022.stdout:696.out 2023-07-11T00:34:14.447 INFO:teuthology.orchestra.run.smithi022.stdout:697 2023-07-11T00:34:14.447 INFO:teuthology.orchestra.run.smithi022.stdout:697.out 2023-07-11T00:34:14.447 INFO:teuthology.orchestra.run.smithi022.stdout:698 2023-07-11T00:34:14.447 INFO:teuthology.orchestra.run.smithi022.stdout:698.out 2023-07-11T00:34:14.448 INFO:teuthology.orchestra.run.smithi022.stdout:699 2023-07-11T00:34:14.448 INFO:teuthology.orchestra.run.smithi022.stdout:699.out 2023-07-11T00:34:14.448 INFO:teuthology.orchestra.run.smithi022.stdout:700 2023-07-11T00:34:14.448 INFO:teuthology.orchestra.run.smithi022.stdout:700.out 2023-07-11T00:34:14.448 INFO:teuthology.orchestra.run.smithi022.stdout:701 2023-07-11T00:34:14.448 INFO:teuthology.orchestra.run.smithi022.stdout:701.out 2023-07-11T00:34:14.448 INFO:teuthology.orchestra.run.smithi022.stdout:702 2023-07-11T00:34:14.448 INFO:teuthology.orchestra.run.smithi022.stdout:702.out 2023-07-11T00:34:14.449 INFO:teuthology.orchestra.run.smithi022.stdout:703 2023-07-11T00:34:14.449 INFO:teuthology.orchestra.run.smithi022.stdout:703.out 2023-07-11T00:34:14.449 INFO:teuthology.orchestra.run.smithi022.stdout:704 2023-07-11T00:34:14.449 INFO:teuthology.orchestra.run.smithi022.stdout:704.out 2023-07-11T00:34:14.449 INFO:teuthology.orchestra.run.smithi022.stdout:705 2023-07-11T00:34:14.449 INFO:teuthology.orchestra.run.smithi022.stdout:705.out 2023-07-11T00:34:14.449 INFO:teuthology.orchestra.run.smithi022.stdout:706 2023-07-11T00:34:14.450 INFO:teuthology.orchestra.run.smithi022.stdout:706.out 2023-07-11T00:34:14.450 INFO:teuthology.orchestra.run.smithi022.stdout:707 2023-07-11T00:34:14.450 INFO:teuthology.orchestra.run.smithi022.stdout:707.out 2023-07-11T00:34:14.450 INFO:teuthology.orchestra.run.smithi022.stdout:708 2023-07-11T00:34:14.450 INFO:teuthology.orchestra.run.smithi022.stdout:708.out 2023-07-11T00:34:14.450 INFO:teuthology.orchestra.run.smithi022.stdout:709 2023-07-11T00:34:14.450 INFO:teuthology.orchestra.run.smithi022.stdout:709.out 2023-07-11T00:34:14.451 INFO:teuthology.orchestra.run.smithi022.stdout:710 2023-07-11T00:34:14.451 INFO:teuthology.orchestra.run.smithi022.stdout:710.out 2023-07-11T00:34:14.451 INFO:teuthology.orchestra.run.smithi022.stdout:711 2023-07-11T00:34:14.451 INFO:teuthology.orchestra.run.smithi022.stdout:711.out 2023-07-11T00:34:14.451 INFO:teuthology.orchestra.run.smithi022.stdout:712 2023-07-11T00:34:14.451 INFO:teuthology.orchestra.run.smithi022.stdout:712.out 2023-07-11T00:34:14.451 INFO:teuthology.orchestra.run.smithi022.stdout:713 2023-07-11T00:34:14.452 INFO:teuthology.orchestra.run.smithi022.stdout:713.out 2023-07-11T00:34:14.452 INFO:teuthology.orchestra.run.smithi022.stdout:714 2023-07-11T00:34:14.452 INFO:teuthology.orchestra.run.smithi022.stdout:714.out 2023-07-11T00:34:14.452 INFO:teuthology.orchestra.run.smithi022.stdout:715 2023-07-11T00:34:14.452 INFO:teuthology.orchestra.run.smithi022.stdout:715.out 2023-07-11T00:34:14.452 INFO:teuthology.orchestra.run.smithi022.stdout:716 2023-07-11T00:34:14.452 INFO:teuthology.orchestra.run.smithi022.stdout:716.out 2023-07-11T00:34:14.452 INFO:teuthology.orchestra.run.smithi022.stdout:717 2023-07-11T00:34:14.453 INFO:teuthology.orchestra.run.smithi022.stdout:717.out 2023-07-11T00:34:14.453 INFO:teuthology.orchestra.run.smithi022.stdout:718 2023-07-11T00:34:14.453 INFO:teuthology.orchestra.run.smithi022.stdout:718.out 2023-07-11T00:34:14.453 INFO:teuthology.orchestra.run.smithi022.stdout:719 2023-07-11T00:34:14.453 INFO:teuthology.orchestra.run.smithi022.stdout:719.out 2023-07-11T00:34:14.453 INFO:teuthology.orchestra.run.smithi022.stdout:720 2023-07-11T00:34:14.453 INFO:teuthology.orchestra.run.smithi022.stdout:720.out 2023-07-11T00:34:14.454 INFO:teuthology.orchestra.run.smithi022.stdout:721 2023-07-11T00:34:14.454 INFO:teuthology.orchestra.run.smithi022.stdout:721.out 2023-07-11T00:34:14.454 INFO:teuthology.orchestra.run.smithi022.stdout:722 2023-07-11T00:34:14.454 INFO:teuthology.orchestra.run.smithi022.stdout:722.out 2023-07-11T00:34:14.454 INFO:teuthology.orchestra.run.smithi022.stdout:723 2023-07-11T00:34:14.454 INFO:teuthology.orchestra.run.smithi022.stdout:723.out 2023-07-11T00:34:14.454 INFO:teuthology.orchestra.run.smithi022.stdout:724 2023-07-11T00:34:14.455 INFO:teuthology.orchestra.run.smithi022.stdout:724.out 2023-07-11T00:34:14.455 INFO:teuthology.orchestra.run.smithi022.stdout:725 2023-07-11T00:34:14.455 INFO:teuthology.orchestra.run.smithi022.stdout:725.out 2023-07-11T00:34:14.455 INFO:teuthology.orchestra.run.smithi022.stdout:726 2023-07-11T00:34:14.455 INFO:teuthology.orchestra.run.smithi022.stdout:726.out 2023-07-11T00:34:14.455 INFO:teuthology.orchestra.run.smithi022.stdout:727 2023-07-11T00:34:14.455 INFO:teuthology.orchestra.run.smithi022.stdout:727.out 2023-07-11T00:34:14.455 INFO:teuthology.orchestra.run.smithi022.stdout:728 2023-07-11T00:34:14.456 INFO:teuthology.orchestra.run.smithi022.stdout:728.out 2023-07-11T00:34:14.456 INFO:teuthology.orchestra.run.smithi022.stdout:729 2023-07-11T00:34:14.456 INFO:teuthology.orchestra.run.smithi022.stdout:729.out 2023-07-11T00:34:14.456 INFO:teuthology.orchestra.run.smithi022.stdout:group.list 2023-07-11T00:34:14.456 INFO:teuthology.orchestra.run.smithi022.stdout:Makefile 2023-07-11T00:34:14.458 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-07-11T00:34:14.970 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:34:14.983 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:34:14.984 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:34:14.986 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:34:14.987 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:34:22.666 INFO:teuthology.orchestra.run.smithi022.stdout:generic/001 7s 2023-07-11T00:34:22.678 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/001 2023-07-11T00:34:22.679 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:34:22.685 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:34:22.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:34:22.821 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-07-11T00:34:23.276 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:34:23.288 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:34:23.289 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:34:23.291 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:34:23.292 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:34:24.177 INFO:teuthology.orchestra.run.smithi022.stdout:generic/002 1s 2023-07-11T00:34:24.190 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/002 2023-07-11T00:34:24.190 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:34:24.196 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:34:24.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:34:24.280 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-07-11T00:34:24.740 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:34:24.751 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:34:24.752 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:34:24.754 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:34:24.755 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:34:25.257 INFO:teuthology.orchestra.run.smithi022.stdout:generic/003 [not run] atime not maintained by ceph 2023-07-11T00:34:25.267 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/003 2023-07-11T00:34:25.268 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/003 2023-07-11T00:34:25.268 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:34:25.274 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:34:25.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:34:25.313 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-07-11T00:34:25.768 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:34:25.781 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:34:25.781 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:34:25.784 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:34:25.784 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:34:26.290 INFO:teuthology.orchestra.run.smithi022.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-07-11T00:34:26.300 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/004 2023-07-11T00:34:26.300 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/004 2023-07-11T00:34:26.300 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:34:26.306 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:34:26.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:34:26.341 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-07-11T00:34:26.795 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:34:26.808 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:34:26.813 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:34:26.813 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:34:26.813 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:34:27.610 INFO:teuthology.orchestra.run.smithi022.stdout:generic/005 0s 2023-07-11T00:34:27.623 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/005 2023-07-11T00:34:27.623 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:34:27.629 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:34:27.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:34:27.737 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-07-11T00:34:28.185 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:34:28.198 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:34:28.199 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:34:28.201 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:34:28.201 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:34:36.574 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:34:36.581 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:34:51.603 INFO:teuthology.orchestra.run.smithi022.stdout:generic/006 23s 2023-07-11T00:34:51.998 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/006 2023-07-11T00:34:51.998 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:34:52.012 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:34:52.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:34:52.213 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-07-11T00:34:52.666 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:34:52.678 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:34:52.679 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:34:52.682 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:34:52.682 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:35:06.696 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:35:06.701 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:35:37.850 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:35:37.855 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:35:42.448 INFO:teuthology.orchestra.run.smithi022.stdout:generic/007 50s 2023-07-11T00:35:42.461 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/007 2023-07-11T00:35:42.461 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:35:42.467 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:35:42.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:35:42.531 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-07-11T00:35:43.120 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:35:43.132 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:35:43.134 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:35:43.136 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:35:43.136 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:35:43.727 INFO:teuthology.orchestra.run.smithi022.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-11T00:35:43.736 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/008 2023-07-11T00:35:43.737 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/008 2023-07-11T00:35:43.737 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:35:43.742 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:35:43.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:35:43.788 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-07-11T00:35:44.237 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:35:44.250 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:35:44.251 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:35:44.253 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:35:44.253 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:35:44.851 INFO:teuthology.orchestra.run.smithi022.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-11T00:35:44.860 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/009 2023-07-11T00:35:44.860 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/009 2023-07-11T00:35:44.860 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:35:44.866 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:35:44.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:35:44.913 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-07-11T00:35:45.381 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:35:45.393 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:35:45.395 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:35:45.397 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:35:45.398 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:35:45.891 INFO:teuthology.orchestra.run.smithi022.stdout:generic/010 [not run] /tmp/tmp.QzQkhuoEboxfstests-dev/src/dbtest not built 2023-07-11T00:35:45.900 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/010 2023-07-11T00:35:45.900 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/010 2023-07-11T00:35:45.901 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:35:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:35:45.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:35:45.946 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-07-11T00:35:46.406 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:35:46.417 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:35:46.418 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:35:46.420 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:35:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:36:08.022 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:36:08.027 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:36:16.766 INFO:teuthology.orchestra.run.smithi022.stdout:generic/011 30s 2023-07-11T00:36:16.779 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/011 2023-07-11T00:36:16.780 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:36:16.785 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:36:16.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:36:16.961 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-07-11T00:36:17.489 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:36:17.501 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:36:17.502 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:36:17.505 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:36:17.505 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:36:18.161 INFO:teuthology.orchestra.run.smithi022.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-11T00:36:18.171 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/012 2023-07-11T00:36:18.171 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/012 2023-07-11T00:36:18.171 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:36:18.177 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:36:18.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:36:18.253 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-07-11T00:36:18.700 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:36:18.713 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:36:18.714 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:36:18.717 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:36:18.717 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:36:39.644 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:36:39.657 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:37:10.171 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:37:10.178 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:37:19.747 INFO:teuthology.orchestra.run.smithi022.stdout:generic/013 61s 2023-07-11T00:37:20.041 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/013 2023-07-11T00:37:20.042 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:37:20.051 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:37:20.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:37:20.124 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-07-11T00:37:20.829 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:37:20.847 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:37:20.849 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:37:20.852 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:37:20.853 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:37:40.317 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:37:40.334 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:38:11.092 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:38:11.104 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:38:41.251 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:38:41.261 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:39:11.427 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:39:11.434 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:39:41.597 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:39:41.618 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:40:11.764 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:40:11.786 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:40:41.946 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:40:41.953 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:41:12.131 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:41:12.143 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:41:42.289 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:41:42.296 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:41:59.555 INFO:teuthology.orchestra.run.smithi022.stdout:generic/014 278s 2023-07-11T00:41:59.635 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/014 2023-07-11T00:41:59.635 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:41:59.644 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:41:59.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:41:59.713 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-07-11T00:42:00.430 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:42:00.454 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:42:00.455 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:42:00.458 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:42:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:42:01.209 INFO:teuthology.orchestra.run.smithi022.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-11T00:42:01.229 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/015 2023-07-11T00:42:01.230 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/015 2023-07-11T00:42:01.230 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:42:01.238 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:42:01.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:42:01.297 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-07-11T00:42:02.015 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:42:02.036 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:42:02.038 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:42:02.044 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:42:02.044 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:42:03.047 INFO:teuthology.orchestra.run.smithi022.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-11T00:42:03.061 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/016 2023-07-11T00:42:03.061 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/016 2023-07-11T00:42:03.062 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:42:03.069 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:42:03.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:42:03.242 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-07-11T00:42:04.078 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:42:04.100 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:42:04.102 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:42:04.105 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:42:04.106 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:42:04.921 INFO:teuthology.orchestra.run.smithi022.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-11T00:42:04.939 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/017 2023-07-11T00:42:04.939 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/017 2023-07-11T00:42:04.939 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:42:04.946 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:42:05.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:42:05.002 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-07-11T00:42:05.733 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:42:05.753 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:42:05.755 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:42:05.758 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:42:05.758 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:42:06.743 INFO:teuthology.orchestra.run.smithi022.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-07-11T00:42:06.779 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/018 2023-07-11T00:42:06.779 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/018 2023-07-11T00:42:06.779 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:42:06.789 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:42:06.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:42:06.843 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-07-11T00:42:07.554 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:42:07.567 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:42:07.568 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:42:07.571 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:42:07.571 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:42:08.382 INFO:teuthology.orchestra.run.smithi022.stdout:generic/019 [not run] require 172.21.15.22:6789:/scratch to be valid block disk 2023-07-11T00:42:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/019 2023-07-11T00:42:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/019 2023-07-11T00:42:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:42:08.415 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:42:08.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:42:08.469 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-07-11T00:42:09.208 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:42:09.228 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:42:09.230 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:42:09.234 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:42:09.234 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:42:12.470 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:42:12.484 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:42:17.737 INFO:teuthology.orchestra.run.smithi022.stdout:generic/020 8s 2023-07-11T00:42:17.762 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/020 2023-07-11T00:42:17.763 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:42:17.774 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:42:17.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:42:17.921 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-07-11T00:42:18.745 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:42:18.763 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:42:18.765 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:42:18.769 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:42:18.769 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:42:19.797 INFO:teuthology.orchestra.run.smithi022.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-11T00:42:19.812 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/021 2023-07-11T00:42:19.812 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/021 2023-07-11T00:42:19.812 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:42:19.820 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:42:19.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:42:19.965 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-07-11T00:42:20.830 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:42:20.848 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:42:20.849 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:42:20.853 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:42:20.853 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:42:21.899 INFO:teuthology.orchestra.run.smithi022.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-11T00:42:21.918 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/022 2023-07-11T00:42:21.919 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/022 2023-07-11T00:42:21.919 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:42:21.930 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:42:22.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:42:22.060 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-07-11T00:42:22.886 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:42:22.912 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:42:22.913 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:42:22.916 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:42:22.916 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:42:42.628 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:42:42.634 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:43:00.870 INFO:teuthology.orchestra.run.smithi022.stdout:generic/023 37s 2023-07-11T00:43:02.515 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/023 2023-07-11T00:43:02.516 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:02.525 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:02.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:02.647 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-07-11T00:43:03.338 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:03.355 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:03.356 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:03.360 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:03.360 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:04.196 INFO:teuthology.orchestra.run.smithi022.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-07-11T00:43:04.213 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/024 2023-07-11T00:43:04.213 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/024 2023-07-11T00:43:04.213 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:04.222 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:04.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:04.361 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-07-11T00:43:05.224 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:05.243 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:05.244 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:05.246 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:05.247 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:06.056 INFO:teuthology.orchestra.run.smithi022.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-07-11T00:43:06.071 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/025 2023-07-11T00:43:06.071 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/025 2023-07-11T00:43:06.071 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:06.080 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:06.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:06.184 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-07-11T00:43:07.053 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:07.071 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:07.072 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:07.075 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:07.075 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:07.966 INFO:teuthology.orchestra.run.smithi022.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-07-11T00:43:07.980 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/026 2023-07-11T00:43:07.980 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/026 2023-07-11T00:43:07.980 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:07.991 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:08.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:08.065 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-07-11T00:43:08.775 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:08.798 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:08.802 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:08.804 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:08.805 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:09.604 INFO:teuthology.orchestra.run.smithi022.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-11T00:43:09.623 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/027 2023-07-11T00:43:09.623 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/027 2023-07-11T00:43:09.624 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:09.633 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:09.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:09.687 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-07-11T00:43:10.405 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:10.426 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:10.428 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:10.432 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:10.432 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:13.012 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:43:13.019 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:43:16.273 INFO:teuthology.orchestra.run.smithi022.stdout:generic/028 6s 2023-07-11T00:43:16.293 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/028 2023-07-11T00:43:16.293 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:16.302 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:16.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:16.359 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-07-11T00:43:17.074 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:17.092 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:17.094 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:17.098 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:17.098 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:21.043 INFO:teuthology.orchestra.run.smithi022.stdout:generic/029 4s 2023-07-11T00:43:21.055 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/029 2023-07-11T00:43:21.055 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:21.061 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:21.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:21.082 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-07-11T00:43:21.530 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:21.542 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:21.544 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:21.546 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:21.546 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:23.243 INFO:teuthology.orchestra.run.smithi022.stdout:generic/030 2s 2023-07-11T00:43:23.256 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/030 2023-07-11T00:43:23.256 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:23.262 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:23.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:23.283 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-07-11T00:43:23.730 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:23.743 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:23.744 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:23.746 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:23.747 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:24.381 INFO:teuthology.orchestra.run.smithi022.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-07-11T00:43:24.391 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/031 2023-07-11T00:43:24.392 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/031 2023-07-11T00:43:24.392 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:24.398 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:24.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:24.447 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-07-11T00:43:24.902 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:24.914 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:24.915 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:24.917 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:24.918 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:25.431 INFO:teuthology.orchestra.run.smithi022.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-11T00:43:25.441 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/032 2023-07-11T00:43:25.441 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/032 2023-07-11T00:43:25.441 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:25.447 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:25.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:25.489 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-07-11T00:43:25.942 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:25.955 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:25.956 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:25.958 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:25.959 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:26.583 INFO:teuthology.orchestra.run.smithi022.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-11T00:43:26.593 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/033 2023-07-11T00:43:26.593 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/033 2023-07-11T00:43:26.594 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:26.599 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:26.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:26.641 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-07-11T00:43:27.105 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:27.117 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:27.118 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:27.121 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:27.121 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:27.651 INFO:teuthology.orchestra.run.smithi022.stdout:generic/034 [not run] require 172.21.15.22:6789:/scratch to be valid block disk 2023-07-11T00:43:27.661 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/034 2023-07-11T00:43:27.661 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/034 2023-07-11T00:43:27.662 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:27.667 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:27.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:27.706 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-07-11T00:43:28.158 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:28.170 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:28.171 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:28.174 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:28.174 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:28.758 INFO:teuthology.orchestra.run.smithi022.stdout:generic/035 0s 2023-07-11T00:43:28.771 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/035 2023-07-11T00:43:28.771 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:28.777 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:28.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:28.919 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-07-11T00:43:29.528 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:29.540 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:29.541 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:29.544 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:29.544 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:40.164 INFO:teuthology.orchestra.run.smithi022.stdout:generic/036 11s 2023-07-11T00:43:40.176 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/036 2023-07-11T00:43:40.176 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:40.183 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:40.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:40.320 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-07-11T00:43:40.941 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:40.954 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:40.955 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:40.958 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:40.958 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:43.392 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:43:43.399 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:43:48.266 INFO:teuthology.orchestra.run.smithi022.stdout:generic/037 7s 2023-07-11T00:43:48.279 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/037 2023-07-11T00:43:48.280 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:48.285 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:48.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:48.306 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-07-11T00:43:48.759 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:48.772 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:48.773 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:48.775 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:48.775 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:49.303 INFO:teuthology.orchestra.run.smithi022.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-11T00:43:49.313 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/038 2023-07-11T00:43:49.313 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/038 2023-07-11T00:43:49.313 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:49.319 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:49.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:49.360 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-07-11T00:43:49.814 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:49.826 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:49.830 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:49.830 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:50.369 INFO:teuthology.orchestra.run.smithi022.stdout:generic/039 [not run] require 172.21.15.22:6789:/scratch to be valid block disk 2023-07-11T00:43:50.379 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/039 2023-07-11T00:43:50.379 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/039 2023-07-11T00:43:50.379 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:50.385 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:50.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:50.427 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-07-11T00:43:50.882 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:50.895 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:50.896 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:50.899 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:50.899 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:51.434 INFO:teuthology.orchestra.run.smithi022.stdout:generic/040 [not run] require 172.21.15.22:6789:/scratch to be valid block disk 2023-07-11T00:43:51.444 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/040 2023-07-11T00:43:51.445 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/040 2023-07-11T00:43:51.445 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:51.450 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:51.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:51.497 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-07-11T00:43:51.950 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:51.962 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:51.963 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:51.966 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:51.966 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:52.514 INFO:teuthology.orchestra.run.smithi022.stdout:generic/041 [not run] require 172.21.15.22:6789:/scratch to be valid block disk 2023-07-11T00:43:52.524 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/041 2023-07-11T00:43:52.524 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/041 2023-07-11T00:43:52.525 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:52.530 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:52.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:52.576 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-07-11T00:43:53.034 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:53.047 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:53.048 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:53.050 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:53.051 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:53.699 INFO:teuthology.orchestra.run.smithi022.stdout:generic/042 [not run] ceph does not support shutdown 2023-07-11T00:43:53.725 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/042 2023-07-11T00:43:53.725 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/042 2023-07-11T00:43:53.725 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:53.731 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:53.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:53.768 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-07-11T00:43:54.218 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:54.230 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:54.231 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:54.233 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:54.234 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:54.881 INFO:teuthology.orchestra.run.smithi022.stdout:generic/043 [not run] ceph does not support shutdown 2023-07-11T00:43:54.907 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/043 2023-07-11T00:43:54.907 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/043 2023-07-11T00:43:54.907 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:54.913 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:54.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:54.957 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-07-11T00:43:55.407 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:55.420 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:55.421 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:55.423 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:55.423 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:56.076 INFO:teuthology.orchestra.run.smithi022.stdout:generic/044 [not run] ceph does not support shutdown 2023-07-11T00:43:56.108 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/044 2023-07-11T00:43:56.108 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/044 2023-07-11T00:43:56.108 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:56.114 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:56.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:56.149 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-07-11T00:43:56.614 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:56.627 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:56.628 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:56.631 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:56.631 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:57.302 INFO:teuthology.orchestra.run.smithi022.stdout:generic/045 [not run] ceph does not support shutdown 2023-07-11T00:43:57.329 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/045 2023-07-11T00:43:57.329 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/045 2023-07-11T00:43:57.330 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:57.335 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:57.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:57.373 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-07-11T00:43:57.831 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:57.843 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:57.844 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:57.847 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:57.847 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:58.500 INFO:teuthology.orchestra.run.smithi022.stdout:generic/046 [not run] ceph does not support shutdown 2023-07-11T00:43:58.525 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/046 2023-07-11T00:43:58.525 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/046 2023-07-11T00:43:58.525 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:58.531 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:58.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:58.569 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-07-11T00:43:59.018 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:43:59.031 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:43:59.032 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:43:59.034 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:43:59.035 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:59.679 INFO:teuthology.orchestra.run.smithi022.stdout:generic/047 [not run] ceph does not support shutdown 2023-07-11T00:43:59.704 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/047 2023-07-11T00:43:59.704 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/047 2023-07-11T00:43:59.704 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:43:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:43:59.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:43:59.748 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-07-11T00:44:00.198 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:00.211 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:00.212 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:00.214 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:00.862 INFO:teuthology.orchestra.run.smithi022.stdout:generic/048 [not run] ceph does not support shutdown 2023-07-11T00:44:00.889 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/048 2023-07-11T00:44:00.889 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/048 2023-07-11T00:44:00.889 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:00.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:00.931 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-07-11T00:44:01.390 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:01.403 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:01.404 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:01.406 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:01.406 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:02.051 INFO:teuthology.orchestra.run.smithi022.stdout:generic/049 [not run] ceph does not support shutdown 2023-07-11T00:44:02.077 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/049 2023-07-11T00:44:02.078 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/049 2023-07-11T00:44:02.078 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:02.083 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:02.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:02.121 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-07-11T00:44:02.576 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:02.589 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:02.589 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:02.592 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:02.592 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:03.240 INFO:teuthology.orchestra.run.smithi022.stdout:generic/050 [not run] ceph does not support shutdown 2023-07-11T00:44:03.263 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/050 2023-07-11T00:44:03.263 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/050 2023-07-11T00:44:03.264 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:03.269 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:03.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:03.305 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-07-11T00:44:03.758 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:03.770 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:03.771 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:03.774 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:03.774 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:04.429 INFO:teuthology.orchestra.run.smithi022.stdout:generic/051 [not run] ceph does not support shutdown 2023-07-11T00:44:04.438 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/051 2023-07-11T00:44:04.439 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/051 2023-07-11T00:44:04.439 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:04.444 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:04.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:04.483 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-07-11T00:44:04.934 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:04.946 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:04.947 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:04.950 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:04.950 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:05.624 INFO:teuthology.orchestra.run.smithi022.stdout:generic/052 [not run] ceph does not support shutdown 2023-07-11T00:44:05.651 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/052 2023-07-11T00:44:05.652 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/052 2023-07-11T00:44:05.652 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:05.657 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:05.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:05.695 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-07-11T00:44:06.143 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:06.156 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:06.157 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:06.159 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:06.159 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:07.316 INFO:teuthology.orchestra.run.smithi022.stdout:generic/053 1s 2023-07-11T00:44:07.403 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/053 2023-07-11T00:44:07.403 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:07.421 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:07.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:07.464 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-07-11T00:44:07.913 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:07.926 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:07.927 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:07.930 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:07.930 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:08.615 INFO:teuthology.orchestra.run.smithi022.stdout:generic/054 [not run] ceph does not support shutdown 2023-07-11T00:44:08.640 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/054 2023-07-11T00:44:08.640 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/054 2023-07-11T00:44:08.641 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:08.646 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:08.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:08.683 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-07-11T00:44:09.142 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:09.154 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:09.155 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:09.158 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:09.158 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:09.822 INFO:teuthology.orchestra.run.smithi022.stdout:generic/055 [not run] ceph does not support shutdown 2023-07-11T00:44:09.848 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/055 2023-07-11T00:44:09.849 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/055 2023-07-11T00:44:09.849 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:09.854 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:09.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:09.893 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-07-11T00:44:10.345 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:10.357 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:10.358 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:10.361 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:10.361 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:10.910 INFO:teuthology.orchestra.run.smithi022.stdout:generic/056 [not run] require 172.21.15.22:6789:/scratch to be valid block disk 2023-07-11T00:44:10.920 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/056 2023-07-11T00:44:10.921 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/056 2023-07-11T00:44:10.921 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:10.926 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:10.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:10.966 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-07-11T00:44:11.418 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:11.430 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:11.432 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:11.434 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:11.434 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:11.983 INFO:teuthology.orchestra.run.smithi022.stdout:generic/057 [not run] require 172.21.15.22:6789:/scratch to be valid block disk 2023-07-11T00:44:11.992 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/057 2023-07-11T00:44:11.992 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/057 2023-07-11T00:44:11.992 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:11.998 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:12.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:12.038 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-07-11T00:44:12.493 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:12.506 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:12.507 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:12.509 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:12.510 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:13.181 INFO:teuthology.orchestra.run.smithi022.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-11T00:44:13.191 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/058 2023-07-11T00:44:13.191 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/058 2023-07-11T00:44:13.191 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:13.197 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:13.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:13.310 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-07-11T00:44:13.521 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:44:13.530 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:44:13.955 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:13.968 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:13.969 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:13.971 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:13.971 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:14.512 INFO:teuthology.orchestra.run.smithi022.stdout:generic/059 [not run] require 172.21.15.22:6789:/scratch to be valid block disk 2023-07-11T00:44:14.522 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/059 2023-07-11T00:44:14.522 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/059 2023-07-11T00:44:14.522 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:14.528 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:14.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:14.563 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-07-11T00:44:15.015 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:15.028 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:15.029 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:15.031 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:15.684 INFO:teuthology.orchestra.run.smithi022.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-11T00:44:15.694 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/060 2023-07-11T00:44:15.694 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/060 2023-07-11T00:44:15.694 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:15.700 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:15.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:15.844 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-07-11T00:44:16.469 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:16.482 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:16.483 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:16.485 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:16.486 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:17.141 INFO:teuthology.orchestra.run.smithi022.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-11T00:44:17.151 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/061 2023-07-11T00:44:17.151 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/061 2023-07-11T00:44:17.151 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:17.157 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:17.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:17.286 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-07-11T00:44:17.909 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:17.921 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:17.922 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:17.925 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:17.925 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:20.683 INFO:teuthology.orchestra.run.smithi022.stdout:generic/062 2s 2023-07-11T00:44:20.746 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/062 2023-07-11T00:44:20.747 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:20.758 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:20.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:20.807 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-07-11T00:44:21.279 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:21.291 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:21.293 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:21.295 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:21.295 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:22.001 INFO:teuthology.orchestra.run.smithi022.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-11T00:44:22.011 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/063 2023-07-11T00:44:22.011 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/063 2023-07-11T00:44:22.011 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:22.017 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:22.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:22.145 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-07-11T00:44:22.771 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:22.783 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:22.784 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:22.787 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:22.787 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:23.324 INFO:teuthology.orchestra.run.smithi022.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-11T00:44:23.334 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/064 2023-07-11T00:44:23.334 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/064 2023-07-11T00:44:23.335 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:23.340 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:23.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:23.379 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-07-11T00:44:23.835 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:23.848 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:23.849 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:23.851 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:23.851 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:24.385 INFO:teuthology.orchestra.run.smithi022.stdout:generic/065 [not run] require 172.21.15.22:6789:/scratch to be valid block disk 2023-07-11T00:44:24.391 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/065 2023-07-11T00:44:24.392 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/065 2023-07-11T00:44:24.392 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:24.397 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:24.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:24.440 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-07-11T00:44:24.894 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:24.906 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:24.907 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:24.910 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:24.910 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:25.442 INFO:teuthology.orchestra.run.smithi022.stdout:generic/066 [not run] require 172.21.15.22:6789:/scratch to be valid block disk 2023-07-11T00:44:25.452 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/066 2023-07-11T00:44:25.453 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/066 2023-07-11T00:44:25.453 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:25.458 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:25.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:25.508 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-07-11T00:44:25.956 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:25.970 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:25.971 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:25.973 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:25.973 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:26.552 INFO:teuthology.orchestra.run.smithi022.stdout:generic/067 [not run] require 172.21.15.22:6789:/scratch to be valid block disk 2023-07-11T00:44:26.562 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/067 2023-07-11T00:44:26.562 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/067 2023-07-11T00:44:26.562 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:26.567 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:26.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:26.615 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-07-11T00:44:27.067 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:27.079 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:27.080 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:27.083 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:27.083 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:27.605 INFO:teuthology.orchestra.run.smithi022.stdout:generic/068 [not run] ceph does not support freezing 2023-07-11T00:44:27.616 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/068 2023-07-11T00:44:27.616 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/068 2023-07-11T00:44:27.616 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:27.622 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:27.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:27.664 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-07-11T00:44:28.119 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:28.131 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:28.132 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:28.135 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:28.135 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:43.651 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:44:43.656 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:44:48.699 INFO:teuthology.orchestra.run.smithi022.stdout:generic/069 20s 2023-07-11T00:44:48.764 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/069 2023-07-11T00:44:48.764 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:44:48.777 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:44:48.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:44:48.847 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-07-11T00:44:49.310 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:44:49.322 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:44:49.323 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:44:49.326 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:44:49.326 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:45:12.106 INFO:teuthology.orchestra.run.smithi022.stdout:generic/070 23s 2023-07-11T00:45:12.132 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/070 2023-07-11T00:45:12.132 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:45:12.142 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:45:12.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:45:12.614 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-07-11T00:45:13.414 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:45:13.431 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:45:13.433 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:45:13.437 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:45:13.437 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:45:13.797 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:45:13.804 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:45:14.276 INFO:teuthology.orchestra.run.smithi022.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-11T00:45:14.359 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/071 2023-07-11T00:45:14.359 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/071 2023-07-11T00:45:14.359 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:45:14.360 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:45:14.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:45:14.366 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-07-11T00:45:15.089 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:45:15.109 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:45:15.111 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:45:15.116 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:45:15.116 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:45:16.153 INFO:teuthology.orchestra.run.smithi022.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-07-11T00:45:16.168 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/072 2023-07-11T00:45:16.168 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/072 2023-07-11T00:45:16.169 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:45:16.177 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:45:16.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:45:16.243 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-07-11T00:45:16.960 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:45:16.984 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:45:16.986 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:45:16.990 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:45:16.991 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:45:17.807 INFO:teuthology.orchestra.run.smithi022.stdout:generic/073 [not run] require 172.21.15.22:6789:/scratch to be valid block disk 2023-07-11T00:45:17.820 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/073 2023-07-11T00:45:17.820 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/073 2023-07-11T00:45:17.820 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:45:17.831 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:45:17.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:45:17.895 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-07-11T00:45:18.623 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:45:18.639 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:45:18.641 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:45:18.644 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:45:18.644 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:45:44.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:45:44.016 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:45:44.238 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-07-11T00:45:44.237+0000 7fe0b21f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 121783) UID: 0 2023-07-11T00:45:44.239 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-07-11T00:45:44.237+0000 7ff9b27f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 121783) UID: 0 2023-07-11T00:46:06.174 INFO:teuthology.orchestra.run.smithi022.stdout:generic/074 48s 2023-07-11T00:46:06.191 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/074 2023-07-11T00:46:06.191 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:46:06.202 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:46:07.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:46:07.208 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-07-11T00:46:08.102 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:46:08.122 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:46:08.124 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:46:08.128 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:46:08.128 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:46:49.572 INFO:teuthology.orchestra.run.smithi022.stdout:generic/075 41s 2023-07-11T00:46:49.593 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/075 2023-07-11T00:46:49.593 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:46:49.601 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:46:49.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:46:49.777 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-07-11T00:46:50.634 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:46:50.660 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:46:50.661 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:46:50.670 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:46:50.670 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:46:51.417 INFO:teuthology.orchestra.run.smithi022.stdout:generic/076 [not run] require 172.21.15.22:6789:/scratch to be local device 2023-07-11T00:46:51.430 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/076 2023-07-11T00:46:51.430 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/076 2023-07-11T00:46:51.430 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:46:51.440 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:46:51.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:46:51.496 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-07-11T00:46:52.187 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:46:52.207 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:46:52.209 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:46:52.217 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:46:52.217 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:46:54.201 INFO:teuthology.orchestra.run.smithi022.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-11T00:46:54.229 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/077 2023-07-11T00:46:54.229 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/077 2023-07-11T00:46:54.230 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:46:54.243 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:46:54.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:46:54.495 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-07-11T00:46:55.187 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:46:55.199 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:46:55.200 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:46:55.203 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:46:55.203 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:46:55.739 INFO:teuthology.orchestra.run.smithi022.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-07-11T00:46:55.748 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/078 2023-07-11T00:46:55.749 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/078 2023-07-11T00:46:55.749 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:46:55.754 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:46:55.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:46:55.879 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-07-11T00:46:56.533 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:46:56.545 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:46:56.546 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:46:56.549 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:46:56.549 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:46:57.082 INFO:teuthology.orchestra.run.smithi022.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-07-11T00:46:57.092 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/079 2023-07-11T00:46:57.092 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/079 2023-07-11T00:46:57.092 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:46:57.098 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:46:57.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:46:57.143 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-07-11T00:46:57.602 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:46:57.614 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:46:57.615 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:46:57.618 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:46:57.618 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:00.205 INFO:teuthology.orchestra.run.smithi022.stdout:generic/080 3s 2023-07-11T00:47:00.218 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/080 2023-07-11T00:47:00.219 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:47:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:00.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:47:00.284 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-07-11T00:47:00.741 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:47:00.754 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:47:00.755 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:47:00.758 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:47:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:01.315 INFO:teuthology.orchestra.run.smithi022.stdout:generic/081 [not run] require 172.21.15.22:6789:/scratch to be valid block disk 2023-07-11T00:47:01.325 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/081 2023-07-11T00:47:01.325 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/081 2023-07-11T00:47:01.325 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:47:01.333 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:01.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:47:01.368 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-07-11T00:47:01.828 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:47:01.841 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:47:01.842 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:47:01.846 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:47:01.846 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:02.367 INFO:teuthology.orchestra.run.smithi022.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-11T00:47:02.377 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/082 2023-07-11T00:47:02.377 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/082 2023-07-11T00:47:02.377 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:47:02.383 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:02.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:47:02.423 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-07-11T00:47:02.875 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:47:02.888 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:47:02.889 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:47:02.891 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:47:02.892 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:03.407 INFO:teuthology.orchestra.run.smithi022.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-11T00:47:03.417 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/083 2023-07-11T00:47:03.417 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/083 2023-07-11T00:47:03.417 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:47:03.423 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:03.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:47:03.462 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-07-11T00:47:03.913 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:47:03.926 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:47:03.927 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:47:03.930 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:47:03.931 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:06.225 INFO:tasks.ceph.mds.d.smithi184.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7ff9aafea700 time 2023-07-11T00:47:06.223750+0000 2023-07-11T00:47:06.225 INFO:tasks.ceph.mds.d.smithi184.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-11T00:47:06.275 INFO:tasks.ceph.mds.d.smithi184.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-11T00:47:06.275 INFO:tasks.ceph.mds.d.smithi184.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff9c14a8dbf] 2023-07-11T00:47:06.275 INFO:tasks.ceph.mds.d.smithi184.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7ff9c14a8f85] 2023-07-11T00:47:06.275 INFO:tasks.ceph.mds.d.smithi184.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x557fdcaf2bc2] 2023-07-11T00:47:06.276 INFO:tasks.ceph.mds.d.smithi184.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x557fdcadae5c] 2023-07-11T00:47:06.276 INFO:tasks.ceph.mds.d.smithi184.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x557fdcae3a37] 2023-07-11T00:47:06.276 INFO:tasks.ceph.mds.d.smithi184.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x557fdcae82af] 2023-07-11T00:47:06.276 INFO:tasks.ceph.mds.d.smithi184.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x557fdc93a137] 2023-07-11T00:47:06.276 INFO:tasks.ceph.mds.d.smithi184.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x557fdc93afe0] 2023-07-11T00:47:06.276 INFO:tasks.ceph.mds.d.smithi184.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x557fdc93cee5] 2023-07-11T00:47:06.277 INFO:tasks.ceph.mds.d.smithi184.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x557fdc9c3585] 2023-07-11T00:47:06.277 INFO:tasks.ceph.mds.d.smithi184.stderr: 11: (MDSContext::complete(int)+0x5f) [0x557fdcc2179f] 2023-07-11T00:47:06.277 INFO:tasks.ceph.mds.d.smithi184.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x557fdcc21f24] 2023-07-11T00:47:06.277 INFO:tasks.ceph.mds.d.smithi184.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x557fdcc222db] 2023-07-11T00:47:06.277 INFO:tasks.ceph.mds.d.smithi184.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7ff9c154c93d] 2023-07-11T00:47:06.277 INFO:tasks.ceph.mds.d.smithi184.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff9bf8081ca] 2023-07-11T00:47:06.277 INFO:tasks.ceph.mds.d.smithi184.stderr: 16: clone() 2023-07-11T00:47:06.278 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-07-11T00:47:06.272+0000 7ff9aafea700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7ff9aafea700 time 2023-07-11T00:47:06.223750+0000 2023-07-11T00:47:06.278 INFO:tasks.ceph.mds.d.smithi184.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-11T00:47:06.278 INFO:tasks.ceph.mds.d.smithi184.stderr: 2023-07-11T00:47:06.278 INFO:tasks.ceph.mds.d.smithi184.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-11T00:47:06.278 INFO:tasks.ceph.mds.d.smithi184.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff9c14a8dbf] 2023-07-11T00:47:06.278 INFO:tasks.ceph.mds.d.smithi184.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7ff9c14a8f85] 2023-07-11T00:47:06.278 INFO:tasks.ceph.mds.d.smithi184.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x557fdcaf2bc2] 2023-07-11T00:47:06.279 INFO:tasks.ceph.mds.d.smithi184.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x557fdcadae5c] 2023-07-11T00:47:06.279 INFO:tasks.ceph.mds.d.smithi184.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x557fdcae3a37] 2023-07-11T00:47:06.279 INFO:tasks.ceph.mds.d.smithi184.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x557fdcae82af] 2023-07-11T00:47:06.279 INFO:tasks.ceph.mds.d.smithi184.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x557fdc93a137] 2023-07-11T00:47:06.279 INFO:tasks.ceph.mds.d.smithi184.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x557fdc93afe0] 2023-07-11T00:47:06.279 INFO:tasks.ceph.mds.d.smithi184.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x557fdc93cee5] 2023-07-11T00:47:06.279 INFO:tasks.ceph.mds.d.smithi184.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x557fdc9c3585] 2023-07-11T00:47:06.279 INFO:tasks.ceph.mds.d.smithi184.stderr: 11: (MDSContext::complete(int)+0x5f) [0x557fdcc2179f] 2023-07-11T00:47:06.280 INFO:tasks.ceph.mds.d.smithi184.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x557fdcc21f24] 2023-07-11T00:47:06.280 INFO:tasks.ceph.mds.d.smithi184.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x557fdcc222db] 2023-07-11T00:47:06.280 INFO:tasks.ceph.mds.d.smithi184.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7ff9c154c93d] 2023-07-11T00:47:06.280 INFO:tasks.ceph.mds.d.smithi184.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff9bf8081ca] 2023-07-11T00:47:06.280 INFO:tasks.ceph.mds.d.smithi184.stderr: 16: clone() 2023-07-11T00:47:06.280 INFO:tasks.ceph.mds.d.smithi184.stderr: 2023-07-11T00:47:06.280 INFO:tasks.ceph.mds.d.smithi184.stderr:*** Caught signal (Aborted) ** 2023-07-11T00:47:06.281 INFO:tasks.ceph.mds.d.smithi184.stderr: in thread 7ff9aafea700 thread_name:MR_Finisher 2023-07-11T00:47:06.281 INFO:tasks.ceph.mds.d.smithi184.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-11T00:47:06.281 INFO:tasks.ceph.mds.d.smithi184.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7ff9bf812cf0] 2023-07-11T00:47:06.281 INFO:tasks.ceph.mds.d.smithi184.stderr: 2: gsignal() 2023-07-11T00:47:06.281 INFO:tasks.ceph.mds.d.smithi184.stderr: 3: abort() 2023-07-11T00:47:06.282 INFO:tasks.ceph.mds.d.smithi184.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff9c14a8e19] 2023-07-11T00:47:06.282 INFO:tasks.ceph.mds.d.smithi184.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7ff9c14a8f85] 2023-07-11T00:47:06.282 INFO:tasks.ceph.mds.d.smithi184.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x557fdcaf2bc2] 2023-07-11T00:47:06.282 INFO:tasks.ceph.mds.d.smithi184.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x557fdcadae5c] 2023-07-11T00:47:06.282 INFO:tasks.ceph.mds.d.smithi184.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x557fdcae3a37] 2023-07-11T00:47:06.282 INFO:tasks.ceph.mds.d.smithi184.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x557fdcae82af] 2023-07-11T00:47:06.282 INFO:tasks.ceph.mds.d.smithi184.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x557fdc93a137] 2023-07-11T00:47:06.283 INFO:tasks.ceph.mds.d.smithi184.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x557fdc93afe0] 2023-07-11T00:47:06.283 INFO:tasks.ceph.mds.d.smithi184.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x557fdc93cee5] 2023-07-11T00:47:06.283 INFO:tasks.ceph.mds.d.smithi184.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x557fdc9c3585] 2023-07-11T00:47:06.283 INFO:tasks.ceph.mds.d.smithi184.stderr: 14: (MDSContext::complete(int)+0x5f) [0x557fdcc2179f] 2023-07-11T00:47:06.283 INFO:tasks.ceph.mds.d.smithi184.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x557fdcc21f24] 2023-07-11T00:47:06.283 INFO:tasks.ceph.mds.d.smithi184.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x557fdcc222db] 2023-07-11T00:47:06.283 INFO:tasks.ceph.mds.d.smithi184.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7ff9c154c93d] 2023-07-11T00:47:06.283 INFO:tasks.ceph.mds.d.smithi184.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7ff9bf8081ca] 2023-07-11T00:47:06.284 INFO:tasks.ceph.mds.d.smithi184.stderr: 19: clone() 2023-07-11T00:47:06.284 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-07-11T00:47:06.275+0000 7ff9aafea700 -1 *** Caught signal (Aborted) ** 2023-07-11T00:47:06.284 INFO:tasks.ceph.mds.d.smithi184.stderr: in thread 7ff9aafea700 thread_name:MR_Finisher 2023-07-11T00:47:06.284 INFO:tasks.ceph.mds.d.smithi184.stderr: 2023-07-11T00:47:06.284 INFO:tasks.ceph.mds.d.smithi184.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-11T00:47:06.284 INFO:tasks.ceph.mds.d.smithi184.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7ff9bf812cf0] 2023-07-11T00:47:06.284 INFO:tasks.ceph.mds.d.smithi184.stderr: 2: gsignal() 2023-07-11T00:47:06.285 INFO:tasks.ceph.mds.d.smithi184.stderr: 3: abort() 2023-07-11T00:47:06.285 INFO:tasks.ceph.mds.d.smithi184.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff9c14a8e19] 2023-07-11T00:47:06.285 INFO:tasks.ceph.mds.d.smithi184.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7ff9c14a8f85] 2023-07-11T00:47:06.285 INFO:tasks.ceph.mds.d.smithi184.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x557fdcaf2bc2] 2023-07-11T00:47:06.285 INFO:tasks.ceph.mds.d.smithi184.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x557fdcadae5c] 2023-07-11T00:47:06.285 INFO:tasks.ceph.mds.d.smithi184.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x557fdcae3a37] 2023-07-11T00:47:06.285 INFO:tasks.ceph.mds.d.smithi184.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x557fdcae82af] 2023-07-11T00:47:06.285 INFO:tasks.ceph.mds.d.smithi184.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x557fdc93a137] 2023-07-11T00:47:06.286 INFO:tasks.ceph.mds.d.smithi184.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x557fdc93afe0] 2023-07-11T00:47:06.286 INFO:tasks.ceph.mds.d.smithi184.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x557fdc93cee5] 2023-07-11T00:47:06.286 INFO:tasks.ceph.mds.d.smithi184.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x557fdc9c3585] 2023-07-11T00:47:06.287 INFO:tasks.ceph.mds.d.smithi184.stderr: 14: (MDSContext::complete(int)+0x5f) [0x557fdcc2179f] 2023-07-11T00:47:06.287 INFO:tasks.ceph.mds.d.smithi184.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x557fdcc21f24] 2023-07-11T00:47:06.287 INFO:tasks.ceph.mds.d.smithi184.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x557fdcc222db] 2023-07-11T00:47:06.287 INFO:tasks.ceph.mds.d.smithi184.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7ff9c154c93d] 2023-07-11T00:47:06.287 INFO:tasks.ceph.mds.d.smithi184.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7ff9bf8081ca] 2023-07-11T00:47:06.287 INFO:tasks.ceph.mds.d.smithi184.stderr: 19: clone() 2023-07-11T00:47:06.287 INFO:tasks.ceph.mds.d.smithi184.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-11T00:47:06.288 INFO:tasks.ceph.mds.d.smithi184.stderr: 2023-07-11T00:47:06.320 INFO:tasks.ceph.mds.d.smithi184.stderr: -1> 2023-07-11T00:47:06.272+0000 7ff9aafea700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7ff9aafea700 time 2023-07-11T00:47:06.223750+0000 2023-07-11T00:47:06.321 INFO:tasks.ceph.mds.d.smithi184.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-11T00:47:06.321 INFO:tasks.ceph.mds.d.smithi184.stderr: 2023-07-11T00:47:06.321 INFO:tasks.ceph.mds.d.smithi184.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-11T00:47:06.321 INFO:tasks.ceph.mds.d.smithi184.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff9c14a8dbf] 2023-07-11T00:47:06.321 INFO:tasks.ceph.mds.d.smithi184.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7ff9c14a8f85] 2023-07-11T00:47:06.322 INFO:tasks.ceph.mds.d.smithi184.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x557fdcaf2bc2] 2023-07-11T00:47:06.322 INFO:tasks.ceph.mds.d.smithi184.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x557fdcadae5c] 2023-07-11T00:47:06.322 INFO:tasks.ceph.mds.d.smithi184.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x557fdcae3a37] 2023-07-11T00:47:06.322 INFO:tasks.ceph.mds.d.smithi184.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x557fdcae82af] 2023-07-11T00:47:06.322 INFO:tasks.ceph.mds.d.smithi184.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x557fdc93a137] 2023-07-11T00:47:06.322 INFO:tasks.ceph.mds.d.smithi184.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x557fdc93afe0] 2023-07-11T00:47:06.323 INFO:tasks.ceph.mds.d.smithi184.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x557fdc93cee5] 2023-07-11T00:47:06.323 INFO:tasks.ceph.mds.d.smithi184.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x557fdc9c3585] 2023-07-11T00:47:06.323 INFO:tasks.ceph.mds.d.smithi184.stderr: 11: (MDSContext::complete(int)+0x5f) [0x557fdcc2179f] 2023-07-11T00:47:06.323 INFO:tasks.ceph.mds.d.smithi184.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x557fdcc21f24] 2023-07-11T00:47:06.323 INFO:tasks.ceph.mds.d.smithi184.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x557fdcc222db] 2023-07-11T00:47:06.323 INFO:tasks.ceph.mds.d.smithi184.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7ff9c154c93d] 2023-07-11T00:47:06.324 INFO:tasks.ceph.mds.d.smithi184.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff9bf8081ca] 2023-07-11T00:47:06.324 INFO:tasks.ceph.mds.d.smithi184.stderr: 16: clone() 2023-07-11T00:47:06.324 INFO:tasks.ceph.mds.d.smithi184.stderr: 2023-07-11T00:47:06.324 INFO:tasks.ceph.mds.d.smithi184.stderr: 0> 2023-07-11T00:47:06.275+0000 7ff9aafea700 -1 *** Caught signal (Aborted) ** 2023-07-11T00:47:06.324 INFO:tasks.ceph.mds.d.smithi184.stderr: in thread 7ff9aafea700 thread_name:MR_Finisher 2023-07-11T00:47:06.324 INFO:tasks.ceph.mds.d.smithi184.stderr: 2023-07-11T00:47:06.324 INFO:tasks.ceph.mds.d.smithi184.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-11T00:47:06.325 INFO:tasks.ceph.mds.d.smithi184.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7ff9bf812cf0] 2023-07-11T00:47:06.325 INFO:tasks.ceph.mds.d.smithi184.stderr: 2: gsignal() 2023-07-11T00:47:06.325 INFO:tasks.ceph.mds.d.smithi184.stderr: 3: abort() 2023-07-11T00:47:06.325 INFO:tasks.ceph.mds.d.smithi184.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff9c14a8e19] 2023-07-11T00:47:06.325 INFO:tasks.ceph.mds.d.smithi184.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7ff9c14a8f85] 2023-07-11T00:47:06.325 INFO:tasks.ceph.mds.d.smithi184.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x557fdcaf2bc2] 2023-07-11T00:47:06.325 INFO:tasks.ceph.mds.d.smithi184.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x557fdcadae5c] 2023-07-11T00:47:06.326 INFO:tasks.ceph.mds.d.smithi184.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x557fdcae3a37] 2023-07-11T00:47:06.326 INFO:tasks.ceph.mds.d.smithi184.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x557fdcae82af] 2023-07-11T00:47:06.326 INFO:tasks.ceph.mds.d.smithi184.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x557fdc93a137] 2023-07-11T00:47:06.326 INFO:tasks.ceph.mds.d.smithi184.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x557fdc93afe0] 2023-07-11T00:47:06.326 INFO:tasks.ceph.mds.d.smithi184.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x557fdc93cee5] 2023-07-11T00:47:06.326 INFO:tasks.ceph.mds.d.smithi184.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x557fdc9c3585] 2023-07-11T00:47:06.327 INFO:tasks.ceph.mds.d.smithi184.stderr: 14: (MDSContext::complete(int)+0x5f) [0x557fdcc2179f] 2023-07-11T00:47:06.327 INFO:tasks.ceph.mds.d.smithi184.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x557fdcc21f24] 2023-07-11T00:47:06.327 INFO:tasks.ceph.mds.d.smithi184.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x557fdcc222db] 2023-07-11T00:47:06.328 INFO:tasks.ceph.mds.d.smithi184.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7ff9c154c93d] 2023-07-11T00:47:06.328 INFO:tasks.ceph.mds.d.smithi184.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7ff9bf8081ca] 2023-07-11T00:47:06.328 INFO:tasks.ceph.mds.d.smithi184.stderr: 19: clone() 2023-07-11T00:47:06.328 INFO:tasks.ceph.mds.d.smithi184.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-11T00:47:06.328 INFO:tasks.ceph.mds.d.smithi184.stderr: 2023-07-11T00:47:06.334 INFO:tasks.ceph.mds.d.smithi184.stderr: -12> 2023-07-11T00:47:06.272+0000 7ff9aafea700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7ff9aafea700 time 2023-07-11T00:47:06.223750+0000 2023-07-11T00:47:06.335 INFO:tasks.ceph.mds.d.smithi184.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-11T00:47:06.335 INFO:tasks.ceph.mds.d.smithi184.stderr: 2023-07-11T00:47:06.335 INFO:tasks.ceph.mds.d.smithi184.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-11T00:47:06.336 INFO:tasks.ceph.mds.d.smithi184.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff9c14a8dbf] 2023-07-11T00:47:06.336 INFO:tasks.ceph.mds.d.smithi184.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7ff9c14a8f85] 2023-07-11T00:47:06.336 INFO:tasks.ceph.mds.d.smithi184.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x557fdcaf2bc2] 2023-07-11T00:47:06.337 INFO:tasks.ceph.mds.d.smithi184.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x557fdcadae5c] 2023-07-11T00:47:06.337 INFO:tasks.ceph.mds.d.smithi184.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x557fdcae3a37] 2023-07-11T00:47:06.337 INFO:tasks.ceph.mds.d.smithi184.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x557fdcae82af] 2023-07-11T00:47:06.337 INFO:tasks.ceph.mds.d.smithi184.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x557fdc93a137] 2023-07-11T00:47:06.338 INFO:tasks.ceph.mds.d.smithi184.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x557fdc93afe0] 2023-07-11T00:47:06.338 INFO:tasks.ceph.mds.d.smithi184.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x557fdc93cee5] 2023-07-11T00:47:06.338 INFO:tasks.ceph.mds.d.smithi184.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x557fdc9c3585] 2023-07-11T00:47:06.338 INFO:tasks.ceph.mds.d.smithi184.stderr: 11: (MDSContext::complete(int)+0x5f) [0x557fdcc2179f] 2023-07-11T00:47:06.338 INFO:tasks.ceph.mds.d.smithi184.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x557fdcc21f24] 2023-07-11T00:47:06.338 INFO:tasks.ceph.mds.d.smithi184.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x557fdcc222db] 2023-07-11T00:47:06.338 INFO:tasks.ceph.mds.d.smithi184.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7ff9c154c93d] 2023-07-11T00:47:06.338 INFO:tasks.ceph.mds.d.smithi184.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff9bf8081ca] 2023-07-11T00:47:06.339 INFO:tasks.ceph.mds.d.smithi184.stderr: 16: clone() 2023-07-11T00:47:06.339 INFO:tasks.ceph.mds.d.smithi184.stderr: 2023-07-11T00:47:06.339 INFO:tasks.ceph.mds.d.smithi184.stderr: -11> 2023-07-11T00:47:06.275+0000 7ff9aafea700 -1 *** Caught signal (Aborted) ** 2023-07-11T00:47:06.339 INFO:tasks.ceph.mds.d.smithi184.stderr: in thread 7ff9aafea700 thread_name:MR_Finisher 2023-07-11T00:47:06.339 INFO:tasks.ceph.mds.d.smithi184.stderr: 2023-07-11T00:47:06.339 INFO:tasks.ceph.mds.d.smithi184.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-11T00:47:06.339 INFO:tasks.ceph.mds.d.smithi184.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7ff9bf812cf0] 2023-07-11T00:47:06.340 INFO:tasks.ceph.mds.d.smithi184.stderr: 2: gsignal() 2023-07-11T00:47:06.340 INFO:tasks.ceph.mds.d.smithi184.stderr: 3: abort() 2023-07-11T00:47:06.340 INFO:tasks.ceph.mds.d.smithi184.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff9c14a8e19] 2023-07-11T00:47:06.340 INFO:tasks.ceph.mds.d.smithi184.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7ff9c14a8f85] 2023-07-11T00:47:06.340 INFO:tasks.ceph.mds.d.smithi184.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x557fdcaf2bc2] 2023-07-11T00:47:06.340 INFO:tasks.ceph.mds.d.smithi184.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x557fdcadae5c] 2023-07-11T00:47:06.340 INFO:tasks.ceph.mds.d.smithi184.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x557fdcae3a37] 2023-07-11T00:47:06.341 INFO:tasks.ceph.mds.d.smithi184.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x557fdcae82af] 2023-07-11T00:47:06.341 INFO:tasks.ceph.mds.d.smithi184.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x557fdc93a137] 2023-07-11T00:47:06.341 INFO:tasks.ceph.mds.d.smithi184.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x557fdc93afe0] 2023-07-11T00:47:06.341 INFO:tasks.ceph.mds.d.smithi184.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x557fdc93cee5] 2023-07-11T00:47:06.341 INFO:tasks.ceph.mds.d.smithi184.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x557fdc9c3585] 2023-07-11T00:47:06.341 INFO:tasks.ceph.mds.d.smithi184.stderr: 14: (MDSContext::complete(int)+0x5f) [0x557fdcc2179f] 2023-07-11T00:47:06.341 INFO:tasks.ceph.mds.d.smithi184.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x557fdcc21f24] 2023-07-11T00:47:06.341 INFO:tasks.ceph.mds.d.smithi184.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x557fdcc222db] 2023-07-11T00:47:06.342 INFO:tasks.ceph.mds.d.smithi184.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7ff9c154c93d] 2023-07-11T00:47:06.342 INFO:tasks.ceph.mds.d.smithi184.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7ff9bf8081ca] 2023-07-11T00:47:06.342 INFO:tasks.ceph.mds.d.smithi184.stderr: 19: clone() 2023-07-11T00:47:06.342 INFO:tasks.ceph.mds.d.smithi184.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-11T00:47:06.342 INFO:tasks.ceph.mds.d.smithi184.stderr: 2023-07-11T00:47:08.436 INFO:tasks.ceph.mds.d.smithi184.stderr:daemon-helper: command crashed with signal 6 2023-07-11T00:47:11.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-07-11T00:47:17.781 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2023-07-11T00:47:24.393 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~13s 2023-07-11T00:47:31.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~20s 2023-07-11T00:47:37.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~26s 2023-07-11T00:47:42.312 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-07-11T00:47:42.310+0000 7fe0ae1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-11T00:47:44.222 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~33s 2023-07-11T00:47:45.816 INFO:teuthology.orchestra.run.smithi022.stdout:generic/084 41s 2023-07-11T00:47:45.857 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/084 2023-07-11T00:47:45.858 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:47:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:45.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:47:45.947 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-07-11T00:47:46.459 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:47:46.471 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:47:46.472 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:47:46.475 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:47:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:47.034 INFO:teuthology.orchestra.run.smithi022.stdout:generic/085 [not run] require 172.21.15.22:6789:/scratch to be valid block disk 2023-07-11T00:47:47.044 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/085 2023-07-11T00:47:47.044 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/085 2023-07-11T00:47:47.044 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:47:47.050 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:47.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:47:47.091 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-07-11T00:47:47.539 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:47:47.551 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:47:47.552 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:47:47.555 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:47:47.555 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:48.086 INFO:teuthology.orchestra.run.smithi022.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-11T00:47:48.096 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/086 2023-07-11T00:47:48.096 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/086 2023-07-11T00:47:48.097 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:47:48.102 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:48.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:47:48.147 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-07-11T00:47:48.600 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:47:48.612 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:47:48.613 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:47:48.616 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:47:48.616 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:49.240 INFO:teuthology.orchestra.run.smithi022.stdout:generic/087 1s 2023-07-11T00:47:49.253 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/087 2023-07-11T00:47:49.253 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:47:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:49.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:47:49.423 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-07-11T00:47:50.082 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:47:50.095 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:47:50.096 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:47:50.098 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:47:50.098 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:50.650 INFO:teuthology.orchestra.run.smithi022.stdout:generic/088 0s 2023-07-11T00:47:50.663 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/088 2023-07-11T00:47:50.663 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-07-11T00:47:50.669 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:50.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-11T00:47:50.814 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.QzQkhuoEboxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-07-11T00:47:50.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~40s 2023-07-11T00:47:51.462 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-07-11T00:47:51.475 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:47:51.476 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-07-11T00:47:51.478 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBToqxkkVHyNBAAhyDYFPgXIVR3KrrPOX9//g== -o context=system_u:object_r:root_t:s0 172.21.15.22:6789:/scratch /tmp/tmp.v9PKeVhYmRscratch 2023-07-11T00:47:51.479 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:47:57.446 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~46s 2023-07-11T00:48:04.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~53s 2023-07-11T00:48:10.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~59s 2023-07-11T00:48:17.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~66s 2023-07-11T00:48:23.895 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~73s 2023-07-11T00:48:30.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~79s 2023-07-11T00:48:37.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~86s 2023-07-11T00:48:43.727 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~93s 2023-07-11T00:48:50.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~99s 2023-07-11T00:48:56.946 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~106s 2023-07-11T00:49:01.717 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:49:01.730 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:49:03.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~112s 2023-07-11T00:49:10.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~119s 2023-07-11T00:49:16.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~126s 2023-07-11T00:49:23.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~132s 2023-07-11T00:49:30.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~139s 2023-07-11T00:49:36.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~145s 2023-07-11T00:49:41.702 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:49:41.707 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:49:43.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~152s 2023-07-11T00:49:49.843 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~159s 2023-07-11T00:49:56.453 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~165s 2023-07-11T00:50:03.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~172s 2023-07-11T00:50:09.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~179s 2023-07-11T00:50:12.319 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:50:12.324 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:50:16.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~185s 2023-07-11T00:50:22.900 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~192s 2023-07-11T00:50:29.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~198s 2023-07-11T00:50:36.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~205s 2023-07-11T00:50:42.446 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:50:42.452 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:50:42.740 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~212s 2023-07-11T00:50:49.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~218s 2023-07-11T00:50:55.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~225s 2023-07-11T00:51:02.571 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~231s 2023-07-11T00:51:09.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~238s 2023-07-11T00:51:12.616 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:51:12.622 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:51:12.792 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-07-11T00:51:12.790+0000 7fe0b21f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 122111) UID: 0 2023-07-11T00:51:15.795 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~245s 2023-07-11T00:51:22.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~251s 2023-07-11T00:51:29.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~258s 2023-07-11T00:51:35.633 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~264s 2023-07-11T00:51:42.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~271s 2023-07-11T00:51:48.857 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~278s 2023-07-11T00:51:55.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~284s 2023-07-11T00:52:02.081 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~291s 2023-07-11T00:52:08.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~298s 2023-07-11T00:52:15.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~304s 2023-07-11T00:52:15.306 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-07-11T00:52:15.306 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:52:15.308 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:52:15.357 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:52:15.357 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:52:15.444 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:52:15.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.696+0000 7ffbabbff700 1 Processor -- start 2023-07-11T00:52:15.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.696+0000 7ffbabbff700 1 -- start start 2023-07-11T00:52:15.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.697+0000 7ffbabbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffba415c460 0x7ffba40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:15.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.697+0000 7ffbabbff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ffba40cf8f0 0x7ffba415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:15.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.697+0000 7ffbabbff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba40d1790 con 0x7ffba40d2640 2023-07-11T00:52:15.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.697+0000 7ffbabbff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba40cedd0 con 0x7ffba40cf8f0 2023-07-11T00:52:15.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.697+0000 7ffbabbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba40cd950 con 0x7ffba415c460 2023-07-11T00:52:15.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.697+0000 7ffba919a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ffba40d2640 0x7ffba40cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45206/0 (socket says 172.21.15.22:45206) 2023-07-11T00:52:15.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.697+0000 7ffba919a700 1 -- 172.21.15.22:0/2199609487 learned_addr learned my addr 172.21.15.22:0/2199609487 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:52:15.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.697+0000 7ffba999b700 1 --2- 172.21.15.22:0/2199609487 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffba415c460 0x7ffba40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:15.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.697+0000 7ffbaa19c700 1 --2- 172.21.15.22:0/2199609487 >> v2:172.21.15.184:3300/0 conn(0x7ffba40cf8f0 0x7ffba415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:15.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.698+0000 7ffba8999700 1 -- 172.21.15.22:0/2199609487 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720864458 0 0) 0x7ffba40d1790 con 0x7ffba40d2640 2023-07-11T00:52:15.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.698+0000 7ffba8999700 1 -- 172.21.15.22:0/2199609487 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb900035b0 con 0x7ffba40d2640 2023-07-11T00:52:15.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.698+0000 7ffba999b700 1 -- 172.21.15.22:0/2199609487 >> v2:172.21.15.184:3300/0 conn(0x7ffba40cf8f0 msgr2=0x7ffba415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:52:15.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.698+0000 7ffba999b700 1 --2- 172.21.15.22:0/2199609487 >> v2:172.21.15.184:3300/0 conn(0x7ffba40cf8f0 0x7ffba415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:15.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.698+0000 7ffba999b700 1 -- 172.21.15.22:0/2199609487 >> v1:172.21.15.22:6789/0 conn(0x7ffba40d2640 legacy=0x7ffba40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:15.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.698+0000 7ffba999b700 1 -- 172.21.15.22:0/2199609487 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba40d14b0 con 0x7ffba415c460 2023-07-11T00:52:15.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.698+0000 7ffbaa19c700 1 --2- 172.21.15.22:0/2199609487 >> v2:172.21.15.184:3300/0 conn(0x7ffba40cf8f0 0x7ffba415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:52:15.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.698+0000 7ffba999b700 1 --2- 172.21.15.22:0/2199609487 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffba415c460 0x7ffba40b59d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009840 tx=0x7ffba0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a33bc68bc5e37b73 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:15.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.699+0000 7ffba8999700 1 -- 172.21.15.22:0/2199609487 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba0011830 con 0x7ffba415c460 2023-07-11T00:52:15.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.699+0000 7ffba8999700 1 -- 172.21.15.22:0/2199609487 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba0011990 con 0x7ffba415c460 2023-07-11T00:52:15.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.699+0000 7ffba8999700 1 -- 172.21.15.22:0/2199609487 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba0011d20 con 0x7ffba415c460 2023-07-11T00:52:15.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.699+0000 7ffbabbff700 1 -- 172.21.15.22:0/2199609487 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffba415c460 msgr2=0x7ffba40b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:15.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.699+0000 7ffbabbff700 1 --2- 172.21.15.22:0/2199609487 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffba415c460 0x7ffba40b59d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009840 tx=0x7ffba0009b50 comp rx=0 tx=0).stop 2023-07-11T00:52:15.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.699+0000 7ffbabbff700 1 -- 172.21.15.22:0/2199609487 shutdown_connections 2023-07-11T00:52:15.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.699+0000 7ffbabbff700 1 --2- 172.21.15.22:0/2199609487 >> v2:172.21.15.184:3300/0 conn(0x7ffba40cf8f0 0x7ffba415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:15.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.699+0000 7ffbabbff700 1 --2- 172.21.15.22:0/2199609487 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffba415c460 0x7ffba40b59d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:15.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.699+0000 7ffbabbff700 1 -- 172.21.15.22:0/2199609487 >> 172.21.15.22:0/2199609487 conn(0x7ffba4071660 msgr2=0x7ffba4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:52:15.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.699+0000 7ffbabbff700 1 -- 172.21.15.22:0/2199609487 shutdown_connections 2023-07-11T00:52:15.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.699+0000 7ffbabbff700 1 -- 172.21.15.22:0/2199609487 wait complete. 2023-07-11T00:52:15.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.701+0000 7ffbabbff700 1 Processor -- start 2023-07-11T00:52:15.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.702+0000 7ffbabbff700 1 -- start start 2023-07-11T00:52:15.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.703+0000 7ffbabbff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffba40cf8f0 0x7ffba415ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:15.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.703+0000 7ffbabbff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffba40d2640 0x7ffba40c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:15.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.703+0000 7ffbabbff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffba415c460 0x7ffba415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:15.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.703+0000 7ffbabbff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba40c8030 con 0x7ffba40cf8f0 2023-07-11T00:52:15.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.703+0000 7ffbabbff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba40c7440 con 0x7ffba40d2640 2023-07-11T00:52:15.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.703+0000 7ffbabbff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba40c7690 con 0x7ffba415c460 2023-07-11T00:52:15.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.703+0000 7ffba999b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffba40cf8f0 0x7ffba415ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:15.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.703+0000 7ffba999b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffba40cf8f0 0x7ffba415ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58674/0 (socket says 172.21.15.22:58674) 2023-07-11T00:52:15.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.703+0000 7ffba999b700 1 -- 172.21.15.22:0/1557623786 learned_addr learned my addr 172.21.15.22:0/1557623786 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:52:15.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.703+0000 7ffba919a700 1 --2- 172.21.15.22:0/1557623786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffba40d2640 0x7ffba40c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:15.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.703+0000 7ffbaa19c700 1 --2- 172.21.15.22:0/1557623786 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffba415c460 0x7ffba415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:15.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.703+0000 7ffba999b700 1 -- 172.21.15.22:0/1557623786 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffba415c460 msgr2=0x7ffba415cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:15.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.703+0000 7ffba999b700 1 --2- 172.21.15.22:0/1557623786 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffba415c460 0x7ffba415cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:15.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.703+0000 7ffba999b700 1 -- 172.21.15.22:0/1557623786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffba40d2640 msgr2=0x7ffba40c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:15.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.703+0000 7ffba999b700 1 --2- 172.21.15.22:0/1557623786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffba40d2640 0x7ffba40c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:15.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.703+0000 7ffba999b700 1 -- 172.21.15.22:0/1557623786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c009a70 con 0x7ffba40cf8f0 2023-07-11T00:52:15.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.704+0000 7ffbaa19c700 1 --2- 172.21.15.22:0/1557623786 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffba415c460 0x7ffba415cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:52:15.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.704+0000 7ffba919a700 1 --2- 172.21.15.22:0/1557623786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffba40d2640 0x7ffba40c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:52:15.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.704+0000 7ffba999b700 1 --2- 172.21.15.22:0/1557623786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffba40cf8f0 0x7ffba415ef20 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ffba0000c00 tx=0x7ffba0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:15.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.704+0000 7ffb9a7fc700 1 -- 172.21.15.22:0/1557623786 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba00036a0 con 0x7ffba40cf8f0 2023-07-11T00:52:15.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.704+0000 7ffb9a7fc700 1 -- 172.21.15.22:0/1557623786 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba001f070 con 0x7ffba40cf8f0 2023-07-11T00:52:15.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.704+0000 7ffb9a7fc700 1 -- 172.21.15.22:0/1557623786 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba0003a40 con 0x7ffba40cf8f0 2023-07-11T00:52:15.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.704+0000 7ffbabbff700 1 -- 172.21.15.22:0/1557623786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba00094a0 con 0x7ffba40cf8f0 2023-07-11T00:52:15.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.704+0000 7ffbabbff700 1 -- 172.21.15.22:0/1557623786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba40c7c50 con 0x7ffba40cf8f0 2023-07-11T00:52:15.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.705+0000 7ffbabbff700 1 -- 172.21.15.22:0/1557623786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba404ea60 con 0x7ffba40cf8f0 2023-07-11T00:52:15.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.706+0000 7ffb9a7fc700 1 -- 172.21.15.22:0/1557623786 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffba0003ba0 con 0x7ffba40cf8f0 2023-07-11T00:52:15.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.707+0000 7ffb9a7fc700 1 --2- 172.21.15.22:0/1557623786 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ffb8806ace0 0x7ffb8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:15.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.707+0000 7ffb9a7fc700 1 -- 172.21.15.22:0/1557623786 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6526+0+0 (secure 0 0 0) 0x7ffba0021070 con 0x7ffba40cf8f0 2023-07-11T00:52:15.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.708+0000 7ffba919a700 1 --2- 172.21.15.22:0/1557623786 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ffb8806ace0 0x7ffb8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:15.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.708+0000 7ffba919a700 1 --2- 172.21.15.22:0/1557623786 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ffb8806ace0 0x7ffb8806d190 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffba40d2030 tx=0x7ffb94009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:15.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.713+0000 7ffb9a7fc700 1 -- 172.21.15.22:0/1557623786 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ffba0055df0 con 0x7ffba40cf8f0 2023-07-11T00:52:15.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.956+0000 7ffbabbff700 1 -- 172.21.15.22:0/1557623786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffba40b4fa0 con 0x7ffba40cf8f0 2023-07-11T00:52:15.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.962+0000 7ffb9a7fc700 1 -- 172.21.15.22:0/1557623786 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18665 (secure 0 0 0) 0x7ffba002b090 con 0x7ffba40cf8f0 2023-07-11T00:52:15.965 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-11T00:52:15.965 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":41,"fsid":"c306ab0a-3faf-4f52-9dba-c4f0807b892e","created":"2023-07-11T00:29:44.975787+0000","modified":"2023-07-11T00:47:25.487746+0000","last_up_change":"2023-07-11T00:29:57.032284+0000","last_in_change":"2023-07-11T00:29:48.358468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:29:57.631007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:29:58.547599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:31:47.379034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-11T00:31:47.929557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abf82eea-e633-4560-8c0c-3d84c1b2e588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6817","nonce":3770043857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6819","nonce":3770043857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6828","nonce":3770043857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3770043857},{"type":"v1","addr":"172.21.15.22:6823","nonce":3770043857}]},"public_addr":"172.21.15.22:6817/3770043857","cluster_addr":"172.21.15.22:6819/3770043857","heartbeat_back_addr":"172.21.15.22:6828/3770043857","heartbeat_front_addr":"172.21.15.22:6823/3770043857","state":["exists","up"]},{"osd":1,"uuid":"ad893bc1-d378-46b2-ba64-ae1284ddbe40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6801","nonce":1848675559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6803","nonce":1848675559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6807","nonce":1848675559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1848675559},{"type":"v1","addr":"172.21.15.22:6805","nonce":1848675559}]},"public_addr":"172.21.15.22:6801/1848675559","cluster_addr":"172.21.15.22:6803/1848675559","heartbeat_back_addr":"172.21.15.22:6807/1848675559","heartbeat_front_addr":"172.21.15.22:6805/1848675559","state":["exists","up"]},{"osd":2,"uuid":"e4e14ad2-14ce-486d-ac23-d7c5652be546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6822","nonce":3888588990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6825","nonce":3888588990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6831","nonce":3888588990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":3888588990},{"type":"v1","addr":"172.21.15.22:6829","nonce":3888588990}]},"public_addr":"172.21.15.22:6822/3888588990","cluster_addr":"172.21.15.22:6825/3888588990","heartbeat_back_addr":"172.21.15.22:6831/3888588990","heartbeat_front_addr":"172.21.15.22:6829/3888588990","state":["exists","up"]},{"osd":3,"uuid":"4845d466-fe99-42e5-a783-337f0cc8a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6809","nonce":3717370188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6811","nonce":3717370188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6815","nonce":3717370188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3717370188},{"type":"v1","addr":"172.21.15.22:6813","nonce":3717370188}]},"public_addr":"172.21.15.22:6809/3717370188","cluster_addr":"172.21.15.22:6811/3717370188","heartbeat_back_addr":"172.21.15.22:6815/3717370188","heartbeat_front_addr":"172.21.15.22:6813/3717370188","state":["exists","up"]},{"osd":4,"uuid":"07d4bc04-8ba6-4d2e-b9a9-679d1658df83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6811","nonce":1848255557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6816","nonce":1848255557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6828","nonce":1848255557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":1848255557},{"type":"v1","addr":"172.21.15.184:6822","nonce":1848255557}]},"public_addr":"172.21.15.184:6811/1848255557","cluster_addr":"172.21.15.184:6816/1848255557","heartbeat_back_addr":"172.21.15.184:6828/1848255557","heartbeat_front_addr":"172.21.15.184:6822/1848255557","state":["exists","up"]},{"osd":5,"uuid":"3ce2a7a0-15bd-40f6-9071-f14c4a96e64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6801","nonce":506475721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6803","nonce":506475721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6807","nonce":506475721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":506475721},{"type":"v1","addr":"172.21.15.184:6805","nonce":506475721}]},"public_addr":"172.21.15.184:6801/506475721","cluster_addr":"172.21.15.184:6803/506475721","heartbeat_back_addr":"172.21.15.184:6807/506475721","heartbeat_front_addr":"172.21.15.184:6805/506475721","state":["exists","up"]},{"osd":6,"uuid":"10a29618-c952-46b4-8b57-2a31fa82cd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6812","nonce":1254324024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6818","nonce":1254324024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6827","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6829","nonce":1254324024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":1254324024},{"type":"v1","addr":"172.21.15.184:6824","nonce":1254324024}]},"public_addr":"172.21.15.184:6812/1254324024","cluster_addr":"172.21.15.184:6818/1254324024","heartbeat_back_addr":"172.21.15.184:6829/1254324024","heartbeat_front_addr":"172.21.15.184:6824/1254324024","state":["exists","up"]},{"osd":7,"uuid":"b83ace85-e5fc-42b5-8db9-6ac4c187acad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6813","nonce":3866238767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6820","nonce":3866238767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6831","nonce":3866238767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":3866238767},{"type":"v1","addr":"172.21.15.184:6826","nonce":3866238767}]},"public_addr":"172.21.15.184:6813/3866238767","cluster_addr":"172.21.15.184:6820/3866238767","heartbeat_back_addr":"172.21.15.184:6831/3866238767","heartbeat_front_addr":"172.21.15.184:6826/3866238767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:54.024540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.607920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.709981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.672148+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.951209+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.645536+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.665657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:29:53.661737+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.38","mappings":[{"from":0,"to":4}]},{"pgid":"7.3c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6837/2685786652":"2023-07-12T00:47:25.487620+0000","172.21.15.184:6835/2685786652":"2023-07-12T00:47:25.487620+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:52:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.970+0000 7ffbabbff700 1 -- 172.21.15.22:0/1557623786 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ffb8806ace0 msgr2=0x7ffb8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.970+0000 7ffbabbff700 1 --2- 172.21.15.22:0/1557623786 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ffb8806ace0 0x7ffb8806d190 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffba40d2030 tx=0x7ffb94009040 comp rx=0 tx=0).stop 2023-07-11T00:52:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.970+0000 7ffbabbff700 1 -- 172.21.15.22:0/1557623786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffba40cf8f0 msgr2=0x7ffba415ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.970+0000 7ffbabbff700 1 --2- 172.21.15.22:0/1557623786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffba40cf8f0 0x7ffba415ef20 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ffba0000c00 tx=0x7ffba0004750 comp rx=0 tx=0).stop 2023-07-11T00:52:15.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.984+0000 7ffbabbff700 1 -- 172.21.15.22:0/1557623786 shutdown_connections 2023-07-11T00:52:15.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.984+0000 7ffbabbff700 1 --2- 172.21.15.22:0/1557623786 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7ffb8806ace0 0x7ffb8806d190 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:15.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.984+0000 7ffbabbff700 1 --2- 172.21.15.22:0/1557623786 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffba415c460 0x7ffba415cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:15.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.984+0000 7ffbabbff700 1 --2- 172.21.15.22:0/1557623786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffba40cf8f0 0x7ffba415ef20 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:15.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.984+0000 7ffbabbff700 1 --2- 172.21.15.22:0/1557623786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffba40d2640 0x7ffba40c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:15.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.984+0000 7ffbabbff700 1 -- 172.21.15.22:0/1557623786 >> 172.21.15.22:0/1557623786 conn(0x7ffba4071660 msgr2=0x7ffba4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:52:15.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.990+0000 7ffbabbff700 1 -- 172.21.15.22:0/1557623786 shutdown_connections 2023-07-11T00:52:15.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:15.995+0000 7ffbabbff700 1 -- 172.21.15.22:0/1557623786 wait complete. 2023-07-11T00:52:16.033 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:29:57.631007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:29:58.547599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:31:47.379034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:31:47.929557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-11T00:52:16.034 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:52:16.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.252+0000 7f65d95ff700 1 Processor -- start 2023-07-11T00:52:16.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.252+0000 7f65d95ff700 1 -- start start 2023-07-11T00:52:16.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.254+0000 7f65d95ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f65d40cd0c0 0x7f65d4069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:16.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.254+0000 7f65d95ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d40c4e90 con 0x7f65d40cd530 2023-07-11T00:52:16.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.254+0000 7f65d95ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d40c4280 con 0x7f65d415c270 2023-07-11T00:52:16.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.254+0000 7f65d95ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d40c5a30 con 0x7f65d40cd0c0 2023-07-11T00:52:16.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.254+0000 7f65d37fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f65d40cd530 0x7f65d40c9310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45214/0 (socket says 172.21.15.22:45214) 2023-07-11T00:52:16.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.254+0000 7f65d37fe700 1 -- 172.21.15.22:0/2550298933 learned_addr learned my addr 172.21.15.22:0/2550298933 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:52:16.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.254+0000 7f65d27fc700 1 --2- 172.21.15.22:0/2550298933 >> v2:172.21.15.184:3300/0 conn(0x7f65d40cd0c0 0x7f65d4069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:16.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.254+0000 7f65d1ffb700 1 -- 172.21.15.22:0/2550298933 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885538163 0 0) 0x7f65d40c4e90 con 0x7f65d40cd530 2023-07-11T00:52:16.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.254+0000 7f65d1ffb700 1 -- 172.21.15.22:0/2550298933 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65bc0035b0 con 0x7f65d40cd530 2023-07-11T00:52:16.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.254+0000 7f65d1ffb700 1 -- 172.21.15.22:0/2550298933 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763860816 0 0) 0x7f65d40c4280 con 0x7f65d415c270 2023-07-11T00:52:16.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.254+0000 7f65d1ffb700 1 -- 172.21.15.22:0/2550298933 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65d40c4e90 con 0x7f65d415c270 2023-07-11T00:52:16.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.255+0000 7f65d27fc700 1 -- 172.21.15.22:0/2550298933 >> v1:172.21.15.184:6789/0 conn(0x7f65d415c270 legacy=0x7f65d40c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:16.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.255+0000 7f65d27fc700 1 -- 172.21.15.22:0/2550298933 >> v1:172.21.15.22:6789/0 conn(0x7f65d40cd530 legacy=0x7f65d40c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:16.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.255+0000 7f65d27fc700 1 -- 172.21.15.22:0/2550298933 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d40c4560 con 0x7f65d40cd0c0 2023-07-11T00:52:16.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.255+0000 7f65d27fc700 1 --2- 172.21.15.22:0/2550298933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65d40cd0c0 0x7f65d4069f30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f65c8009840 tx=0x7f65c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58e650160d8fca25 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:16.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.255+0000 7f65d1ffb700 1 -- 172.21.15.22:0/2550298933 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c8011830 con 0x7f65d40cd0c0 2023-07-11T00:52:16.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.255+0000 7f65d1ffb700 1 -- 172.21.15.22:0/2550298933 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c8011990 con 0x7f65d40cd0c0 2023-07-11T00:52:16.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.255+0000 7f65d1ffb700 1 -- 172.21.15.22:0/2550298933 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c8011d20 con 0x7f65d40cd0c0 2023-07-11T00:52:16.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.256+0000 7f65d95ff700 1 -- 172.21.15.22:0/2550298933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65d40cd0c0 msgr2=0x7f65d4069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:16.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.256+0000 7f65d95ff700 1 --2- 172.21.15.22:0/2550298933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65d40cd0c0 0x7f65d4069f30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f65c8009840 tx=0x7f65c8009b50 comp rx=0 tx=0).stop 2023-07-11T00:52:16.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.256+0000 7f65d95ff700 1 -- 172.21.15.22:0/2550298933 shutdown_connections 2023-07-11T00:52:16.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.256+0000 7f65d95ff700 1 --2- 172.21.15.22:0/2550298933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65d40cd0c0 0x7f65d4069f30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.256+0000 7f65d95ff700 1 -- 172.21.15.22:0/2550298933 >> 172.21.15.22:0/2550298933 conn(0x7f65d40ceae0 msgr2=0x7f65d40ceee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:52:16.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.256+0000 7f65d95ff700 1 -- 172.21.15.22:0/2550298933 shutdown_connections 2023-07-11T00:52:16.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.256+0000 7f65d95ff700 1 -- 172.21.15.22:0/2550298933 wait complete. 2023-07-11T00:52:16.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.258+0000 7f65d95ff700 1 Processor -- start 2023-07-11T00:52:16.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.258+0000 7f65d95ff700 1 -- start start 2023-07-11T00:52:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.259+0000 7f65d95ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65d40cd0c0 0x7f65d40c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:16.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.259+0000 7f65d95ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65d40cd530 0x7f65d4152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.259+0000 7f65d95ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d415c270 0x7f65d40af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.259+0000 7f65d95ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40afb20 con 0x7f65d415c270 2023-07-11T00:52:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.259+0000 7f65d95ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d41593f0 con 0x7f65d40cd0c0 2023-07-11T00:52:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.259+0000 7f65d95ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40afd50 con 0x7f65d40cd530 2023-07-11T00:52:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.260+0000 7f65d37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d415c270 0x7f65d40af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.260+0000 7f65d27fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65d40cd530 0x7f65d4152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.260+0000 7f65d27fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65d40cd530 0x7f65d4152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.22:59718/0 (socket says 172.21.15.22:59718) 2023-07-11T00:52:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.260+0000 7f65d27fc700 1 -- 172.21.15.22:0/1679204380 learned_addr learned my addr 172.21.15.22:0/1679204380 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:52:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.260+0000 7f65d2ffd700 1 --2- 172.21.15.22:0/1679204380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65d40cd0c0 0x7f65d40c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.260+0000 7f65d37fe700 1 -- 172.21.15.22:0/1679204380 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65d40cd530 msgr2=0x7f65d4152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.260+0000 7f65d37fe700 1 --2- 172.21.15.22:0/1679204380 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65d40cd530 0x7f65d4152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.260+0000 7f65d37fe700 1 -- 172.21.15.22:0/1679204380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65d40cd0c0 msgr2=0x7f65d40c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.260+0000 7f65d37fe700 1 --2- 172.21.15.22:0/1679204380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65d40cd0c0 0x7f65d40c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.260+0000 7f65d37fe700 1 -- 172.21.15.22:0/1679204380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c80094a0 con 0x7f65d415c270 2023-07-11T00:52:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.260+0000 7f65d27fc700 1 --2- 172.21.15.22:0/1679204380 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65d40cd530 0x7f65d4152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:52:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.260+0000 7f65d37fe700 1 --2- 172.21.15.22:0/1679204380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d415c270 0x7f65d40af5e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f65d40cd970 tx=0x7f65cc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.260+0000 7f65bb7fe700 1 -- 172.21.15.22:0/1679204380 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc00a9e0 con 0x7f65d415c270 2023-07-11T00:52:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.261+0000 7f65bb7fe700 1 -- 172.21.15.22:0/1679204380 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65cc00ab40 con 0x7f65d415c270 2023-07-11T00:52:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.261+0000 7f65bb7fe700 1 -- 172.21.15.22:0/1679204380 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc012400 con 0x7f65d415c270 2023-07-11T00:52:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.261+0000 7f65d95ff700 1 -- 172.21.15.22:0/1679204380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d40b0030 con 0x7f65d415c270 2023-07-11T00:52:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.261+0000 7f65d95ff700 1 -- 172.21.15.22:0/1679204380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d4159920 con 0x7f65d415c270 2023-07-11T00:52:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.262+0000 7f65d95ff700 1 -- 172.21.15.22:0/1679204380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d40b0270 con 0x7f65d415c270 2023-07-11T00:52:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.263+0000 7f65bb7fe700 1 -- 172.21.15.22:0/1679204380 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f65cc01b3b0 con 0x7f65d415c270 2023-07-11T00:52:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.264+0000 7f65bb7fe700 1 --2- 172.21.15.22:0/1679204380 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f65c006ace0 0x7f65c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.264+0000 7f65bb7fe700 1 -- 172.21.15.22:0/1679204380 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f65cc0891c0 con 0x7f65d415c270 2023-07-11T00:52:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.264+0000 7f65d2ffd700 1 --2- 172.21.15.22:0/1679204380 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f65c006ace0 0x7f65c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.265+0000 7f65d2ffd700 1 --2- 172.21.15.22:0/1679204380 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f65c006ace0 0x7f65c006d190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f65c4001220 tx=0x7f65c4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.269+0000 7f65bb7fe700 1 -- 172.21.15.22:0/1679204380 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f65cc054130 con 0x7f65d415c270 2023-07-11T00:52:16.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.486+0000 7f65d95ff700 1 -- 172.21.15.22:0/1679204380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f65d404ea60 con 0x7f65d415c270 2023-07-11T00:52:16.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.487+0000 7f65bb7fe700 1 -- 172.21.15.22:0/1679204380 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7f65cc057750 con 0x7f65d415c270 2023-07-11T00:52:16.489 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2023-07-11T00:52:16.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.489+0000 7f65d95ff700 1 -- 172.21.15.22:0/1679204380 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f65c006ace0 msgr2=0x7f65c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:16.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.489+0000 7f65d95ff700 1 --2- 172.21.15.22:0/1679204380 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f65c006ace0 0x7f65c006d190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f65c4001220 tx=0x7f65c4009040 comp rx=0 tx=0).stop 2023-07-11T00:52:16.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.489+0000 7f65d95ff700 1 -- 172.21.15.22:0/1679204380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d415c270 msgr2=0x7f65d40af5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:16.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.489+0000 7f65d95ff700 1 --2- 172.21.15.22:0/1679204380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d415c270 0x7f65d40af5e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f65d40cd970 tx=0x7f65cc00cd50 comp rx=0 tx=0).stop 2023-07-11T00:52:16.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.489+0000 7f65d95ff700 1 -- 172.21.15.22:0/1679204380 shutdown_connections 2023-07-11T00:52:16.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.489+0000 7f65d95ff700 1 --2- 172.21.15.22:0/1679204380 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f65c006ace0 0x7f65c006d190 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.489+0000 7f65d95ff700 1 --2- 172.21.15.22:0/1679204380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d415c270 0x7f65d40af5e0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.489+0000 7f65d95ff700 1 --2- 172.21.15.22:0/1679204380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65d40cd0c0 0x7f65d40c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.489+0000 7f65d95ff700 1 --2- 172.21.15.22:0/1679204380 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65d40cd530 0x7f65d4152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.489+0000 7f65d95ff700 1 -- 172.21.15.22:0/1679204380 >> 172.21.15.22:0/1679204380 conn(0x7f65d40ceae0 msgr2=0x7f65d40c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:52:16.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.489+0000 7f65d95ff700 1 -- 172.21.15.22:0/1679204380 shutdown_connections 2023-07-11T00:52:16.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.489+0000 7f65d95ff700 1 -- 172.21.15.22:0/1679204380 wait complete. 2023-07-11T00:52:16.510 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:52:16.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.722+0000 7f32947ff700 1 Processor -- start 2023-07-11T00:52:16.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.722+0000 7f32947ff700 1 -- start start 2023-07-11T00:52:16.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.723+0000 7f32947ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f328c0cc700 0x7f328c06cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:16.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.723+0000 7f32947ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f328c0afdb0 0x7f328c0cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:16.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.723+0000 7f32947ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f328c0d0460 0x7f328c15fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:16.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.723+0000 7f32947ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f328c15c6f0 con 0x7f328c0cc700 2023-07-11T00:52:16.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.723+0000 7f32947ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f328c0ce530 con 0x7f328c0afdb0 2023-07-11T00:52:16.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.723+0000 7f32947ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328c070ce0 con 0x7f328c0d0460 2023-07-11T00:52:16.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.723+0000 7f329259b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f328c0cc700 0x7f328c06cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:16.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.723+0000 7f329259b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f328c0cc700 0x7f328c06cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58698/0 (socket says 172.21.15.22:58698) 2023-07-11T00:52:16.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.723+0000 7f329259b700 1 -- 172.21.15.22:0/114401135 learned_addr learned my addr 172.21.15.22:0/114401135 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:52:16.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.723+0000 7f3292d9c700 1 --2- 172.21.15.22:0/114401135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f328c0d0460 0x7f328c15fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:16.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.724+0000 7f3291d9a700 1 --2- 172.21.15.22:0/114401135 >> v2:172.21.15.184:3300/0 conn(0x7f328c0afdb0 0x7f328c0cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:16.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.724+0000 7f329259b700 1 -- 172.21.15.22:0/114401135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f328c0d0460 msgr2=0x7f328c15fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:52:16.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.724+0000 7f329259b700 1 --2- 172.21.15.22:0/114401135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f328c0d0460 0x7f328c15fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.724+0000 7f329259b700 1 -- 172.21.15.22:0/114401135 >> v2:172.21.15.184:3300/0 conn(0x7f328c0afdb0 msgr2=0x7f328c0cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:52:16.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.724+0000 7f329259b700 1 --2- 172.21.15.22:0/114401135 >> v2:172.21.15.184:3300/0 conn(0x7f328c0afdb0 0x7f328c0cff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.724+0000 7f329259b700 1 -- 172.21.15.22:0/114401135 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c070f80 con 0x7f328c0cc700 2023-07-11T00:52:16.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.724+0000 7f329259b700 1 --2- 172.21.15.22:0/114401135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f328c0cc700 0x7f328c06cce0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f328c071170 tx=0x7f3288009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6113273bdc9e7584 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:16.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.724+0000 7f3291599700 1 -- 172.21.15.22:0/114401135 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288004230 con 0x7f328c0cc700 2023-07-11T00:52:16.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.724+0000 7f3291599700 1 -- 172.21.15.22:0/114401135 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3288004390 con 0x7f328c0cc700 2023-07-11T00:52:16.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.724+0000 7f3291599700 1 -- 172.21.15.22:0/114401135 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32880036a0 con 0x7f328c0cc700 2023-07-11T00:52:16.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.725+0000 7f32947ff700 1 -- 172.21.15.22:0/114401135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f328c0cc700 msgr2=0x7f328c06cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:16.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.725+0000 7f32947ff700 1 --2- 172.21.15.22:0/114401135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f328c0cc700 0x7f328c06cce0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f328c071170 tx=0x7f3288009bd0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.725+0000 7f32947ff700 1 -- 172.21.15.22:0/114401135 shutdown_connections 2023-07-11T00:52:16.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.725+0000 7f32947ff700 1 --2- 172.21.15.22:0/114401135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f328c0d0460 0x7f328c15fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.725+0000 7f32947ff700 1 --2- 172.21.15.22:0/114401135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f328c0cc700 0x7f328c06cce0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.725+0000 7f32947ff700 1 --2- 172.21.15.22:0/114401135 >> v2:172.21.15.184:3300/0 conn(0x7f328c0afdb0 0x7f328c0cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.725+0000 7f32947ff700 1 -- 172.21.15.22:0/114401135 >> 172.21.15.22:0/114401135 conn(0x7f328c06e5c0 msgr2=0x7f328c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:52:16.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.725+0000 7f32947ff700 1 -- 172.21.15.22:0/114401135 shutdown_connections 2023-07-11T00:52:16.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.725+0000 7f32947ff700 1 -- 172.21.15.22:0/114401135 wait complete. 2023-07-11T00:52:16.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.727+0000 7f32947ff700 1 Processor -- start 2023-07-11T00:52:16.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.727+0000 7f32947ff700 1 -- start start 2023-07-11T00:52:16.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.728+0000 7f32947ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f328c0afdb0 0x7f328c0c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:16.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.728+0000 7f32947ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f328c0cc700 0x7f328c153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:16.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.728+0000 7f32947ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f328c0d0460 0x7f328c154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:16.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.728+0000 7f32947ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c0b1c50 con 0x7f328c0afdb0 2023-07-11T00:52:16.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.728+0000 7f32947ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c154940 con 0x7f328c0cc700 2023-07-11T00:52:16.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.728+0000 7f32947ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328c0b1390 con 0x7f328c0d0460 2023-07-11T00:52:16.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.728+0000 7f329259b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f328c0afdb0 0x7f328c0c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:16.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.728+0000 7f329259b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f328c0afdb0 0x7f328c0c6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58708/0 (socket says 172.21.15.22:58708) 2023-07-11T00:52:16.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.728+0000 7f329259b700 1 -- 172.21.15.22:0/2489994304 learned_addr learned my addr 172.21.15.22:0/2489994304 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:52:16.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.729+0000 7f3291d9a700 1 --2- 172.21.15.22:0/2489994304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f328c0cc700 0x7f328c153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:16.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.729+0000 7f3292d9c700 1 --2- 172.21.15.22:0/2489994304 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f328c0d0460 0x7f328c154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:16.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.729+0000 7f329259b700 1 -- 172.21.15.22:0/2489994304 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f328c0d0460 msgr2=0x7f328c154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:16.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.729+0000 7f329259b700 1 --2- 172.21.15.22:0/2489994304 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f328c0d0460 0x7f328c154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.729+0000 7f329259b700 1 -- 172.21.15.22:0/2489994304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f328c0cc700 msgr2=0x7f328c153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:16.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.729+0000 7f329259b700 1 --2- 172.21.15.22:0/2489994304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f328c0cc700 0x7f328c153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.729+0000 7f329259b700 1 -- 172.21.15.22:0/2489994304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3288009550 con 0x7f328c0afdb0 2023-07-11T00:52:16.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.729+0000 7f329259b700 1 --2- 172.21.15.22:0/2489994304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f328c0afdb0 0x7f328c0c6a30 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3288009130 tx=0x7f3288004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:16.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.729+0000 7f3282ffd700 1 -- 172.21.15.22:0/2489994304 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32880039a0 con 0x7f328c0afdb0 2023-07-11T00:52:16.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.729+0000 7f3282ffd700 1 -- 172.21.15.22:0/2489994304 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328801f070 con 0x7f328c0afdb0 2023-07-11T00:52:16.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.729+0000 7f3282ffd700 1 -- 172.21.15.22:0/2489994304 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288003d60 con 0x7f328c0afdb0 2023-07-11T00:52:16.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.729+0000 7f32947ff700 1 -- 172.21.15.22:0/2489994304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328c0b1600 con 0x7f328c0afdb0 2023-07-11T00:52:16.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.730+0000 7f32947ff700 1 -- 172.21.15.22:0/2489994304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328c0b64a0 con 0x7f328c0afdb0 2023-07-11T00:52:16.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.731+0000 7f32947ff700 1 -- 172.21.15.22:0/2489994304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328c04ea60 con 0x7f328c0afdb0 2023-07-11T00:52:16.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.732+0000 7f3282ffd700 1 -- 172.21.15.22:0/2489994304 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3288021030 con 0x7f328c0afdb0 2023-07-11T00:52:16.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.733+0000 7f3282ffd700 1 --2- 172.21.15.22:0/2489994304 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f327006ace0 0x7f327006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:16.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.733+0000 7f3282ffd700 1 -- 172.21.15.22:0/2489994304 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f328808ab30 con 0x7f328c0afdb0 2023-07-11T00:52:16.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.733+0000 7f3291d9a700 1 --2- 172.21.15.22:0/2489994304 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f327006ace0 0x7f327006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:16.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.734+0000 7f3291d9a700 1 --2- 172.21.15.22:0/2489994304 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f327006ace0 0x7f327006d190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f327c009be0 tx=0x7f327c009210 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:16.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.737+0000 7f3282ffd700 1 -- 172.21.15.22:0/2489994304 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3288055b20 con 0x7f328c0afdb0 2023-07-11T00:52:16.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.979+0000 7f32947ff700 1 -- 172.21.15.22:0/2489994304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f328c160730 con 0x7f328c0afdb0 2023-07-11T00:52:16.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.979+0000 7f3282ffd700 1 -- 172.21.15.22:0/2489994304 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3288059140 con 0x7f328c0afdb0 2023-07-11T00:52:16.982 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-07-11T00:52:16.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.982+0000 7f32947ff700 1 -- 172.21.15.22:0/2489994304 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f327006ace0 msgr2=0x7f327006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:16.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.982+0000 7f32947ff700 1 --2- 172.21.15.22:0/2489994304 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f327006ace0 0x7f327006d190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f327c009be0 tx=0x7f327c009210 comp rx=0 tx=0).stop 2023-07-11T00:52:16.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.982+0000 7f32947ff700 1 -- 172.21.15.22:0/2489994304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f328c0afdb0 msgr2=0x7f328c0c6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:16.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.982+0000 7f32947ff700 1 --2- 172.21.15.22:0/2489994304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f328c0afdb0 0x7f328c0c6a30 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3288009130 tx=0x7f3288004750 comp rx=0 tx=0).stop 2023-07-11T00:52:16.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.982+0000 7f32947ff700 1 -- 172.21.15.22:0/2489994304 shutdown_connections 2023-07-11T00:52:16.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.982+0000 7f32947ff700 1 --2- 172.21.15.22:0/2489994304 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f327006ace0 0x7f327006d190 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.982+0000 7f32947ff700 1 --2- 172.21.15.22:0/2489994304 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f328c0d0460 0x7f328c154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.982+0000 7f32947ff700 1 --2- 172.21.15.22:0/2489994304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f328c0afdb0 0x7f328c0c6a30 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.982+0000 7f32947ff700 1 --2- 172.21.15.22:0/2489994304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f328c0cc700 0x7f328c153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:16.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.982+0000 7f32947ff700 1 -- 172.21.15.22:0/2489994304 >> 172.21.15.22:0/2489994304 conn(0x7f328c06e5c0 msgr2=0x7f328c15aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:52:16.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.982+0000 7f32947ff700 1 -- 172.21.15.22:0/2489994304 shutdown_connections 2023-07-11T00:52:16.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:16.982+0000 7f32947ff700 1 -- 172.21.15.22:0/2489994304 wait complete. 2023-07-11T00:52:17.003 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:52:17.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.211+0000 7f3d5a9ff700 1 Processor -- start 2023-07-11T00:52:17.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.211+0000 7f3d5a9ff700 1 -- start start 2023-07-11T00:52:17.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.213+0000 7f3d5a9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d540d3730 0x7f3d540cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:17.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.213+0000 7f3d5a9ff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d540d0b20 con 0x7f3d540cfa90 2023-07-11T00:52:17.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.213+0000 7f3d5a9ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d540cfeb0 con 0x7f3d540b8430 2023-07-11T00:52:17.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.213+0000 7f3d5a9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540cda30 con 0x7f3d540d3730 2023-07-11T00:52:17.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.213+0000 7f3d58f9c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3d540cfa90 0x7f3d540d0fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45220/0 (socket says 172.21.15.22:45220) 2023-07-11T00:52:17.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.213+0000 7f3d58f9c700 1 -- 172.21.15.22:0/1386731544 learned_addr learned my addr 172.21.15.22:0/1386731544 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:52:17.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.213+0000 7f3d537fe700 1 --2- 172.21.15.22:0/1386731544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d540d3730 0x7f3d540cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:17.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.214+0000 7f3d52ffd700 1 -- 172.21.15.22:0/1386731544 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635646912 0 0) 0x7f3d540d0b20 con 0x7f3d540cfa90 2023-07-11T00:52:17.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.214+0000 7f3d52ffd700 1 -- 172.21.15.22:0/1386731544 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d3c0035b0 con 0x7f3d540cfa90 2023-07-11T00:52:17.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.214+0000 7f3d52ffd700 1 -- 172.21.15.22:0/1386731544 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308647810 0 0) 0x7f3d540cfeb0 con 0x7f3d540b8430 2023-07-11T00:52:17.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.214+0000 7f3d52ffd700 1 -- 172.21.15.22:0/1386731544 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d540d0b20 con 0x7f3d540b8430 2023-07-11T00:52:17.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.214+0000 7f3d537fe700 1 -- 172.21.15.22:0/1386731544 >> v1:172.21.15.184:6789/0 conn(0x7f3d540b8430 legacy=0x7f3d540cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:17.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.214+0000 7f3d537fe700 1 -- 172.21.15.22:0/1386731544 >> v1:172.21.15.22:6789/0 conn(0x7f3d540cfa90 legacy=0x7f3d540d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:17.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.214+0000 7f3d537fe700 1 -- 172.21.15.22:0/1386731544 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d540b4ee0 con 0x7f3d540d3730 2023-07-11T00:52:17.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.214+0000 7f3d537fe700 1 --2- 172.21.15.22:0/1386731544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d540d3730 0x7f3d540cf550 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009870 tx=0x7f3d48009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4dd229570a24d05 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:17.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.214+0000 7f3d52ffd700 1 -- 172.21.15.22:0/1386731544 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48011830 con 0x7f3d540d3730 2023-07-11T00:52:17.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.214+0000 7f3d52ffd700 1 -- 172.21.15.22:0/1386731544 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d48011990 con 0x7f3d540d3730 2023-07-11T00:52:17.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.214+0000 7f3d52ffd700 1 -- 172.21.15.22:0/1386731544 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48011d20 con 0x7f3d540d3730 2023-07-11T00:52:17.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.215+0000 7f3d5a9ff700 1 -- 172.21.15.22:0/1386731544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d540d3730 msgr2=0x7f3d540cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:17.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.215+0000 7f3d5a9ff700 1 --2- 172.21.15.22:0/1386731544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d540d3730 0x7f3d540cf550 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009870 tx=0x7f3d48009b80 comp rx=0 tx=0).stop 2023-07-11T00:52:17.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.215+0000 7f3d5a9ff700 1 -- 172.21.15.22:0/1386731544 shutdown_connections 2023-07-11T00:52:17.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.215+0000 7f3d5a9ff700 1 --2- 172.21.15.22:0/1386731544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d540d3730 0x7f3d540cf550 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:17.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.215+0000 7f3d5a9ff700 1 -- 172.21.15.22:0/1386731544 >> 172.21.15.22:0/1386731544 conn(0x7f3d5406b3f0 msgr2=0x7f3d5406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:52:17.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.215+0000 7f3d5a9ff700 1 -- 172.21.15.22:0/1386731544 shutdown_connections 2023-07-11T00:52:17.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.215+0000 7f3d5a9ff700 1 -- 172.21.15.22:0/1386731544 wait complete. 2023-07-11T00:52:17.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.217+0000 7f3d5a9ff700 1 Processor -- start 2023-07-11T00:52:17.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.217+0000 7f3d5a9ff700 1 -- start start 2023-07-11T00:52:17.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.218+0000 7f3d5a9ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d540b8430 0x7f3d541544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:17.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.218+0000 7f3d5a9ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d540cfa90 0x7f3d540c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:17.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.218+0000 7f3d5a9ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d540d3730 0x7f3d540ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:17.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.218+0000 7f3d5a9ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540c75f0 con 0x7f3d540cfa90 2023-07-11T00:52:17.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.218+0000 7f3d5a9ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540c78d0 con 0x7f3d540b8430 2023-07-11T00:52:17.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.218+0000 7f3d5a9ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540c7bb0 con 0x7f3d540d3730 2023-07-11T00:52:17.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.218+0000 7f3d537fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d540cfa90 0x7f3d540c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:17.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.218+0000 7f3d537fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d540cfa90 0x7f3d540c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58724/0 (socket says 172.21.15.22:58724) 2023-07-11T00:52:17.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.218+0000 7f3d537fe700 1 -- 172.21.15.22:0/3320187274 learned_addr learned my addr 172.21.15.22:0/3320187274 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:52:17.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.218+0000 7f3d53fff700 1 --2- 172.21.15.22:0/3320187274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d540b8430 0x7f3d541544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:17.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.219+0000 7f3d58f9c700 1 --2- 172.21.15.22:0/3320187274 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d540d3730 0x7f3d540ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:17.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.219+0000 7f3d537fe700 1 -- 172.21.15.22:0/3320187274 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d540d3730 msgr2=0x7f3d540ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:17.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.219+0000 7f3d537fe700 1 --2- 172.21.15.22:0/3320187274 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d540d3730 0x7f3d540ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:17.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.219+0000 7f3d537fe700 1 -- 172.21.15.22:0/3320187274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d540b8430 msgr2=0x7f3d541544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:17.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.219+0000 7f3d537fe700 1 --2- 172.21.15.22:0/3320187274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d540b8430 0x7f3d541544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:17.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.219+0000 7f3d537fe700 1 -- 172.21.15.22:0/3320187274 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d480094a0 con 0x7f3d540cfa90 2023-07-11T00:52:17.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.219+0000 7f3d537fe700 1 --2- 172.21.15.22:0/3320187274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d540cfa90 0x7f3d540c9ef0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009bc0 tx=0x7f3d48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:17.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.220+0000 7f3d50ff9700 1 -- 172.21.15.22:0/3320187274 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4801a6e0 con 0x7f3d540cfa90 2023-07-11T00:52:17.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.220+0000 7f3d50ff9700 1 -- 172.21.15.22:0/3320187274 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4801a860 con 0x7f3d540cfa90 2023-07-11T00:52:17.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.220+0000 7f3d50ff9700 1 -- 172.21.15.22:0/3320187274 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4801ac10 con 0x7f3d540cfa90 2023-07-11T00:52:17.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.220+0000 7f3d5a9ff700 1 -- 172.21.15.22:0/3320187274 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d540c7e90 con 0x7f3d540cfa90 2023-07-11T00:52:17.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.220+0000 7f3d5a9ff700 1 -- 172.21.15.22:0/3320187274 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d54154a10 con 0x7f3d540cfa90 2023-07-11T00:52:17.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.221+0000 7f3d5a9ff700 1 -- 172.21.15.22:0/3320187274 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d540c83b0 con 0x7f3d540cfa90 2023-07-11T00:52:17.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.222+0000 7f3d50ff9700 1 -- 172.21.15.22:0/3320187274 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d48022070 con 0x7f3d540cfa90 2023-07-11T00:52:17.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.222+0000 7f3d50ff9700 1 --2- 172.21.15.22:0/3320187274 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3d4006ad10 0x7f3d4006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:17.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.223+0000 7f3d50ff9700 1 -- 172.21.15.22:0/3320187274 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f3d4808a2a0 con 0x7f3d540cfa90 2023-07-11T00:52:17.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.223+0000 7f3d53fff700 1 --2- 172.21.15.22:0/3320187274 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3d4006ad10 0x7f3d4006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:17.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.224+0000 7f3d53fff700 1 --2- 172.21.15.22:0/3320187274 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3d4006ad10 0x7f3d4006d1c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3d440011e0 tx=0x7f3d44009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:17.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.227+0000 7f3d50ff9700 1 -- 172.21.15.22:0/3320187274 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3d540c83b0 con 0x7f3d540cfa90 2023-07-11T00:52:17.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.436+0000 7f3d5a9ff700 1 -- 172.21.15.22:0/3320187274 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d540c83b0 con 0x7f3d540cfa90 2023-07-11T00:52:17.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.436+0000 7f3d50ff9700 1 -- 172.21.15.22:0/3320187274 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d4805e020 con 0x7f3d540cfa90 2023-07-11T00:52:17.439 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-07-11T00:52:17.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.439+0000 7f3d5a9ff700 1 -- 172.21.15.22:0/3320187274 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3d4006ad10 msgr2=0x7f3d4006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:17.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.439+0000 7f3d5a9ff700 1 --2- 172.21.15.22:0/3320187274 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3d4006ad10 0x7f3d4006d1c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3d440011e0 tx=0x7f3d44009040 comp rx=0 tx=0).stop 2023-07-11T00:52:17.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.439+0000 7f3d5a9ff700 1 -- 172.21.15.22:0/3320187274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d540cfa90 msgr2=0x7f3d540c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:17.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.439+0000 7f3d5a9ff700 1 --2- 172.21.15.22:0/3320187274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d540cfa90 0x7f3d540c9ef0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009bc0 tx=0x7f3d48004750 comp rx=0 tx=0).stop 2023-07-11T00:52:17.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.439+0000 7f3d5a9ff700 1 -- 172.21.15.22:0/3320187274 shutdown_connections 2023-07-11T00:52:17.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.439+0000 7f3d5a9ff700 1 --2- 172.21.15.22:0/3320187274 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f3d4006ad10 0x7f3d4006d1c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:17.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.439+0000 7f3d5a9ff700 1 --2- 172.21.15.22:0/3320187274 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d540d3730 0x7f3d540ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:17.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.439+0000 7f3d5a9ff700 1 --2- 172.21.15.22:0/3320187274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d540b8430 0x7f3d541544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:17.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.439+0000 7f3d5a9ff700 1 --2- 172.21.15.22:0/3320187274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d540cfa90 0x7f3d540c9ef0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:17.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.439+0000 7f3d5a9ff700 1 -- 172.21.15.22:0/3320187274 >> 172.21.15.22:0/3320187274 conn(0x7f3d5406b3f0 msgr2=0x7f3d540d19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:52:17.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.439+0000 7f3d5a9ff700 1 -- 172.21.15.22:0/3320187274 shutdown_connections 2023-07-11T00:52:17.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.439+0000 7f3d5a9ff700 1 -- 172.21.15.22:0/3320187274 wait complete. 2023-07-11T00:52:17.459 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:52:17.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.668+0000 7f5a81bff700 1 Processor -- start 2023-07-11T00:52:17.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.669+0000 7f5a81bff700 1 -- start start 2023-07-11T00:52:17.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.670+0000 7f5a81bff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5a7c0b8430 0x7f5a7c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:17.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.670+0000 7f5a81bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a7c0d3730 0x7f5a7c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:17.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.670+0000 7f5a81bff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7c0d0b20 con 0x7f5a7c0cfa90 2023-07-11T00:52:17.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.670+0000 7f5a81bff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7c0b8800 con 0x7f5a7c0b8430 2023-07-11T00:52:17.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.670+0000 7f5a81bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c0cfeb0 con 0x7f5a7c0d3730 2023-07-11T00:52:17.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.670+0000 7f5a7b7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5a7c0b8430 0x7f5a7c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:17.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.670+0000 7f5a7bfff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5a7c0cfa90 0x7f5a7c15feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45222/0 (socket says 172.21.15.22:45222) 2023-07-11T00:52:17.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.670+0000 7f5a7bfff700 1 -- 172.21.15.22:0/1953661893 learned_addr learned my addr 172.21.15.22:0/1953661893 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:52:17.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.670+0000 7f5a7affd700 1 --2- 172.21.15.22:0/1953661893 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a7c0d3730 0x7f5a7c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:17.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.671+0000 7f5a7b7fe700 1 -- 172.21.15.22:0/1953661893 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a7c0d3730 msgr2=0x7f5a7c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:52:17.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.671+0000 7f5a7b7fe700 1 --2- 172.21.15.22:0/1953661893 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a7c0d3730 0x7f5a7c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:17.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.671+0000 7f5a7b7fe700 1 -- 172.21.15.22:0/1953661893 >> v1:172.21.15.22:6789/0 conn(0x7f5a7c0cfa90 legacy=0x7f5a7c15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:17.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.671+0000 7f5a7a7fc700 1 -- 172.21.15.22:0/1953661893 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153074086 0 0) 0x7f5a7c0d0b20 con 0x7f5a7c0cfa90 2023-07-11T00:52:17.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.671+0000 7f5a7b7fe700 1 -- 172.21.15.22:0/1953661893 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c0b4ee0 con 0x7f5a7c0b8430 2023-07-11T00:52:17.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.671+0000 7f5a7b7fe700 1 --2- 172.21.15.22:0/1953661893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a7c0b8430 0x7f5a7c0cd320 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009840 tx=0x7f5a6c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e049fb80b2da75 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:17.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.671+0000 7f5a7a7fc700 1 -- 172.21.15.22:0/1953661893 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c011830 con 0x7f5a7c0b8430 2023-07-11T00:52:17.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.671+0000 7f5a7a7fc700 1 -- 172.21.15.22:0/1953661893 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c011990 con 0x7f5a7c0b8430 2023-07-11T00:52:17.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.671+0000 7f5a7a7fc700 1 -- 172.21.15.22:0/1953661893 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c011d20 con 0x7f5a7c0b8430 2023-07-11T00:52:17.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.672+0000 7f5a81bff700 1 -- 172.21.15.22:0/1953661893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a7c0b8430 msgr2=0x7f5a7c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:17.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.672+0000 7f5a81bff700 1 --2- 172.21.15.22:0/1953661893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a7c0b8430 0x7f5a7c0cd320 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009840 tx=0x7f5a6c009b50 comp rx=0 tx=0).stop 2023-07-11T00:52:17.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.672+0000 7f5a81bff700 1 -- 172.21.15.22:0/1953661893 shutdown_connections 2023-07-11T00:52:17.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.672+0000 7f5a81bff700 1 --2- 172.21.15.22:0/1953661893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a7c0b8430 0x7f5a7c0cd320 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:17.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.672+0000 7f5a81bff700 1 --2- 172.21.15.22:0/1953661893 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a7c0d3730 0x7f5a7c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:17.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.672+0000 7f5a81bff700 1 -- 172.21.15.22:0/1953661893 >> 172.21.15.22:0/1953661893 conn(0x7f5a7c06b3f0 msgr2=0x7f5a7c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:52:17.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.672+0000 7f5a81bff700 1 -- 172.21.15.22:0/1953661893 shutdown_connections 2023-07-11T00:52:17.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.672+0000 7f5a81bff700 1 -- 172.21.15.22:0/1953661893 wait complete. 2023-07-11T00:52:17.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.674+0000 7f5a81bff700 1 Processor -- start 2023-07-11T00:52:17.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.675+0000 7f5a81bff700 1 -- start start 2023-07-11T00:52:17.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.676+0000 7f5a81bff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a7c0b8430 0x7f5a7c1f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:17.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.676+0000 7f5a81bff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a7c0cfa90 0x7f5a7c153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:17.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.676+0000 7f5a81bff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a7c0d3730 0x7f5a7c0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:17.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.676+0000 7f5a81bff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c0ca190 con 0x7f5a7c0d3730 2023-07-11T00:52:17.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.676+0000 7f5a81bff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c0d1550 con 0x7f5a7c0cfa90 2023-07-11T00:52:17.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.676+0000 7f5a81bff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c1f28e0 con 0x7f5a7c0b8430 2023-07-11T00:52:17.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.676+0000 7f5a7bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a7c0d3730 0x7f5a7c0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:17.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.676+0000 7f5a7bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a7c0d3730 0x7f5a7c0ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58734/0 (socket says 172.21.15.22:58734) 2023-07-11T00:52:17.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.676+0000 7f5a7bfff700 1 -- 172.21.15.22:0/1260125373 learned_addr learned my addr 172.21.15.22:0/1260125373 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:52:17.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.676+0000 7f5a7b7fe700 1 --2- 172.21.15.22:0/1260125373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a7c0b8430 0x7f5a7c1f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:17.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.676+0000 7f5a7affd700 1 --2- 172.21.15.22:0/1260125373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a7c0cfa90 0x7f5a7c153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:17.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.677+0000 7f5a7bfff700 1 -- 172.21.15.22:0/1260125373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a7c0b8430 msgr2=0x7f5a7c1f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:17.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.677+0000 7f5a7bfff700 1 --2- 172.21.15.22:0/1260125373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a7c0b8430 0x7f5a7c1f23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:17.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.677+0000 7f5a7bfff700 1 -- 172.21.15.22:0/1260125373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a7c0cfa90 msgr2=0x7f5a7c153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:17.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.677+0000 7f5a7bfff700 1 --2- 172.21.15.22:0/1260125373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a7c0cfa90 0x7f5a7c153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:17.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.677+0000 7f5a7bfff700 1 -- 172.21.15.22:0/1260125373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c0094a0 con 0x7f5a7c0d3730 2023-07-11T00:52:17.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.677+0000 7f5a7bfff700 1 --2- 172.21.15.22:0/1260125373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a7c0d3730 0x7f5a7c0ca620 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400ccd0 tx=0x7f5a7400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:17.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.679+0000 7f5a63fff700 1 -- 172.21.15.22:0/1260125373 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400ab30 con 0x7f5a7c0d3730 2023-07-11T00:52:17.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.679+0000 7f5a63fff700 1 -- 172.21.15.22:0/1260125373 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7400ac90 con 0x7f5a7c0d3730 2023-07-11T00:52:17.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.679+0000 7f5a63fff700 1 -- 172.21.15.22:0/1260125373 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a740070d0 con 0x7f5a7c0d3730 2023-07-11T00:52:17.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.679+0000 7f5a81bff700 1 -- 172.21.15.22:0/1260125373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7c0ccb20 con 0x7f5a7c0d3730 2023-07-11T00:52:17.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.679+0000 7f5a81bff700 1 -- 172.21.15.22:0/1260125373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7c0d1a80 con 0x7f5a7c0d3730 2023-07-11T00:52:17.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.681+0000 7f5a81bff700 1 -- 172.21.15.22:0/1260125373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7c04ea60 con 0x7f5a7c0d3730 2023-07-11T00:52:17.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.682+0000 7f5a63fff700 1 -- 172.21.15.22:0/1260125373 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5a74007230 con 0x7f5a7c0d3730 2023-07-11T00:52:17.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.683+0000 7f5a63fff700 1 --2- 172.21.15.22:0/1260125373 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5a6806ace0 0x7f5a6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:17.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.683+0000 7f5a63fff700 1 -- 172.21.15.22:0/1260125373 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f5a74089120 con 0x7f5a7c0d3730 2023-07-11T00:52:17.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.683+0000 7f5a7b7fe700 1 --2- 172.21.15.22:0/1260125373 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5a6806ace0 0x7f5a6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:17.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.684+0000 7f5a7b7fe700 1 --2- 172.21.15.22:0/1260125373 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5a6806ace0 0x7f5a6806d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c000c00 tx=0x7f5a6c01c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:17.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.688+0000 7f5a63fff700 1 -- 172.21.15.22:0/1260125373 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5a74053ff0 con 0x7f5a7c0d3730 2023-07-11T00:52:17.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.900+0000 7f5a81bff700 1 -- 172.21.15.22:0/1260125373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a7c15b4c0 con 0x7f5a7c0d3730 2023-07-11T00:52:17.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.900+0000 7f5a63fff700 1 -- 172.21.15.22:0/1260125373 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a74057610 con 0x7f5a7c0d3730 2023-07-11T00:52:17.903 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-07-11T00:52:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.902+0000 7f5a81bff700 1 -- 172.21.15.22:0/1260125373 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5a6806ace0 msgr2=0x7f5a6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.902+0000 7f5a81bff700 1 --2- 172.21.15.22:0/1260125373 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5a6806ace0 0x7f5a6806d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c000c00 tx=0x7f5a6c01c040 comp rx=0 tx=0).stop 2023-07-11T00:52:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.902+0000 7f5a81bff700 1 -- 172.21.15.22:0/1260125373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a7c0d3730 msgr2=0x7f5a7c0ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.902+0000 7f5a81bff700 1 --2- 172.21.15.22:0/1260125373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a7c0d3730 0x7f5a7c0ca620 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400ccd0 tx=0x7f5a7400a060 comp rx=0 tx=0).stop 2023-07-11T00:52:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.903+0000 7f5a81bff700 1 -- 172.21.15.22:0/1260125373 shutdown_connections 2023-07-11T00:52:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.903+0000 7f5a81bff700 1 --2- 172.21.15.22:0/1260125373 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7f5a6806ace0 0x7f5a6806d190 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.903+0000 7f5a81bff700 1 --2- 172.21.15.22:0/1260125373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a7c0b8430 0x7f5a7c1f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.903+0000 7f5a81bff700 1 --2- 172.21.15.22:0/1260125373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a7c0d3730 0x7f5a7c0ca620 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.903+0000 7f5a81bff700 1 --2- 172.21.15.22:0/1260125373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a7c0cfa90 0x7f5a7c153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.903+0000 7f5a81bff700 1 -- 172.21.15.22:0/1260125373 >> 172.21.15.22:0/1260125373 conn(0x7f5a7c06b3f0 msgr2=0x7f5a7c0b7110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:52:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.903+0000 7f5a81bff700 1 -- 172.21.15.22:0/1260125373 shutdown_connections 2023-07-11T00:52:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:17.903+0000 7f5a81bff700 1 -- 172.21.15.22:0/1260125373 wait complete. 2023-07-11T00:52:17.923 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-11T00:52:18.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.127+0000 7fc9271ff700 1 Processor -- start 2023-07-11T00:52:18.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.127+0000 7fc9271ff700 1 -- start start 2023-07-11T00:52:18.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.129+0000 7fc9271ff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc9200d2640 0x7fc9200b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:18.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.129+0000 7fc9271ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc9200cf8f0 0x7fc92015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:18.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.129+0000 7fc9271ff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9200d1790 con 0x7fc92015c460 2023-07-11T00:52:18.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.129+0000 7fc9271ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9200cedd0 con 0x7fc9200cf8f0 2023-07-11T00:52:18.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.129+0000 7fc9271ff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9200cd950 con 0x7fc9200d2640 2023-07-11T00:52:18.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.129+0000 7fc92579c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc9200cf8f0 0x7fc92015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:18.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.129+0000 7fc91ffff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc9200d2640 0x7fc9200b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:18.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.129+0000 7fc924f9b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fc92015c460 0x7fc9200cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.22:59878/0 (socket says 172.21.15.22:59878) 2023-07-11T00:52:18.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.129+0000 7fc924f9b700 1 -- 172.21.15.22:0/1035650439 learned_addr learned my addr 172.21.15.22:0/1035650439 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-07-11T00:52:18.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.129+0000 7fc91f7fe700 1 -- 172.21.15.22:0/1035650439 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104989129 0 0) 0x7fc9200d1790 con 0x7fc92015c460 2023-07-11T00:52:18.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.130+0000 7fc91ffff700 1 -- 172.21.15.22:0/1035650439 >> v2:172.21.15.22:3300/0 conn(0x7fc9200cf8f0 msgr2=0x7fc92015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:52:18.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.130+0000 7fc91ffff700 1 --2- 172.21.15.22:0/1035650439 >> v2:172.21.15.22:3300/0 conn(0x7fc9200cf8f0 0x7fc92015fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:18.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.130+0000 7fc91ffff700 1 -- 172.21.15.22:0/1035650439 >> v1:172.21.15.184:6789/0 conn(0x7fc92015c460 legacy=0x7fc9200cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:18.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.130+0000 7fc91ffff700 1 -- 172.21.15.22:0/1035650439 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9200d14b0 con 0x7fc9200d2640 2023-07-11T00:52:18.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.130+0000 7fc92579c700 1 --2- 172.21.15.22:0/1035650439 >> v2:172.21.15.22:3300/0 conn(0x7fc9200cf8f0 0x7fc92015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:52:18.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.130+0000 7fc91ffff700 1 --2- 172.21.15.22:0/1035650439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9200d2640 0x7fc9200b59d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc92015fd80 tx=0x7fc90c009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11c83fa99c767763 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:18.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.130+0000 7fc91f7fe700 1 -- 172.21.15.22:0/1035650439 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c011830 con 0x7fc9200d2640 2023-07-11T00:52:18.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.130+0000 7fc91f7fe700 1 -- 172.21.15.22:0/1035650439 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c011990 con 0x7fc9200d2640 2023-07-11T00:52:18.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.130+0000 7fc91f7fe700 1 -- 172.21.15.22:0/1035650439 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c011d20 con 0x7fc9200d2640 2023-07-11T00:52:18.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.131+0000 7fc9271ff700 1 -- 172.21.15.22:0/1035650439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9200d2640 msgr2=0x7fc9200b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:18.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.131+0000 7fc9271ff700 1 --2- 172.21.15.22:0/1035650439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9200d2640 0x7fc9200b59d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc92015fd80 tx=0x7fc90c009b20 comp rx=0 tx=0).stop 2023-07-11T00:52:18.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.131+0000 7fc9271ff700 1 -- 172.21.15.22:0/1035650439 shutdown_connections 2023-07-11T00:52:18.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.131+0000 7fc9271ff700 1 --2- 172.21.15.22:0/1035650439 >> v2:172.21.15.22:3300/0 conn(0x7fc9200cf8f0 0x7fc92015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:18.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.131+0000 7fc9271ff700 1 --2- 172.21.15.22:0/1035650439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9200d2640 0x7fc9200b59d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:18.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.131+0000 7fc9271ff700 1 -- 172.21.15.22:0/1035650439 >> 172.21.15.22:0/1035650439 conn(0x7fc920071660 msgr2=0x7fc920071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:52:18.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.131+0000 7fc9271ff700 1 -- 172.21.15.22:0/1035650439 shutdown_connections 2023-07-11T00:52:18.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.131+0000 7fc9271ff700 1 -- 172.21.15.22:0/1035650439 wait complete. 2023-07-11T00:52:18.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.133+0000 7fc9271ff700 1 Processor -- start 2023-07-11T00:52:18.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.133+0000 7fc9271ff700 1 -- start start 2023-07-11T00:52:18.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.134+0000 7fc9271ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9200cf8f0 0x7fc9200c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:18.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.134+0000 7fc9271ff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9200d2640 0x7fc9200c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:18.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.134+0000 7fc9271ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc92015c460 0x7fc9201e5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:18.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.134+0000 7fc9271ff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc920156160 con 0x7fc92015c460 2023-07-11T00:52:18.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.134+0000 7fc9271ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200c9d70 con 0x7fc9200cf8f0 2023-07-11T00:52:18.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.134+0000 7fc9271ff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200c9240 con 0x7fc9200d2640 2023-07-11T00:52:18.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.134+0000 7fc92579c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc92015c460 0x7fc9201e5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:18.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.134+0000 7fc91ffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9200d2640 0x7fc9200c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:18.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.134+0000 7fc924f9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9200cf8f0 0x7fc9200c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:18.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.134+0000 7fc92579c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc92015c460 0x7fc9201e5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58756/0 (socket says 172.21.15.22:58756) 2023-07-11T00:52:18.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.134+0000 7fc92579c700 1 -- 172.21.15.22:0/4051050282 learned_addr learned my addr 172.21.15.22:0/4051050282 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-07-11T00:52:18.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.135+0000 7fc91ffff700 1 -- 172.21.15.22:0/4051050282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9200cf8f0 msgr2=0x7fc9200c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:18.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.135+0000 7fc91ffff700 1 --2- 172.21.15.22:0/4051050282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9200cf8f0 0x7fc9200c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:18.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.135+0000 7fc91ffff700 1 -- 172.21.15.22:0/4051050282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc92015c460 msgr2=0x7fc9201e5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:18.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.135+0000 7fc91ffff700 1 --2- 172.21.15.22:0/4051050282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc92015c460 0x7fc9201e5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:18.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.135+0000 7fc91ffff700 1 -- 172.21.15.22:0/4051050282 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc918009a70 con 0x7fc9200d2640 2023-07-11T00:52:18.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.135+0000 7fc91ffff700 1 --2- 172.21.15.22:0/4051050282 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9200d2640 0x7fc9200c57b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc90c016000 tx=0x7fc90c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:18.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.135+0000 7fc91d7fa700 1 -- 172.21.15.22:0/4051050282 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c0036a0 con 0x7fc9200d2640 2023-07-11T00:52:18.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.136+0000 7fc91d7fa700 1 -- 172.21.15.22:0/4051050282 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c01e070 con 0x7fc9200d2640 2023-07-11T00:52:18.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.136+0000 7fc91d7fa700 1 -- 172.21.15.22:0/4051050282 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c003a40 con 0x7fc9200d2640 2023-07-11T00:52:18.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.136+0000 7fc9271ff700 1 -- 172.21.15.22:0/4051050282 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90c0094a0 con 0x7fc9200d2640 2023-07-11T00:52:18.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.136+0000 7fc9271ff700 1 -- 172.21.15.22:0/4051050282 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9200c9fc0 con 0x7fc9200d2640 2023-07-11T00:52:18.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.137+0000 7fc9271ff700 1 -- 172.21.15.22:0/4051050282 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92004ea60 con 0x7fc9200d2640 2023-07-11T00:52:18.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.138+0000 7fc91d7fa700 1 -- 172.21.15.22:0/4051050282 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc90c003ba0 con 0x7fc9200d2640 2023-07-11T00:52:18.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.139+0000 7fc91d7fa700 1 --2- 172.21.15.22:0/4051050282 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc90406ace0 0x7fc90406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:52:18.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.139+0000 7fc91d7fa700 1 -- 172.21.15.22:0/4051050282 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6526+0+0 (secure 0 0 0) 0x7fc90c08a8b0 con 0x7fc9200d2640 2023-07-11T00:52:18.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.140+0000 7fc924f9b700 1 --2- 172.21.15.22:0/4051050282 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc90406ace0 0x7fc90406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:52:18.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.140+0000 7fc924f9b700 1 --2- 172.21.15.22:0/4051050282 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc90406ace0 0x7fc90406d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc914007fd0 tx=0x7fc914007de0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:52:18.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.148+0000 7fc91d7fa700 1 -- 172.21.15.22:0/4051050282 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc90c055800 con 0x7fc9200d2640 2023-07-11T00:52:18.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.375+0000 7fc9271ff700 1 -- 172.21.15.22:0/4051050282 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc9200b4fa0 con 0x7fc9200d2640 2023-07-11T00:52:18.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.376+0000 7fc91d7fa700 1 -- 172.21.15.22:0/4051050282 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v41) v1 ==== 80+0+124 (secure 0 0 0) 0x7fc90c058e20 con 0x7fc9200d2640 2023-07-11T00:52:18.379 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.184:6837/2685786652 2023-07-12T00:47:25.487620+0000 2023-07-11T00:52:18.379 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.184:6835/2685786652 2023-07-12T00:47:25.487620+0000 2023-07-11T00:52:18.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.378+0000 7fc9271ff700 1 -- 172.21.15.22:0/4051050282 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc90406ace0 msgr2=0x7fc90406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:18.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.378+0000 7fc9271ff700 1 --2- 172.21.15.22:0/4051050282 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc90406ace0 0x7fc90406d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc914007fd0 tx=0x7fc914007de0 comp rx=0 tx=0).stop 2023-07-11T00:52:18.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.378+0000 7fc9271ff700 1 -- 172.21.15.22:0/4051050282 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9200d2640 msgr2=0x7fc9200c57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:52:18.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.378+0000 7fc9271ff700 1 --2- 172.21.15.22:0/4051050282 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9200d2640 0x7fc9200c57b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc90c016000 tx=0x7fc90c004750 comp rx=0 tx=0).stop 2023-07-11T00:52:18.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.378+0000 7fc9271ff700 1 -- 172.21.15.22:0/4051050282 shutdown_connections 2023-07-11T00:52:18.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.378+0000 7fc9271ff700 1 --2- 172.21.15.22:0/4051050282 >> [v2:172.21.15.184:6832/380612710,v1:172.21.15.184:6833/380612710] conn(0x7fc90406ace0 0x7fc90406d190 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:18.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.378+0000 7fc9271ff700 1 --2- 172.21.15.22:0/4051050282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc92015c460 0x7fc9201e5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:18.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.378+0000 7fc9271ff700 1 --2- 172.21.15.22:0/4051050282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9200cf8f0 0x7fc9200c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:18.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.378+0000 7fc9271ff700 1 --2- 172.21.15.22:0/4051050282 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9200d2640 0x7fc9200c57b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:52:18.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.378+0000 7fc9271ff700 1 -- 172.21.15.22:0/4051050282 >> 172.21.15.22:0/4051050282 conn(0x7fc920071660 msgr2=0x7fc9200b7470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:52:18.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.379+0000 7fc9271ff700 1 -- 172.21.15.22:0/4051050282 shutdown_connections 2023-07-11T00:52:18.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-07-11T00:52:18.379+0000 7fc9271ff700 1 -- 172.21.15.22:0/4051050282 wait complete. 2023-07-11T00:52:18.383 INFO:teuthology.orchestra.run.smithi022.stderr:listed 2 entries 2023-07-11T00:52:18.399 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-11T00:52:18.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:52:18.401 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-11T00:52:18.493 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-07-11T00:52:18.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:52:18.494 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-11T00:52:18.543 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-11T00:52:18.543 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:52:18.590 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348780k,nr_inodes=4087195,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 172.21.15.22:6789:/test /tmp/tmp.pzJBEiZFlJtest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=c306ab0a-3faf-4f52-9dba-c4f0807b892e,acl 0 0 2023-07-11T00:52:18.591 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-07-11T00:52:18.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:52:18.591 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-11T00:52:18.678 INFO:teuthology.orchestra.run.smithi022.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-07-11T00:52:18.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-11T00:52:18.680 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:52:18.680 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:52:19.268 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345696k,nr_inodes=4086424,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-11T00:52:19.268 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-07-11T00:52:19.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:52:19.269 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-11T00:52:19.476 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-07-11T00:52:19.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-11T00:52:19.478 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-11T00:52:19.478 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:52:19.571 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345696k,nr_inodes=4086424,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-11T00:52:19.571 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-07-11T00:52:19.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:52:19.572 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-11T00:52:19.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-11T00:52:19.628 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-07-11T00:52:21.240 INFO:tasks.ceph.osd.0:Sent signal 15 2023-07-11T00:52:21.241 INFO:tasks.ceph.osd.1:Sent signal 15 2023-07-11T00:52:21.242 INFO:tasks.ceph.osd.2:Sent signal 15 2023-07-11T00:52:21.242 INFO:tasks.ceph.osd.3:Sent signal 15 2023-07-11T00:52:21.242 INFO:tasks.ceph.osd.4:Sent signal 15 2023-07-11T00:52:21.242 INFO:tasks.ceph.osd.5:Sent signal 15 2023-07-11T00:52:21.243 INFO:tasks.ceph.osd.6:Sent signal 15 2023-07-11T00:52:21.243 INFO:tasks.ceph.osd.7:Sent signal 15 2023-07-11T00:52:21.243 INFO:tasks.ceph.mds.a:Sent signal 15 2023-07-11T00:52:21.244 INFO:tasks.ceph.mds.c:Sent signal 15 2023-07-11T00:52:21.245 INFO:tasks.ceph.mds.b:Sent signal 15 2023-07-11T00:52:21.246 INFO:tasks.ceph.mon.a:Sent signal 15 2023-07-11T00:52:21.246 INFO:tasks.ceph.mon.b:Sent signal 15 2023-07-11T00:52:21.246 INFO:tasks.ceph.mon.c:Sent signal 15 2023-07-11T00:52:21.246 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-07-11T00:52:21.247 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-07-11T00:52:21.247 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-07-11T00:52:21.241+0000 7f5a13ff9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 112335) UID: 0 2023-07-11T00:52:21.248 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-07-11T00:52:21.241+0000 7f5a13ff9700 -1 osd.4 41 *** Got signal Terminated *** 2023-07-11T00:52:21.248 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-07-11T00:52:21.241+0000 7f5a13ff9700 -1 osd.4 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-11T00:52:21.248 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-07-11T00:52:21.241+0000 7f019c1f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 112338) UID: 0 2023-07-11T00:52:21.248 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-07-11T00:52:21.241+0000 7f019c1f9700 -1 osd.5 41 *** Got signal Terminated *** 2023-07-11T00:52:21.248 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-07-11T00:52:21.241+0000 7f019c1f9700 -1 osd.5 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-11T00:52:21.249 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-07-11T00:52:21.241+0000 7f7905ff9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 112343) UID: 0 2023-07-11T00:52:21.249 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-07-11T00:52:21.241+0000 7f7905ff9700 -1 osd.7 41 *** Got signal Terminated *** 2023-07-11T00:52:21.249 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-07-11T00:52:21.241+0000 7f7905ff9700 -1 osd.7 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-11T00:52:21.249 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-07-11T00:52:21.242+0000 7fd5219f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 112340) UID: 0 2023-07-11T00:52:21.250 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-07-11T00:52:21.242+0000 7fd5219f9700 -1 osd.6 41 *** Got signal Terminated *** 2023-07-11T00:52:21.250 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-07-11T00:52:21.242+0000 7fd5219f9700 -1 osd.6 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-11T00:52:21.251 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-07-11T00:52:21.243+0000 7fe0b21f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 120222) UID: 0 2023-07-11T00:52:21.251 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-07-11T00:52:21.243+0000 7fe0b21f9700 -1 mds.b *** got signal Terminated *** 2023-07-11T00:52:21.251 INFO:tasks.ceph.mon.b.smithi184.stderr:2023-07-11T00:52:21.244+0000 7f5a3ffff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 111634) UID: 0 2023-07-11T00:52:21.251 INFO:tasks.ceph.mon.b.smithi184.stderr:2023-07-11T00:52:21.244+0000 7f5a3ffff700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-07-11T00:52:21.252 INFO:tasks.ceph.mon.c.smithi184.stderr:2023-07-11T00:52:21.245+0000 7f5137fff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 111635) UID: 0 2023-07-11T00:52:21.252 INFO:tasks.ceph.mon.c.smithi184.stderr:2023-07-11T00:52:21.245+0000 7f5137fff700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-07-11T00:52:21.252 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-07-11T00:52:21.244+0000 7f4df53f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 112114) UID: 0 2023-07-11T00:52:21.253 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-07-11T00:52:21.244+0000 7f4df53f9700 -1 osd.1 41 *** Got signal Terminated *** 2023-07-11T00:52:21.253 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-07-11T00:52:21.244+0000 7f4df53f9700 -1 osd.1 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-11T00:52:21.253 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-07-11T00:52:21.245+0000 7fe5bf7f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-11T00:52:21.253 INFO:tasks.ceph.mds.a.smithi022.stderr:2023-07-11T00:52:21.244+0000 7f45b99f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 128041) UID: 0 2023-07-11T00:52:21.254 INFO:tasks.ceph.mds.a.smithi022.stderr:2023-07-11T00:52:21.244+0000 7f45b99f9700 -1 mds.a *** got signal Terminated *** 2023-07-11T00:52:21.254 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-07-11T00:52:21.245+0000 7f257dbf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 112101) UID: 0 2023-07-11T00:52:21.254 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-07-11T00:52:21.245+0000 7f257dbf9700 -1 osd.0 41 *** Got signal Terminated *** 2023-07-11T00:52:21.254 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-07-11T00:52:21.245+0000 7f257dbf9700 -1 osd.0 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-11T00:52:21.255 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-07-11T00:52:21.250+0000 7fb215df9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 112115) UID: 0 2023-07-11T00:52:21.255 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-07-11T00:52:21.250+0000 7fb215df9700 -1 osd.2 41 *** Got signal Terminated *** 2023-07-11T00:52:21.255 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-07-11T00:52:21.250+0000 7fb215df9700 -1 osd.2 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-11T00:52:21.255 INFO:tasks.ceph.mds.c.smithi022.stderr:2023-07-11T00:52:21.248+0000 7fdb803f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 128042) UID: 0 2023-07-11T00:52:21.255 INFO:tasks.ceph.mds.c.smithi022.stderr:2023-07-11T00:52:21.248+0000 7fdb803f9700 -1 mds.c *** got signal Terminated *** 2023-07-11T00:52:21.263 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-07-11T00:52:21.252+0000 7fe5c4fff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 111779) UID: 0 2023-07-11T00:52:21.263 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-07-11T00:52:21.252+0000 7fe5c4fff700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-07-11T00:52:21.263 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-07-11T00:52:21.251+0000 7f07ed5f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 112117) UID: 0 2023-07-11T00:52:21.263 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-07-11T00:52:21.251+0000 7f07ed5f9700 -1 osd.3 41 *** Got signal Terminated *** 2023-07-11T00:52:21.264 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-07-11T00:52:21.252+0000 7f07ed5f9700 -1 osd.3 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-11T00:52:21.448 INFO:tasks.ceph.mgr.y.smithi022.stderr:daemon-helper: command crashed with signal 15 2023-07-11T00:53:46.895 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:53:46.900 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:54:17.015 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:54:17.022 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:54:47.123 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:54:47.128 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:55:17.298 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:55:17.303 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:55:47.468 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:55:47.473 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:56:17.588 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:56:17.593 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:56:47.910 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:56:47.915 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:57:18.047 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:57:18.052 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:57:48.152 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:57:48.157 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:58:18.537 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:58:18.542 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:58:48.726 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:58:48.731 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:59:18.845 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:59:18.851 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:59:48.959 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:59:48.964 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:00:19.104 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:00:19.109 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:00:49.216 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:00:49.222 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:01:19.389 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:01:19.395 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:01:49.499 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:01:49.504 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:02:19.612 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:02:19.618 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:02:49.907 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:02:49.913 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:03:20.053 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:03:20.058 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:03:50.178 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:03:50.184 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:04:20.351 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:04:20.359 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:04:50.473 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:04:50.478 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:05:20.585 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:05:20.590 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:05:50.755 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:05:50.759 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:06:20.951 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:06:20.956 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:06:51.072 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:06:51.078 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:07:21.267 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:07:21.273 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:07:51.454 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:07:51.459 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:08:21.574 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:08:21.579 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:08:51.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:08:51.700 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:09:21.841 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:09:21.846 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:09:52.020 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:09:52.026 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:10:22.141 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:10:22.147 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:10:52.437 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:10:52.442 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:11:22.557 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:11:22.562 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:11:52.687 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:11:52.694 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:12:22.865 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:12:22.870 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:12:52.979 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:12:52.985 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:13:23.139 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:13:23.144 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:13:53.334 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:13:53.340 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:14:23.455 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:14:23.460 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:14:53.709 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:14:53.714 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:15:23.905 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:15:23.911 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:15:54.033 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:15:54.039 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:16:24.371 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:16:24.376 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:16:54.575 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:16:54.581 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:17:24.699 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:17:24.704 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:17:54.983 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:17:54.988 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:18:25.178 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:18:25.183 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:18:55.299 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:18:55.303 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:19:25.603 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:19:25.608 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:19:55.790 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:19:55.795 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:20:25.902 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:20:25.907 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:20:56.307 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:20:56.312 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:21:26.418 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:21:26.423 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:21:56.532 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:21:56.538 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:22:26.752 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:22:26.758 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:22:56.930 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:22:56.936 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:23:27.042 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:23:27.047 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:23:57.230 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:23:57.235 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:24:27.408 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:24:27.413 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:24:57.529 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:24:57.534 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:25:27.708 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:25:27.713 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:25:57.829 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:25:57.834 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:26:27.944 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:26:27.949 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:26:58.195 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:26:58.201 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:27:28.408 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:27:28.413 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:27:58.520 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:27:58.526 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:28:28.640 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:28:28.645 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:28:58.827 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:28:58.832 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:29:28.990 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:29:28.998 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:29:59.285 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:29:59.291 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:30:29.473 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:30:29.478 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:30:59.593 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:30:59.599 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:31:29.873 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:31:29.878 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:31:59.993 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:31:59.999 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:32:30.122 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:32:30.127 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:33:00.317 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:33:00.323 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:33:30.488 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:33:30.494 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:34:00.600 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:34:00.606 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:34:30.712 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:34:30.717 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:35:00.908 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:35:00.913 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:35:31.030 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:35:31.037 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:36:01.308 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:36:01.314 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:36:31.495 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:36:31.500 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:37:01.619 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:37:01.624 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:37:31.869 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:37:31.874 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:38:02.066 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:38:02.071 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:38:32.185 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:38:32.191 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:39:02.381 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:39:02.387 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:39:32.576 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:39:32.582 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:40:02.706 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:40:02.712 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:40:32.934 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:40:32.939 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:41:03.072 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:41:03.078 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:41:33.204 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:41:33.209 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:42:03.500 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:42:03.506 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:42:33.634 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:42:33.639 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:43:03.829 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:43:03.835 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:43:34.233 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:43:34.238 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:44:04.412 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:44:04.417 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:44:34.532 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:44:34.537 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:45:04.887 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:45:04.892 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:45:35.082 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:45:35.088 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:46:05.261 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:46:05.267 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:46:35.431 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:46:35.436 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:47:05.619 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:47:05.625 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:47:35.722 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:47:35.727 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:48:06.127 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:48:06.132 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:48:36.313 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:48:36.319 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:49:06.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:49:06.431 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:49:36.738 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:49:36.744 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:50:06.884 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:50:06.893 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:50:37.013 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:50:37.018 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:51:07.236 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:51:07.241 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:51:37.412 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:51:37.417 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:52:07.524 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:52:07.529 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:52:37.929 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:52:37.934 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:53:08.123 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:53:08.128 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:53:38.238 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:53:38.243 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:54:08.450 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:54:08.456 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:54:38.645 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:54:38.650 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:55:08.775 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:55:08.781 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:55:39.179 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:55:39.184 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:56:09.358 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:56:09.363 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:56:39.470 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:56:39.475 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:57:09.782 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:57:09.787 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:57:39.962 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:57:39.967 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:58:10.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:58:10.096 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:58:40.453 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:58:40.458 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:59:10.657 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:59:10.663 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:59:40.777 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:59:40.782 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:00:11.081 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:00:11.087 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:00:41.268 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:00:41.274 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:01:11.389 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:01:11.394 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:01:41.736 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:01:41.741 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:02:11.922 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:02:11.928 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:02:42.051 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:02:42.057 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:03:12.380 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:03:12.385 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:03:42.550 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:03:42.555 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:04:12.662 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:04:12.667 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:04:43.034 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:04:43.039 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:05:13.371 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:05:13.377 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:05:43.491 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:05:43.496 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:06:13.796 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:06:13.801 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:06:43.975 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:06:43.980 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:07:14.088 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:07:14.093 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:07:44.308 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:07:44.313 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:08:14.428 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:08:14.433 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:08:44.549 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:08:44.554 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:09:14.736 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:09:14.741 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:09:44.907 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:09:44.913 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:10:15.019 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:10:15.024 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:10:45.198 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:10:45.203 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:11:15.303 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:11:15.308 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:11:45.431 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:11:45.436 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:12:15.610 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:12:15.616 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:12:45.789 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:12:45.794 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:13:15.914 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:13:15.919 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:13:46.096 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:13:46.101 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:14:16.276 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:14:16.281 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:14:46.396 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:14:46.401 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:15:16.517 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:15:16.522 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:15:46.696 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:15:46.701 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:16:16.816 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:16:16.821 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:16:47.129 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:16:47.134 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:17:17.316 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:17:17.686 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:17:47.828 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:17:47.833 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:18:18.024 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:18:18.029 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:18:48.219 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:18:48.224 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:19:18.357 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:19:18.362 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:19:48.544 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:19:48.549 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:20:18.723 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:20:18.728 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:20:48.844 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:20:48.849 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:21:19.039 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:21:19.044 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:21:49.226 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:21:49.231 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:22:19.356 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:22:19.362 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:22:49.536 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:22:49.541 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:23:19.722 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:23:19.727 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:23:49.834 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:23:49.839 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:24:19.946 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:24:19.951 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:24:50.142 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:24:50.147 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:25:20.254 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:25:20.260 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:25:50.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:25:50.438 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:26:20.616 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:26:20.621 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:26:50.729 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:26:50.734 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:27:20.929 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:27:20.934 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:27:51.107 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:27:51.112 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:28:21.226 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:28:21.231 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:28:51.398 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:28:51.403 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:29:21.594 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:29:21.599 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:29:51.723 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:29:51.728 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:30:21.919 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:30:21.924 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:30:52.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:30:52.095 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:31:22.223 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:31:22.228 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:31:52.381 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:31:52.386 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:32:22.534 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:32:22.540 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:32:52.655 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:32:52.661 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:33:23.009 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:33:23.014 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:33:53.155 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:33:53.160 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:34:23.286 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:34:23.291 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:34:53.638 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:34:53.643 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:35:23.817 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:35:23.822 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:35:53.925 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:35:53.931 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:36:24.258 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:36:24.262 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:36:54.437 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:36:54.442 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:37:24.582 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:37:24.587 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:37:54.962 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:37:54.967 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:38:25.157 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:38:25.162 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:38:55.271 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:38:55.276 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:39:25.565 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:39:25.570 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:39:55.710 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:39:55.716 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:40:25.860 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:40:25.865 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:40:56.243 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:40:56.248 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:41:26.423 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:41:26.428 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:41:56.534 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:41:56.539 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:42:26.814 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:42:26.819 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:42:56.992 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:42:56.997 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:43:27.103 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:43:27.108 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:43:57.483 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:43:57.488 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:44:27.670 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:44:27.675 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:44:57.782 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:44:57.787 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:45:28.120 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:45:28.125 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:45:58.291 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:45:58.296 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:46:28.411 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:46:28.416 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:46:58.573 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:46:58.578 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:47:28.736 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:47:28.741 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:47:58.848 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:47:58.853 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:48:28.960 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:48:28.965 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:48:59.147 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:48:59.152 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:49:29.336 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:49:29.341 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:49:59.453 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:49:59.458 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:50:29.633 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:50:29.638 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:50:59.821 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:50:59.826 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:51:29.935 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:51:29.940 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:52:00.104 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:52:00.109 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:52:30.300 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:52:30.305 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:53:00.417 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:53:00.989 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:53:31.300 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:53:31.305 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:54:01.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:54:01.483 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:54:31.866 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:54:31.871 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:55:02.053 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:55:02.058 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:55:32.174 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:55:32.181 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:56:02.419 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:56:02.425 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:56:32.534 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:56:32.538 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:57:02.643 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:57:02.648 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:57:32.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:57:32.786 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:58:02.952 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:58:02.957 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:58:33.064 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:58:33.069 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:59:03.234 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:59:03.239 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:59:33.405 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:59:33.410 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:00:03.526 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:00:03.531 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:00:33.688 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:00:33.693 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:01:03.884 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:01:03.889 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:01:33.999 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:01:34.004 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:02:04.150 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:02:04.156 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:02:34.329 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:02:34.335 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:03:04.442 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:03:04.447 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:03:34.559 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:03:34.564 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:04:04.741 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:04:04.747 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:04:34.937 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:04:34.941 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:05:05.282 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:05:05.287 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:05:35.485 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:05:35.490 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:06:05.605 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:06:05.610 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:06:35.759 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:06:35.765 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:07:05.964 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:07:05.969 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:07:36.076 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:07:36.081 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:08:06.313 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:08:06.318 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:08:36.493 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:08:36.497 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:09:06.605 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:09:06.610 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:09:36.900 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:09:36.905 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:10:07.087 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:10:07.093 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:10:37.211 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:10:37.216 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:11:07.570 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:11:07.574 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:11:37.758 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:11:37.763 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:12:07.886 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:12:07.891 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:12:38.277 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:12:38.282 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:13:08.386 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:13:08.391 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:13:38.591 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:13:38.596 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:14:09.006 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:14:09.011 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:14:39.198 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:14:39.203 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:15:09.309 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:15:09.315 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:15:39.706 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:15:39.711 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:16:09.885 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:16:09.890 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:16:39.996 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:16:40.001 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:17:10.284 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:17:10.289 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:17:40.463 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:17:40.467 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:18:10.577 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:18:10.582 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:18:40.871 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:18:40.875 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:19:11.049 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:19:11.054 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:19:41.178 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:19:41.182 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:20:11.373 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:20:11.379 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:20:41.579 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:20:41.584 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:21:11.749 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:21:11.754 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:21:42.070 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:21:42.075 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:22:12.198 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:22:12.203 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:22:42.385 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:22:42.390 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:23:12.756 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:23:12.761 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:23:42.873 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:23:42.878 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:24:13.030 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:24:13.035 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:24:43.135 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:24:43.140 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:25:13.349 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:25:13.355 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:25:43.568 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:25:43.573 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:26:13.680 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:26:13.685 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:26:43.794 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:26:43.799 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:27:13.918 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:27:13.923 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:27:44.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:27:44.045 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:28:14.238 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:28:14.243 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:28:44.408 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:28:44.413 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:29:14.513 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:29:14.518 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:29:44.658 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:29:44.663 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:30:14.857 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:30:14.862 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:30:44.975 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:30:44.980 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:31:15.154 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:31:15.159 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:31:45.350 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:31:45.355 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:32:15.462 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:32:15.467 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:32:45.580 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:32:45.585 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:33:15.778 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:33:15.783 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:33:45.924 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:33:45.929 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:34:16.303 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:34:16.308 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:34:46.491 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:34:46.496 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:35:16.603 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:35:16.608 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:35:46.865 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:35:46.870 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:36:17.044 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:36:17.050 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:36:47.164 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:36:47.169 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:37:17.418 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:37:17.423 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:37:47.605 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:37:47.611 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:38:17.751 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:38:17.756 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:38:48.122 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:38:48.127 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:39:18.292 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:39:18.297 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:39:48.406 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:39:48.411 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:40:18.734 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:40:18.740 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:40:48.842 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:40:48.847 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:41:18.975 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:41:18.980 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:41:49.088 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:41:49.093 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:42:19.267 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:42:19.272 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:42:49.454 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:42:49.460 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:43:19.599 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:43:19.604 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:43:49.787 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:43:49.792 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:44:19.958 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:44:19.963 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:44:50.081 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:44:50.086 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:45:20.275 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:45:20.281 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:45:50.461 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:45:50.466 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:46:20.574 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:46:20.579 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:46:50.761 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:46:50.767 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:47:20.873 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:47:20.878 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:47:50.985 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:47:50.990 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:48:21.156 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:48:21.161 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:48:51.319 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:48:51.324 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:49:21.431 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:49:21.437 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:49:51.610 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:49:51.615 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:50:21.806 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:50:21.811 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:50:51.932 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:50:51.938 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:51:22.047 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:51:22.059 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:51:52.176 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:51:52.181 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:52:22.347 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:52:22.352 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:52:52.459 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:52:52.465 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:53:22.629 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:53:22.635 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:53:52.825 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:53:52.831 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:54:22.954 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:54:22.960 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:54:53.158 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:54:53.163 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:55:23.380 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:55:23.386 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:55:53.500 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:55:53.509 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:56:23.671 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:56:23.677 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:56:53.851 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:56:53.858 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:57:23.980 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:57:23.986 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:57:54.232 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:57:54.238 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:58:24.427 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:58:24.433 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:58:54.542 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:58:54.549 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:59:24.670 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:59:24.675 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:59:54.786 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:59:54.794 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:00:24.911 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:00:24.917 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:00:55.083 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:00:55.089 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:01:25.262 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:01:25.271 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:01:55.398 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:01:55.411 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:02:25.578 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:02:25.594 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:02:55.747 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:02:55.754 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:03:25.867 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:03:25.873 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:03:56.107 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:03:56.117 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:04:26.300 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:04:26.305 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:04:56.417 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:04:56.424 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:05:26.716 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:05:26.722 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:05:56.912 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:05:56.917 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:06:27.033 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:06:27.039 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:06:57.429 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:06:57.435 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:07:27.541 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:07:27.548 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:07:57.671 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:07:57.678 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:08:27.783 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:08:27.789 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:08:57.906 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:08:57.911 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:09:28.132 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:09:28.138 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:09:58.319 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:09:58.324 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:10:28.431 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:10:28.436 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:10:58.669 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:10:58.674 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:11:28.839 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:11:28.844 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:11:58.961 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:11:58.966 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:12:29.298 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:12:29.303 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:12:59.476 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:12:59.481 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:13:29.589 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:13:29.594 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:13:59.851 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:13:59.857 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:14:29.968 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:14:29.974 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:15:00.093 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:15:00.098 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:15:30.439 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:15:30.444 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:16:00.626 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:16:00.631 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:16:30.745 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:16:30.751 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:17:00.875 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:17:00.880 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:17:31.062 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:17:31.067 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:18:01.296 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:18:01.301 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:18:31.655 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:18:31.660 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:19:01.833 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:19:01.839 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:19:31.945 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:19:31.950 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:20:02.307 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:20:02.312 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:20:32.495 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:20:32.500 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:21:02.615 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:21:02.622 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:21:33.003 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:21:33.008 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:22:03.182 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:22:03.187 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:22:33.295 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:22:33.301 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:23:03.657 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:23:03.662 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:23:33.860 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:23:33.865 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:24:03.972 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:24:03.979 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:24:34.368 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:24:34.373 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:25:04.547 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:25:04.552 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:25:34.735 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:25:34.741 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:26:05.110 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:26:05.115 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:26:35.284 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:26:35.289 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:27:05.438 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:27:05.443 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:27:35.558 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:27:35.564 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:28:05.703 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:28:05.708 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:28:35.883 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:28:35.891 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:29:06.003 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:29:06.009 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:29:36.408 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:29:36.413 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:30:06.617 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:30:06.622 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:30:37.007 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:30:37.013 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:31:07.136 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:31:07.142 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:31:37.248 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:31:37.253 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:32:07.545 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:32:07.551 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:32:37.732 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:32:37.738 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:33:07.912 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:33:07.919 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:33:38.282 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:33:38.289 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:34:08.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:34:08.484 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:34:38.598 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:34:38.604 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:35:08.861 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:35:08.868 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:35:39.038 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:35:39.050 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:36:09.168 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:36:09.175 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:36:39.413 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:36:39.419 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:37:09.592 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:37:09.599 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:37:39.798 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:37:39.803 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:38:10.084 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:38:10.090 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:38:40.279 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:38:40.284 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:39:10.427 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:39:10.433 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:39:40.782 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:39:40.788 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:40:10.902 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:40:10.908 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:40:41.031 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:40:41.036 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:41:11.268 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:41:11.274 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:41:41.464 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:41:41.470 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:42:11.643 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:42:11.649 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:42:41.763 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:42:41.768 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:43:11.892 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:43:11.897 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:43:42.079 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:43:42.084 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:44:12.209 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:44:12.214 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:44:42.379 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:44:42.385 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:45:12.574 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:45:12.579 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:45:42.686 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:45:42.692 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:46:12.808 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:46:12.813 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:46:43.006 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:46:43.012 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:47:13.125 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:47:13.131 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:47:43.303 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:47:43.309 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:48:13.489 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:48:13.495 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:48:43.610 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:48:43.615 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:49:13.799 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:49:13.804 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:49:43.977 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:49:43.983 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:50:14.089 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:50:14.099 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:50:44.268 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:50:44.274 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:51:14.464 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:51:14.470 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:51:44.610 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:51:44.616 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:52:14.789 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:52:14.795 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:52:44.985 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:52:44.991 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:53:15.104 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:53:15.109 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:53:45.300 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:53:45.305 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:54:15.488 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:54:15.493 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:54:45.609 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:54:45.615 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:55:15.721 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:55:15.726 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:55:45.863 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:55:45.868 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:56:16.247 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:56:16.252 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:56:46.450 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:56:46.455 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:57:16.573 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:57:16.578 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:57:46.807 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:57:46.812 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:58:16.986 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:58:16.991 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:58:47.098 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:58:47.104 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:59:17.227 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:59:17.233 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:59:47.339 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:59:47.345 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:00:17.454 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:00:17.461 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:00:47.632 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:00:47.638 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:01:17.818 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:01:17.824 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:01:47.931 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:01:47.937 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:02:18.126 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:02:18.131 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:02:48.323 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:02:48.328 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:03:18.443 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:03:18.448 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:03:48.614 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:03:48.619 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:04:18.735 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:04:18.741 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:04:48.854 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:04:48.860 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:05:19.033 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:05:19.039 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:05:49.229 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:05:49.235 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:06:19.350 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:06:19.355 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:06:49.467 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:06:49.472 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:07:19.650 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:07:19.655 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:07:49.770 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:07:49.776 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:08:20.099 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:08:20.104 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:08:50.303 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:08:50.307 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:09:20.424 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:09:20.429 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:09:50.705 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:09:50.710 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:10:20.906 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:10:20.911 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:10:51.026 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:10:51.031 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:11:21.364 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:11:21.370 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:11:51.568 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:11:51.573 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:12:21.688 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:12:21.695 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:12:51.809 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:12:51.814 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:13:21.929 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:13:21.934 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:13:52.050 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:13:52.057 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:14:22.229 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:14:22.235 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:14:52.408 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:14:52.413 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:15:22.523 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:15:22.527 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:15:52.699 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:15:52.705 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:16:22.878 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:16:22.884 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:16:52.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:16:53.001 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:17:23.187 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:17:23.193 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:17:53.304 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:17:53.309 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:18:23.420 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:18:23.427 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:18:53.606 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:18:53.612 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:19:23.785 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:19:23.791 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:19:53.906 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:19:53.912 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:20:24.027 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:20:24.032 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:20:54.150 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:20:54.155 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:21:24.271 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:21:24.277 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:21:54.447 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:21:54.453 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:22:24.634 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:22:24.640 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:22:54.757 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:22:54.763 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:23:24.884 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:23:24.890 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:23:55.080 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:23:55.087 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:24:25.194 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:24:25.201 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:24:55.388 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:24:55.393 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:25:25.576 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:25:25.581 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:25:55.690 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:25:55.696 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:26:25.825 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:26:25.832 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:26:55.937 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:26:55.943 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:27:26.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:27:26.114 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:27:56.295 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:27:56.301 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:28:26.490 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:28:26.495 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:28:56.603 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:28:56.609 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:29:26.789 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:29:26.795 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:29:56.976 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:29:56.981 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:30:27.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:30:27.095 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:30:57.285 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:30:57.291 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:31:27.465 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:31:27.470 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:31:57.576 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:31:57.581 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:32:27.772 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:32:27.778 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:32:57.967 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:32:57.972 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:33:28.089 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:33:28.094 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:33:58.292 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:33:58.298 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:34:28.463 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:34:28.468 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:34:58.584 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:34:58.589 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:35:28.888 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:35:28.893 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:35:59.091 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:35:59.097 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:36:29.246 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:36:29.251 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:36:59.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:36:59.430 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:37:29.605 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:37:29.610 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:37:59.724 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:37:59.730 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:38:30.086 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:38:30.091 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:39:00.298 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:39:00.304 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:39:30.419 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:39:30.425 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:40:00.682 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:40:00.687 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:40:30.886 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:40:30.891 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:41:01.014 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:41:01.019 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:41:31.344 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:41:31.349 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:42:01.548 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:42:01.552 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:42:31.668 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:42:31.673 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:43:02.005 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:43:02.010 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:43:32.146 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:43:32.152 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:44:02.271 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:44:02.276 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:44:32.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:44:32.438 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:45:02.629 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:45:02.635 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:45:32.775 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:45:32.780 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:46:02.878 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:46:02.883 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:46:33.016 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:46:33.023 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:47:03.136 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:47:03.141 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:47:33.315 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:47:33.320 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:48:03.502 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:48:03.508 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:48:33.623 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:48:33.628 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:49:03.819 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:49:03.824 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:49:34.014 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:49:34.020 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:50:04.135 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:50:04.140 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:50:34.333 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:50:34.339 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:51:04.501 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:51:04.507 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:51:34.599 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:51:34.604 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:52:04.793 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:52:04.799 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:52:34.979 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:52:34.984 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:53:05.105 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:53:05.111 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:53:35.296 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:53:35.301 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:54:05.424 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:54:05.430 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:54:35.553 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:54:35.558 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:55:05.857 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:55:05.862 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:55:36.036 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:55:36.041 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:56:06.173 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:56:06.178 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:56:36.288 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:56:36.294 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:57:06.481 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:57:06.486 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:57:36.691 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:57:36.697 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:58:07.014 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:58:07.019 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:58:37.202 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:58:37.207 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:59:07.339 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:59:07.344 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:59:37.576 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:59:37.581 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:00:07.689 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:00:07.694 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:00:37.875 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:00:37.880 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:01:08.054 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:01:08.059 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:01:38.161 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:01:38.166 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:02:08.361 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:02:08.367 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:02:38.557 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:02:38.562 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:03:08.743 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:03:08.749 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:03:38.922 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:03:38.929 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:04:09.102 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:04:09.107 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:04:39.288 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:04:39.293 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:05:09.459 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:05:09.465 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:05:39.670 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:05:39.675 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:06:09.857 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:06:09.863 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:06:40.053 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:06:40.058 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:07:10.240 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:07:10.245 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:07:40.427 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:07:40.436 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:08:10.639 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:08:10.644 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:08:40.793 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:08:40.797 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:09:10.921 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:09:10.926 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:09:41.028 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:09:41.033 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:10:11.212 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:10:11.217 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:10:41.391 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:10:41.397 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:11:11.562 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:11:11.567 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:11:41.748 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:11:41.753 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:12:11.936 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:12:11.941 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:12:42.122 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:12:42.127 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:13:12.325 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:13:12.331 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:13:42.504 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:13:42.510 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:14:12.692 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:14:12.698 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:14:42.864 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:14:43.130 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:15:13.307 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:15:13.313 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:15:43.495 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:15:43.500 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:16:13.657 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:16:13.662 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:16:43.861 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:16:43.866 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:17:14.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:17:14.046 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:17:44.210 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:17:44.215 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:18:14.399 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:18:14.405 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:18:44.576 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:18:44.582 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:19:14.762 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:19:14.767 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:19:44.949 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:19:44.954 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:20:15.153 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:20:15.159 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:20:45.366 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:20:45.372 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:21:15.544 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:21:15.549 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:21:45.723 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:21:45.728 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:22:15.901 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:22:15.906 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:22:46.035 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:22:46.040 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:23:16.226 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:23:16.231 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:23:46.412 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:23:46.417 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:24:16.533 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:24:16.538 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:24:46.729 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:24:46.736 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:25:16.916 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:25:16.921 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:25:47.101 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:25:47.107 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:26:17.297 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:26:17.303 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:26:47.501 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:26:47.507 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:27:17.681 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:27:17.686 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:27:47.858 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:27:47.863 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:28:18.054 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:28:18.058 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:28:48.249 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:28:48.255 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:29:18.446 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:29:18.451 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:29:48.641 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:29:48.646 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:30:18.827 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:30:18.833 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:30:48.945 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:30:48.950 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:31:19.134 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:31:19.142 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:31:49.339 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:31:49.345 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:32:19.533 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:32:19.538 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:32:49.712 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:32:49.717 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:33:19.900 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:33:19.905 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:33:50.020 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:33:50.025 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:34:20.198 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:34:20.204 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:34:50.402 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:34:50.408 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:35:20.590 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:35:20.596 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:35:50.760 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:35:50.766 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:36:20.938 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:36:20.945 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:36:51.109 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:36:51.114 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:37:21.305 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:37:21.310 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:37:51.475 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:37:51.480 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:38:21.644 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:38:21.650 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:38:51.841 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:38:51.846 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:39:22.036 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:39:22.041 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:39:52.222 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:39:52.228 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:40:22.427 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:40:22.433 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:40:52.614 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:40:52.620 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:41:22.759 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:41:22.764 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:41:52.963 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:41:52.969 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:42:23.140 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:42:23.145 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:42:53.312 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:42:53.317 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:43:23.492 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:43:23.497 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:43:53.636 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:43:53.641 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:44:23.815 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:44:23.820 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:44:53.994 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:44:54.000 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:45:24.190 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:45:24.195 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:45:54.359 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:45:54.364 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:46:24.471 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:46:24.476 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:46:54.642 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:46:54.648 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:47:24.838 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:47:24.844 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:47:55.032 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:47:55.039 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:48:25.224 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:48:25.230 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:48:55.382 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:48:55.388 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:49:25.560 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:49:25.565 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:49:55.738 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:49:55.745 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:50:25.918 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:50:25.923 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:50:56.096 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:50:56.101 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:51:26.275 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:51:26.281 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:51:56.479 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:51:56.490 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:52:26.665 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:52:26.671 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:52:56.783 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:52:56.788 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:53:26.973 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:53:26.978 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:53:57.168 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:53:57.173 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:54:27.273 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:54:27.279 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:54:57.386 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:54:57.391 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:55:27.496 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:55:27.502 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:55:57.609 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:55:57.614 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:56:27.720 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:56:27.726 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:56:57.839 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:56:57.844 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:57:27.984 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:57:27.989 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:57:58.106 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:57:58.116 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:58:28.245 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:58:28.251 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:58:58.358 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:58:58.363 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:59:28.471 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:59:28.476 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:59:58.592 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:59:58.598 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:00:28.708 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:00:28.714 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:00:58.827 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:00:58.833 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:01:28.956 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:01:28.962 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:01:59.079 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:01:59.087 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:02:29.199 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:02:29.205 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:02:59.312 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:02:59.317 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:03:29.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:03:29.431 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:03:59.546 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:03:59.552 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:04:29.677 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:04:29.683 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:04:59.793 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:04:59.798 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:05:29.912 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:05:29.918 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:06:00.025 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:06:00.031 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:06:30.146 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:06:30.151 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:07:00.258 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:07:00.263 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:07:30.377 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:07:30.382 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:08:00.567 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:08:00.572 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:08:30.744 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:08:30.749 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:09:00.948 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:09:00.953 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:09:31.134 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:09:31.140 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:10:01.330 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:10:01.336 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:10:31.501 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:10:31.507 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:11:01.687 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:11:01.693 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:11:31.867 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:11:31.873 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:12:02.044 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:12:02.050 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:12:32.215 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:12:32.221 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:13:02.386 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:13:02.391 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:13:32.564 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:13:32.569 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:14:02.734 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:14:02.739 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:14:32.912 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:14:32.917 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:15:03.100 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:15:03.105 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:15:33.278 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:15:33.283 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:16:03.483 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:16:03.488 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:16:33.661 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:16:33.666 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:17:03.849 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:17:03.855 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:17:34.028 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:17:34.033 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:18:04.223 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:18:04.228 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:18:34.410 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:18:34.415 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:19:04.596 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:19:04.602 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:19:34.784 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:19:34.789 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:20:04.921 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:20:04.926 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:20:35.111 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:20:35.116 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:21:05.295 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:21:05.301 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:21:35.482 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:21:35.488 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:22:05.653 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:22:05.658 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:22:35.773 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:22:35.778 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:23:05.952 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:23:05.958 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:23:36.147 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:23:36.153 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:24:06.326 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:24:06.331 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:24:36.437 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:24:36.443 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:25:06.616 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:25:06.622 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:25:36.803 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:25:36.809 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:26:07.007 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:26:07.013 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:26:37.174 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:26:37.179 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:27:07.364 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:27:07.370 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:27:37.552 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:27:37.557 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:28:07.731 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:28:07.736 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:28:37.926 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:28:37.932 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:29:08.033 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:29:08.039 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:29:38.209 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:29:38.214 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:30:08.396 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:30:08.402 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:30:38.574 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:30:38.580 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:31:08.703 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:31:08.708 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:31:38.891 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:31:38.896 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:32:09.077 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:32:09.083 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:32:39.256 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:32:39.262 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:33:09.426 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:33:09.432 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:33:39.529 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:33:39.534 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:34:09.730 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:34:09.735 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:34:39.834 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:34:39.840 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:35:09.957 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:35:09.962 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:35:40.069 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:35:40.074 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:36:10.191 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:36:10.204 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:36:40.312 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:36:40.317 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:37:10.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:37:10.438 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:37:40.543 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:37:40.548 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:38:10.659 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:38:10.664 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:38:40.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:38:40.786 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:39:10.902 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:39:10.907 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:39:41.007 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:39:41.012 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:40:11.128 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:40:11.134 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:40:41.242 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:40:41.248 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:41:11.364 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:41:11.370 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:41:41.486 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:41:41.491 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:42:11.606 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:42:11.611 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:42:41.714 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:42:41.719 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:43:11.823 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:43:11.829 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:43:41.938 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:43:41.943 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:44:12.049 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:44:12.054 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:44:42.239 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:44:42.244 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:45:12.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:45:12.430 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:45:42.606 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:45:42.612 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:46:12.800 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:46:12.806 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:46:42.971 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:46:42.976 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:47:13.133 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:47:13.138 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:47:43.328 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:47:43.334 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:48:13.515 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:48:13.520 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:48:43.703 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:48:43.707 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:49:13.881 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:49:13.887 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:49:44.068 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:49:44.073 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:50:14.246 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:50:14.252 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:50:44.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:50:44.456 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:51:14.638 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:51:14.643 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:51:44.833 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:51:44.837 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:52:15.011 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:52:15.016 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:52:45.131 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:52:45.136 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:53:15.302 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:53:15.308 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:53:45.472 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:53:45.478 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:54:15.643 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:54:15.649 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:54:45.830 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:54:45.835 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:55:15.992 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:55:15.997 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:55:46.179 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:55:46.184 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:56:16.357 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:56:16.362 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:56:46.553 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:56:46.558 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:57:16.715 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:57:16.721 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:57:46.910 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:57:46.915 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:58:17.080 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:58:17.086 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:58:47.187 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:58:47.193 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:59:17.293 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:59:17.299 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:59:47.409 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:59:47.414 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:00:17.526 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:00:17.533 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:00:47.655 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:00:47.660 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:01:17.762 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:01:17.767 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:01:47.882 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:01:47.888 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:02:17.996 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:02:18.001 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:02:48.198 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:02:48.203 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:03:18.393 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:03:18.399 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:03:48.589 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:03:48.595 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:04:18.759 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:04:18.765 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:04:48.954 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:04:48.960 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:05:19.142 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:05:19.147 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:05:49.354 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:05:49.360 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:06:19.533 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:06:19.538 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:06:49.712 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:06:49.717 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:07:19.891 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:07:19.896 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:07:50.060 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:07:50.066 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:08:20.239 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:08:20.245 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:08:50.426 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:08:50.431 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:09:20.614 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:09:20.619 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:09:50.808 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:09:50.813 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:10:21.012 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:10:21.018 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:10:51.216 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:10:51.222 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:11:21.420 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:11:21.425 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:11:51.615 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:11:51.621 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:12:21.818 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:12:21.823 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:12:51.938 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:12:51.943 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:13:22.058 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:13:22.063 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:13:52.163 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:13:52.169 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:14:22.284 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:14:22.289 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:14:52.426 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:14:52.431 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:15:22.544 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:15:22.550 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:15:52.665 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:15:52.669 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:16:22.778 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:16:22.783 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:16:52.885 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:16:52.890 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:17:23.004 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:17:23.009 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:17:53.185 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:17:53.190 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:18:23.388 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:18:23.393 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:18:53.567 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:18:53.572 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:19:23.762 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:19:23.767 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:19:53.959 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:19:53.965 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:20:24.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:20:24.150 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:20:54.253 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:20:54.259 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:21:24.437 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:21:24.442 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:21:54.623 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:21:54.628 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:22:24.819 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:22:24.825 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:22:54.931 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:22:54.936 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:23:25.059 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:23:25.065 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:23:55.222 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:23:55.227 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:24:25.408 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:24:25.414 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:24:55.587 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:24:55.592 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:25:25.774 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:25:25.779 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:25:55.928 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:25:55.934 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:26:26.107 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:26:26.113 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:26:56.311 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:26:56.316 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:27:26.430 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:27:26.435 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:27:56.534 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:27:56.539 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:28:26.659 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:28:26.665 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:28:56.769 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:28:56.774 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:29:26.891 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:29:26.897 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:29:57.008 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:29:57.013 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:30:27.125 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:30:27.130 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:30:57.241 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:30:57.245 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:31:27.367 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:31:27.372 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:31:57.481 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:31:57.487 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:32:27.602 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:32:27.607 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:32:57.713 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:32:57.719 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:33:27.828 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:33:27.833 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:33:57.942 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:33:57.947 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:34:28.061 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:34:28.067 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:34:58.179 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:34:58.184 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:35:28.296 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:35:28.302 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:35:58.403 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:35:58.409 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:36:28.514 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:36:28.519 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:36:58.618 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:36:58.624 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:37:28.731 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:37:28.737 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:37:58.842 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:37:58.847 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:38:28.966 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:38:28.971 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:38:59.074 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:38:59.080 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:39:29.262 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:39:29.267 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:39:59.449 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:39:59.457 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:40:29.628 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:40:29.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:40:59.806 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:40:59.813 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:41:29.929 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:41:29.939 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:42:00.039 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:42:00.044 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:42:30.156 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:42:30.164 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:43:00.267 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:43:00.273 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:43:30.375 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:43:30.380 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:44:00.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:44:00.483 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:44:30.597 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:44:30.602 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:45:00.702 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:45:00.708 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:45:30.824 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:45:30.829 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:46:01.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:46:01.016 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:46:31.205 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:46:31.210 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:47:01.400 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:47:01.406 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:47:31.604 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:47:31.609 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:48:01.774 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:48:01.780 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:48:31.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:48:31.974 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:49:02.148 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:49:02.153 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:49:32.269 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:49:32.274 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:50:02.399 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:50:02.404 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:50:32.520 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:50:32.525 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:51:02.630 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:51:02.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:51:32.746 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:51:32.755 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:52:02.862 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:52:02.868 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:52:32.983 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:52:32.997 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:53:03.111 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:53:03.117 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:53:33.233 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:53:33.238 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:54:03.410 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:54:03.415 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:54:33.580 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:54:33.585 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:55:03.785 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:55:03.790 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:55:33.988 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:55:33.993 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:56:04.158 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:56:04.164 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:56:34.346 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:56:34.352 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:57:04.524 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:57:04.529 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:57:34.703 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:57:34.709 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:58:04.898 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:58:04.904 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:58:35.102 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:58:35.107 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:59:05.288 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:59:05.294 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:59:35.468 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:59:35.473 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:00:05.663 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:00:05.668 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:00:35.867 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:00:35.872 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:01:06.053 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:01:06.059 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:01:36.232 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:01:36.238 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:02:06.436 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:02:06.441 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:02:36.615 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:02:36.620 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:03:06.835 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:03:06.840 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:03:37.022 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:03:37.028 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:04:07.234 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:04:07.239 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:04:37.421 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:04:37.427 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:05:07.601 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:05:07.607 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:05:37.787 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:05:37.792 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:06:07.949 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:06:07.954 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:06:38.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:06:38.150 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:07:08.323 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:07:08.329 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:07:38.510 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:07:38.515 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:08:08.689 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:08:08.694 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:08:38.867 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:08:38.872 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:09:08.974 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:09:08.981 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:09:39.149 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:09:39.155 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:10:09.345 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:10:09.350 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:10:39.549 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:10:39.554 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:11:09.736 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:11:09.741 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:11:39.940 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:11:39.945 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:12:10.118 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:12:10.123 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:12:40.313 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:12:40.318 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:13:10.450 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:13:10.455 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:13:40.623 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:13:40.628 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:14:10.807 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:14:10.813 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:14:40.978 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:14:40.984 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:15:11.156 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:15:11.162 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:15:41.294 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:15:41.300 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:16:11.482 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:16:11.487 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:16:41.651 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:16:41.658 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:17:11.838 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:17:11.844 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:17:42.034 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:17:42.040 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:18:12.249 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:18:12.254 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:18:42.362 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:18:42.367 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:19:12.537 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:19:12.542 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:19:42.723 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:19:42.729 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:20:12.902 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:20:12.907 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:20:43.023 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:20:43.029 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:21:13.185 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:21:13.191 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:21:43.364 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:21:43.369 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:22:13.534 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:22:13.540 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:22:43.654 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:22:43.659 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:23:13.844 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:23:13.849 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:23:44.020 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:23:44.025 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:24:14.215 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:24:14.221 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:24:44.429 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:24:44.434 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:25:14.606 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:25:14.611 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:25:44.810 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:25:44.815 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:26:14.998 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:26:15.003 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:26:45.183 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:26:45.188 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:27:15.362 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:27:15.367 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:27:45.524 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:27:45.529 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:28:15.661 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:28:15.667 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:28:45.848 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:28:45.854 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:29:16.027 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:29:16.032 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:29:46.205 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:29:46.211 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:30:16.401 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:30:16.406 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:30:46.580 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:30:46.585 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:31:16.775 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:31:16.781 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:31:46.954 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:31:46.959 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:32:17.149 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:32:17.154 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:32:47.319 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:32:47.325 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:33:17.515 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:33:17.520 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:33:47.702 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:33:47.707 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:34:17.873 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:34:17.878 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:34:48.042 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:34:48.048 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:35:18.246 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:35:18.251 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:35:48.458 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:35:48.463 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:36:18.671 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:36:18.676 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:36:48.849 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:36:48.854 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:37:19.036 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:37:19.042 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:37:49.148 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:37:49.153 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:38:19.335 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:38:19.340 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:38:49.522 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:38:49.527 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:39:19.717 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:39:19.723 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:39:49.905 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:39:49.910 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:40:20.099 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:40:20.104 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:40:50.270 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:40:50.275 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:41:20.456 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:41:20.461 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:41:50.643 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:41:50.648 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:42:20.839 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:42:20.844 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:42:51.059 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:42:51.065 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:43:21.290 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:43:21.295 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:43:51.458 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:43:51.463 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:44:21.566 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:44:21.571 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:44:51.674 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:44:51.679 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:45:21.794 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:45:21.799 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:45:51.905 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:45:51.910 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:46:22.009 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:46:22.015 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:46:52.131 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:46:52.136 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:47:22.245 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:47:22.251 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:47:52.371 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:47:52.376 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:48:22.482 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:48:22.487 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:48:52.645 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:48:52.650 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:49:22.823 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:49:22.829 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:49:53.019 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:49:53.024 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:50:23.205 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:50:23.210 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:50:53.375 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:50:53.380 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:51:23.482 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:51:23.487 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:51:53.666 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:51:53.671 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:52:23.854 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:52:23.860 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:52:54.049 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:52:54.054 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:53:24.228 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:53:24.233 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:53:54.423 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:53:54.428 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:54:24.610 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:54:24.615 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:54:54.788 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:54:54.793 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:55:24.966 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:55:24.971 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:55:55.153 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:55:55.158 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:56:25.349 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:56:25.354 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:56:55.536 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:56:55.541 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:57:25.707 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:57:25.712 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:57:55.885 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:57:55.890 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:58:26.056 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:58:26.061 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:58:56.226 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:58:56.231 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:59:26.413 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:59:26.418 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:59:56.583 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:59:56.587 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:00:26.787 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:00:26.792 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:00:56.966 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:00:56.970 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:01:27.136 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:01:27.141 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:01:57.323 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:01:57.328 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:02:27.518 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:02:27.523 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:02:57.655 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:02:57.661 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:03:27.828 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:03:27.833 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:03:58.051 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:03:58.056 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:04:28.216 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:04:28.221 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:04:58.403 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:04:58.408 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:05:28.524 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:05:28.529 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:05:58.719 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:05:58.724 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:06:28.906 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:06:28.911 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:06:59.084 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:06:59.089 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:07:29.271 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:07:29.276 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:07:59.400 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:07:59.405 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:08:29.609 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:08:29.614 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:08:59.791 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:08:59.796 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:09:29.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:09:29.975 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:10:00.172 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:10:00.178 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:10:30.319 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:10:30.324 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:11:00.514 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:11:00.520 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:11:30.693 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:11:30.698 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:12:00.879 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:12:00.884 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:12:31.066 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:12:31.071 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:13:01.254 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:13:01.259 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:13:31.448 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:13:31.453 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:14:01.635 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:14:01.640 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:14:31.830 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:14:31.835 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:15:02.001 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:15:02.006 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:15:32.146 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:15:32.151 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:16:02.333 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:16:02.338 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:16:32.504 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:16:32.509 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:17:02.629 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:17:02.635 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:17:32.735 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:17:32.740 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:18:02.857 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:18:02.861 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:18:32.967 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:18:32.972 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:19:03.082 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:19:03.087 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:19:33.192 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:19:33.197 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:20:03.316 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:20:03.321 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:20:33.432 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:20:33.437 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:21:03.567 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:21:03.572 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:21:33.730 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:21:33.735 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:22:03.851 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:22:03.856 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:22:33.965 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:22:33.970 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:23:04.103 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:23:04.108 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:23:34.221 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:23:34.227 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:24:04.336 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:24:04.341 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:24:34.453 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:24:34.458 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:25:04.571 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:25:04.575 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:25:34.686 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:25:34.691 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:26:04.865 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:26:04.870 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:26:35.043 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:26:35.048 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:27:05.238 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:27:05.243 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:27:35.417 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:27:35.422 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:28:05.596 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:28:05.601 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:28:35.791 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:28:35.796 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:29:05.986 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:29:05.992 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:29:36.156 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:29:36.161 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:30:06.335 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:30:06.341 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:30:36.540 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:30:36.546 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:31:06.725 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:31:06.730 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:31:36.913 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:31:36.918 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:32:07.100 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:32:07.105 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:32:37.287 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:32:37.292 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:33:07.474 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:33:07.480 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:33:37.661 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:33:37.666 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:34:07.848 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:34:07.853 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:34:38.051 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:34:38.056 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:35:08.246 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:35:08.252 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:35:38.434 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:35:38.439 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:36:08.637 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:36:08.642 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:36:38.807 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:36:38.813 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:37:08.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:37:09.001 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:37:39.190 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:37:39.195 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:38:09.360 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:38:09.365 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:38:39.539 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:38:39.544 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:39:09.734 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:39:09.738 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:39:39.905 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:39:39.910 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:40:10.117 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:40:10.122 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:40:40.321 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:40:40.327 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:41:10.499 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:41:10.504 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:41:40.694 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:41:40.699 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:42:10.873 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:42:10.878 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:42:41.076 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:42:41.082 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:43:11.196 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:43:11.202 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:43:41.368 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:43:41.373 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:44:11.555 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:44:11.560 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:44:41.733 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:44:41.738 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:45:11.929 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:45:11.934 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:45:42.036 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:45:42.041 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:46:12.144 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:46:12.149 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:46:42.256 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:46:42.262 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:47:12.358 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:47:12.363 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:47:42.471 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:47:42.476 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:48:12.584 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:48:12.590 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:48:42.688 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:48:42.694 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:49:12.802 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:49:12.807 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:49:42.978 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:49:42.983 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:50:13.157 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:50:13.162 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:50:43.327 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:50:43.332 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:51:13.490 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:51:13.494 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:51:43.677 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:51:43.682 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:52:13.787 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:52:13.792 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:52:43.893 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:52:43.898 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:53:14.088 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:53:14.093 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:53:44.258 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:53:44.263 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:54:14.436 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:54:14.441 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:54:44.606 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:54:44.612 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:55:14.752 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:55:14.757 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:55:44.939 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:55:44.944 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:56:15.126 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:56:15.131 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:56:45.230 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:56:45.234 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:57:15.400 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:57:15.405 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:57:45.521 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:57:45.526 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:58:15.691 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:58:15.696 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:58:45.861 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:58:45.867 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:59:16.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:59:16.046 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:59:46.218 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:59:46.224 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:00:16.373 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:00:16.379 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:00:46.576 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:00:46.582 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:01:16.772 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:01:16.778 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:01:46.959 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:01:46.965 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:02:17.154 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:02:17.161 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:02:47.342 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:02:47.347 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:03:17.545 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:03:17.550 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:03:47.723 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:03:47.728 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:04:17.911 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:04:17.916 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:04:48.097 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:04:48.102 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:05:18.284 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:05:18.289 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:05:48.480 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:05:48.485 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:06:18.600 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:06:18.605 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:06:48.778 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:06:48.783 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:07:18.982 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:07:18.987 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:07:49.153 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:07:49.158 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:08:19.347 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:08:19.353 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:08:49.535 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:08:49.540 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:09:19.721 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:09:19.726 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:09:49.909 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:09:49.914 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:10:20.062 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:10:20.068 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:10:50.283 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:10:50.289 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:11:20.461 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:11:20.467 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:11:50.649 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:11:50.654 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:12:20.873 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:12:20.878 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:12:51.039 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:12:51.045 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:13:21.217 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:13:21.222 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:13:51.424 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:13:51.429 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:14:21.617 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:14:21.622 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:14:51.787 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:14:51.792 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:15:21.966 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:15:21.971 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:15:52.088 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:15:52.093 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:16:22.273 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:16:22.278 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:16:52.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:16:52.456 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:17:22.614 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:17:22.619 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:17:52.784 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:17:52.789 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:18:22.971 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:18:22.975 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:18:53.166 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:18:53.171 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:19:23.362 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:19:23.367 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:19:53.549 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:19:53.554 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:20:23.745 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:20:23.751 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:20:53.865 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:20:53.870 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:21:24.043 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:21:24.048 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:21:54.214 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:21:54.219 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:22:24.393 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:22:24.398 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:22:54.504 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:22:54.509 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:23:24.700 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:23:24.705 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:23:54.870 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:23:54.875 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:24:25.057 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:24:25.062 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:24:55.236 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:24:55.241 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:25:25.440 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:25:25.445 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:25:55.610 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:25:55.615 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:26:25.805 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:26:25.810 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:26:55.909 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:26:55.914 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:27:26.029 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:27:26.034 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:27:56.132 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:27:56.137 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:28:26.262 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:28:26.267 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:28:56.382 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:28:56.387 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:29:26.497 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:29:26.502 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:29:56.614 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:29:56.619 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:30:26.718 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:30:26.723 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:30:56.838 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:30:56.843 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:31:26.973 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:31:26.978 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:31:57.087 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:31:57.092 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:32:27.208 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:32:27.213 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:32:57.313 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:32:57.318 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:33:27.417 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:33:27.422 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:33:57.522 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:33:57.527 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:34:27.635 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:34:27.640 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:34:57.760 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:34:57.766 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:35:27.880 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:35:27.885 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:35:57.991 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:35:57.996 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:36:28.112 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:36:28.118 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:36:58.228 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:36:58.233 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:37:28.362 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:37:28.367 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:37:58.465 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:37:58.470 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:38:28.585 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:38:28.590 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:38:58.689 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:38:58.694 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:39:28.809 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:39:28.815 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:39:58.929 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:39:58.934 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:40:29.044 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:40:29.049 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:40:59.173 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:40:59.178 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:41:29.282 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:41:29.287 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:41:59.386 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:41:59.391 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:42:29.490 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:42:29.495 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:42:59.601 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:42:59.607 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:43:29.723 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:43:29.728 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:43:59.836 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:43:59.841 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:44:29.958 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:44:29.963 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:45:00.062 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:45:00.067 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:45:30.175 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:45:30.180 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:46:00.292 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:46:00.297 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:46:30.409 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:46:30.415 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:47:00.530 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:47:00.536 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:47:30.637 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:47:30.642 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:48:00.740 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:48:00.745 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:48:30.919 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:48:30.924 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:49:01.106 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:49:01.111 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:49:31.285 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:49:31.290 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:50:01.422 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:50:01.427 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:50:31.603 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:50:31.608 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:51:01.780 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:51:01.785 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:51:31.966 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:51:31.971 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:52:02.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:52:02.151 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:52:32.341 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:52:32.346 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:53:02.519 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:53:02.525 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:53:32.698 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:53:32.704 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:54:02.869 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:54:02.874 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:54:33.047 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:54:33.051 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:55:03.225 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:55:03.231 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:55:33.412 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:55:33.418 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:56:03.656 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:56:03.661 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:56:33.853 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:56:33.858 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:57:04.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:57:04.045 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:57:34.220 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:57:34.225 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:58:04.331 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:58:04.336 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:58:34.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:58:34.456 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:59:04.555 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:59:04.559 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:59:34.667 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:59:34.672 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:00:04.770 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:00:04.775 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:00:34.892 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:00:34.897 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:01:04.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:01:05.000 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:01:35.116 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:01:35.122 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:02:05.227 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:02:05.233 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:02:35.342 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:02:35.348 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:03:05.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:03:05.456 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:03:35.568 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:03:35.573 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:04:05.684 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:04:05.689 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:04:35.796 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:04:35.801 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:05:05.900 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:05:05.905 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:05:36.033 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:05:36.038 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:06:06.141 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:06:06.146 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:06:36.259 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:06:36.264 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:07:06.456 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:07:06.461 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:07:36.635 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:07:36.640 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:08:06.805 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:08:06.810 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:08:37.000 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:08:37.005 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:09:07.170 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:09:07.175 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:09:37.349 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:09:37.354 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:10:07.519 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:10:07.524 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:10:37.707 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:10:37.712 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:11:07.902 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:11:07.907 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T12:11:37.572 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-07-11T12:11:37.573 DEBUG:teuthology.task.console_log:Killing console logger for smithi022 2023-07-11T12:11:37.574 DEBUG:teuthology.task.console_log:Killing console logger for smithi184 2023-07-11T12:11:37.574 DEBUG:teuthology.exit:Finished running handlers